system

Abstract

To provide a system that can provide a more fulfilling travel experience for users. [Solution] A system including: a means for a user to input desired conditions such as travel dates, budget, and desired activities; a means for receiving the input information and generating an optimal travel plan using generative artificial intelligence; a means for sending the generated plan to the user's terminal and making it selectable; a means for automatically arranging air tickets, accommodation, and tickets to tourist attractions based on the selected plan; a means for integrating the arranged reservation information and sending it to the user's terminal; a means for obtaining the user's location information during the trip and calculating and displaying the optimal route to the destination; a means for responding in real time to problems and questions from the user; a means for uploading photos, videos, and notes taken by the user during the trip; and a means for organizing the uploaded data, generating a travel record, and sending it to the user's terminal.

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] The process of planning, preparing, experiencing, and recording a trip is time-consuming and laborious, and if the process is incomplete, the entire travel experience may be compromised. In particular, the complicated processes of planning a trip, making the necessary arrangements, navigating and troubleshooting during the trip, and recording the trip afterward are all required a system that provides consistent support. The objective of this invention is to provide a system that can solve the above problems and provide users with a more fulfilling travel experience. [Means for solving the problem]

[0005] The present invention provides a system including a means for a user to input desired conditions such as travel itinerary, budget, and desired activities, a means for receiving the input information and generating an optimal travel plan using generative artificial intelligence, a means for sending the generated plan to the user's terminal and making it selectable, a means for automatically arranging air tickets, accommodations, and tickets to tourist attractions based on the selected plan, a means for integrating the arranged reservation information and sending it to the user's terminal, a means for acquiring the user's location information during the trip and calculating and displaying the optimal route to the destination, a means for responding in real time to problems and questions from the user, a means for uploading photos, videos, and notes taken by the user during the trip, and a means for organizing the uploaded data, generating a travel record, and sending it to the user's terminal.

[0006] "User" means an individual or organization that uses the system to plan, book, experience, and record a trip.

[0007] A "terminal" is an electronic device such as a computer, smartphone, or tablet that allows a user to use the system.

[0008] "Server" means a computer system that processes user input, generates travel plans, arranges reservations, provides real-time support, and generates travel records.

[0009] "Generative artificial intelligence" is an AI technology that has algorithms for generating travel plans based on user requests.

[0010] A "travel plan" is a collection of travel schedules and related information that are constructed based on the dates, budget, desired activities, etc. specified by the user.

[0011] "Making arrangements" refers to the process of reserving and purchasing airfare, accommodation, and tickets to tourist attractions required for your travel plans.

[0012] "Reservation information" refers to detailed information about arranged air tickets, accommodations, tickets to tourist attractions, etc.

[0013] "Location information" is data that indicates a user's current location and is obtained using GPS or other technologies.

[0014] "Calculating a route" means calculating the optimal travel route from the user's current location to the destination.

[0015] "Real-time responses" means responding immediately to user questions and problems and providing solutions and information.

[0016] A "travel log" is a document or photo album that organizes photos, videos, and notes taken by a user during a trip, and compiles travel memories. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0018] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0021] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0022] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0023] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0025] [First embodiment]

[0026] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0027] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0030] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0033] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0037] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0038] The present invention is a system that consistently supports planning, preparing, experiencing, and recording a trip. A specific embodiment of this system will be described below.

[0039] Travel plan suggestions

[0040] The user inputs desired conditions such as travel dates, budget, and desired activities. For example, consider a user inputting a desire for "five days starting April 10, 2023, budget of 200,000 yen, visiting art museums." These conditions are sent to the server via the device. The server analyzes the received input information and generates an optimal travel plan using generative artificial intelligence. This AI collects information on tourist spots, accommodations, transportation, etc. from a database and creates multiple candidate plans. The generated plans include destinations such as Paris, Amsterdam, and London, along with their respective museums, accommodations, and transportation methods. The generated plans are sent to the user's device, and the user can choose from multiple plans.

[0041] Travel preparation and arrangements

[0042] The user reviews the proposed plans and selects the one they want. For example, suppose they select a plan for Paris and Amsterdam. Based on the selected plan, the server automatically arranges airfare, accommodation, and tickets to tourist attractions. The server makes these arrangements through the APIs of various reservation services and integrates the reservation information to generate a single document. This reservation information includes airfare details, hotel reservation number, ticket information for tourist attractions, etc. The generated reservation information is sent to the user's device so that it can be viewed.

[0043] Experience support during your trip

[0044] While traveling, users can use their device to check their next destination and the optimal route. For example, if a user wants to go to the Eiffel Tower in Paris, they can check its location in the app. The device uses GPS to obtain its current location and sends it to the server. The server then calculates the optimal route to the destination based on the received location information and sends it to the device. It also displays real-time traffic and weather information. If a problem occurs, for example if the train is delayed, the user can use the chat function in the app to send a message to the server. The server then uses AI to suggest alternative routes and solutions.

[0045] Travel Records

[0046] Users can upload photos, videos, and notes taken during their trip to the app. This data is sent to the server via their device. The server organizes the uploaded data chronologically and integrates it in the form of a travel diary or photo album. For example, photos taken and videos recorded during a trip are organized chronologically and edited for easy viewing. The server generates a travel record that reflects the overview and highlights of the trip and sends it to the user's device. The generated travel record becomes a digital album or travel diary that can be saved as memories, making it convenient for users to look back on later.

[0047] In this way, the present invention provides users with consistent support throughout the entire process of planning, preparing, experiencing, and recording their trip, simplifies complicated procedures, and enables them to have a more fulfilling travel experience.

[0048] The processing flow will be explained below.

[0049] Step 1:

[0050] The user inputs desired conditions such as travel dates, budget, desired activities, etc. For example, the user might input "5 days from April 10, 2023, budget 200,000 yen, visiting art museums."

[0051] Step 2:

[0052] The terminal sends the input information to the server, which converts the user's input data into an appropriate format and forwards it to the server.

[0053] Step 3:

[0054] The server analyzes the received requirements, processes each item (date, budget, desired activities) separately, and prepares to retrieve the relevant information from the database.

[0055] Step 4:

[0056] The server uses generative artificial intelligence to generate optimal travel plans. The AI ​​creates multiple plans that best fit the user's preferences based on collected information on tourist destinations, accommodations, transportation, etc.

[0057] Step 5:

[0058] The server sends the generated plan to the user's device, which displays the received plans to the user, allowing them to select from multiple plans.

[0059] Step 6:

[0060] The user reviews the proposed itineraries and selects the one they want. For example, the user may select a plan for Paris and Amsterdam.

[0061] Step 7:

[0062] The terminal transmits the selected plan information to the server. The terminal communicates again to transfer the user's selection results to the server.

[0063] Step 8:

[0064] The server automatically arranges airfare, accommodation, and tourist attraction tickets based on the selected plan. The server connects with various reservation services via API and performs the necessary reservation procedures.

[0065] Step 9:

[0066] The server integrates the reservation information and generates a document. The server compiles the booked flight, accommodation, and tourist attraction ticket information into a single integrated document.

[0067] Step 10:

[0068] The server sends the generated reservation information to the user's terminal, and the user confirms the reservation information through the terminal and completes the travel plan.

[0069] Step 11:

[0070] While traveling, the user uses the device to confirm their next destination, such as a specific destination, such as wanting to visit the Eiffel Tower.

[0071] Step 12:

[0072] The device uses GPS to obtain its current location and sends it to the server, where it is used for the next calculation.

[0073] Step 13:

[0074] The server calculates the optimal route to the destination and sends it to the device. Based on the requested route and mode of transportation, the server generates the optimal guidance.

[0075] Step 14:

[0076] The device displays the optimal route based on real-time traffic and weather information, allowing users to choose the most suitable mode of transportation for their current situation.

[0077] Step 15:

[0078] When a user encounters a problem or trouble, they can use the chat function to send a message to the server, for example, to report that the train is delayed.

[0079] Step 16:

[0080] The server uses AI to suggest alternative routes and solutions and respond to users, providing appropriate support in real time and quickly resolving user issues.

[0081] Step 17:

[0082] Users upload photos, videos, and notes they take during their trip to the app, and this data is sent to the server via the device.

[0083] Step 18:

[0084] The server organizes the uploaded data chronologically and generates a travel record, which is then integrated into a travel diary or photo album and provided to the user.

[0085] Step 19:

[0086] The server sends the generated travel record to the user's terminal, where an electronic album or travel diary is displayed to help the user look back on their travel memories.

[0087] In this way, a system is realized in which the server, terminal, and user work together to support the user's travel experience throughout the entire process.

[0088] Example 1

[0089] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0090] Modern travel planning requires users to gather a lot of information and make reservations, which takes a lot of time and effort. These cumbersome procedures can take away from the enjoyment of traveling. There is also a need for systems that can quickly respond to unexpected issues that arise during a trip. Furthermore, users want to be able to organize the photos and notes they take during their trip and keep them as a travel record, but doing this manually is time-consuming.

[0091] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0092] In this invention, the server includes: means for a user to input desired conditions such as travel itinerary, budget, and desired activities; means for receiving the input information and generating an optimal travel plan using generative artificial intelligence; means for sending the generated plan to the user's terminal and making it selectable; means for automatically arranging air tickets, accommodations, and admission tickets to tourist attractions based on the selected plan; means for acquiring the user's location data during the trip and calculating and displaying the optimal route to the destination; means for responding in real time to problems and questions from the user; means for uploading data and notes taken by the user during the trip; and means for organizing the uploaded data, generating a travel record, and transmitting it to the user's terminal. This allows the user to perform a comprehensive process from planning and arranging the trip, to receiving support during the trip, and generating the travel record.

[0093] A "user" is a person who uses the travel system to perform operations such as planning a trip, making a reservation, experiencing, and recording.

[0094] The "date" is information that indicates the period from the start date to the end date of the trip.

[0095] "Budget" is information that specifies the upper limit of travel expenses.

[0096] "Desired activities" is information that refers to events or experiences that the user wants to have during their trip.

[0097] A "terminal" is a device used by a user, such as a computer, smartphone, or tablet.

[0098] A "server" is a computer system that receives and processes information sent by users.

[0099] "Generative AI" is an AI technology that generates optimal travel plans based on input data.

[0100] A "travel plan" is a detailed plan that includes travel dates, places to visit, accommodation, transportation, tourist spots, etc.

[0101] An "air ticket" is a ticket that indicates a seat on an aircraft.

[0102] "Accommodation" means a hotel, inn, resort, or other place of accommodation for travel.

[0103] A "tourist attraction admission ticket" is a ticket for admission to a specific tourist attraction or event.

[0104] "Location data" is information that indicates the user's current location.

[0105] A "route" is the optimal path from the current location to the destination.

[0106] "Data" refers to information such as photos, videos, and notes taken by the user during their trip.

[0107] A "travel log" is a record that organizes and compiles all the data obtained during a trip.

[0108] "Means" are the methods or techniques used to achieve a particular goal.

[0109] The present invention is a system that uses generative artificial intelligence to provide an optimal travel plan based on user input of travel conditions such as travel itinerary, budget, and desired activities. This system supports the entire process of planning, preparing, implementing, and recording the trip. Specific embodiments are described below.

[0110] Enter travel conditions

[0111] The user uses the device's application to input the travel schedule, budget, and desired activities. For example, a user may input the desired conditions as "five days from April 10, 2023, budget of 200,000 yen, visiting museums." This input is done through the mobile application interface.

[0112] Generate a travel plan

[0113] The device converts the user's input data into JSON format data and sends it to a server via the Internet. The server then analyzes the received data and uses generative artificial intelligence (AI) to generate an optimal travel plan. Specifically, it uses an AI model (e.g., GPT-4 (registered trademark)) to collect information from a tourist destination database, accommodation database, and transportation database to create multiple travel plans.

[0114] Presenting and selecting a travel plan

[0115] The server sends the generated itineraries to the user's device. The user can then review these itineraries and select the one they want through the application. This selection is made through the device, and the result of the selection is sent back to the server.

[0116] Automatic booking

[0117] The server automatically arranges air tickets, accommodations, and admission tickets to tourist attractions based on the selected travel plan. To do this, it uses the APIs of various reservation services (e.g., airline APIs, hotel reservation site APIs, tourist attraction ticket sales service APIs). Once the arrangements are complete, the reservation information is integrated and generated as a document in PDF or HTML format.

[0118] Experience support during your trip

[0119] While traveling, users can use the device's application to check their next destination and the optimal route. The device uses the GPS sensor to obtain their current location and sends that information to a server. The server calculates the optimal route to the destination based on the received current location information, and also displays real-time traffic and weather information. Users can also use the device's chat function to send inquiries to the server and receive real-time responses to any problems or questions they may have. The server uses AI to suggest alternative routes and solutions.

[0120] Travel Records

[0121] During a trip, users can upload photos, videos, and notes they have taken through the device's application. This data is sent to the server and organized chronologically. The server then creates a travel record based on this data and sends it to the user's device in the form of a travel diary or photo album. The created travel record is saved as a digital album or travel diary, allowing for easy review later.

[0122] Specific examples

[0123] If a user inputs their desire to visit museums for five days starting April 10, 2023, with a budget of 200,000 yen, the system will generate a plan to visit Paris, Amsterdam, and London. If the user selects the Paris and Amsterdam plans, the server will automatically book flights and accommodations and generate an integrated document. During the trip, the user can use the GPS function to check the route to the Eiffel Tower, and if any problems arise, they can get solutions through the chat function. After the trip is completed, a travel record based on the photos and videos taken is generated and saved as a digital album.

[0124] Prompt Sentence Examples

[0125] "Please suggest a five-day trip that includes visiting museums in Paris and Amsterdam, starting April 10, 2023, with a budget of 200,000 yen."

[0126] The above is a specific embodiment of the present invention. The present invention allows users to consistently handle everything from travel planning and reservation arrangements to support during the trip and creation of a travel record, making it possible to maximize the enjoyment of travel.

[0127] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0128] Step 1:

[0129] Users input their travel dates, budget, and desired activities. Specifically, they operate the application interface to enter conditions such as "five days starting April 10, 2023, budget of 200,000 yen, visiting art museums." This generates the user's desired travel conditions as input data.

[0130] Step 2:

[0131] The terminal formats the data entered by the user and sends it to the server. Specifically, it converts the entered data into JSON format and sends it to the server as an HTTP request. The input is the user's desired data, and the output is the formatted data sent to the server.

[0132] Step 3:

[0133] The server analyzes the received data. The input is the JSON formatted travel condition data sent from the device, and the output is the analyzed condition data such as the itinerary, budget, desired activities, etc. Specifically, it uses a JSON parser to parse the data and extracts the individual conditions.

[0134] Step 4:

[0135] The server uses a generative artificial intelligence (AI) model to generate the optimal travel plan. The input is analyzed travel condition data, and the output is multiple travel plans. Specifically, the server inputs travel conditions into the AI ​​model and generates the optimal plan based on information on tourist spots, accommodation, and transportation. GPT-4 and other AI models are used.

[0136] Step 5:

[0137] The server sends the generated itinerary to the user's device. The input is the generated itinerary, and the output is the itinerary data sent to the device. Specifically, the server converts the generated itinerary back into JSON format and sends it to the device via an HTTP response.

[0138] Step 6:

[0139] The user checks the multiple plans sent from the server and selects the one they want. The input is the travel plan displayed on the terminal, and the output is the plan selected by the user. Specifically, the user selects the desired plan using the application interface.

[0140] Step 7:

[0141] The terminal sends the selected plan information to the server. The input is the travel plan selected by the user, and the output is the selected plan data sent to the server. Specifically, the terminal converts the selected plan ID into JSON format and sends it to the server as an HTTP request.

[0142] Step 8:

[0143] The server automatically arranges airline tickets, accommodations, and tickets to tourist attractions. The input is the selected travel plan data, and the output is reservation confirmation information. Specifically, it calls the APIs of various reservation services to make reservations for airline tickets and accommodations, and arranges tickets to tourist attractions.

[0144] Step 9:

[0145] The server consolidates the reservation information it has arranged and sends it to the user's terminal. The input is various reservation data, and the output is an integrated reservation information document. Specifically, it aggregates multiple reservation information, converts it into a document in PDF or HTML format, and sends it to the terminal.

[0146] Step 10:

[0147] While traveling, users use an application on their device to check their next destination and the best route. The input is the user's current location information, and the output is information about the best route to the destination. Specifically, the application uses a GPS sensor to obtain the user's current location and sends that information to a server.

[0148] Step 11:

[0149] The server calculates the optimal route based on the current location information and sends it to the device. The input is the user's current location data and the output is the optimal route information. Specifically, it uses a navigation API to calculate the route and sends it to the device along with real-time traffic and weather information.

[0150] Step 12:

[0151] When a user has a problem or question, they can use the chat function on their device to send a message to the server. The input is a message from the user, and the output is an inquiry request to the server. Specifically, the user enters a message using the chat interface and presses the send button.

[0152] Step 13:

[0153] The server analyzes the received message and uses AI to propose alternative routes and solutions. The input is the user's inquiry message, and the output is a proposed solution or alternative route. Specifically, it analyzes the message using natural language processing technology, generates an appropriate response, and sends it back to the user.

[0154] Step 14:

[0155] Users upload data and notes taken during their trip to the server via their device. The input is the photos and videos taken and the note data, and the output is a file upload request to the server. Specifically, the user selects a file using the application's upload function and presses the send button.

[0156] Step 15:

[0157] The server organizes the uploaded data and generates a travel record. The input is the data uploaded by the user, and the output is an organized travel record document. Specifically, the server organizes the data along the timeline, generates a document as a travel record, and sends it to the user's device.

[0158] (Application example 1)

[0159] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0160] When planning and executing a trip, arranging meals can be a complicated process. The tasks of finding and booking local restaurants and cafes, and then arranging for delivery, in particular, are a significant burden for travelers. Furthermore, choosing meals in foreign countries or tourist destinations is often difficult due to language and cultural barriers. For this reason, there is a demand for a system that makes it easy to arrange meals as part of travel planning and provides consistent support for meal selection and delivery during travel.

[0161] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0162] In this invention, the server includes a means for generating recommended restaurants for the area to be visited based on the user's travel plan data, a means for delivering meals to the user's current location based on the generated list of recommended restaurants, and a means for consistently managing and supporting the entire travel process, thereby enabling travelers to receive recommendations for optimal local meals based on their travel plans and automatically arrange for delivery.

[0163] The "means for the user to input desired conditions such as travel schedule, budget, desired activities, etc." is an interface for the user to input detailed information about the desired trip into the terminal.

[0164] "Means for receiving input information and generating an optimal travel plan using generative artificial intelligence" refers to a system that automatically creates an optimal travel plan using generative artificial intelligence based on information entered by the user.

[0165] "Means for sending the generated plan to the user's terminal and making it selectable" refers to a system that sends the generated travel plan to the user's terminal and makes it possible for the user to check and select the plan.

[0166] "Means for automatically arranging air tickets, accommodations, and tickets to tourist spots based on a selected plan" is a system that automatically makes various reservations based on a travel plan selected by the user.

[0167] The "means for integrating arranged reservation information and transmitting it to the user terminal" is a system that centrally integrates arranged reservation information and transmits it to the user terminal.

[0168] "Means for acquiring the location information of a user traveling, and calculating and displaying the optimal route to the destination" is a system that acquires the current location of a user traveling, and calculates and displays the optimal travel route to the destination.

[0169] "Means for providing real-time answers to problems and questions from users" is a system that provides real-time solutions and information to problems and questions that users encounter while traveling.

[0170] "A means for uploading photos, videos, and notes taken by users while traveling" is a system for uploading photos, videos, and notes taken by users while traveling to the cloud.

[0171] "Means for organizing uploaded data, generating a travel record, and sending it to the user terminal" refers to a system that organizes uploaded data in chronological order, edits and generates a travel record, and sends it to the user terminal.

[0172] The "means for generating recommended restaurants for a visit area based on the user's travel plan data" is a system that recommends optimal restaurants for a visit area included in the user's travel plan.

[0173] The "means for delivering meals to the user's current location based on the generated list of recommended restaurants" is a system that arranges for meals to be delivered from recommended restaurants to the user's current location.

[0174] The present invention is a system that consistently supports the proposal, preparation, experience, and recording of travel plans, and specific embodiments are described below.

[0175] System Program

[0176] Hardware and software used

[0177] Hardware: Smartphones, GPS devices

[0178] Database: Amazon RDS

[0179] API: Google (registered trademark) Maps API, OpenWeatherMap API, Reservation Service API

[0180] AI: GPT-4 (OpenAI (registered trademark))

[0181] Specific processing contents of the program

[0182] Travel plan suggestions

[0183] Users use their smartphones to input travel conditions such as travel dates, budget, and desired activities. This information is sent from the device to a server. The server receives the information and uses generative artificial intelligence (GPT-4) to generate an optimal travel plan. This generative AI collects information such as tourist destinations, accommodations, and transportation methods from a database and creates multiple candidate plans. The generated plans are sent to the user's device, and the user can choose from multiple plans.

[0184] Travel preparation and arrangements

[0185] Once the user selects the desired plan, the server automatically arranges airfare, accommodation, and sightseeing tickets, using the APIs of various reservation services. The arranged reservation information is integrated into a single document and sent to the user's device.

[0186] Experience support during your trip

[0187] While traveling, users can use their device to check their next destination and the best route. The device uses GPS to obtain their current location and sends it to the server. The server calculates the best route to the destination based on real-time location data and sends it to the device. Real-time traffic and weather information is also displayed. In the unlikely event that a problem occurs, users can use the chat function within the app to send a message to the server. The server uses AI to suggest alternative routes and solutions.

[0188] Meal suggestions and delivery arrangements

[0189] The server generates recommended restaurants in the area to be visited based on the user's travel plan data. The generated list is sent to the user's device, and the user can select delivery from the recommended restaurants. The selected meal is arranged through the server using the reservation service API and delivered to the user's current location.

[0190] Travel Records

[0191] Photos, videos, and notes taken by users during their trip are uploaded from their device to the cloud. The server organizes the uploaded data chronologically and consolidates it in the form of a travel diary or photo album. Photos and videos taken during the trip are organized chronologically and edited for easy viewing. The server generates a travel record that reflects the trip's overview and highlights and sends it to the user's device. The generated travel record is provided as a digital album or travel diary that can be saved as a memory.

[0192] Specific examples

[0193] For example, if a user inputs their travel plan for "visiting art museums for five days starting April 10, 2023, with a budget of 200,000 yen," the server will use generative artificial intelligence to propose an optimal travel plan. This plan will include destinations such as Paris, Amsterdam, and London, and details of each museum, accommodation, and transportation. Recommended restaurants in the area will also be suggested, and the user can choose to have them delivered.

[0194] Prompt Sentence Examples

[0195] The prompt to use for the generative AI model:

[0196] Please recommend a restaurant. Location: Paris, Preferences: Vegetarian, Budget: Under 5,000 yen.

[0197] In this way, the present invention provides a system that consistently supports planning, preparing, experiencing, and recording a trip, making the trip more comfortable and fulfilling for the user.

[0198] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0199] Step 1:

[0200] The user enters desired conditions such as travel dates, budget, and desired activities into a smartphone application.

[0201] Input: Travel conditions such as "5 days from April 10, 2023, budget of 200,000 yen, visiting art museums"

[0202] How it works: Information entered by the user is sent to the server via the application.

[0203] Output: Travel conditions information sent to the server

[0204] Step 2:

[0205] The server uses generative artificial intelligence (GPT-4) to generate the optimal travel plan based on the travel conditions received.

[0206] Input: Travel conditions information

[0207] How it works: The server passes the received conditions to the generative AI model as a prompt sentence, for example, "Please create a travel plan based on a five-day trip starting April 10, 2023, with a budget of 200,000 yen and including a visit to art museums."

[0208] Output: Generated itineraries (e.g., a plan that includes visits to museums in Paris, Amsterdam, and London)

[0209] Step 3:

[0210] The server transmits the generated travel plan to the user's terminal, allowing the user to select a plan.

[0211] Input: Generated itinerary

[0212] Operation: The server sends the generated plan to the user's terminal and displays multiple plans as options.

[0213] Output: Multiple itineraries displayed on the user's device

[0214] Step 4:

[0215] The user selects the desired travel plan on the terminal.

[0216] Input: User selected itinerary

[0217] Operation: The user selects one of the plans presented, and the selection information is sent from the terminal to the server.

[0218] Output: Plan information selected by the user

[0219] Step 5:

[0220] The server automatically arranges airfare, accommodation, and tourist attraction tickets based on the selected plan.

[0221] Input: Selected plan information

[0222] How it works: The server uses various reservation service APIs to reserve and arrange tickets for airline tickets, accommodations, and tourist attractions.

[0223] Output: Various reservation information (airline tickets, accommodation, tourist attraction ticket details)

[0224] Step 6:

[0225] The server integrates the arranged reservation information, generates it as a single document, and sends it to the user terminal.

[0226] Input: Various reservation information

[0227] How it works: The server consolidates reservation information, organizes it into a single, easy-to-read document, and sends it to the user's terminal.

[0228] Output: Consolidated reservation information displayed on the user's terminal

[0229] Step 7:

[0230] While traveling, the user uses the device to check the best route from their current location to their destination.

[0231] Input: User's current location (GPS)

[0232] How it works: The device uses GPS to determine its current location and sends it to the server. The server calculates the optimal route and sends directions to the destination to the device.

[0233] Output: Optimal route displayed on the terminal

[0234] Step 8:

[0235] The server generates recommended restaurants in the area to be visited based on the user's travel plan data and transmits them to the user's terminal.

[0236] Input: Travel planning data

[0237] How it works: The server uses generative artificial intelligence to generate a list of restaurant recommendations based on travel planning data, for example, a list of vegetarian restaurants while in Paris.

[0238] Output: A list of recommended restaurants displayed on the user's device

[0239] Step 9:

[0240] The user selects delivery from a list of recommended restaurants and arranges the order through the server.

[0241] Input: The restaurant and delivery details selected by the user

[0242] How it works: The server receives the selected information and uses the reservation service API to arrange delivery.

[0243] Output: Delivery arrangement confirmation information

[0244] Step 10:

[0245] Users can upload photos, videos, and notes taken using their device while traveling to the cloud.

[0246] Input: Files taken or recorded by the user

[0247] How it works: A user uses their device to upload photos, videos, and notes to a cloud service.

[0248] Output: User's travel history stored in the cloud

[0249] Step 11:

[0250] The server organizes the data stored in the cloud, generates a travel record, and sends it to the user's device.

[0251] Input: File data stored in the cloud

[0252] How it works: The server organizes the data chronologically, generates a travel diary or photo album, and sends the results to the user's device.

[0253] Output: Trip log displayed on user's terminal

[0254] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0255] The present invention provides a system that consistently supports planning, preparing, experiencing, and recording a trip, and combines an emotion engine that recognizes a user's emotions. A specific embodiment of this system is described below.

[0256] Travel plan suggestions

[0257] The user inputs desired conditions such as travel dates, budget, and desired activities. For example, consider a case where a user inputs "five days starting April 10, 2023, budget of 200,000 yen, visiting art museums." These conditions are sent to the server via the device. The server analyzes the received input information and generates an optimal travel plan using generative artificial intelligence. This AI collects information on tourist destinations, accommodations, transportation, etc. from a database and creates multiple candidate plans.

[0258] Furthermore, the emotion engine recognizes the user's emotions from their input and interaction and reflects them in the generated travel plan. For example, if the user is tired, a plan that includes many relaxing tourist spots and spa facilities will be suggested. The generated plan includes destinations such as Paris, Amsterdam, and London, along with their respective museums, accommodations, and transportation options. The generated plan is sent to the user's device, and the user can choose from multiple plans.

[0259] Travel preparation and arrangements

[0260] The user reviews the proposed plans and selects the one they want. For example, suppose they select a plan for Paris and Amsterdam. Based on the selected plan, the server automatically arranges airfare, accommodation, and tickets to tourist attractions. The server makes these arrangements through the APIs of various reservation services and integrates the reservation information to generate a single document. This reservation information includes airfare details, hotel reservation number, ticket information for tourist attractions, etc. The generated reservation information is sent to the user's device so that it can be viewed.

[0261] Experience support during your trip

[0262] While traveling, users can use their device to check their next destination and the best route. For example, if a user wants to go to the Eiffel Tower in Paris, they can check its location in the app. The device uses GPS to obtain its current location and sends it to the server. The server then calculates the best route to the destination based on the received current location information and sends it to the device. In addition, real-time traffic and weather information is also displayed.

[0263] The emotion engine monitors the user's emotional state in real time and can change guidance and suggestions during the trip. For example, if the user is feeling stressed, the server will suggest quieter roads and less crowded tourist spots.

[0264] If a problem occurs, for example if a train is delayed, the user can use the chat function in the app to send a message to the server, which will then use AI to suggest alternative routes and solutions. The emotion engine will analyze the user's emotional state and suggest measures to reduce stress.

[0265] Travel Records

[0266] Users can upload photos, videos, and notes taken during their trip to the app. This data is sent to the server via their device. The server organizes the uploaded data chronologically and integrates it in the form of a travel diary or photo album. For example, photos taken and videos recorded during a trip are organized chronologically and edited for easy viewing. The server generates a travel record that reflects the overview and highlights of the trip and sends it to the user's device. The generated travel record becomes a digital album or travel diary that can be saved as memories, making it convenient for users to look back on later.

[0267] The emotion engine can also add comments and tags that reflect the user's emotions to travel photos, allowing users to vividly record their memories, including changes in their emotions during their trip.

[0268] In this way, the present invention not only provides users with consistent support throughout the entire process of planning, preparing, experiencing, and recording their trip, but also allows them to receive suggestions and support that respond to changes in their emotions through the emotion engine, making it possible for them to have a more fulfilling travel experience.

[0269] The processing flow will be explained below.

[0270] Step 1:

[0271] The user inputs desired conditions such as travel dates, budget, and desired activities into the terminal.

[0272] Example: A user enters the following conditions: "5 days from April 10, 2023, budget 200,000 yen, visiting art museums."

[0273] Step 2:

[0274] The terminal transmits the input information to the server.

[0275] The input data is converted to an appropriate format on the terminal and transferred to the server.

[0276] Step 3:

[0277] The server analyzes the received desired conditions.

[0278] The server processes each item such as schedule, budget, activities, etc. and retrieves the necessary data from the database.

[0279] Step 4:

[0280] The server uses an emotion engine to recognize the user's emotion.

[0281] It analyzes emotions from user input and past data to determine the user's current emotional state.

[0282] Step 5:

[0283] The server uses generative artificial intelligence to generate the optimal travel plan.

[0284] The AI ​​takes into account the user's desired conditions and emotional state, collects information on tourist spots, accommodation, transportation, etc. from a database, and creates multiple candidate plans.

[0285] Step 6:

[0286] The server transmits the generated plan to the user's terminal.

[0287] The terminal displays the received plans to the user, allowing the user to select from a plurality of plans.

[0288] Step 7:

[0289] The user checks the proposed plans and selects the one they want.

[0290] The user selects a plan for Paris and Amsterdam.

[0291] Step 8:

[0292] The terminal transmits the selected plan information to the server.

[0293] The selection result is retransmitted from the terminal to the server.

[0294] Step 9:

[0295] The server automatically arranges air tickets, accommodations, and tickets for sightseeing spots based on the selected plan.

[0296] The server connects with each reservation service through its API and carries out the necessary reservation procedures.

[0297] Step 10:

[0298] The server aggregates the reservation information and generates a document.

[0299] Compile all your flight, accommodation, and tourist ticket information into one document.

[0300] Step 11:

[0301] The server transmits the generated reservation information to the user's terminal.

[0302] The user uses the terminal to confirm reservation information and complete travel planning.

[0303] Step 12:

[0304] During the trip, the user uses the terminal to check the next destination.

[0305] If a user is in Paris and wants to go to the Eiffel Tower, they can check its location in the app.

[0306] Step 13:

[0307] The device uses GPS to obtain its current location and sends it to the server.

[0308] The current location information is sent to the server and used as material for the next calculation.

[0309] Step 14:

[0310] The server calculates the optimal route to the destination and sends it to the device.

[0311] Based on the requested route and mode of transportation, the server generates the optimal directions.

[0312] Step 15:

[0313] The device displays the optimal route based on real-time traffic and weather information.

[0314] Users can choose the most suitable mode of transportation for their current situation.

[0315] Step 16:

[0316] An emotion engine monitors the user's emotional state in real time and adjusts guidance during the journey.

[0317] If the user is feeling stressed, the server will suggest quieter roads and less crowded tourist spots.

[0318] Step 17:

[0319] If a user has a problem or question, they can use the chat function within the app to send a message to the server.

[0320] Example: Report that the train is delayed.

[0321] Step 18:

[0322] The server uses AI to suggest alternative routes and solutions and respond to the user.

[0323] The emotion engine analyzes the user's emotional state and suggests measures to reduce stress.

[0324] Step 19:

[0325] Users upload photos, videos, and notes they take while traveling to the app.

[0326] These data are transmitted to the server via the terminal.

[0327] Step 20:

[0328] The server organizes the uploaded data chronologically and generates a travel record.

[0329] The data is integrated and provided to users in the form of a travel diary or photo album.

[0330] Step 21:

[0331] The emotion engine adds comments and tags to photos and videos that reflect the user's emotions.

[0332] This allows users to record their memories, including changes in their emotions during their trip.

[0333] Step 22:

[0334] The server transmits the generated travel record to the user terminal.

[0335] Users can check their travel records through the device and save them as an electronic album or travel diary.

[0336] Example 2

[0337] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0338] Conventional travel planning support systems are limited to proposing travel plans that take into account the user's desired conditions. This often results in a fixed plan that ignores the user's emotions, resulting in a poor quality travel experience. Furthermore, support for dealing with troubles during the trip and responding to emotions is insufficient, causing significant stress and burden for users. Furthermore, travel records are limited to simple data uploads, and are not saved in the form of emotionally relevant memories, which is an issue.

[0339] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for a user to input desired conditions such as travel itinerary, budget, and desired activities; means for receiving the input information and generating an optimal travel plan using a generative AI model; means for recognizing emotions from the input information and reflecting them in the generated plan; means for sending the generated plan to the user's terminal and making it selectable; means for automatically arranging air tickets, accommodations, and tickets for tourist attractions based on the selected plan; means for integrating the arranged reservation information and sending it to the user's terminal; means for acquiring the user's location information during the trip and calculating and displaying the optimal route to the destination; means for responding in real time to problems and questions from the user; means for uploading images, videos, and notes taken by the user during the trip; and means for organizing the uploaded data, generating a travel record, and sending it to the user's terminal. This makes it possible to provide a travel plan that reflects the user's emotions, improve flexibility in dealing with problems, and generate a travel record that reflects the user's emotions.

[0340] A "user" is an entity that uses the system to plan, prepare, experience, and record a trip.

[0341] "Travel itinerary" is information indicating the period from the start date to the end date of the trip.

[0342] "Budget" is information indicating the upper limit of expenses that can be spent on a trip.

[0343] "Desired activities" is information indicating specific activities and conditions for destinations that the user wants to do during the trip.

[0344] "Input information" refers to information provided by the user via the terminal as conditions including travel schedule, budget, desired activities, and the like.

[0345] A "generative AI model" is an artificial intelligence platform that analyzes input information and generates optimal travel plans.

[0346] "Emotion" is information that indicates the user's current emotional state and is the subject of recognition and analysis by the system.

[0347] A "travel plan" is a proposal that includes destinations, accommodations, transportation, activities, etc., created based on the user's desired conditions and feelings.

[0348] A "terminal" is a device through which a user accesses the system and enters and receives information.

[0349] An "air ticket" is information used to reserve a seat on an airplane during a trip.

[0350] "Accommodation" is information about facilities where the user stays during the trip.

[0351] A "tourist attraction ticket" is information indicating the right to enter a tourist attraction.

[0352] "Location information" is information that indicates geographical data of the user's current location.

[0353] An "optimal route" is a travel route that optimizes conditions such as time and distance when traveling from the current location to the destination.

[0354] "Trouble" refers to a problem or obstacle that occurs during the trip that the user did not anticipate.

[0355] A "question" is information indicating an inquiry that a user requests the system to solve.

[0356] "Real-time" means that processing and response are carried out immediately without delay.

[0357] "Images" are data representing photographs taken by the user during the trip.

[0358] "Video" is data representing videos taken by the user during the trip.

[0359] "Notes" are text information recorded by the user during the trip.

[0360] "Travel Records" is data that organizes and consolidates images, videos, and notes taken during a trip and provides them as travel memories.

[0361] "Means" refers to the methods or techniques used to achieve a particular goal.

[0362] The present invention relates to a system that supports a user's entire travel experience, and in particular, it is a system that combines a generative AI model and an emotion engine to provide an optimal travel plan based on the user's emotions and consistently support the experience and record during the trip.

[0363] System Overview

[0364] This system is composed of a terminal and a server. The user uses the terminal to input their desired travel conditions, and the server generates the optimal travel plan based on that information. It also uses an emotion engine to analyze the user's emotions and adjust the plan accordingly. During the trip, the system obtains location information in real time, calculates and displays the optimal route, and also handles trouble and emotional care. As a travel record, it organizes and consolidates the images, videos, and notes taken by the user, and creates a digital album with emotion tags.

[0365] Hardware and software used

[0366] Device: A user device such as a smartphone or tablet that allows the user to input travel preferences, view generated itineraries, and receive route guidance during the trip.

[0367] Server: A high-performance server utilizing cloud services. This is the core of the system, making full use of generative AI models and emotion engines to process various data and perform calculations.

[0368] Generative AI model: An artificial intelligence model that generates optimal travel plans based on input information (e.g., OpenAI GPT-4).

[0369] Emotion engine: Ability to analyze user emotions and adjust plans accordingly (e.g., IBM Watson® Tone Analyzer).

[0370] Other APIs: APIs used to connect with various services (e.g., Google Places API, Expedia API, OpenWeather API, etc.).

[0371] Specific operation of the system

[0372] 1. Input and analysis:

[0373] The user inputs travel conditions such as travel dates, budget, desired activities, etc. via the terminal. For example, if the user wishes to travel for five days from April 10, 2023, with a budget of 200,000 yen and visit art museums, the user writes this information in the input form. The terminal then sends this information to the server.

[0374] 2. Generate a travel plan:

[0375] The server analyzes the input information and generates an optimal travel plan using a generative AI model. This AI generates multiple plans using a pre-built database of tourist attractions, accommodations, and transportation. For example, a plan to visit Paris, Amsterdam, and London is generated, including detailed information on tourist attractions and accommodations.

[0376] 3. Reflecting emotions:

[0377] The server uses an emotion engine to recognize emotions from user input and dialogue and reflect them in the plan. For example, if the user is tired, a plan that includes many relaxing tourist spots and spa facilities will be generated. An example of a prompt sentence is, "The travel dates are five days from April 10, 2023, the budget is 200,000 yen, and I would like to visit art museums. I am currently tired. Please generate the optimal travel plan."

[0378] 4. Check and select your plan:

[0379] The generated travel plans are sent to the user's terminal, from which the user can select one. The terminal then sends the selected plan information to the server, which then starts making various reservations.

[0380] 5. Reservation arrangements:

[0381] The server automatically arranges air tickets, accommodations, and tickets for tourist attractions based on the selected plan, using various reservation service APIs to integrate the acquired reservation information, such as air ticket details, hotel reservation numbers, and ticket information for tourist attractions.

[0382] 6. Travel support:

[0383] While the user is traveling, the device uses GPS to obtain their current location and sends it to the server. The server calculates the optimal route based on the current location information and sends it to the device along with real-time traffic and weather information. If the user encounters a problem, the server uses AI to suggest alternative routes and solutions. In addition, an emotion engine analyzes the user's emotional state in real time and suggests the best course of action.

[0384] 7. Generate a trip record:

[0385] Users upload photos, videos, and notes they take during their trip to their device. The server organizes this data chronologically and integrates it into a travel record. The emotion engine assigns emotion tags to this data, allowing for clear recording of the user's emotional changes.

[0386] In this way, the present invention provides consistent support for users from planning their trip to experiencing it and recording it, and by utilizing the emotion engine, it is possible to provide a more personalized travel experience.

[0387] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0388] Step 1:

[0389] Collecting input information

[0390] The user inputs the travel schedule, budget, desired activities, etc. into the terminal. The input information may include, for example, "5 days from April 10, 2023, budget of 200,000 yen, visiting art museums."

[0391] Input: The user fills in the travel requirements in the input form.

[0392] Output: The terminal sends the input information to the server. Specifically, it forwards it to the server as an HTTP request.

[0393] Step 2:

[0394] Analysis of input information

[0395] The server parses the received input information. It uses a Python library (e.g. BeautifulSoup) to parse the input information as text data.

[0396] Input: User's desired conditions transferred from the terminal.

[0397] Output: The analyzed data is generated as a prompt sentence and converted into a format to be input into the generative AI model. Example: "The travel dates are 5 days from April 10, 2023, the budget is 200,000 yen, and I would like to visit art museums."

[0398] Step 3:

[0399] Generate a travel plan

[0400] The server generates an optimal travel plan based on the input information using a generative AI model (e.g., OpenAI GPT-4). This AI collects information from databases of tourist destinations, accommodations, and transportation.

[0401] Input: The parsed prompt statement.

[0402] Data processing: The generative AI model analyzes the prompt, extracts relevant information from the database, and generates a travel plan.

[0403] Output: A list of multiple itineraries, for example: "Louvre in Paris, luxury hotel, rail transport" or "British Museum in London, mid-range hotel, bus transport".

[0404] Step 4:

[0405] Recognizing and reflecting emotions

[0406] The server uses an emotion engine (e.g., IBM Watson Tone Analyzer) to recognize emotions from user input and dialogue and reflect them in the travel plan.

[0407] Input: User input information and generated itinerary.

[0408] Data Calculation: The emotion engine analyzes the user's emotions from the text and adjusts the contents of the travel plan. For example, if the user is tired, the plan will be changed to include more relaxing tourist spots and spa facilities.

[0409] Output: The adjusted itinerary.

[0410] Step 5:

[0411] Submit and confirm your travel plans

[0412] The server sends the generated and adjusted travel plan to the user's device using the HTTP protocol.

[0413] Input: Adjusted travel plans.

[0414] Output: The terminal displays the itinerary and allows the user to choose from multiple itineraries.

[0415] Step 6:

[0416] Select a travel plan

[0417] The user reviews the proposed itineraries and selects the one they want, for example, Paris and Amsterdam.

[0418] Input: Multiple itineraries displayed on the device.

[0419] Output: The selected plan information is sent to the server.

[0420] Step 7:

[0421] Start making reservations

[0422] The server automatically arranges air tickets, accommodations, and tickets for sightseeing spots based on the selected plan, using various reservation service APIs (e.g., Expedia API).

[0423] Input: The selected itinerary.

[0424] Data calculation: Make an API call to get reservation information.

[0425] Output: The arranged reservation information is stored on the server.

[0426] Step 8:

[0427] Aggregation of reservation information

[0428] The server consolidates the reservation information and organizes it into a single document, e.g., using a PDF generation library (e.g., ReportLab) to combine flight details, hotel reservation number, and tourist attraction ticket information into a single PDF file.

[0429] Input: Various reservation information.

[0430] Data processing: Integrate the acquired data and convert it into a document format.

[0431] Output: The generated booking information document.

[0432] Step 9:

[0433] Submit and confirm reservation information

[0434] The server transmits the generated reservation information to the user's terminal.

[0435] Input: The generated booking information document.

[0436] Output: The reservation information is displayed on the terminal for the user to review.

[0437] Step 10:

[0438] Check your destination and route

[0439] The user uses the device to check their next destination and the best route. For example, if the user wants to go to the Eiffel Tower in Paris, they check its location on the device.

[0440] Input: Destination location.

[0441] Output: The location of the destination will be displayed on the device.

[0442] Step 11:

[0443] Get and send your current location

[0444] The device uses GPS to determine its current location.

[0445] Input: Location data from GPS.

[0446] Output: The current location is sent to the server.

[0447] Step 12:

[0448] Viewing real-time information

[0449] Based on the received current location information, the server calculates the optimal route to the destination, obtains real-time traffic and weather information (e.g., OpenWeather API), and sends it to the device.

[0450] Input: Your current location.

[0451] Data calculation: Calculate optimal routes and get real-time information.

[0452] Output: Route information and real-time information will be displayed on the terminal.

[0453] Step 13:

[0454] Troubleshooting

[0455] When a user encounters a problem (e.g., a train delay), they can use the app's chat function to send a message to the server, which then uses AI to suggest alternative routes and solutions.

[0456] Input: Trouble message from the user.

[0457] Data computation: AI-powered generation of alternative routes and solutions.

[0458] Output: The proposed solution is displayed on the terminal.

[0459] Step 14:

[0460] Upload your trip log

[0461] Users upload images, videos, and notes taken during their trip to the app.

[0462] Input: Image, video, and note data from the user.

[0463] Output: Data is sent to the server.

[0464] Step 15:

[0465] Data organization and integration

[0466] The server organizes the uploaded data chronologically and integrates it into a travel record.

[0467] Input: Uploaded image, video, and note data.

[0468] Data processing: Organize and integrate data in chronological order.

[0469] Output: An organized travel log.

[0470] Step 16:

[0471] Emotion tagging

[0472] The emotion engine adds comments and tags that reflect the user's emotions to travel photos.

[0473] Input: Organized travel log data.

[0474] Data operations: Emotion tagging.

[0475] Output: Travel log tagged with emotions.

[0476] Step 17:

[0477] Sending a trip log

[0478] The server transmits the generated travel record to the user's terminal.

[0479] Input: Travel log data with emotion tags.

[0480] Output: The trip log sent to the device is displayed.

[0481] In this way, users can receive consistent support from planning to experiencing and recording their trip, and by utilizing the emotion engine, it is possible to provide a more personalized travel experience.

[0482] (Application example 2)

[0483] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0484] Conventional travel planning systems propose travel plans without considering the user's emotional state, which means they are unable to fully enhance the user's psychological satisfaction. Furthermore, they are unable to respond in real time to the user's emotional changes during the trip, and lack appropriate suggestions and support to reduce stress and anxiety.

[0485] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for a user to input desired conditions such as travel itinerary, budget, and desired activities; means for receiving the input information and generating an optimal travel plan using generative artificial intelligence; means for sending the generated plan to the user's terminal and making it selectable; means for automatically arranging air tickets, accommodations, and tickets for tourist attractions based on the selected plan; means for integrating the arranged reservation information and sending it to the user's terminal; means for acquiring the user's location information during the trip and calculating and displaying the optimal route to the destination; means for responding to user problems and questions in real time; means for uploading photos, videos, and notes taken by the user during the trip; means for organizing the uploaded data, creating a travel record, and sending it to the user's terminal; and means for monitoring the user's emotions in real time using an emotion engine and suggesting dishes and entertainment accordingly. This makes it possible to grasp the user's emotional state in real time and suggest travel plans and meals based on that, thereby providing a more personalized and fulfilling travel experience.

[0486] "User" means an individual who uses the system to plan, arrange, or receive support for travel.

[0487] "Itinerary" refers to the specific schedule during the trip, including the start and end dates of the trip.

[0488] "Budget" is the amount of money the user plans to spend on the trip.

[0489] "Desired conditions" are specific requests such as the activities the user wants to do on the trip, the places they want to visit, and the accommodations they want to stay at.

[0490] "Input information" refers to data such as schedule, budget, desired conditions, etc. that the user provides to the system.

[0491] "Generative AI" is AI that generates optimal travel plans based on input information.

[0492] A "travel plan" is a detailed travel plan proposed based on the user's desired conditions.

[0493] A "terminal" is a device that allows a user to access the system and perform necessary operations.

[0494] "Air ticket" means a boarding pass for an aircraft used for travel.

[0495] "Accommodation" refers to a facility where a user stays during a trip.

[0496] "Tourist attraction tickets" are admission tickets or vouchers required to visit a tourist attraction.

[0497] "Reservation information" refers to detailed information such as air tickets, accommodations, and tickets to tourist attractions arranged based on the travel plan.

[0498] "Location information" is data about the user's current location.

[0499] An "optimal route" is the most efficient route for a user to reach a destination.

[0500] The "emotion engine" is a system for monitoring and analyzing a user's emotional state in real time.

[0501] "Cuisine" refers to meals suggested based on the user's emotions and desired conditions.

[0502] "Entertainment" refers to entertainment and fun suggested based on the user's emotions and desired conditions.

[0503] This invention is a system that consistently supports planning, preparing, experiencing, and recording a trip. This system is combined with an emotion engine that recognizes the user's emotions, and is configured as follows.

[0504] Travel Planner

[0505] Users input desired conditions such as travel dates, budget, and desired activities into their device. For example, they input specific desired conditions such as "five days starting April 10, 2023, budget of 200,000 yen, visiting art museums." This information is sent from the device to the server. The server analyzes the received information and generates an optimal travel plan using a generative AI model. This AI collects information from databases of various tourist destinations, accommodations, and transportation options, and creates multiple candidate plans.

[0506] Use of emotion engine

[0507] Furthermore, the emotion engine recognizes the user's emotions from their input and interaction and reflects them in the generated travel plans. For example, if the user is tired, it will suggest plans that include many relaxing tourist spots and spa facilities.

[0508] Travel preparation and arrangements

[0509] The user reviews the proposed plans and selects the one they want. Based on the selected plan, the server automatically arranges airfare, accommodation, and tourist attraction tickets. The server makes these arrangements through the APIs of various reservation services and integrates the reservation information to generate a single document. The generated reservation information is sent to the user's device, where it can be viewed.

[0510] Experience support during your trip

[0511] While traveling, users can use their device to check their next destination and the optimal route. The server uses GPS to obtain their current location, calculates the optimal route to the destination, and sends this to the user's device. Real-time traffic and weather information is also displayed. The emotion engine monitors the user's emotional state in real time and changes guidance and suggestions as needed. For example, if the user is feeling stressed, it will suggest quieter roads and less crowded tourist spots. Furthermore, if a problem occurs during the trip, such as a train delay, the user can send a message to the server using the app's chat function. The server then uses AI to suggest alternative routes and solutions.

[0512] Travel Records

[0513] Users can upload photos, videos, and notes taken during their trip to the app. This data is sent from the device to the server, which organizes the uploaded data chronologically and integrates it into a travel diary or photo album. For example, photos taken and videos recorded during a trip are organized chronologically and edited for easy viewing. The server generates a travel record that reflects the trip's overview and highlights and sends it to the user's device. The generated travel record becomes a digital album or travel diary, making it convenient for users to look back on later.

[0514] technical means

[0515] The server integrates "generative artificial intelligence," an emotion engine, and a system for collecting and analyzing real-time data. This allows it to grasp the user's emotional state in real time and make travel plans and meal suggestions accordingly. This forms the basis for providing a more personalized and fulfilling travel experience. As an example, the following prompt sentences can be input into the system:

[0516] Examples of prompt statements

[0517] "User is angry. Current emotional state is Angry. What type of food should we suggest next?"

[0518] "User preference: Italian, emotional state: Relaxed, budget: 3000 yen. Please suggest the best dish based on these."

[0519] This invention allows users to receive attentive service tailored to their emotions, enabling a more comfortable and satisfying travel experience.

[0520] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0521] Step 1:

[0522] The user logs in to the device and inputs desired conditions such as travel dates, budget, desired activities, etc. The input data is sent from the device to the server, which receives this input information and stores it in a database.

[0523] Step 2:

[0524] The server analyzes the received input information and generates an optimal travel plan based on generative AI. This generative AI collects information from databases of tourist spots, accommodations, transportation, etc., and creates multiple candidate plans. The generated plan is then sent from the server to the user's device.

[0525] Step 3:

[0526] The user checks the proposed travel plans on the terminal and selects the one they want. The selected plan information is sent from the terminal to the server, and the server automatically arranges various reservations based on that information. The arranged reservation information is stored on the server.

[0527] Step 4:

[0528] The server integrates the reservation information and generates a detailed reservation document, which includes ticket information for the flight, accommodation, and sightseeing spots. The generated reservation information is sent from the server to the user's terminal, where the user can view it.

[0529] Step 5:

[0530] While traveling, users use their devices to check their next destination and the best route. The device uses its GPS to obtain its current location and sends this information to a server. The server then calculates the best route from the current location to the destination and sends it to the user's device in real time.

[0531] Step 6:

[0532] The emotional engine monitors the user's emotional state in real time. The device's camera and microphone are used to capture the user's facial expressions and voice data, which are then sent to the server. The server then uses the emotional engine to analyze the user's emotional state and adjusts the suggestions and support content based on the results.

[0533] Step 7:

[0534] The app responds to user problems and questions in real time. Users use the app's chat function to send messages to the server, which then uses AI to respond immediately. For example, if a train is delayed, the app will suggest an alternative route.

[0535] Step 8:

[0536] Users upload photos, videos, and notes they take during their trip from their device to the app. This data is sent from the device to a server, which organizes the uploaded data chronologically and integrates it into a travel diary or photo album. Travel records are sent from the server to the user's device, allowing the user to look back on their travel memories later.

[0537] Step 9:

[0538] The emotion engine analyzes the user's emotional state and tags photos and videos with their emotions. This tagged data can be saved as a digital album or travel diary, allowing users to more vividly record their travel memories, including changes in their emotions.

[0539] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0540] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0541] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0542] [Second embodiment]

[0543] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0544] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0545] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0546] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0547] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0548] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0549] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0550] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0551] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0552] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0553] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0554] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0555] The present invention is a system that consistently supports planning, preparing, experiencing, and recording a trip. A specific embodiment of this system will be described below.

[0556] Travel plan suggestions

[0557] The user inputs desired conditions such as travel dates, budget, and desired activities. For example, consider a user inputting a desire for "five days starting April 10, 2023, budget of 200,000 yen, visiting art museums." These conditions are sent to the server via the device. The server analyzes the received input information and generates an optimal travel plan using generative artificial intelligence. This AI collects information on tourist spots, accommodations, transportation, etc. from a database and creates multiple candidate plans. The generated plans include destinations such as Paris, Amsterdam, and London, along with their respective museums, accommodations, and transportation methods. The generated plans are sent to the user's device, and the user can choose from multiple plans.

[0558] Travel preparation and arrangements

[0559] The user reviews the proposed plans and selects the one they want. For example, suppose they select a plan for Paris and Amsterdam. Based on the selected plan, the server automatically arranges airfare, accommodation, and tickets to tourist attractions. The server makes these arrangements through the APIs of various reservation services and integrates the reservation information to generate a single document. This reservation information includes airfare details, hotel reservation number, ticket information for tourist attractions, etc. The generated reservation information is sent to the user's device so that it can be viewed.

[0560] Experience support during your trip

[0561] While traveling, users can use their device to check their next destination and the optimal route. For example, if a user wants to go to the Eiffel Tower in Paris, they can check its location in the app. The device uses GPS to obtain its current location and sends it to the server. The server then calculates the optimal route to the destination based on the received location information and sends it to the device. It also displays real-time traffic and weather information. If a problem occurs, for example if the train is delayed, the user can use the chat function in the app to send a message to the server. The server then uses AI to suggest alternative routes and solutions.

[0562] Travel Records

[0563] Users can upload photos, videos, and notes taken during their trip to the app. This data is sent to the server via their device. The server organizes the uploaded data chronologically and integrates it in the form of a travel diary or photo album. For example, photos taken and videos recorded during a trip are organized chronologically and edited for easy viewing. The server generates a travel record that reflects the overview and highlights of the trip and sends it to the user's device. The generated travel record becomes a digital album or travel diary that can be saved as memories, making it convenient for users to look back on later.

[0564] In this way, the present invention provides users with consistent support throughout the entire process of planning, preparing, experiencing, and recording their trip, simplifies complicated procedures, and enables them to have a more fulfilling travel experience.

[0565] The processing flow will be explained below.

[0566] Step 1:

[0567] The user inputs desired conditions such as travel dates, budget, desired activities, etc. For example, the user might input "5 days from April 10, 2023, budget 200,000 yen, visiting art museums."

[0568] Step 2:

[0569] The terminal sends the input information to the server, which converts the user's input data into an appropriate format and forwards it to the server.

[0570] Step 3:

[0571] The server analyzes the received requirements, processes each item (date, budget, desired activities) separately, and prepares to retrieve the relevant information from the database.

[0572] Step 4:

[0573] The server uses generative artificial intelligence to generate optimal travel plans. The AI ​​creates multiple plans that best fit the user's preferences based on collected information on tourist destinations, accommodations, transportation, etc.

[0574] Step 5:

[0575] The server sends the generated plan to the user's device, which displays the received plans to the user, allowing them to select from multiple plans.

[0576] Step 6:

[0577] The user reviews the proposed itineraries and selects the one they want. For example, the user may select a plan for Paris and Amsterdam.

[0578] Step 7:

[0579] The terminal transmits the selected plan information to the server. The terminal communicates again to transfer the user's selection results to the server.

[0580] Step 8:

[0581] The server automatically arranges airfare, accommodation, and tourist attraction tickets based on the selected plan. The server connects with various reservation services via API and performs the necessary reservation procedures.

[0582] Step 9:

[0583] The server integrates the reservation information and generates a document. The server compiles the booked flight, accommodation, and tourist attraction ticket information into a single integrated document.

[0584] Step 10:

[0585] The server sends the generated reservation information to the user's terminal, and the user confirms the reservation information through the terminal and completes the travel plan.

[0586] Step 11:

[0587] While traveling, the user uses the device to confirm their next destination, such as a specific destination, such as wanting to visit the Eiffel Tower.

[0588] Step 12:

[0589] The device uses GPS to obtain its current location and sends it to the server, where it is used for the next calculation.

[0590] Step 13:

[0591] The server calculates the optimal route to the destination and sends it to the device. Based on the requested route and mode of transportation, the server generates the optimal guidance.

[0592] Step 14:

[0593] The device displays the optimal route based on real-time traffic and weather information, allowing users to choose the most suitable mode of transportation for their current situation.

[0594] Step 15:

[0595] When a user encounters a problem or trouble, they can use the chat function to send a message to the server, for example, to report that the train is delayed.

[0596] Step 16:

[0597] The server uses AI to suggest alternative routes and solutions and respond to users, providing appropriate support in real time and quickly resolving user issues.

[0598] Step 17:

[0599] Users upload photos, videos, and notes they take during their trip to the app, and this data is sent to the server via the device.

[0600] Step 18:

[0601] The server organizes the uploaded data chronologically and generates a travel record, which is then integrated into a travel diary or photo album and provided to the user.

[0602] Step 19:

[0603] The server sends the generated travel record to the user's terminal, where an electronic album or travel diary is displayed to help the user look back on their travel memories.

[0604] In this way, a system is realized in which the server, terminal, and user work together to support the user's travel experience throughout the entire process.

[0605] Example 1

[0606] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0607] Modern travel planning requires users to gather a lot of information and make reservations, which takes a lot of time and effort. These cumbersome procedures can take away from the enjoyment of traveling. There is also a need for systems that can quickly respond to unexpected issues that arise during a trip. Furthermore, users want to be able to organize the photos and notes they take during their trip and keep them as a travel record, but doing this manually is time-consuming.

[0608] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0609] In this invention, the server includes: means for a user to input desired conditions such as travel itinerary, budget, and desired activities; means for receiving the input information and generating an optimal travel plan using generative artificial intelligence; means for sending the generated plan to the user's terminal and making it selectable; means for automatically arranging air tickets, accommodations, and admission tickets to tourist attractions based on the selected plan; means for acquiring the user's location data during the trip and calculating and displaying the optimal route to the destination; means for responding in real time to problems and questions from the user; means for uploading data and notes taken by the user during the trip; and means for organizing the uploaded data, generating a travel record, and transmitting it to the user's terminal. This allows the user to perform a comprehensive process from planning and arranging the trip, to receiving support during the trip, and generating the travel record.

[0610] A "user" is a person who uses the travel system to perform operations such as planning a trip, making a reservation, experiencing, and recording.

[0611] The "date" is information that indicates the period from the start date to the end date of the trip.

[0612] "Budget" is information that specifies the upper limit of travel expenses.

[0613] "Desired activities" is information that refers to events or experiences that the user wants to have during their trip.

[0614] A "terminal" is a device used by a user, such as a computer, smartphone, or tablet.

[0615] A "server" is a computer system that receives and processes information sent by users.

[0616] "Generative AI" is an AI technology that generates optimal travel plans based on input data.

[0617] A "travel plan" is a detailed plan that includes travel dates, places to visit, accommodation, transportation, tourist spots, etc.

[0618] An "air ticket" is a ticket that indicates a seat on an aircraft.

[0619] "Accommodation" means a hotel, inn, resort, or other place of accommodation for travel.

[0620] A "tourist attraction admission ticket" is a ticket for admission to a specific tourist attraction or event.

[0621] "Location data" is information that indicates the user's current location.

[0622] A "route" is the optimal path from the current location to the destination.

[0623] "Data" refers to information such as photos, videos, and notes taken by the user during their trip.

[0624] A "travel log" is a record that organizes and compiles all the data obtained during a trip.

[0625] "Means" are the methods or techniques used to achieve a particular goal.

[0626] The present invention is a system that uses generative artificial intelligence to provide an optimal travel plan based on user input of travel conditions such as travel itinerary, budget, and desired activities. This system supports the entire process of planning, preparing, implementing, and recording the trip. Specific embodiments are described below.

[0627] Enter travel conditions

[0628] The user uses the device's application to input the travel schedule, budget, and desired activities. For example, a user may input the desired conditions as "five days from April 10, 2023, budget of 200,000 yen, visiting museums." This input is done through the mobile application interface.

[0629] Generate a travel plan

[0630] The device converts the user's input into JSON format data and sends it to a server via the internet. The server then analyzes the received data and uses generative artificial intelligence (AI) to generate an optimal travel plan. Specifically, it uses an AI model (e.g., GPT-4) to collect information from a database of tourist destinations, accommodations, and transportation options to create multiple travel plans.

[0631] Presenting and selecting a travel plan

[0632] The server sends the generated itineraries to the user's device. The user can then review these itineraries and select the one they want through the application. This selection is made through the device, and the result of the selection is sent back to the server.

[0633] Automatic booking

[0634] The server automatically arranges air tickets, accommodations, and admission tickets to tourist attractions based on the selected travel plan. To do this, it uses the APIs of various reservation services (e.g., airline APIs, hotel reservation site APIs, tourist attraction ticket sales service APIs). Once the arrangements are complete, the reservation information is integrated and generated as a document in PDF or HTML format.

[0635] Experience support during your trip

[0636] While traveling, users can use the device's application to check their next destination and the optimal route. The device uses the GPS sensor to obtain their current location and sends that information to a server. The server calculates the optimal route to the destination based on the received current location information, and also displays real-time traffic and weather information. Users can also use the device's chat function to send inquiries to the server and receive real-time responses to any problems or questions they may have. The server uses AI to suggest alternative routes and solutions.

[0637] Travel Records

[0638] During a trip, users can upload photos, videos, and notes they have taken through the device's application. This data is sent to the server and organized chronologically. The server then creates a travel record based on this data and sends it to the user's device in the form of a travel diary or photo album. The created travel record is saved as a digital album or travel diary, allowing for easy review later.

[0639] Specific examples

[0640] If a user inputs their desire to visit museums for five days starting April 10, 2023, with a budget of 200,000 yen, the system will generate a plan to visit Paris, Amsterdam, and London. If the user selects the Paris and Amsterdam plans, the server will automatically book flights and accommodations and generate an integrated document. During the trip, the user can use the GPS function to check the route to the Eiffel Tower, and if any problems arise, they can get solutions through the chat function. After the trip is completed, a travel record based on the photos and videos taken is generated and saved as a digital album.

[0641] Prompt Sentence Examples

[0642] "Please suggest a five-day trip that includes visiting museums in Paris and Amsterdam, starting April 10, 2023, with a budget of 200,000 yen."

[0643] The above is a specific embodiment of the present invention. The present invention allows users to consistently handle everything from travel planning and reservation arrangements to support during the trip and creation of a travel record, making it possible to maximize the enjoyment of travel.

[0644] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0645] Step 1:

[0646] Users input their travel dates, budget, and desired activities. Specifically, they operate the application interface to enter conditions such as "five days starting April 10, 2023, budget of 200,000 yen, visiting art museums." This generates the user's desired travel conditions as input data.

[0647] Step 2:

[0648] The terminal formats the data entered by the user and sends it to the server. Specifically, it converts the entered data into JSON format and sends it to the server as an HTTP request. The input is the user's desired data, and the output is the formatted data sent to the server.

[0649] Step 3:

[0650] The server analyzes the received data. The input is the JSON formatted travel condition data sent from the device, and the output is the analyzed condition data such as the itinerary, budget, desired activities, etc. Specifically, it uses a JSON parser to parse the data and extracts the individual conditions.

[0651] Step 4:

[0652] The server uses a generative artificial intelligence (AI) model to generate the optimal travel plan. The input is analyzed travel condition data, and the output is multiple travel plans. Specifically, the server inputs travel conditions into the AI ​​model and generates the optimal plan based on information on tourist spots, accommodation, and transportation. GPT-4 and other AI models are used.

[0653] Step 5:

[0654] The server sends the generated itinerary to the user's device. The input is the generated itinerary, and the output is the itinerary data sent to the device. Specifically, the server converts the generated itinerary back into JSON format and sends it to the device via an HTTP response.

[0655] Step 6:

[0656] The user checks the multiple plans sent from the server and selects the one they want. The input is the travel plan displayed on the terminal, and the output is the plan selected by the user. Specifically, the user selects the desired plan using the application interface.

[0657] Step 7:

[0658] The terminal sends the selected plan information to the server. The input is the travel plan selected by the user, and the output is the selected plan data sent to the server. Specifically, the terminal converts the selected plan ID into JSON format and sends it to the server as an HTTP request.

[0659] Step 8:

[0660] The server automatically arranges airline tickets, accommodations, and tickets to tourist attractions. The input is the selected travel plan data, and the output is reservation confirmation information. Specifically, it calls the APIs of various reservation services to make reservations for airline tickets and accommodations, and arranges tickets to tourist attractions.

[0661] Step 9:

[0662] The server consolidates the reservation information it has arranged and sends it to the user's terminal. The input is various reservation data, and the output is an integrated reservation information document. Specifically, it aggregates multiple reservation information, converts it into a document in PDF or HTML format, and sends it to the terminal.

[0663] Step 10:

[0664] While traveling, users use an application on their device to check their next destination and the best route. The input is the user's current location information, and the output is information about the best route to the destination. Specifically, the application uses a GPS sensor to obtain the user's current location and sends that information to a server.

[0665] Step 11:

[0666] The server calculates the optimal route based on the current location information and sends it to the device. The input is the user's current location data and the output is the optimal route information. Specifically, it uses a navigation API to calculate the route and sends it to the device along with real-time traffic and weather information.

[0667] Step 12:

[0668] When a user has a problem or question, they can use the chat function on their device to send a message to the server. The input is a message from the user, and the output is an inquiry request to the server. Specifically, the user enters a message using the chat interface and presses the send button.

[0669] Step 13:

[0670] The server analyzes the received message and uses AI to propose alternative routes and solutions. The input is the user's inquiry message, and the output is a proposed solution or alternative route. Specifically, it analyzes the message using natural language processing technology, generates an appropriate response, and sends it back to the user.

[0671] Step 14:

[0672] Users upload data and notes taken during their trip to the server via their device. The input is the photos and videos taken and the note data, and the output is a file upload request to the server. Specifically, the user selects a file using the application's upload function and presses the send button.

[0673] Step 15:

[0674] The server organizes the uploaded data and generates a travel record. The input is the data uploaded by the user, and the output is an organized travel record document. Specifically, the server organizes the data along the timeline, generates a document as a travel record, and sends it to the user's device.

[0675] (Application example 1)

[0676] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0677] When planning and executing a trip, arranging meals can be a complicated process. The tasks of finding and booking local restaurants and cafes, and then arranging for delivery, in particular, are a significant burden for travelers. Furthermore, choosing meals in foreign countries or tourist destinations is often difficult due to language and cultural barriers. For this reason, there is a demand for a system that makes it easy to arrange meals as part of travel planning and provides consistent support for meal selection and delivery during travel.

[0678] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0679] In this invention, the server includes a means for generating recommended restaurants for the area to be visited based on the user's travel plan data, a means for delivering meals to the user's current location based on the generated list of recommended restaurants, and a means for consistently managing and supporting the entire travel process, thereby enabling travelers to receive recommendations for optimal local meals based on their travel plans and automatically arrange for delivery.

[0680] The "means for the user to input desired conditions such as travel schedule, budget, desired activities, etc." is an interface for the user to input detailed information about the desired trip into the terminal.

[0681] "Means for receiving input information and generating an optimal travel plan using generative artificial intelligence" refers to a system that automatically creates an optimal travel plan using generative artificial intelligence based on information entered by the user.

[0682] "Means for sending the generated plan to the user's terminal and making it selectable" refers to a system that sends the generated travel plan to the user's terminal and makes it possible for the user to check and select the plan.

[0683] "Means for automatically arranging air tickets, accommodations, and tickets to tourist spots based on a selected plan" is a system that automatically makes various reservations based on a travel plan selected by the user.

[0684] The "means for integrating arranged reservation information and transmitting it to the user terminal" is a system that centrally integrates arranged reservation information and transmits it to the user terminal.

[0685] "Means for acquiring the location information of a user traveling, and calculating and displaying the optimal route to the destination" is a system that acquires the current location of a user traveling, and calculates and displays the optimal travel route to the destination.

[0686] "Means for providing real-time answers to problems and questions from users" is a system that provides real-time solutions and information to problems and questions that users encounter while traveling.

[0687] "A means for uploading photos, videos, and notes taken by users while traveling" is a system for uploading photos, videos, and notes taken by users while traveling to the cloud.

[0688] "Means for organizing uploaded data, generating a travel record, and sending it to the user terminal" refers to a system that organizes uploaded data in chronological order, edits and generates a travel record, and sends it to the user terminal.

[0689] The "means for generating recommended restaurants for a visit area based on the user's travel plan data" is a system that recommends optimal restaurants for a visit area included in the user's travel plan.

[0690] The "means for delivering meals to the user's current location based on the generated list of recommended restaurants" is a system that arranges for meals to be delivered from recommended restaurants to the user's current location.

[0691] The present invention is a system that consistently supports the proposal, preparation, experience, and recording of travel plans, and specific embodiments are described below.

[0692] System Program

[0693] Hardware and software used

[0694] Hardware: Smartphones, GPS devices

[0695] Database: Amazon RDS

[0696] API: Google Maps API, OpenWeatherMap API, Booking Service API

[0697] AI: GPT-4 (OpenAI)

[0698] Specific processing contents of the program

[0699] Travel plan suggestions

[0700] Users use their smartphones to input travel conditions such as travel dates, budget, and desired activities. This information is sent from the device to a server. The server receives the information and uses generative artificial intelligence (GPT-4) to generate an optimal travel plan. This generative AI collects information such as tourist destinations, accommodations, and transportation methods from a database and creates multiple candidate plans. The generated plans are sent to the user's device, and the user can choose from multiple plans.

[0701] Travel preparation and arrangements

[0702] Once the user selects the desired plan, the server automatically arranges airfare, accommodation, and sightseeing tickets, using the APIs of various reservation services. The arranged reservation information is integrated into a single document and sent to the user's device.

[0703] Experience support during your trip

[0704] While traveling, users can use their device to check their next destination and the best route. The device uses GPS to obtain their current location and sends it to the server. The server calculates the best route to the destination based on real-time location data and sends it to the device. Real-time traffic and weather information is also displayed. In the unlikely event that a problem occurs, users can use the chat function within the app to send a message to the server. The server uses AI to suggest alternative routes and solutions.

[0705] Meal suggestions and delivery arrangements

[0706] The server generates recommended restaurants in the area to be visited based on the user's travel plan data. The generated list is sent to the user's device, and the user can select delivery from the recommended restaurants. The selected meal is arranged through the server using the reservation service API and delivered to the user's current location.

[0707] Travel Records

[0708] Photos, videos, and notes taken by users during their trip are uploaded from their device to the cloud. The server organizes the uploaded data chronologically and consolidates it in the form of a travel diary or photo album. Photos and videos taken during the trip are organized chronologically and edited for easy viewing. The server generates a travel record that reflects the trip's overview and highlights and sends it to the user's device. The generated travel record is provided as a digital album or travel diary that can be saved as a memory.

[0709] Specific examples

[0710] For example, if a user inputs their travel plan for "visiting art museums for five days starting April 10, 2023, with a budget of 200,000 yen," the server will use generative artificial intelligence to propose an optimal travel plan. This plan will include destinations such as Paris, Amsterdam, and London, and details of each museum, accommodation, and transportation. Recommended restaurants in the area will also be suggested, and the user can choose to have them delivered.

[0711] Prompt Sentence Examples

[0712] The prompt to use for the generative AI model:

[0713] Please recommend a restaurant. Location: Paris, Preferences: Vegetarian, Budget: Under 5,000 yen.

[0714] In this way, the present invention provides a system that consistently supports planning, preparing, experiencing, and recording a trip, making the trip more comfortable and fulfilling for the user.

[0715] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0716] Step 1:

[0717] The user enters desired conditions such as travel dates, budget, and desired activities into a smartphone application.

[0718] Input: Travel conditions such as "5 days from April 10, 2023, budget of 200,000 yen, visiting art museums"

[0719] How it works: Information entered by the user is sent to the server via the application.

[0720] Output: Travel conditions information sent to the server

[0721] Step 2:

[0722] The server uses generative artificial intelligence (GPT-4) to generate the optimal travel plan based on the travel conditions received.

[0723] Input: Travel conditions information

[0724] How it works: The server passes the received conditions to the generative AI model as a prompt sentence, for example, "Please create a travel plan based on a five-day trip starting April 10, 2023, with a budget of 200,000 yen and including a visit to art museums."

[0725] Output: Generated itineraries (e.g., a plan that includes visits to museums in Paris, Amsterdam, and London)

[0726] Step 3:

[0727] The server transmits the generated travel plan to the user's terminal, allowing the user to select a plan.

[0728] Input: Generated itinerary

[0729] Operation: The server sends the generated plan to the user's terminal and displays multiple plans as options.

[0730] Output: Multiple itineraries displayed on the user's device

[0731] Step 4:

[0732] The user selects the desired travel plan on the terminal.

[0733] Input: User selected itinerary

[0734] Operation: The user selects one of the plans presented, and the selection information is sent from the terminal to the server.

[0735] Output: Plan information selected by the user

[0736] Step 5:

[0737] The server automatically arranges airfare, accommodation, and tourist attraction tickets based on the selected plan.

[0738] Input: Selected plan information

[0739] How it works: The server uses various reservation service APIs to reserve and arrange tickets for airline tickets, accommodations, and tourist attractions.

[0740] Output: Various reservation information (airline tickets, accommodation, tourist attraction ticket details)

[0741] Step 6:

[0742] The server integrates the arranged reservation information, generates it as a single document, and sends it to the user terminal.

[0743] Input: Various reservation information

[0744] How it works: The server consolidates reservation information, organizes it into a single, easy-to-read document, and sends it to the user's terminal.

[0745] Output: Consolidated reservation information displayed on the user's terminal

[0746] Step 7:

[0747] While traveling, the user uses the device to check the best route from their current location to their destination.

[0748] Input: User's current location (GPS)

[0749] How it works: The device uses GPS to determine its current location and sends it to the server. The server calculates the optimal route and sends directions to the destination to the device.

[0750] Output: Optimal route displayed on the terminal

[0751] Step 8:

[0752] The server generates recommended restaurants in the area to be visited based on the user's travel plan data and transmits them to the user's terminal.

[0753] Input: Travel planning data

[0754] How it works: The server uses generative artificial intelligence to generate a list of restaurant recommendations based on travel planning data, for example, a list of vegetarian restaurants while in Paris.

[0755] Output: A list of recommended restaurants displayed on the user's device

[0756] Step 9:

[0757] The user selects delivery from a list of recommended restaurants and arranges the order through the server.

[0758] Input: The restaurant and delivery details selected by the user

[0759] How it works: The server receives the selected information and uses the reservation service API to arrange delivery.

[0760] Output: Delivery arrangement confirmation information

[0761] Step 10:

[0762] Users can upload photos, videos, and notes taken using their device while traveling to the cloud.

[0763] Input: Files taken or recorded by the user

[0764] How it works: A user uses their device to upload photos, videos, and notes to a cloud service.

[0765] Output: User's travel history stored in the cloud

[0766] Step 11:

[0767] The server organizes the data stored in the cloud, generates a travel record, and sends it to the user's device.

[0768] Input: File data stored in the cloud

[0769] How it works: The server organizes the data chronologically, generates a travel diary or photo album, and sends the results to the user's device.

[0770] Output: Trip log displayed on user's terminal

[0771] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0772] The present invention provides a system that consistently supports planning, preparing, experiencing, and recording a trip, and combines an emotion engine that recognizes a user's emotions. A specific embodiment of this system is described below.

[0773] Travel plan suggestions

[0774] The user inputs desired conditions such as travel dates, budget, and desired activities. For example, consider a case where a user inputs "five days starting April 10, 2023, budget of 200,000 yen, visiting art museums." These conditions are sent to the server via the device. The server analyzes the received input information and generates an optimal travel plan using generative artificial intelligence. This AI collects information on tourist destinations, accommodations, transportation, etc. from a database and creates multiple candidate plans.

[0775] Furthermore, the emotion engine recognizes the user's emotions from their input and interaction and reflects them in the generated travel plan. For example, if the user is tired, a plan that includes many relaxing tourist spots and spa facilities will be suggested. The generated plan includes destinations such as Paris, Amsterdam, and London, along with their respective museums, accommodations, and transportation options. The generated plan is sent to the user's device, and the user can choose from multiple plans.

[0776] Travel preparation and arrangements

[0777] The user reviews the proposed plans and selects the one they want. For example, suppose they select a plan for Paris and Amsterdam. Based on the selected plan, the server automatically arranges airfare, accommodation, and tickets to tourist attractions. The server makes these arrangements through the APIs of various reservation services and integrates the reservation information to generate a single document. This reservation information includes airfare details, hotel reservation number, ticket information for tourist attractions, etc. The generated reservation information is sent to the user's device so that it can be viewed.

[0778] Experience support during your trip

[0779] While traveling, users can use their device to check their next destination and the best route. For example, if a user wants to go to the Eiffel Tower in Paris, they can check its location in the app. The device uses GPS to obtain its current location and sends it to the server. The server then calculates the best route to the destination based on the received current location information and sends it to the device. In addition, real-time traffic and weather information is also displayed.

[0780] The emotion engine monitors the user's emotional state in real time and can change guidance and suggestions during the trip. For example, if the user is feeling stressed, the server will suggest quieter roads and less crowded tourist spots.

[0781] If a problem occurs, for example if a train is delayed, the user can use the chat function in the app to send a message to the server, which will then use AI to suggest alternative routes and solutions. The emotion engine will analyze the user's emotional state and suggest measures to reduce stress.

[0782] Travel Records

[0783] Users can upload photos, videos, and notes taken during their trip to the app. This data is sent to the server via their device. The server organizes the uploaded data chronologically and integrates it in the form of a travel diary or photo album. For example, photos taken and videos recorded during a trip are organized chronologically and edited for easy viewing. The server generates a travel record that reflects the overview and highlights of the trip and sends it to the user's device. The generated travel record becomes a digital album or travel diary that can be saved as memories, making it convenient for users to look back on later.

[0784] The emotion engine can also add comments and tags that reflect the user's emotions to travel photos, allowing users to vividly record their memories, including changes in their emotions during their trip.

[0785] In this way, the present invention not only provides users with consistent support throughout the entire process of planning, preparing, experiencing, and recording their trip, but also allows them to receive suggestions and support that respond to changes in their emotions through the emotion engine, making it possible for them to have a more fulfilling travel experience.

[0786] The processing flow will be explained below.

[0787] Step 1:

[0788] The user inputs desired conditions such as travel dates, budget, and desired activities into the terminal.

[0789] Example: A user enters the following conditions: "5 days from April 10, 2023, budget 200,000 yen, visiting art museums."

[0790] Step 2:

[0791] The terminal transmits the input information to the server.

[0792] The input data is converted to an appropriate format on the terminal and transferred to the server.

[0793] Step 3:

[0794] The server analyzes the received desired conditions.

[0795] The server processes each item such as schedule, budget, activities, etc. and retrieves the necessary data from the database.

[0796] Step 4:

[0797] The server uses an emotion engine to recognize the user's emotion.

[0798] It analyzes emotions from user input and past data to determine the user's current emotional state.

[0799] Step 5:

[0800] The server uses generative artificial intelligence to generate the optimal travel plan.

[0801] The AI ​​takes into account the user's desired conditions and emotional state, collects information on tourist spots, accommodation, transportation, etc. from a database, and creates multiple candidate plans.

[0802] Step 6:

[0803] The server transmits the generated plan to the user's terminal.

[0804] The terminal displays the received plans to the user, allowing the user to select from a plurality of plans.

[0805] Step 7:

[0806] The user checks the proposed plans and selects the one they want.

[0807] The user selects a plan for Paris and Amsterdam.

[0808] Step 8:

[0809] The terminal transmits the selected plan information to the server.

[0810] The selection result is retransmitted from the terminal to the server.

[0811] Step 9:

[0812] The server automatically arranges air tickets, accommodations, and tickets for sightseeing spots based on the selected plan.

[0813] The server connects with each reservation service through its API and carries out the necessary reservation procedures.

[0814] Step 10:

[0815] The server aggregates the reservation information and generates a document.

[0816] Compile all your flight, accommodation, and tourist ticket information into one document.

[0817] Step 11:

[0818] The server transmits the generated reservation information to the user's terminal.

[0819] The user uses the terminal to confirm reservation information and complete travel planning.

[0820] Step 12:

[0821] During the trip, the user uses the terminal to check the next destination.

[0822] If a user is in Paris and wants to go to the Eiffel Tower, they can check its location in the app.

[0823] Step 13:

[0824] The device uses GPS to obtain its current location and sends it to the server.

[0825] The current location information is sent to the server and used as material for the next calculation.

[0826] Step 14:

[0827] The server calculates the optimal route to the destination and sends it to the device.

[0828] Based on the requested route and mode of transportation, the server generates the optimal directions.

[0829] Step 15:

[0830] The device displays the optimal route based on real-time traffic and weather information.

[0831] Users can choose the most suitable mode of transportation for their current situation.

[0832] Step 16:

[0833] An emotion engine monitors the user's emotional state in real time and adjusts guidance during the journey.

[0834] If the user is feeling stressed, the server will suggest quieter roads and less crowded tourist spots.

[0835] Step 17:

[0836] If a user has a problem or question, they can use the chat function within the app to send a message to the server.

[0837] Example: Report that the train is delayed.

[0838] Step 18:

[0839] The server uses AI to suggest alternative routes and solutions and respond to the user.

[0840] The emotion engine analyzes the user's emotional state and suggests measures to reduce stress.

[0841] Step 19:

[0842] Users upload photos, videos, and notes they take while traveling to the app.

[0843] These data are transmitted to the server via the terminal.

[0844] Step 20:

[0845] The server organizes the uploaded data chronologically and generates a travel record.

[0846] The data is integrated and provided to users in the form of a travel diary or photo album.

[0847] Step 21:

[0848] The emotion engine adds comments and tags to photos and videos that reflect the user's emotions.

[0849] This allows users to record their memories, including changes in their emotions during their trip.

[0850] Step 22:

[0851] The server transmits the generated travel record to the user terminal.

[0852] Users can check their travel records through the device and save them as an electronic album or travel diary.

[0853] Example 2

[0854] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0855] Conventional travel planning support systems are limited to proposing travel plans that take into account the user's desired conditions. This often results in a fixed plan that ignores the user's emotions, resulting in a poor quality travel experience. Furthermore, support for dealing with troubles during the trip and responding to emotions is insufficient, causing significant stress and burden for users. Furthermore, travel records are limited to simple data uploads, and are not saved in the form of emotionally relevant memories, which is an issue.

[0856] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for a user to input desired conditions such as travel itinerary, budget, and desired activities; means for receiving the input information and generating an optimal travel plan using a generative AI model; means for recognizing emotions from the input information and reflecting them in the generated plan; means for sending the generated plan to the user's terminal and making it selectable; means for automatically arranging air tickets, accommodations, and tickets for tourist attractions based on the selected plan; means for integrating the arranged reservation information and sending it to the user's terminal; means for acquiring the user's location information during the trip and calculating and displaying the optimal route to the destination; means for responding in real time to problems and questions from the user; means for uploading images, videos, and notes taken by the user during the trip; and means for organizing the uploaded data, generating a travel record, and sending it to the user's terminal. This makes it possible to provide a travel plan that reflects the user's emotions, improve flexibility in dealing with problems, and generate a travel record that reflects the user's emotions.

[0857] A "user" is an entity that uses the system to plan, prepare, experience, and record a trip.

[0858] "Travel itinerary" is information indicating the period from the start date to the end date of the trip.

[0859] "Budget" is information indicating the upper limit of expenses that can be spent on a trip.

[0860] "Desired activities" is information indicating specific activities and conditions for destinations that the user wants to do during the trip.

[0861] "Input information" refers to information provided by the user via the terminal as conditions including travel schedule, budget, desired activities, and the like.

[0862] A "generative AI model" is an artificial intelligence platform that analyzes input information and generates optimal travel plans.

[0863] "Emotion" is information that indicates the user's current emotional state and is the subject of recognition and analysis by the system.

[0864] A "travel plan" is a proposal that includes destinations, accommodations, transportation, activities, etc., created based on the user's desired conditions and feelings.

[0865] A "terminal" is a device through which a user accesses the system and enters and receives information.

[0866] An "air ticket" is information used to reserve a seat on an airplane during a trip.

[0867] "Accommodation" is information about facilities where the user stays during the trip.

[0868] A "tourist attraction ticket" is information indicating the right to enter a tourist attraction.

[0869] "Location information" is information that indicates geographical data of the user's current location.

[0870] An "optimal route" is a travel route that optimizes conditions such as time and distance when traveling from the current location to the destination.

[0871] "Trouble" refers to a problem or obstacle that occurs during the trip that the user did not anticipate.

[0872] A "question" is information indicating an inquiry that a user requests the system to solve.

[0873] "Real-time" means that processing and response are carried out immediately without delay.

[0874] "Images" are data representing photographs taken by the user during the trip.

[0875] "Video" is data representing videos taken by the user during the trip.

[0876] "Notes" are text information recorded by the user during the trip.

[0877] "Travel Records" is data that organizes and consolidates images, videos, and notes taken during a trip and provides them as travel memories.

[0878] "Means" refers to the methods or techniques used to achieve a particular goal.

[0879] The present invention relates to a system that supports a user's entire travel experience, and in particular, it is a system that combines a generative AI model and an emotion engine to provide an optimal travel plan based on the user's emotions and consistently support the experience and record during the trip.

[0880] System Overview

[0881] This system is composed of a terminal and a server. The user uses the terminal to input their desired travel conditions, and the server generates the optimal travel plan based on that information. It also uses an emotion engine to analyze the user's emotions and adjust the plan accordingly. During the trip, the system obtains location information in real time, calculates and displays the optimal route, and also handles trouble and emotional care. As a travel record, it organizes and consolidates the images, videos, and notes taken by the user, and creates a digital album with emotion tags.

[0882] Hardware and software used

[0883] Device: A user device such as a smartphone or tablet that allows the user to input travel preferences, view generated itineraries, and receive route guidance during the trip.

[0884] Server: A high-performance server utilizing cloud services. This is the core of the system, making full use of generative AI models and emotion engines to process various data and perform calculations.

[0885] Generative AI model: An artificial intelligence model that generates optimal travel plans based on input information (e.g., OpenAI GPT-4).

[0886] Emotion engine: The ability to analyze user emotions and adjust plans accordingly (e.g., IBM Watson Tone Analyzer).

[0887] Other APIs: APIs used to connect with various services (e.g., Google Places API, Expedia API, OpenWeather API, etc.).

[0888] Specific operation of the system

[0889] 1. Input and analysis:

[0890] The user inputs travel conditions such as travel dates, budget, desired activities, etc. via the terminal. For example, if the user wishes to travel for five days from April 10, 2023, with a budget of 200,000 yen and visit art museums, the user writes this information in the input form. The terminal then sends this information to the server.

[0891] 2. Generate a travel plan:

[0892] The server analyzes the input information and generates an optimal travel plan using a generative AI model. This AI generates multiple plans using a pre-built database of tourist attractions, accommodations, and transportation. For example, a plan to visit Paris, Amsterdam, and London is generated, including detailed information on tourist attractions and accommodations.

[0893] 3. Reflecting emotions:

[0894] The server uses an emotion engine to recognize emotions from user input and dialogue and reflect them in the plan. For example, if the user is tired, a plan that includes many relaxing tourist spots and spa facilities will be generated. An example of a prompt sentence is, "The travel dates are five days from April 10, 2023, the budget is 200,000 yen, and I would like to visit art museums. I am currently tired. Please generate the optimal travel plan."

[0895] 4. Check and select your plan:

[0896] The generated travel plans are sent to the user's terminal, from which the user can select one. The terminal then sends the selected plan information to the server, which then starts making various reservations.

[0897] 5. Reservation arrangements:

[0898] The server automatically arranges air tickets, accommodations, and tickets for tourist attractions based on the selected plan, using various reservation service APIs to integrate the acquired reservation information, such as air ticket details, hotel reservation numbers, and ticket information for tourist attractions.

[0899] 6. Travel support:

[0900] While the user is traveling, the device uses GPS to obtain their current location and sends it to the server. The server calculates the optimal route based on the current location information and sends it to the device along with real-time traffic and weather information. If the user encounters a problem, the server uses AI to suggest alternative routes and solutions. In addition, an emotion engine analyzes the user's emotional state in real time and suggests the best course of action.

[0901] 7. Generate a trip record:

[0902] Users upload photos, videos, and notes they take during their trip to their device. The server organizes this data chronologically and integrates it into a travel record. The emotion engine assigns emotion tags to this data, allowing for clear recording of the user's emotional changes.

[0903] In this way, the present invention provides consistent support for users from planning their trip to experiencing it and recording it, and by utilizing the emotion engine, it is possible to provide a more personalized travel experience.

[0904] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0905] Step 1:

[0906] Collecting input information

[0907] The user inputs the travel schedule, budget, desired activities, etc. into the terminal. The input information may include, for example, "5 days from April 10, 2023, budget of 200,000 yen, visiting art museums."

[0908] Input: The user fills in the travel requirements in the input form.

[0909] Output: The terminal sends the input information to the server. Specifically, it forwards it to the server as an HTTP request.

[0910] Step 2:

[0911] Analysis of input information

[0912] The server parses the received input information. It uses a Python library (e.g. BeautifulSoup) to parse the input information as text data.

[0913] Input: User's desired conditions transferred from the terminal.

[0914] Output: The analyzed data is generated as a prompt sentence and converted into a format to be input into the generative AI model. Example: "The travel dates are 5 days from April 10, 2023, the budget is 200,000 yen, and I would like to visit art museums."

[0915] Step 3:

[0916] Generate a travel plan

[0917] The server generates an optimal travel plan based on the input information using a generative AI model (e.g., OpenAI GPT-4). This AI collects information from databases of tourist destinations, accommodations, and transportation.

[0918] Input: The parsed prompt statement.

[0919] Data processing: The generative AI model analyzes the prompt, extracts relevant information from the database, and generates a travel plan.

[0920] Output: A list of multiple itineraries, for example: "Louvre in Paris, luxury hotel, rail transport" or "British Museum in London, mid-range hotel, bus transport".

[0921] Step 4:

[0922] Recognizing and reflecting emotions

[0923] The server uses an emotion engine (e.g., IBM Watson Tone Analyzer) to recognize emotions from user input and dialogue and reflect them in the travel plan.

[0924] Input: User input information and generated itinerary.

[0925] Data Calculation: The emotion engine analyzes the user's emotions from the text and adjusts the contents of the travel plan. For example, if the user is tired, the plan will be changed to include more relaxing tourist spots and spa facilities.

[0926] Output: The adjusted itinerary.

[0927] Step 5:

[0928] Submit and confirm your travel plans

[0929] The server sends the generated and adjusted travel plan to the user's device using the HTTP protocol.

[0930] Input: Adjusted travel plans.

[0931] Output: The terminal displays the itinerary and allows the user to choose from multiple itineraries.

[0932] Step 6:

[0933] Select a travel plan

[0934] The user reviews the proposed itineraries and selects the one they want, for example, Paris and Amsterdam.

[0935] Input: Multiple itineraries displayed on the device.

[0936] Output: The selected plan information is sent to the server.

[0937] Step 7:

[0938] Start making reservations

[0939] The server automatically arranges air tickets, accommodations, and tickets for sightseeing spots based on the selected plan, using various reservation service APIs (e.g., Expedia API).

[0940] Input: The selected itinerary.

[0941] Data calculation: Make an API call to get reservation information.

[0942] Output: The arranged reservation information is stored on the server.

[0943] Step 8:

[0944] Aggregation of reservation information

[0945] The server consolidates the reservation information and organizes it into a single document, e.g., using a PDF generation library (e.g., ReportLab) to combine flight details, hotel reservation number, and tourist attraction ticket information into a single PDF file.

[0946] Input: Various reservation information.

[0947] Data processing: Integrate the acquired data and convert it into a document format.

[0948] Output: The generated booking information document.

[0949] Step 9:

[0950] Submit and confirm reservation information

[0951] The server transmits the generated reservation information to the user's terminal.

[0952] Input: The generated booking information document.

[0953] Output: The reservation information is displayed on the terminal for the user to review.

[0954] Step 10:

[0955] Check your destination and route

[0956] The user uses the device to check their next destination and the best route. For example, if the user wants to go to the Eiffel Tower in Paris, they check its location on the device.

[0957] Input: Destination location.

[0958] Output: The location of the destination will be displayed on the device.

[0959] Step 11:

[0960] Get and send your current location

[0961] The device uses GPS to determine its current location.

[0962] Input: Location data from GPS.

[0963] Output: The current location is sent to the server.

[0964] Step 12:

[0965] Viewing real-time information

[0966] Based on the received current location information, the server calculates the optimal route to the destination, obtains real-time traffic and weather information (e.g., OpenWeather API), and sends it to the device.

[0967] Input: Your current location.

[0968] Data calculation: Calculate optimal routes and get real-time information.

[0969] Output: Route information and real-time information will be displayed on the terminal.

[0970] Step 13:

[0971] Troubleshooting

[0972] When a user encounters a problem (e.g., a train delay), they can use the app's chat function to send a message to the server, which then uses AI to suggest alternative routes and solutions.

[0973] Input: Trouble message from the user.

[0974] Data computation: AI-powered generation of alternative routes and solutions.

[0975] Output: The proposed solution is displayed on the terminal.

[0976] Step 14:

[0977] Upload your trip log

[0978] Users upload images, videos, and notes taken during their trip to the app.

[0979] Input: Image, video, and note data from the user.

[0980] Output: Data is sent to the server.

[0981] Step 15:

[0982] Data organization and integration

[0983] The server organizes the uploaded data chronologically and integrates it into a travel record.

[0984] Input: Uploaded image, video, and note data.

[0985] Data processing: Organize and integrate data in chronological order.

[0986] Output: An organized travel log.

[0987] Step 16:

[0988] Emotion tagging

[0989] The emotion engine adds comments and tags that reflect the user's emotions to travel photos.

[0990] Input: Organized travel log data.

[0991] Data operations: Emotion tagging.

[0992] Output: Travel log tagged with emotions.

[0993] Step 17:

[0994] Sending a trip log

[0995] The server transmits the generated travel record to the user's terminal.

[0996] Input: Travel log data with emotion tags.

[0997] Output: The trip log sent to the device is displayed.

[0998] In this way, users can receive consistent support from planning to experiencing and recording their trip, and by utilizing the emotion engine, it is possible to provide a more personalized travel experience.

[0999] (Application example 2)

[1000] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1001] Conventional travel planning systems propose travel plans without considering the user's emotional state, which means they are unable to fully enhance the user's psychological satisfaction. Furthermore, they are unable to respond in real time to the user's emotional changes during the trip, and lack appropriate suggestions and support to reduce stress and anxiety.

[1002] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for a user to input desired conditions such as travel itinerary, budget, and desired activities; means for receiving the input information and generating an optimal travel plan using generative artificial intelligence; means for sending the generated plan to the user's terminal and making it selectable; means for automatically arranging air tickets, accommodations, and tickets for tourist attractions based on the selected plan; means for integrating the arranged reservation information and sending it to the user's terminal; means for acquiring the user's location information during the trip and calculating and displaying the optimal route to the destination; means for responding to user problems and questions in real time; means for uploading photos, videos, and notes taken by the user during the trip; means for organizing the uploaded data, creating a travel record, and sending it to the user's terminal; and means for monitoring the user's emotions in real time using an emotion engine and suggesting dishes and entertainment accordingly. This makes it possible to grasp the user's emotional state in real time and suggest travel plans and meals based on that, thereby providing a more personalized and fulfilling travel experience.

[1003] "User" means an individual who uses the system to plan, arrange, or receive support for travel.

[1004] "Itinerary" refers to the specific schedule during the trip, including the start and end dates of the trip.

[1005] "Budget" is the amount of money the user plans to spend on the trip.

[1006] "Desired conditions" are specific requests such as the activities the user wants to do on the trip, the places they want to visit, and the accommodations they want to stay at.

[1007] "Input information" refers to data such as schedule, budget, desired conditions, etc. that the user provides to the system.

[1008] "Generative AI" is AI that generates optimal travel plans based on input information.

[1009] A "travel plan" is a detailed travel plan proposed based on the user's desired conditions.

[1010] A "terminal" is a device that allows a user to access the system and perform necessary operations.

[1011] "Air ticket" means a boarding pass for an aircraft used for travel.

[1012] "Accommodation" refers to a facility where a user stays during a trip.

[1013] "Tourist attraction tickets" are admission tickets or vouchers required to visit a tourist attraction.

[1014] "Reservation information" refers to detailed information such as air tickets, accommodations, and tickets to tourist attractions arranged based on the travel plan.

[1015] "Location information" is data about the user's current location.

[1016] An "optimal route" is the most efficient route for a user to reach a destination.

[1017] The "emotion engine" is a system for monitoring and analyzing a user's emotional state in real time.

[1018] "Cuisine" refers to meals suggested based on the user's emotions and desired conditions.

[1019] "Entertainment" refers to entertainment and fun suggested based on the user's emotions and desired conditions.

[1020] This invention is a system that consistently supports planning, preparing, experiencing, and recording a trip. This system is combined with an emotion engine that recognizes the user's emotions, and is configured as follows.

[1021] Travel Planner

[1022] Users input desired conditions such as travel dates, budget, and desired activities into their device. For example, they input specific desired conditions such as "five days starting April 10, 2023, budget of 200,000 yen, visiting art museums." This information is sent from the device to the server. The server analyzes the received information and generates an optimal travel plan using a generative AI model. This AI collects information from databases of various tourist destinations, accommodations, and transportation options, and creates multiple candidate plans.

[1023] Use of emotion engine

[1024] Furthermore, the emotion engine recognizes the user's emotions from their input and interaction and reflects them in the generated travel plans. For example, if the user is tired, it will suggest plans that include many relaxing tourist spots and spa facilities.

[1025] Travel preparation and arrangements

[1026] The user reviews the proposed plans and selects the one they want. Based on the selected plan, the server automatically arranges airfare, accommodation, and tourist attraction tickets. The server makes these arrangements through the APIs of various reservation services and integrates the reservation information to generate a single document. The generated reservation information is sent to the user's device, where it can be viewed.

[1027] Experience support during your trip

[1028] While traveling, users can use their device to check their next destination and the optimal route. The server uses GPS to obtain their current location, calculates the optimal route to the destination, and sends this to the user's device. Real-time traffic and weather information is also displayed. The emotion engine monitors the user's emotional state in real time and changes guidance and suggestions as needed. For example, if the user is feeling stressed, it will suggest quieter roads and less crowded tourist spots. Furthermore, if a problem occurs during the trip, such as a train delay, the user can send a message to the server using the app's chat function. The server then uses AI to suggest alternative routes and solutions.

[1029] Travel Records

[1030] Users can upload photos, videos, and notes taken during their trip to the app. This data is sent from the device to the server, which organizes the uploaded data chronologically and integrates it into a travel diary or photo album. For example, photos taken and videos recorded during a trip are organized chronologically and edited for easy viewing. The server generates a travel record that reflects the trip's overview and highlights and sends it to the user's device. The generated travel record becomes a digital album or travel diary, making it convenient for users to look back on later.

[1031] technical means

[1032] The server integrates "generative artificial intelligence," an emotion engine, and a system for collecting and analyzing real-time data. This allows it to grasp the user's emotional state in real time and make travel plans and meal suggestions accordingly. This forms the basis for providing a more personalized and fulfilling travel experience. As an example, the following prompt sentences can be input into the system:

[1033] Examples of prompt statements

[1034] "User is angry. Current emotional state is Angry. What type of food should we suggest next?"

[1035] "User preference: Italian, emotional state: Relaxed, budget: 3000 yen. Please suggest the best dish based on these."

[1036] This invention allows users to receive attentive service tailored to their emotions, enabling a more comfortable and satisfying travel experience.

[1037] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1038] Step 1:

[1039] The user logs in to the device and inputs desired conditions such as travel dates, budget, desired activities, etc. The input data is sent from the device to the server, which receives this input information and stores it in a database.

[1040] Step 2:

[1041] The server analyzes the received input information and generates an optimal travel plan based on generative AI. This generative AI collects information from databases of tourist spots, accommodations, transportation, etc., and creates multiple candidate plans. The generated plan is then sent from the server to the user's device.

[1042] Step 3:

[1043] The user checks the proposed travel plans on the terminal and selects the one they want. The selected plan information is sent from the terminal to the server, and the server automatically arranges various reservations based on that information. The arranged reservation information is stored on the server.

[1044] Step 4:

[1045] The server integrates the reservation information and generates a detailed reservation document, which includes ticket information for the flight, accommodation, and sightseeing spots. The generated reservation information is sent from the server to the user's terminal, where the user can view it.

[1046] Step 5:

[1047] While traveling, users use their devices to check their next destination and the best route. The device uses its GPS to obtain its current location and sends this information to a server. The server then calculates the best route from the current location to the destination and sends it to the user's device in real time.

[1048] Step 6:

[1049] The emotional engine monitors the user's emotional state in real time. The device's camera and microphone are used to capture the user's facial expressions and voice data, which are then sent to the server. The server then uses the emotional engine to analyze the user's emotional state and adjusts the suggestions and support content based on the results.

[1050] Step 7:

[1051] The app responds to user problems and questions in real time. Users use the app's chat function to send messages to the server, which then uses AI to respond immediately. For example, if a train is delayed, the app will suggest an alternative route.

[1052] Step 8:

[1053] Users upload photos, videos, and notes they take during their trip from their device to the app. This data is sent from the device to a server, which organizes the uploaded data chronologically and integrates it into a travel diary or photo album. Travel records are sent from the server to the user's device, allowing the user to look back on their travel memories later.

[1054] Step 9:

[1055] The emotion engine analyzes the user's emotional state and tags photos and videos with their emotions. This tagged data can be saved as a digital album or travel diary, allowing users to more vividly record their travel memories, including changes in their emotions.

[1056] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1057] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1058] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1059] [Third embodiment]

[1060] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1061] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1062] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1063] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1064] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1065] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1066] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1067] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1068] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1069] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1070] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1071] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1072] The present invention is a system that consistently supports planning, preparing, experiencing, and recording a trip. A specific embodiment of this system will be described below.

[1073] Travel plan suggestions

[1074] The user inputs desired conditions such as travel dates, budget, and desired activities. For example, consider a user inputting a desire for "five days starting April 10, 2023, budget of 200,000 yen, visiting art museums." These conditions are sent to the server via the device. The server analyzes the received input information and generates an optimal travel plan using generative artificial intelligence. This AI collects information on tourist spots, accommodations, transportation, etc. from a database and creates multiple candidate plans. The generated plans include destinations such as Paris, Amsterdam, and London, along with their respective museums, accommodations, and transportation methods. The generated plans are sent to the user's device, and the user can choose from multiple plans.

[1075] Travel preparation and arrangements

[1076] The user reviews the proposed plans and selects the one they want. For example, suppose they select a plan for Paris and Amsterdam. Based on the selected plan, the server automatically arranges airfare, accommodation, and tickets to tourist attractions. The server makes these arrangements through the APIs of various reservation services and integrates the reservation information to generate a single document. This reservation information includes airfare details, hotel reservation number, ticket information for tourist attractions, etc. The generated reservation information is sent to the user's device so that it can be viewed.

[1077] Experience support during your trip

[1078] While traveling, users can use their device to check their next destination and the optimal route. For example, if a user wants to go to the Eiffel Tower in Paris, they can check its location in the app. The device uses GPS to obtain its current location and sends it to the server. The server then calculates the optimal route to the destination based on the received location information and sends it to the device. It also displays real-time traffic and weather information. If a problem occurs, for example if the train is delayed, the user can use the chat function in the app to send a message to the server. The server then uses AI to suggest alternative routes and solutions.

[1079] Travel Records

[1080] Users can upload photos, videos, and notes taken during their trip to the app. This data is sent to the server via their device. The server organizes the uploaded data chronologically and integrates it in the form of a travel diary or photo album. For example, photos taken and videos recorded during a trip are organized chronologically and edited for easy viewing. The server generates a travel record that reflects the overview and highlights of the trip and sends it to the user's device. The generated travel record becomes a digital album or travel diary that can be saved as memories, making it convenient for users to look back on later.

[1081] In this way, the present invention provides users with consistent support throughout the entire process of planning, preparing, experiencing, and recording their trip, simplifies complicated procedures, and enables them to have a more fulfilling travel experience.

[1082] The processing flow will be explained below.

[1083] Step 1:

[1084] The user inputs desired conditions such as travel dates, budget, desired activities, etc. For example, the user might input "5 days from April 10, 2023, budget 200,000 yen, visiting art museums."

[1085] Step 2:

[1086] The terminal sends the input information to the server, which converts the user's input data into an appropriate format and forwards it to the server.

[1087] Step 3:

[1088] The server analyzes the received requirements, processes each item (date, budget, desired activities) separately, and prepares to retrieve the relevant information from the database.

[1089] Step 4:

[1090] The server uses generative artificial intelligence to generate optimal travel plans. The AI ​​creates multiple plans that best fit the user's preferences based on collected information on tourist destinations, accommodations, transportation, etc.

[1091] Step 5:

[1092] The server sends the generated plan to the user's device, which displays the received plans to the user, allowing them to select from multiple plans.

[1093] Step 6:

[1094] The user reviews the proposed itineraries and selects the one they want. For example, the user may select a plan for Paris and Amsterdam.

[1095] Step 7:

[1096] The terminal transmits the selected plan information to the server. The terminal communicates again to transfer the user's selection results to the server.

[1097] Step 8:

[1098] The server automatically arranges airfare, accommodation, and tourist attraction tickets based on the selected plan. The server connects with various reservation services via API and performs the necessary reservation procedures.

[1099] Step 9:

[1100] The server integrates the reservation information and generates a document. The server compiles the booked flight, accommodation, and tourist attraction ticket information into a single integrated document.

[1101] Step 10:

[1102] The server sends the generated reservation information to the user's terminal, and the user confirms the reservation information through the terminal and completes the travel plan.

[1103] Step 11:

[1104] While traveling, the user uses the device to confirm their next destination, such as a specific destination, such as wanting to visit the Eiffel Tower.

[1105] Step 12:

[1106] The device uses GPS to obtain its current location and sends it to the server, where it is used for the next calculation.

[1107] Step 13:

[1108] The server calculates the optimal route to the destination and sends it to the device. Based on the requested route and mode of transportation, the server generates the optimal guidance.

[1109] Step 14:

[1110] The device displays the optimal route based on real-time traffic and weather information, allowing users to choose the most suitable mode of transportation for their current situation.

[1111] Step 15:

[1112] When a user encounters a problem or trouble, they can use the chat function to send a message to the server, for example, to report that the train is delayed.

[1113] Step 16:

[1114] The server uses AI to suggest alternative routes and solutions and respond to users, providing appropriate support in real time and quickly resolving user issues.

[1115] Step 17:

[1116] Users upload photos, videos, and notes they take during their trip to the app, and this data is sent to the server via the device.

[1117] Step 18:

[1118] The server organizes the uploaded data chronologically and generates a travel record, which is then integrated into a travel diary or photo album and provided to the user.

[1119] Step 19:

[1120] The server sends the generated travel record to the user's terminal, where an electronic album or travel diary is displayed to help the user look back on their travel memories.

[1121] In this way, a system is realized in which the server, terminal, and user work together to support the user's travel experience throughout the entire process.

[1122] Example 1

[1123] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1124] Modern travel planning requires users to gather a lot of information and make reservations, which takes a lot of time and effort. These cumbersome procedures can take away from the enjoyment of traveling. There is also a need for systems that can quickly respond to unexpected issues that arise during a trip. Furthermore, users want to be able to organize the photos and notes they take during their trip and keep them as a travel record, but doing this manually is time-consuming.

[1125] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1126] In this invention, the server includes: means for a user to input desired conditions such as travel itinerary, budget, and desired activities; means for receiving the input information and generating an optimal travel plan using generative artificial intelligence; means for sending the generated plan to the user's terminal and making it selectable; means for automatically arranging air tickets, accommodations, and admission tickets to tourist attractions based on the selected plan; means for acquiring the user's location data during the trip and calculating and displaying the optimal route to the destination; means for responding in real time to problems and questions from the user; means for uploading data and notes taken by the user during the trip; and means for organizing the uploaded data, generating a travel record, and transmitting it to the user's terminal. This allows the user to perform a comprehensive process from planning and arranging the trip, to receiving support during the trip, and generating the travel record.

[1127] A "user" is a person who uses the travel system to perform operations such as planning a trip, making a reservation, experiencing, and recording.

[1128] The "date" is information that indicates the period from the start date to the end date of the trip.

[1129] "Budget" is information that specifies the upper limit of travel expenses.

[1130] "Desired activities" is information that refers to events or experiences that the user wants to have during their trip.

[1131] A "terminal" is a device used by a user, such as a computer, smartphone, or tablet.

[1132] A "server" is a computer system that receives and processes information sent by users.

[1133] "Generative AI" is an AI technology that generates optimal travel plans based on input data.

[1134] A "travel plan" is a detailed plan that includes travel dates, places to visit, accommodation, transportation, tourist spots, etc.

[1135] An "air ticket" is a ticket that indicates a seat on an aircraft.

[1136] "Accommodation" means a hotel, inn, resort, or other place of accommodation for travel.

[1137] A "tourist attraction admission ticket" is a ticket for admission to a specific tourist attraction or event.

[1138] "Location data" is information that indicates the user's current location.

[1139] A "route" is the optimal path from the current location to the destination.

[1140] "Data" refers to information such as photos, videos, and notes taken by the user during their trip.

[1141] A "travel log" is a record that organizes and compiles all the data obtained during a trip.

[1142] "Means" are the methods or techniques used to achieve a particular goal.

[1143] The present invention is a system that uses generative artificial intelligence to provide an optimal travel plan based on user input of travel conditions such as travel itinerary, budget, and desired activities. This system supports the entire process of planning, preparing, implementing, and recording the trip. Specific embodiments are described below.

[1144] Enter travel conditions

[1145] The user uses the device's application to input the travel schedule, budget, and desired activities. For example, a user may input the desired conditions as "five days from April 10, 2023, budget of 200,000 yen, visiting museums." This input is done through the mobile application interface.

[1146] Generate a travel plan

[1147] The device converts the user's input into JSON format data and sends it to a server via the internet. The server then analyzes the received data and uses generative artificial intelligence (AI) to generate an optimal travel plan. Specifically, it uses an AI model (e.g., GPT-4) to collect information from a database of tourist destinations, accommodations, and transportation options to create multiple travel plans.

[1148] Presenting and selecting a travel plan

[1149] The server sends the generated itineraries to the user's device. The user can then review these itineraries and select the one they want through the application. This selection is made through the device, and the result of the selection is sent back to the server.

[1150] Automatic booking

[1151] The server automatically arranges air tickets, accommodations, and admission tickets to tourist attractions based on the selected travel plan. To do this, it uses the APIs of various reservation services (e.g., airline APIs, hotel reservation site APIs, tourist attraction ticket sales service APIs). Once the arrangements are complete, the reservation information is integrated and generated as a document in PDF or HTML format.

[1152] Experience support during your trip

[1153] While traveling, users can use the device's application to check their next destination and the optimal route. The device uses the GPS sensor to obtain their current location and sends that information to a server. The server calculates the optimal route to the destination based on the received current location information, and also displays real-time traffic and weather information. Users can also use the device's chat function to send inquiries to the server and receive real-time responses to any problems or questions they may have. The server uses AI to suggest alternative routes and solutions.

[1154] Travel Records

[1155] During a trip, users can upload photos, videos, and notes they have taken through the device's application. This data is sent to the server and organized chronologically. The server then creates a travel record based on this data and sends it to the user's device in the form of a travel diary or photo album. The created travel record is saved as a digital album or travel diary, allowing for easy review later.

[1156] Specific examples

[1157] If a user inputs their desire to visit museums for five days starting April 10, 2023, with a budget of 200,000 yen, the system will generate a plan to visit Paris, Amsterdam, and London. If the user selects the Paris and Amsterdam plans, the server will automatically book flights and accommodations and generate an integrated document. During the trip, the user can use the GPS function to check the route to the Eiffel Tower, and if any problems arise, they can get solutions through the chat function. After the trip is completed, a travel record based on the photos and videos taken is generated and saved as a digital album.

[1158] Prompt Sentence Examples

[1159] "Please suggest a five-day trip that includes visiting museums in Paris and Amsterdam, starting April 10, 2023, with a budget of 200,000 yen."

[1160] The above is a specific embodiment of the present invention. The present invention allows users to consistently handle everything from travel planning and reservation arrangements to support during the trip and creation of a travel record, making it possible to maximize the enjoyment of travel.

[1161] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1162] Step 1:

[1163] Users input their travel dates, budget, and desired activities. Specifically, they operate the application interface to enter conditions such as "five days starting April 10, 2023, budget of 200,000 yen, visiting art museums." This generates the user's desired travel conditions as input data.

[1164] Step 2:

[1165] The terminal formats the data entered by the user and sends it to the server. Specifically, it converts the entered data into JSON format and sends it to the server as an HTTP request. The input is the user's desired data, and the output is the formatted data sent to the server.

[1166] Step 3:

[1167] The server analyzes the received data. The input is the JSON formatted travel condition data sent from the device, and the output is the analyzed condition data such as the itinerary, budget, desired activities, etc. Specifically, it uses a JSON parser to parse the data and extracts the individual conditions.

[1168] Step 4:

[1169] The server uses a generative artificial intelligence (AI) model to generate the optimal travel plan. The input is analyzed travel condition data, and the output is multiple travel plans. Specifically, the server inputs travel conditions into the AI ​​model and generates the optimal plan based on information on tourist spots, accommodation, and transportation. GPT-4 and other AI models are used.

[1170] Step 5:

[1171] The server sends the generated itinerary to the user's device. The input is the generated itinerary, and the output is the itinerary data sent to the device. Specifically, the server converts the generated itinerary back into JSON format and sends it to the device via an HTTP response.

[1172] Step 6:

[1173] The user checks the multiple plans sent from the server and selects the one they want. The input is the travel plan displayed on the terminal, and the output is the plan selected by the user. Specifically, the user selects the desired plan using the application interface.

[1174] Step 7:

[1175] The terminal sends the selected plan information to the server. The input is the travel plan selected by the user, and the output is the selected plan data sent to the server. Specifically, the terminal converts the selected plan ID into JSON format and sends it to the server as an HTTP request.

[1176] Step 8:

[1177] The server automatically arranges airline tickets, accommodations, and tickets to tourist attractions. The input is the selected travel plan data, and the output is reservation confirmation information. Specifically, it calls the APIs of various reservation services to make reservations for airline tickets and accommodations, and arranges tickets to tourist attractions.

[1178] Step 9:

[1179] The server consolidates the reservation information it has arranged and sends it to the user's terminal. The input is various reservation data, and the output is an integrated reservation information document. Specifically, it aggregates multiple reservation information, converts it into a document in PDF or HTML format, and sends it to the terminal.

[1180] Step 10:

[1181] While traveling, users use an application on their device to check their next destination and the best route. The input is the user's current location information, and the output is information about the best route to the destination. Specifically, the application uses a GPS sensor to obtain the user's current location and sends that information to a server.

[1182] Step 11:

[1183] The server calculates the optimal route based on the current location information and sends it to the device. The input is the user's current location data and the output is the optimal route information. Specifically, it uses a navigation API to calculate the route and sends it to the device along with real-time traffic and weather information.

[1184] Step 12:

[1185] When a user has a problem or question, they can use the chat function on their device to send a message to the server. The input is a message from the user, and the output is an inquiry request to the server. Specifically, the user enters a message using the chat interface and presses the send button.

[1186] Step 13:

[1187] The server analyzes the received message and uses AI to propose alternative routes and solutions. The input is the user's inquiry message, and the output is a proposed solution or alternative route. Specifically, it analyzes the message using natural language processing technology, generates an appropriate response, and sends it back to the user.

[1188] Step 14:

[1189] Users upload data and notes taken during their trip to the server via their device. The input is the photos and videos taken and the note data, and the output is a file upload request to the server. Specifically, the user selects a file using the application's upload function and presses the send button.

[1190] Step 15:

[1191] The server organizes the uploaded data and generates a travel record. The input is the data uploaded by the user, and the output is an organized travel record document. Specifically, the server organizes the data along the timeline, generates a document as a travel record, and sends it to the user's device.

[1192] (Application example 1)

[1193] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1194] When planning and executing a trip, arranging meals can be a complicated process. The tasks of finding and booking local restaurants and cafes, and then arranging for delivery, in particular, are a significant burden for travelers. Furthermore, choosing meals in foreign countries or tourist destinations is often difficult due to language and cultural barriers. For this reason, there is a demand for a system that makes it easy to arrange meals as part of travel planning and provides consistent support for meal selection and delivery during travel.

[1195] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1196] In this invention, the server includes a means for generating recommended restaurants for the area to be visited based on the user's travel plan data, a means for delivering meals to the user's current location based on the generated list of recommended restaurants, and a means for consistently managing and supporting the entire travel process, thereby enabling travelers to receive recommendations for optimal local meals based on their travel plans and automatically arrange for delivery.

[1197] The "means for the user to input desired conditions such as travel schedule, budget, desired activities, etc." is an interface for the user to input detailed information about the desired trip into the terminal.

[1198] "Means for receiving input information and generating an optimal travel plan using generative artificial intelligence" refers to a system that automatically creates an optimal travel plan using generative artificial intelligence based on information entered by the user.

[1199] "Means for sending the generated plan to the user's terminal and making it selectable" refers to a system that sends the generated travel plan to the user's terminal and makes it possible for the user to check and select the plan.

[1200] "Means for automatically arranging air tickets, accommodations, and tickets to tourist spots based on a selected plan" is a system that automatically makes various reservations based on a travel plan selected by the user.

[1201] The "means for integrating arranged reservation information and transmitting it to the user terminal" is a system that centrally integrates arranged reservation information and transmits it to the user terminal.

[1202] "Means for acquiring the location information of a user traveling, and calculating and displaying the optimal route to the destination" is a system that acquires the current location of a user traveling, and calculates and displays the optimal travel route to the destination.

[1203] "Means for providing real-time answers to problems and questions from users" is a system that provides real-time solutions and information to problems and questions that users encounter while traveling.

[1204] "A means for uploading photos, videos, and notes taken by users while traveling" is a system for uploading photos, videos, and notes taken by users while traveling to the cloud.

[1205] "Means for organizing uploaded data, generating a travel record, and sending it to the user terminal" refers to a system that organizes uploaded data in chronological order, edits and generates a travel record, and sends it to the user terminal.

[1206] The "means for generating recommended restaurants for a visit area based on the user's travel plan data" is a system that recommends optimal restaurants for a visit area included in the user's travel plan.

[1207] The "means for delivering meals to the user's current location based on the generated list of recommended restaurants" is a system that arranges for meals to be delivered from recommended restaurants to the user's current location.

[1208] The present invention is a system that consistently supports the proposal, preparation, experience, and recording of travel plans, and specific embodiments are described below.

[1209] System Program

[1210] Hardware and software used

[1211] Hardware: Smartphones, GPS devices

[1212] Database: Amazon RDS

[1213] API: Google Maps API, OpenWeatherMap API, Booking Service API

[1214] AI: GPT-4 (OpenAI)

[1215] Specific processing contents of the program

[1216] Travel plan suggestions

[1217] Users use their smartphones to input travel conditions such as travel dates, budget, and desired activities. This information is sent from the device to a server. The server receives the information and uses generative artificial intelligence (GPT-4) to generate an optimal travel plan. This generative AI collects information such as tourist destinations, accommodations, and transportation methods from a database and creates multiple candidate plans. The generated plans are sent to the user's device, and the user can choose from multiple plans.

[1218] Travel preparation and arrangements

[1219] Once the user selects the desired plan, the server automatically arranges airfare, accommodation, and sightseeing tickets, using the APIs of various reservation services. The arranged reservation information is integrated into a single document and sent to the user's device.

[1220] Experience support during your trip

[1221] While traveling, users can use their device to check their next destination and the best route. The device uses GPS to obtain their current location and sends it to the server. The server calculates the best route to the destination based on real-time location data and sends it to the device. Real-time traffic and weather information is also displayed. In the unlikely event that a problem occurs, users can use the chat function within the app to send a message to the server. The server uses AI to suggest alternative routes and solutions.

[1222] Meal suggestions and delivery arrangements

[1223] The server generates recommended restaurants in the area to be visited based on the user's travel plan data. The generated list is sent to the user's device, and the user can select delivery from the recommended restaurants. The selected meal is arranged through the server using the reservation service API and delivered to the user's current location.

[1224] Travel Records

[1225] Photos, videos, and notes taken by users during their trip are uploaded from their device to the cloud. The server organizes the uploaded data chronologically and consolidates it in the form of a travel diary or photo album. Photos and videos taken during the trip are organized chronologically and edited for easy viewing. The server generates a travel record that reflects the trip's overview and highlights and sends it to the user's device. The generated travel record is provided as a digital album or travel diary that can be saved as a memory.

[1226] Specific examples

[1227] For example, if a user inputs their travel plan for "visiting art museums for five days starting April 10, 2023, with a budget of 200,000 yen," the server will use generative artificial intelligence to propose an optimal travel plan. This plan will include destinations such as Paris, Amsterdam, and London, and details of each museum, accommodation, and transportation. Recommended restaurants in the area will also be suggested, and the user can choose to have them delivered.

[1228] Prompt Sentence Examples

[1229] The prompt to use for the generative AI model:

[1230] Please recommend a restaurant. Location: Paris, Preferences: Vegetarian, Budget: Under 5,000 yen.

[1231] In this way, the present invention provides a system that consistently supports planning, preparing, experiencing, and recording a trip, making the trip more comfortable and fulfilling for the user.

[1232] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1233] Step 1:

[1234] The user enters desired conditions such as travel dates, budget, and desired activities into a smartphone application.

[1235] Input: Travel conditions such as "5 days from April 10, 2023, budget of 200,000 yen, visiting art museums"

[1236] How it works: Information entered by the user is sent to the server via the application.

[1237] Output: Travel conditions information sent to the server

[1238] Step 2:

[1239] The server uses generative artificial intelligence (GPT-4) to generate the optimal travel plan based on the travel conditions received.

[1240] Input: Travel conditions information

[1241] How it works: The server passes the received conditions to the generative AI model as a prompt sentence, for example, "Please create a travel plan based on a five-day trip starting April 10, 2023, with a budget of 200,000 yen and including a visit to art museums."

[1242] Output: Generated itineraries (e.g., a plan that includes visits to museums in Paris, Amsterdam, and London)

[1243] Step 3:

[1244] The server transmits the generated travel plan to the user's terminal, allowing the user to select a plan.

[1245] Input: Generated itinerary

[1246] Operation: The server sends the generated plan to the user's terminal and displays multiple plans as options.

[1247] Output: Multiple itineraries displayed on the user's device

[1248] Step 4:

[1249] The user selects the desired travel plan on the terminal.

[1250] Input: User selected itinerary

[1251] Operation: The user selects one of the plans presented, and the selection information is sent from the terminal to the server.

[1252] Output: Plan information selected by the user

[1253] Step 5:

[1254] The server automatically arranges airfare, accommodation, and tourist attraction tickets based on the selected plan.

[1255] Input: Selected plan information

[1256] How it works: The server uses various reservation service APIs to reserve and arrange tickets for airline tickets, accommodations, and tourist attractions.

[1257] Output: Various reservation information (airline tickets, accommodation, tourist attraction ticket details)

[1258] Step 6:

[1259] The server integrates the arranged reservation information, generates it as a single document, and sends it to the user terminal.

[1260] Input: Various reservation information

[1261] How it works: The server consolidates reservation information, organizes it into a single, easy-to-read document, and sends it to the user's terminal.

[1262] Output: Consolidated reservation information displayed on the user's terminal

[1263] Step 7:

[1264] While traveling, the user uses the device to check the best route from their current location to their destination.

[1265] Input: User's current location (GPS)

[1266] How it works: The device uses GPS to determine its current location and sends it to the server. The server calculates the optimal route and sends directions to the destination to the device.

[1267] Output: Optimal route displayed on the terminal

[1268] Step 8:

[1269] The server generates recommended restaurants in the area to be visited based on the user's travel plan data and transmits them to the user's terminal.

[1270] Input: Travel planning data

[1271] How it works: The server uses generative artificial intelligence to generate a list of restaurant recommendations based on travel planning data, for example, a list of vegetarian restaurants while in Paris.

[1272] Output: A list of recommended restaurants displayed on the user's device

[1273] Step 9:

[1274] The user selects delivery from a list of recommended restaurants and arranges the order through the server.

[1275] Input: The restaurant and delivery details selected by the user

[1276] How it works: The server receives the selected information and uses the reservation service API to arrange delivery.

[1277] Output: Delivery arrangement confirmation information

[1278] Step 10:

[1279] Users can upload photos, videos, and notes taken using their device while traveling to the cloud.

[1280] Input: Files taken or recorded by the user

[1281] How it works: A user uses their device to upload photos, videos, and notes to a cloud service.

[1282] Output: User's travel history stored in the cloud

[1283] Step 11:

[1284] The server organizes the data stored in the cloud, generates a travel record, and sends it to the user's device.

[1285] Input: File data stored in the cloud

[1286] How it works: The server organizes the data chronologically, generates a travel diary or photo album, and sends the results to the user's device.

[1287] Output: Trip log displayed on user's terminal

[1288] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1289] The present invention provides a system that consistently supports planning, preparing, experiencing, and recording a trip, and combines an emotion engine that recognizes a user's emotions. A specific embodiment of this system is described below.

[1290] Travel plan suggestions

[1291] The user inputs desired conditions such as travel dates, budget, and desired activities. For example, consider a case where a user inputs "five days starting April 10, 2023, budget of 200,000 yen, visiting art museums." These conditions are sent to the server via the device. The server analyzes the received input information and generates an optimal travel plan using generative artificial intelligence. This AI collects information on tourist destinations, accommodations, transportation, etc. from a database and creates multiple candidate plans.

[1292] Furthermore, the emotion engine recognizes the user's emotions from their input and interaction and reflects them in the generated travel plan. For example, if the user is tired, a plan that includes many relaxing tourist spots and spa facilities will be suggested. The generated plan includes destinations such as Paris, Amsterdam, and London, along with their respective museums, accommodations, and transportation options. The generated plan is sent to the user's device, and the user can choose from multiple plans.

[1293] Travel preparation and arrangements

[1294] The user reviews the proposed plans and selects the one they want. For example, suppose they select a plan for Paris and Amsterdam. Based on the selected plan, the server automatically arranges airfare, accommodation, and tickets to tourist attractions. The server makes these arrangements through the APIs of various reservation services and integrates the reservation information to generate a single document. This reservation information includes airfare details, hotel reservation number, ticket information for tourist attractions, etc. The generated reservation information is sent to the user's device so that it can be viewed.

[1295] Experience support during your trip

[1296] While traveling, users can use their device to check their next destination and the best route. For example, if a user wants to go to the Eiffel Tower in Paris, they can check its location in the app. The device uses GPS to obtain its current location and sends it to the server. The server then calculates the best route to the destination based on the received current location information and sends it to the device. In addition, real-time traffic and weather information is also displayed.

[1297] The emotion engine monitors the user's emotional state in real time and can change guidance and suggestions during the trip. For example, if the user is feeling stressed, the server will suggest quieter roads and less crowded tourist spots.

[1298] If a problem occurs, for example if a train is delayed, the user can use the chat function in the app to send a message to the server, which will then use AI to suggest alternative routes and solutions. The emotion engine will analyze the user's emotional state and suggest measures to reduce stress.

[1299] Travel Records

[1300] Users can upload photos, videos, and notes taken during their trip to the app. This data is sent to the server via their device. The server organizes the uploaded data chronologically and integrates it in the form of a travel diary or photo album. For example, photos taken and videos recorded during a trip are organized chronologically and edited for easy viewing. The server generates a travel record that reflects the overview and highlights of the trip and sends it to the user's device. The generated travel record becomes a digital album or travel diary that can be saved as memories, making it convenient for users to look back on later.

[1301] The emotion engine can also add comments and tags that reflect the user's emotions to travel photos, allowing users to vividly record their memories, including changes in their emotions during their trip.

[1302] In this way, the present invention not only provides users with consistent support throughout the entire process of planning, preparing, experiencing, and recording their trip, but also allows them to receive suggestions and support that respond to changes in their emotions through the emotion engine, making it possible for them to have a more fulfilling travel experience.

[1303] The processing flow will be explained below.

[1304] Step 1:

[1305] The user inputs desired conditions such as travel dates, budget, and desired activities into the terminal.

[1306] Example: A user enters the following conditions: "5 days from April 10, 2023, budget 200,000 yen, visiting art museums."

[1307] Step 2:

[1308] The terminal transmits the input information to the server.

[1309] The input data is converted to an appropriate format on the terminal and transferred to the server.

[1310] Step 3:

[1311] The server analyzes the received desired conditions.

[1312] The server processes each item such as schedule, budget, activities, etc. and retrieves the necessary data from the database.

[1313] Step 4:

[1314] The server uses an emotion engine to recognize the user's emotion.

[1315] It analyzes emotions from user input and past data to determine the user's current emotional state.

[1316] Step 5:

[1317] The server uses generative artificial intelligence to generate the optimal travel plan.

[1318] The AI ​​takes into account the user's desired conditions and emotional state, collects information on tourist spots, accommodation, transportation, etc. from a database, and creates multiple candidate plans.

[1319] Step 6:

[1320] The server transmits the generated plan to the user's terminal.

[1321] The terminal displays the received plans to the user, allowing the user to select from a plurality of plans.

[1322] Step 7:

[1323] The user checks the proposed plans and selects the one they want.

[1324] The user selects a plan for Paris and Amsterdam.

[1325] Step 8:

[1326] The terminal transmits the selected plan information to the server.

[1327] The selection result is retransmitted from the terminal to the server.

[1328] Step 9:

[1329] The server automatically arranges air tickets, accommodations, and tickets for sightseeing spots based on the selected plan.

[1330] The server connects with each reservation service through its API and carries out the necessary reservation procedures.

[1331] Step 10:

[1332] The server aggregates the reservation information and generates a document.

[1333] Compile all your flight, accommodation, and tourist ticket information into one document.

[1334] Step 11:

[1335] The server transmits the generated reservation information to the user's terminal.

[1336] The user uses the terminal to confirm reservation information and complete travel planning.

[1337] Step 12:

[1338] During the trip, the user uses the terminal to check the next destination.

[1339] If a user is in Paris and wants to go to the Eiffel Tower, they can check its location in the app.

[1340] Step 13:

[1341] The device uses GPS to obtain its current location and sends it to the server.

[1342] The current location information is sent to the server and used as material for the next calculation.

[1343] Step 14:

[1344] The server calculates the optimal route to the destination and sends it to the device.

[1345] Based on the requested route and mode of transportation, the server generates the optimal directions.

[1346] Step 15:

[1347] The device displays the optimal route based on real-time traffic and weather information.

[1348] Users can choose the most suitable mode of transportation for their current situation.

[1349] Step 16:

[1350] An emotion engine monitors the user's emotional state in real time and adjusts guidance during the journey.

[1351] If the user is feeling stressed, the server will suggest quieter roads and less crowded tourist spots.

[1352] Step 17:

[1353] If a user has a problem or question, they can use the chat function within the app to send a message to the server.

[1354] Example: Report that the train is delayed.

[1355] Step 18:

[1356] The server uses AI to suggest alternative routes and solutions and respond to the user.

[1357] The emotion engine analyzes the user's emotional state and suggests measures to reduce stress.

[1358] Step 19:

[1359] Users upload photos, videos, and notes they take while traveling to the app.

[1360] These data are transmitted to the server via the terminal.

[1361] Step 20:

[1362] The server organizes the uploaded data chronologically and generates a travel record.

[1363] The data is integrated and provided to users in the form of a travel diary or photo album.

[1364] Step 21:

[1365] The emotion engine adds comments and tags to photos and videos that reflect the user's emotions.

[1366] This allows users to record their memories, including changes in their emotions during their trip.

[1367] Step 22:

[1368] The server transmits the generated travel record to the user terminal.

[1369] Users can check their travel records through the device and save them as an electronic album or travel diary.

[1370] Example 2

[1371] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1372] Conventional travel planning support systems are limited to proposing travel plans that take into account the user's desired conditions. This often results in a fixed plan that ignores the user's emotions, resulting in a poor quality travel experience. Furthermore, support for dealing with troubles during the trip and responding to emotions is insufficient, causing significant stress and burden for users. Furthermore, travel records are limited to simple data uploads, and are not saved in the form of emotionally relevant memories, which is an issue.

[1373] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for a user to input desired conditions such as travel itinerary, budget, and desired activities; means for receiving the input information and generating an optimal travel plan using a generative AI model; means for recognizing emotions from the input information and reflecting them in the generated plan; means for sending the generated plan to the user's terminal and making it selectable; means for automatically arranging air tickets, accommodations, and tickets for tourist attractions based on the selected plan; means for integrating the arranged reservation information and sending it to the user's terminal; means for acquiring the user's location information during the trip and calculating and displaying the optimal route to the destination; means for responding in real time to problems and questions from the user; means for uploading images, videos, and notes taken by the user during the trip; and means for organizing the uploaded data, generating a travel record, and sending it to the user's terminal. This makes it possible to provide a travel plan that reflects the user's emotions, improve flexibility in dealing with problems, and generate a travel record that reflects the user's emotions.

[1374] A "user" is an entity that uses the system to plan, prepare, experience, and record a trip.

[1375] "Travel itinerary" is information indicating the period from the start date to the end date of the trip.

[1376] "Budget" is information indicating the upper limit of expenses that can be spent on a trip.

[1377] "Desired activities" is information indicating specific activities and conditions for destinations that the user wants to do during the trip.

[1378] "Input information" refers to information provided by the user via the terminal as conditions including travel schedule, budget, desired activities, and the like.

[1379] A "generative AI model" is an artificial intelligence platform that analyzes input information and generates optimal travel plans.

[1380] "Emotion" is information that indicates the user's current emotional state and is the subject of recognition and analysis by the system.

[1381] A "travel plan" is a proposal that includes destinations, accommodations, transportation, activities, etc., created based on the user's desired conditions and feelings.

[1382] A "terminal" is a device through which a user accesses the system and enters and receives information.

[1383] An "air ticket" is information used to reserve a seat on an airplane during a trip.

[1384] "Accommodation" is information about facilities where the user stays during the trip.

[1385] A "tourist attraction ticket" is information indicating the right to enter a tourist attraction.

[1386] "Location information" is information that indicates geographical data of the user's current location.

[1387] An "optimal route" is a travel route that optimizes conditions such as time and distance when traveling from the current location to the destination.

[1388] "Trouble" refers to a problem or obstacle that occurs during the trip that the user did not anticipate.

[1389] A "question" is information indicating an inquiry that a user requests the system to solve.

[1390] "Real-time" means that processing and response are carried out immediately without delay.

[1391] "Images" are data representing photographs taken by the user during the trip.

[1392] "Video" is data representing videos taken by the user during the trip.

[1393] "Notes" are text information recorded by the user during the trip.

[1394] "Travel Records" is data that organizes and consolidates images, videos, and notes taken during a trip and provides them as travel memories.

[1395] "Means" refers to the methods or techniques used to achieve a particular goal.

[1396] The present invention relates to a system that supports a user's entire travel experience, and in particular, it is a system that combines a generative AI model and an emotion engine to provide an optimal travel plan based on the user's emotions and consistently support the experience and record during the trip.

[1397] System Overview

[1398] This system is composed of a terminal and a server. The user uses the terminal to input their desired travel conditions, and the server generates the optimal travel plan based on that information. It also uses an emotion engine to analyze the user's emotions and adjust the plan accordingly. During the trip, the system obtains location information in real time, calculates and displays the optimal route, and also handles trouble and emotional care. As a travel record, it organizes and consolidates the images, videos, and notes taken by the user, and creates a digital album with emotion tags.

[1399] Hardware and software used

[1400] Device: A user device such as a smartphone or tablet that allows the user to input travel preferences, view generated itineraries, and receive route guidance during the trip.

[1401] Server: A high-performance server utilizing cloud services. This is the core of the system, making full use of generative AI models and emotion engines to process various data and perform calculations.

[1402] Generative AI model: An artificial intelligence model that generates optimal travel plans based on input information (e.g., OpenAI GPT-4).

[1403] Emotion engine: The ability to analyze user emotions and adjust plans accordingly (e.g., IBM Watson Tone Analyzer).

[1404] Other APIs: APIs used to connect with various services (e.g., Google Places API, Expedia API, OpenWeather API, etc.).

[1405] Specific operation of the system

[1406] 1. Input and analysis:

[1407] The user inputs travel conditions such as travel dates, budget, desired activities, etc. via the terminal. For example, if the user wishes to travel for five days from April 10, 2023, with a budget of 200,000 yen and visit art museums, the user writes this information in the input form. The terminal then sends this information to the server.

[1408] 2. Generate a travel plan:

[1409] The server analyzes the input information and generates an optimal travel plan using a generative AI model. This AI generates multiple plans using a pre-built database of tourist attractions, accommodations, and transportation. For example, a plan to visit Paris, Amsterdam, and London is generated, including detailed information on tourist attractions and accommodations.

[1410] 3. Reflecting emotions:

[1411] The server uses an emotion engine to recognize emotions from user input and dialogue and reflect them in the plan. For example, if the user is tired, a plan that includes many relaxing tourist spots and spa facilities will be generated. An example of a prompt sentence is, "The travel dates are five days from April 10, 2023, the budget is 200,000 yen, and I would like to visit art museums. I am currently tired. Please generate the optimal travel plan."

[1412] 4. Check and select your plan:

[1413] The generated travel plans are sent to the user's terminal, from which the user can select one. The terminal then sends the selected plan information to the server, which then starts making various reservations.

[1414] 5. Reservation arrangements:

[1415] The server automatically arranges air tickets, accommodations, and tickets for tourist attractions based on the selected plan, using various reservation service APIs to integrate the acquired reservation information, such as air ticket details, hotel reservation numbers, and ticket information for tourist attractions.

[1416] 6. Travel support:

[1417] While the user is traveling, the device uses GPS to obtain their current location and sends it to the server. The server calculates the optimal route based on the current location information and sends it to the device along with real-time traffic and weather information. If the user encounters a problem, the server uses AI to suggest alternative routes and solutions. In addition, an emotion engine analyzes the user's emotional state in real time and suggests the best course of action.

[1418] 7. Generate a trip record:

[1419] Users upload photos, videos, and notes they take during their trip to their device. The server organizes this data chronologically and integrates it into a travel record. The emotion engine assigns emotion tags to this data, allowing for clear recording of the user's emotional changes.

[1420] In this way, the present invention provides consistent support for users from planning their trip to experiencing it and recording it, and by utilizing the emotion engine, it is possible to provide a more personalized travel experience.

[1421] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1422] Step 1:

[1423] Collecting input information

[1424] The user inputs the travel schedule, budget, desired activities, etc. into the terminal. The input information may include, for example, "5 days from April 10, 2023, budget of 200,000 yen, visiting art museums."

[1425] Input: The user fills in the travel requirements in the input form.

[1426] Output: The terminal sends the input information to the server. Specifically, it forwards it to the server as an HTTP request.

[1427] Step 2:

[1428] Analysis of input information

[1429] The server parses the received input information. It uses a Python library (e.g. BeautifulSoup) to parse the input information as text data.

[1430] Input: User's desired conditions transferred from the terminal.

[1431] Output: The analyzed data is generated as a prompt sentence and converted into a format to be input into the generative AI model. Example: "The travel dates are 5 days from April 10, 2023, the budget is 200,000 yen, and I would like to visit art museums."

[1432] Step 3:

[1433] Generate a travel plan

[1434] The server generates an optimal travel plan based on the input information using a generative AI model (e.g., OpenAI GPT-4). This AI collects information from databases of tourist destinations, accommodations, and transportation.

[1435] Input: The parsed prompt statement.

[1436] Data processing: The generative AI model analyzes the prompt, extracts relevant information from the database, and generates a travel plan.

[1437] Output: A list of multiple itineraries, for example: "Louvre in Paris, luxury hotel, rail transport" or "British Museum in London, mid-range hotel, bus transport".

[1438] Step 4:

[1439] Recognizing and reflecting emotions

[1440] The server uses an emotion engine (e.g., IBM Watson Tone Analyzer) to recognize emotions from user input and dialogue and reflect them in the travel plan.

[1441] Input: User input information and generated itinerary.

[1442] Data Calculation: The emotion engine analyzes the user's emotions from the text and adjusts the contents of the travel plan. For example, if the user is tired, the plan will be changed to include more relaxing tourist spots and spa facilities.

[1443] Output: The adjusted itinerary.

[1444] Step 5:

[1445] Submit and confirm your travel plans

[1446] The server sends the generated and adjusted travel plan to the user's device using the HTTP protocol.

[1447] Input: Adjusted travel plans.

[1448] Output: The terminal displays the itinerary and allows the user to choose from multiple itineraries.

[1449] Step 6:

[1450] Select a travel plan

[1451] The user reviews the proposed itineraries and selects the one they want, for example, Paris and Amsterdam.

[1452] Input: Multiple itineraries displayed on the device.

[1453] Output: The selected plan information is sent to the server.

[1454] Step 7:

[1455] Start making reservations

[1456] The server automatically arranges air tickets, accommodations, and tickets for sightseeing spots based on the selected plan, using various reservation service APIs (e.g., Expedia API).

[1457] Input: The selected itinerary.

[1458] Data calculation: Make an API call to get reservation information.

[1459] Output: The arranged reservation information is stored on the server.

[1460] Step 8:

[1461] Aggregation of reservation information

[1462] The server consolidates the reservation information and organizes it into a single document, e.g., using a PDF generation library (e.g., ReportLab) to combine flight details, hotel reservation number, and tourist attraction ticket information into a single PDF file.

[1463] Input: Various reservation information.

[1464] Data processing: Integrate the acquired data and convert it into a document format.

[1465] Output: The generated booking information document.

[1466] Step 9:

[1467] Submit and confirm reservation information

[1468] The server transmits the generated reservation information to the user's terminal.

[1469] Input: The generated booking information document.

[1470] Output: The reservation information is displayed on the terminal for the user to review.

[1471] Step 10:

[1472] Check your destination and route

[1473] The user uses the device to check their next destination and the best route. For example, if the user wants to go to the Eiffel Tower in Paris, they check its location on the device.

[1474] Input: Destination location.

[1475] Output: The location of the destination will be displayed on the device.

[1476] Step 11:

[1477] Get and send your current location

[1478] The device uses GPS to determine its current location.

[1479] Input: Location data from GPS.

[1480] Output: The current location is sent to the server.

[1481] Step 12:

[1482] Viewing real-time information

[1483] Based on the received current location information, the server calculates the optimal route to the destination, obtains real-time traffic and weather information (e.g., OpenWeather API), and sends it to the device.

[1484] Input: Your current location.

[1485] Data calculation: Calculate optimal routes and get real-time information.

[1486] Output: Route information and real-time information will be displayed on the terminal.

[1487] Step 13:

[1488] Troubleshooting

[1489] When a user encounters a problem (e.g., a train delay), they can use the app's chat function to send a message to the server, which then uses AI to suggest alternative routes and solutions.

[1490] Input: Trouble message from the user.

[1491] Data computation: AI-powered generation of alternative routes and solutions.

[1492] Output: The proposed solution is displayed on the terminal.

[1493] Step 14:

[1494] Upload your trip log

[1495] Users upload images, videos, and notes taken during their trip to the app.

[1496] Input: Image, video, and note data from the user.

[1497] Output: Data is sent to the server.

[1498] Step 15:

[1499] Data organization and integration

[1500] The server organizes the uploaded data chronologically and integrates it into a travel record.

[1501] Input: Uploaded image, video, and note data.

[1502] Data processing: Organize and integrate data in chronological order.

[1503] Output: An organized travel log.

[1504] Step 16:

[1505] Emotion tagging

[1506] The emotion engine adds comments and tags that reflect the user's emotions to travel photos.

[1507] Input: Organized travel log data.

[1508] Data operations: Emotion tagging.

[1509] Output: Travel log tagged with emotions.

[1510] Step 17:

[1511] Sending a trip log

[1512] The server transmits the generated travel record to the user's terminal.

[1513] Input: Travel log data with emotion tags.

[1514] Output: The trip log sent to the device is displayed.

[1515] In this way, users can receive consistent support from planning to experiencing and recording their trip, and by utilizing the emotion engine, it is possible to provide a more personalized travel experience.

[1516] (Application example 2)

[1517] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1518] Conventional travel planning systems propose travel plans without considering the user's emotional state, which means they are unable to fully enhance the user's psychological satisfaction. Furthermore, they are unable to respond in real time to the user's emotional changes during the trip, and lack appropriate suggestions and support to reduce stress and anxiety.

[1519] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for a user to input desired conditions such as travel itinerary, budget, and desired activities; means for receiving the input information and generating an optimal travel plan using generative artificial intelligence; means for sending the generated plan to the user's terminal and making it selectable; means for automatically arranging air tickets, accommodations, and tickets for tourist attractions based on the selected plan; means for integrating the arranged reservation information and sending it to the user's terminal; means for acquiring the user's location information during the trip and calculating and displaying the optimal route to the destination; means for responding to user problems and questions in real time; means for uploading photos, videos, and notes taken by the user during the trip; means for organizing the uploaded data, creating a travel record, and sending it to the user's terminal; and means for monitoring the user's emotions in real time using an emotion engine and suggesting dishes and entertainment accordingly. This makes it possible to grasp the user's emotional state in real time and suggest travel plans and meals based on that, thereby providing a more personalized and fulfilling travel experience.

[1520] "User" means an individual who uses the system to plan, arrange, or receive support for travel.

[1521] "Itinerary" refers to the specific schedule during the trip, including the start and end dates of the trip.

[1522] "Budget" is the amount of money the user plans to spend on the trip.

[1523] "Desired conditions" are specific requests such as the activities the user wants to do on the trip, the places they want to visit, and the accommodations they want to stay at.

[1524] "Input information" refers to data such as schedule, budget, desired conditions, etc. that the user provides to the system.

[1525] "Generative AI" is AI that generates optimal travel plans based on input information.

[1526] A "travel plan" is a detailed travel plan proposed based on the user's desired conditions.

[1527] A "terminal" is a device that allows a user to access the system and perform necessary operations.

[1528] "Air ticket" means a boarding pass for an aircraft used for travel.

[1529] "Accommodation" refers to a facility where a user stays during a trip.

[1530] "Tourist attraction tickets" are admission tickets or vouchers required to visit a tourist attraction.

[1531] "Reservation information" refers to detailed information such as air tickets, accommodations, and tickets to tourist attractions arranged based on the travel plan.

[1532] "Location information" is data about the user's current location.

[1533] An "optimal route" is the most efficient route for a user to reach a destination.

[1534] The "emotion engine" is a system for monitoring and analyzing a user's emotional state in real time.

[1535] "Cuisine" refers to meals suggested based on the user's emotions and desired conditions.

[1536] "Entertainment" refers to entertainment and fun suggested based on the user's emotions and desired conditions.

[1537] This invention is a system that consistently supports planning, preparing, experiencing, and recording a trip. This system is combined with an emotion engine that recognizes the user's emotions, and is configured as follows.

[1538] Travel Planner

[1539] Users input desired conditions such as travel dates, budget, and desired activities into their device. For example, they input specific desired conditions such as "five days starting April 10, 2023, budget of 200,000 yen, visiting art museums." This information is sent from the device to the server. The server analyzes the received information and generates an optimal travel plan using a generative AI model. This AI collects information from databases of various tourist destinations, accommodations, and transportation options, and creates multiple candidate plans.

[1540] Use of emotion engine

[1541] Furthermore, the emotion engine recognizes the user's emotions from their input and interaction and reflects them in the generated travel plans. For example, if the user is tired, it will suggest plans that include many relaxing tourist spots and spa facilities.

[1542] Travel preparation and arrangements

[1543] The user reviews the proposed plans and selects the one they want. Based on the selected plan, the server automatically arranges airfare, accommodation, and tourist attraction tickets. The server makes these arrangements through the APIs of various reservation services and integrates the reservation information to generate a single document. The generated reservation information is sent to the user's device, where it can be viewed.

[1544] Experience support during your trip

[1545] While traveling, users can use their device to check their next destination and the optimal route. The server uses GPS to obtain their current location, calculates the optimal route to the destination, and sends this to the user's device. Real-time traffic and weather information is also displayed. The emotion engine monitors the user's emotional state in real time and changes guidance and suggestions as needed. For example, if the user is feeling stressed, it will suggest quieter roads and less crowded tourist spots. Furthermore, if a problem occurs during the trip, such as a train delay, the user can send a message to the server using the app's chat function. The server then uses AI to suggest alternative routes and solutions.

[1546] Travel Records

[1547] Users can upload photos, videos, and notes taken during their trip to the app. This data is sent from the device to the server, which organizes the uploaded data chronologically and integrates it into a travel diary or photo album. For example, photos taken and videos recorded during a trip are organized chronologically and edited for easy viewing. The server generates a travel record that reflects the trip's overview and highlights and sends it to the user's device. The generated travel record becomes a digital album or travel diary, making it convenient for users to look back on later.

[1548] technical means

[1549] The server integrates "generative artificial intelligence," an emotion engine, and a system for collecting and analyzing real-time data. This allows it to grasp the user's emotional state in real time and make travel plans and meal suggestions accordingly. This forms the basis for providing a more personalized and fulfilling travel experience. As an example, the following prompt sentences can be input into the system:

[1550] Examples of prompt statements

[1551] "User is angry. Current emotional state is Angry. What type of food should we suggest next?"

[1552] "User preference: Italian, emotional state: Relaxed, budget: 3000 yen. Please suggest the best dish based on these."

[1553] This invention allows users to receive attentive service tailored to their emotions, enabling a more comfortable and satisfying travel experience.

[1554] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1555] Step 1:

[1556] The user logs in to the device and inputs desired conditions such as travel dates, budget, desired activities, etc. The input data is sent from the device to the server, which receives this input information and stores it in a database.

[1557] Step 2:

[1558] The server analyzes the received input information and generates an optimal travel plan based on generative AI. This generative AI collects information from databases of tourist spots, accommodations, transportation, etc., and creates multiple candidate plans. The generated plan is then sent from the server to the user's device.

[1559] Step 3:

[1560] The user checks the proposed travel plans on the terminal and selects the one they want. The selected plan information is sent from the terminal to the server, and the server automatically arranges various reservations based on that information. The arranged reservation information is stored on the server.

[1561] Step 4:

[1562] The server integrates the reservation information and generates a detailed reservation document, which includes ticket information for the flight, accommodation, and sightseeing spots. The generated reservation information is sent from the server to the user's terminal, where the user can view it.

[1563] Step 5:

[1564] While traveling, users use their devices to check their next destination and the best route. The device uses its GPS to obtain its current location and sends this information to a server. The server then calculates the best route from the current location to the destination and sends it to the user's device in real time.

[1565] Step 6:

[1566] The emotional engine monitors the user's emotional state in real time. The device's camera and microphone are used to capture the user's facial expressions and voice data, which are then sent to the server. The server then uses the emotional engine to analyze the user's emotional state and adjusts the suggestions and support content based on the results.

[1567] Step 7:

[1568] The app responds to user problems and questions in real time. Users use the app's chat function to send messages to the server, which then uses AI to respond immediately. For example, if a train is delayed, the app will suggest an alternative route.

[1569] Step 8:

[1570] Users upload photos, videos, and notes they take during their trip from their device to the app. This data is sent from the device to a server, which organizes the uploaded data chronologically and integrates it into a travel diary or photo album. Travel records are sent from the server to the user's device, allowing the user to look back on their travel memories later.

[1571] Step 9:

[1572] The emotion engine analyzes the user's emotional state and tags photos and videos with their emotions. This tagged data can be saved as a digital album or travel diary, allowing users to more vividly record their travel memories, including changes in their emotions.

[1573] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1574] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1575] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1576] [Fourth embodiment]

[1577] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1578] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1579] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1580] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1581] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1582] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1583] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1584] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1585] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1586] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1587] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1588] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1589] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1590] The present invention is a system that consistently supports planning, preparing, experiencing, and recording a trip. A specific embodiment of this system will be described below.

[1591] Travel plan suggestions

[1592] The user inputs desired conditions such as travel dates, budget, and desired activities. For example, consider a user inputting a desire for "five days starting April 10, 2023, budget of 200,000 yen, visiting art museums." These conditions are sent to the server via the device. The server analyzes the received input information and generates an optimal travel plan using generative artificial intelligence. This AI collects information on tourist spots, accommodations, transportation, etc. from a database and creates multiple candidate plans. The generated plans include destinations such as Paris, Amsterdam, and London, along with their respective museums, accommodations, and transportation methods. The generated plans are sent to the user's device, and the user can choose from multiple plans.

[1593] Travel preparation and arrangements

[1594] The user reviews the proposed plans and selects the one they want. For example, suppose they select a plan for Paris and Amsterdam. Based on the selected plan, the server automatically arranges airfare, accommodation, and tickets to tourist attractions. The server makes these arrangements through the APIs of various reservation services and integrates the reservation information to generate a single document. This reservation information includes airfare details, hotel reservation number, ticket information for tourist attractions, etc. The generated reservation information is sent to the user's device so that it can be viewed.

[1595] Experience support during your trip

[1596] While traveling, users can use their device to check their next destination and the optimal route. For example, if a user wants to go to the Eiffel Tower in Paris, they can check its location in the app. The device uses GPS to obtain its current location and sends it to the server. The server then calculates the optimal route to the destination based on the received location information and sends it to the device. It also displays real-time traffic and weather information. If a problem occurs, for example if the train is delayed, the user can use the chat function in the app to send a message to the server. The server then uses AI to suggest alternative routes and solutions.

[1597] Travel Records

[1598] Users can upload photos, videos, and notes taken during their trip to the app. This data is sent to the server via their device. The server organizes the uploaded data chronologically and integrates it in the form of a travel diary or photo album. For example, photos taken and videos recorded during a trip are organized chronologically and edited for easy viewing. The server generates a travel record that reflects the overview and highlights of the trip and sends it to the user's device. The generated travel record becomes a digital album or travel diary that can be saved as memories, making it convenient for users to look back on later.

[1599] In this way, the present invention provides users with consistent support throughout the entire process of planning, preparing, experiencing, and recording their trip, simplifies complicated procedures, and enables them to have a more fulfilling travel experience.

[1600] The processing flow will be explained below.

[1601] Step 1:

[1602] The user inputs desired conditions such as travel dates, budget, desired activities, etc. For example, the user might input "5 days from April 10, 2023, budget 200,000 yen, visiting art museums."

[1603] Step 2:

[1604] The terminal sends the input information to the server, which converts the user's input data into an appropriate format and forwards it to the server.

[1605] Step 3:

[1606] The server analyzes the received requirements, processes each item (date, budget, desired activities) separately, and prepares to retrieve the relevant information from the database.

[1607] Step 4:

[1608] The server uses generative artificial intelligence to generate optimal travel plans. The AI ​​creates multiple plans that best fit the user's preferences based on collected information on tourist destinations, accommodations, transportation, etc.

[1609] Step 5:

[1610] The server sends the generated plan to the user's device, which displays the received plans to the user, allowing them to select from multiple plans.

[1611] Step 6:

[1612] The user reviews the proposed itineraries and selects the one they want. For example, the user may select a plan for Paris and Amsterdam.

[1613] Step 7:

[1614] The terminal transmits the selected plan information to the server. The terminal communicates again to transfer the user's selection results to the server.

[1615] Step 8:

[1616] The server automatically arranges airfare, accommodation, and tourist attraction tickets based on the selected plan. The server connects with various reservation services via API and performs the necessary reservation procedures.

[1617] Step 9:

[1618] The server integrates the reservation information and generates a document. The server compiles the booked flight, accommodation, and tourist attraction ticket information into a single integrated document.

[1619] Step 10:

[1620] The server sends the generated reservation information to the user's terminal, and the user confirms the reservation information through the terminal and completes the travel plan.

[1621] Step 11:

[1622] While traveling, the user uses the device to confirm their next destination, such as a specific destination, such as wanting to visit the Eiffel Tower.

[1623] Step 12:

[1624] The device uses GPS to obtain its current location and sends it to the server, where it is used for the next calculation.

[1625] Step 13:

[1626] The server calculates the optimal route to the destination and sends it to the device. Based on the requested route and mode of transportation, the server generates the optimal guidance.

[1627] Step 14:

[1628] The device displays the optimal route based on real-time traffic and weather information, allowing users to choose the most suitable mode of transportation for their current situation.

[1629] Step 15:

[1630] When a user encounters a problem or trouble, they can use the chat function to send a message to the server, for example, to report that the train is delayed.

[1631] Step 16:

[1632] The server uses AI to suggest alternative routes and solutions and respond to users, providing appropriate support in real time and quickly resolving user issues.

[1633] Step 17:

[1634] Users upload photos, videos, and notes they take during their trip to the app, and this data is sent to the server via the device.

[1635] Step 18:

[1636] The server organizes the uploaded data chronologically and generates a travel record, which is then integrated into a travel diary or photo album and provided to the user.

[1637] Step 19:

[1638] The server sends the generated travel record to the user's terminal, where an electronic album or travel diary is displayed to help the user look back on their travel memories.

[1639] In this way, a system is realized in which the server, terminal, and user work together to support the user's travel experience throughout the entire process.

[1640] Example 1

[1641] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1642] Modern travel planning requires users to gather a lot of information and make reservations, which takes a lot of time and effort. These cumbersome procedures can take away from the enjoyment of traveling. There is also a need for systems that can quickly respond to unexpected issues that arise during a trip. Furthermore, users want to be able to organize the photos and notes they take during their trip and keep them as a travel record, but doing this manually is time-consuming.

[1643] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1644] In this invention, the server includes: means for a user to input desired conditions such as travel itinerary, budget, and desired activities; means for receiving the input information and generating an optimal travel plan using generative artificial intelligence; means for sending the generated plan to the user's terminal and making it selectable; means for automatically arranging air tickets, accommodations, and admission tickets to tourist attractions based on the selected plan; means for acquiring the user's location data during the trip and calculating and displaying the optimal route to the destination; means for responding in real time to problems and questions from the user; means for uploading data and notes taken by the user during the trip; and means for organizing the uploaded data, generating a travel record, and transmitting it to the user's terminal. This allows the user to perform a comprehensive process from planning and arranging the trip, to receiving support during the trip, and generating the travel record.

[1645] A "user" is a person who uses the travel system to perform operations such as planning a trip, making a reservation, experiencing, and recording.

[1646] The "date" is information that indicates the period from the start date to the end date of the trip.

[1647] "Budget" is information that specifies the upper limit of travel expenses.

[1648] "Desired activities" is information that refers to events or experiences that the user wants to have during their trip.

[1649] A "terminal" is a device used by a user, such as a computer, smartphone, or tablet.

[1650] A "server" is a computer system that receives and processes information sent by users.

[1651] "Generative AI" is an AI technology that generates optimal travel plans based on input data.

[1652] A "travel plan" is a detailed plan that includes travel dates, places to visit, accommodation, transportation, tourist spots, etc.

[1653] An "air ticket" is a ticket that indicates a seat on an aircraft.

[1654] "Accommodation" means a hotel, inn, resort, or other place of accommodation for travel.

[1655] A "tourist attraction admission ticket" is a ticket for admission to a specific tourist attraction or event.

[1656] "Location data" is information that indicates the user's current location.

[1657] A "route" is the optimal path from the current location to the destination.

[1658] "Data" refers to information such as photos, videos, and notes taken by the user during their trip.

[1659] A "travel log" is a record that organizes and compiles all the data obtained during a trip.

[1660] "Means" are the methods or techniques used to achieve a particular goal.

[1661] The present invention is a system that uses generative artificial intelligence to provide an optimal travel plan based on user input of travel conditions such as travel itinerary, budget, and desired activities. This system supports the entire process of planning, preparing, implementing, and recording the trip. Specific embodiments are described below.

[1662] Enter travel conditions

[1663] The user uses the device's application to input the travel schedule, budget, and desired activities. For example, a user may input the desired conditions as "five days from April 10, 2023, budget of 200,000 yen, visiting museums." This input is done through the mobile application interface.

[1664] Generate a travel plan

[1665] The device converts the user's input into JSON format data and sends it to a server via the internet. The server then analyzes the received data and uses generative artificial intelligence (AI) to generate an optimal travel plan. Specifically, it uses an AI model (e.g., GPT-4) to collect information from a database of tourist destinations, accommodations, and transportation options to create multiple travel plans.

[1666] Presenting and selecting a travel plan

[1667] The server sends the generated itineraries to the user's device. The user can then review these itineraries and select the one they want through the application. This selection is made through the device, and the result of the selection is sent back to the server.

[1668] Automatic booking

[1669] The server automatically arranges air tickets, accommodations, and admission tickets to tourist attractions based on the selected travel plan. To do this, it uses the APIs of various reservation services (e.g., airline APIs, hotel reservation site APIs, tourist attraction ticket sales service APIs). Once the arrangements are complete, the reservation information is integrated and generated as a document in PDF or HTML format.

[1670] Experience support during your trip

[1671] While traveling, users can use the device's application to check their next destination and the optimal route. The device uses the GPS sensor to obtain their current location and sends that information to a server. The server calculates the optimal route to the destination based on the received current location information, and also displays real-time traffic and weather information. Users can also use the device's chat function to send inquiries to the server and receive real-time responses to any problems or questions they may have. The server uses AI to suggest alternative routes and solutions.

[1672] Travel Records

[1673] During a trip, users can upload photos, videos, and notes they have taken through the device's application. This data is sent to the server and organized chronologically. The server then creates a travel record based on this data and sends it to the user's device in the form of a travel diary or photo album. The created travel record is saved as a digital album or travel diary, allowing for easy review later.

[1674] Specific examples

[1675] If a user inputs their desire to visit museums for five days starting April 10, 2023, with a budget of 200,000 yen, the system will generate a plan to visit Paris, Amsterdam, and London. If the user selects the Paris and Amsterdam plans, the server will automatically book flights and accommodations and generate an integrated document. During the trip, the user can use the GPS function to check the route to the Eiffel Tower, and if any problems arise, they can get solutions through the chat function. After the trip is completed, a travel record based on the photos and videos taken is generated and saved as a digital album.

[1676] Prompt Sentence Examples

[1677] "Please suggest a five-day trip that includes visiting museums in Paris and Amsterdam, starting April 10, 2023, with a budget of 200,000 yen."

[1678] The above is a specific embodiment of the present invention. The present invention allows users to consistently handle everything from travel planning and reservation arrangements to support during the trip and creation of a travel record, making it possible to maximize the enjoyment of travel.

[1679] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1680] Step 1:

[1681] Users input their travel dates, budget, and desired activities. Specifically, they operate the application interface to enter conditions such as "five days starting April 10, 2023, budget of 200,000 yen, visiting art museums." This generates the user's desired travel conditions as input data.

[1682] Step 2:

[1683] The terminal formats the data entered by the user and sends it to the server. Specifically, it converts the entered data into JSON format and sends it to the server as an HTTP request. The input is the user's desired data, and the output is the formatted data sent to the server.

[1684] Step 3:

[1685] The server analyzes the received data. The input is the JSON formatted travel condition data sent from the device, and the output is the analyzed condition data such as the itinerary, budget, desired activities, etc. Specifically, it uses a JSON parser to parse the data and extracts the individual conditions.

[1686] Step 4:

[1687] The server uses a generative artificial intelligence (AI) model to generate the optimal travel plan. The input is analyzed travel condition data, and the output is multiple travel plans. Specifically, the server inputs travel conditions into the AI ​​model and generates the optimal plan based on information on tourist spots, accommodation, and transportation. GPT-4 and other AI models are used.

[1688] Step 5:

[1689] The server sends the generated itinerary to the user's device. The input is the generated itinerary, and the output is the itinerary data sent to the device. Specifically, the server converts the generated itinerary back into JSON format and sends it to the device via an HTTP response.

[1690] Step 6:

[1691] The user checks the multiple plans sent from the server and selects the one they want. The input is the travel plan displayed on the terminal, and the output is the plan selected by the user. Specifically, the user selects the desired plan using the application interface.

[1692] Step 7:

[1693] The terminal sends the selected plan information to the server. The input is the travel plan selected by the user, and the output is the selected plan data sent to the server. Specifically, the terminal converts the selected plan ID into JSON format and sends it to the server as an HTTP request.

[1694] Step 8:

[1695] The server automatically arranges airline tickets, accommodations, and tickets to tourist attractions. The input is the selected travel plan data, and the output is reservation confirmation information. Specifically, it calls the APIs of various reservation services to make reservations for airline tickets and accommodations, and arranges tickets to tourist attractions.

[1696] Step 9:

[1697] The server consolidates the reservation information it has arranged and sends it to the user's terminal. The input is various reservation data, and the output is an integrated reservation information document. Specifically, it aggregates multiple reservation information, converts it into a document in PDF or HTML format, and sends it to the terminal.

[1698] Step 10:

[1699] While traveling, users use an application on their device to check their next destination and the best route. The input is the user's current location information, and the output is information about the best route to the destination. Specifically, the application uses a GPS sensor to obtain the user's current location and sends that information to a server.

[1700] Step 11:

[1701] The server calculates the optimal route based on the current location information and sends it to the device. The input is the user's current location data and the output is the optimal route information. Specifically, it uses a navigation API to calculate the route and sends it to the device along with real-time traffic and weather information.

[1702] Step 12:

[1703] When a user has a problem or question, they can use the chat function on their device to send a message to the server. The input is a message from the user, and the output is an inquiry request to the server. Specifically, the user enters a message using the chat interface and presses the send button.

[1704] Step 13:

[1705] The server analyzes the received message and uses AI to propose alternative routes and solutions. The input is the user's inquiry message, and the output is a proposed solution or alternative route. Specifically, it analyzes the message using natural language processing technology, generates an appropriate response, and sends it back to the user.

[1706] Step 14:

[1707] Users upload data and notes taken during their trip to the server via their device. The input is the photos and videos taken and the note data, and the output is a file upload request to the server. Specifically, the user selects a file using the application's upload function and presses the send button.

[1708] Step 15:

[1709] The server organizes the uploaded data and generates a travel record. The input is the data uploaded by the user, and the output is an organized travel record document. Specifically, the server organizes the data along the timeline, generates a document as a travel record, and sends it to the user's device.

[1710] (Application example 1)

[1711] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1712] When planning and executing a trip, arranging meals can be a complicated process. The tasks of finding and booking local restaurants and cafes, and then arranging for delivery, in particular, are a significant burden for travelers. Furthermore, choosing meals in foreign countries or tourist destinations is often difficult due to language and cultural barriers. For this reason, there is a demand for a system that makes it easy to arrange meals as part of travel planning and provides consistent support for meal selection and delivery during travel.

[1713] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1714] In this invention, the server includes a means for generating recommended restaurants for the area to be visited based on the user's travel plan data, a means for delivering meals to the user's current location based on the generated list of recommended restaurants, and a means for consistently managing and supporting the entire travel process, thereby enabling travelers to receive recommendations for optimal local meals based on their travel plans and automatically arrange for delivery.

[1715] The "means for the user to input desired conditions such as travel schedule, budget, desired activities, etc." is an interface for the user to input detailed information about the desired trip into the terminal.

[1716] "Means for receiving input information and generating an optimal travel plan using generative artificial intelligence" refers to a system that automatically creates an optimal travel plan using generative artificial intelligence based on information entered by the user.

[1717] "Means for sending the generated plan to the user's terminal and making it selectable" refers to a system that sends the generated travel plan to the user's terminal and makes it possible for the user to check and select the plan.

[1718] "Means for automatically arranging air tickets, accommodations, and tickets to tourist spots based on a selected plan" is a system that automatically makes various reservations based on a travel plan selected by the user.

[1719] The "means for integrating arranged reservation information and transmitting it to the user terminal" is a system that centrally integrates arranged reservation information and transmits it to the user terminal.

[1720] "Means for acquiring the location information of a user traveling, and calculating and displaying the optimal route to the destination" is a system that acquires the current location of a user traveling, and calculates and displays the optimal travel route to the destination.

[1721] "Means for providing real-time answers to problems and questions from users" is a system that provides real-time solutions and information to problems and questions that users encounter while traveling.

[1722] "A means for uploading photos, videos, and notes taken by users while traveling" is a system for uploading photos, videos, and notes taken by users while traveling to the cloud.

[1723] "Means for organizing uploaded data, generating a travel record, and sending it to the user terminal" refers to a system that organizes uploaded data in chronological order, edits and generates a travel record, and sends it to the user terminal.

[1724] The "means for generating recommended restaurants for a visit area based on the user's travel plan data" is a system that recommends optimal restaurants for a visit area included in the user's travel plan.

[1725] The "means for delivering meals to the user's current location based on the generated list of recommended restaurants" is a system that arranges for meals to be delivered from recommended restaurants to the user's current location.

[1726] The present invention is a system that consistently supports the proposal, preparation, experience, and recording of travel plans, and specific embodiments are described below.

[1727] System Program

[1728] Hardware and software used

[1729] Hardware: Smartphones, GPS devices

[1730] Database: Amazon RDS

[1731] API: Google Maps API, OpenWeatherMap API, Booking Service API

[1732] AI: GPT-4 (OpenAI)

[1733] Specific processing contents of the program

[1734] Travel plan suggestions

[1735] Users use their smartphones to input travel conditions such as travel dates, budget, and desired activities. This information is sent from the device to a server. The server receives the information and uses generative artificial intelligence (GPT-4) to generate an optimal travel plan. This generative AI collects information such as tourist destinations, accommodations, and transportation methods from a database and creates multiple candidate plans. The generated plans are sent to the user's device, and the user can choose from multiple plans.

[1736] Travel preparation and arrangements

[1737] Once the user selects the desired plan, the server automatically arranges airfare, accommodation, and sightseeing tickets, using the APIs of various reservation services. The arranged reservation information is integrated into a single document and sent to the user's device.

[1738] Experience support during your trip

[1739] While traveling, users can use their device to check their next destination and the best route. The device uses GPS to obtain their current location and sends it to the server. The server calculates the best route to the destination based on real-time location data and sends it to the device. Real-time traffic and weather information is also displayed. In the unlikely event that a problem occurs, users can use the chat function within the app to send a message to the server. The server uses AI to suggest alternative routes and solutions.

[1740] Meal suggestions and delivery arrangements

[1741] The server generates recommended restaurants in the area to be visited based on the user's travel plan data. The generated list is sent to the user's device, and the user can select delivery from the recommended restaurants. The selected meal is arranged through the server using the reservation service API and delivered to the user's current location.

[1742] Travel Records

[1743] Photos, videos, and notes taken by users during their trip are uploaded from their device to the cloud. The server organizes the uploaded data chronologically and consolidates it in the form of a travel diary or photo album. Photos and videos taken during the trip are organized chronologically and edited for easy viewing. The server generates a travel record that reflects the trip's overview and highlights and sends it to the user's device. The generated travel record is provided as a digital album or travel diary that can be saved as a memory.

[1744] Specific examples

[1745] For example, if a user inputs their travel plan for "visiting art museums for five days starting April 10, 2023, with a budget of 200,000 yen," the server will use generative artificial intelligence to propose an optimal travel plan. This plan will include destinations such as Paris, Amsterdam, and London, and details of each museum, accommodation, and transportation. Recommended restaurants in the area will also be suggested, and the user can choose to have them delivered.

[1746] Prompt Sentence Examples

[1747] The prompt to use for the generative AI model:

[1748] Please recommend a restaurant. Location: Paris, Preferences: Vegetarian, Budget: Under 5,000 yen.

[1749] In this way, the present invention provides a system that consistently supports planning, preparing, experiencing, and recording a trip, making the trip more comfortable and fulfilling for the user.

[1750] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1751] Step 1:

[1752] The user enters desired conditions such as travel dates, budget, and desired activities into a smartphone application.

[1753] Input: Travel conditions such as "5 days from April 10, 2023, budget of 200,000 yen, visiting art museums"

[1754] How it works: Information entered by the user is sent to the server via the application.

[1755] Output: Travel conditions information sent to the server

[1756] Step 2:

[1757] The server uses generative artificial intelligence (GPT-4) to generate the optimal travel plan based on the travel conditions received.

[1758] Input: Travel conditions information

[1759] How it works: The server passes the received conditions to the generative AI model as a prompt sentence, for example, "Please create a travel plan based on a five-day trip starting April 10, 2023, with a budget of 200,000 yen and including a visit to art museums."

[1760] Output: Generated itineraries (e.g., a plan that includes visits to museums in Paris, Amsterdam, and London)

[1761] Step 3:

[1762] The server transmits the generated travel plan to the user's terminal, allowing the user to select a plan.

[1763] Input: Generated itinerary

[1764] Operation: The server sends the generated plan to the user's terminal and displays multiple plans as options.

[1765] Output: Multiple itineraries displayed on the user's device

[1766] Step 4:

[1767] The user selects the desired travel plan on the terminal.

[1768] Input: User selected itinerary

[1769] Operation: The user selects one of the plans presented, and the selection information is sent from the terminal to the server.

[1770] Output: Plan information selected by the user

[1771] Step 5:

[1772] The server automatically arranges airfare, accommodation, and tourist attraction tickets based on the selected plan.

[1773] Input: Selected plan information

[1774] How it works: The server uses various reservation service APIs to reserve and arrange tickets for airline tickets, accommodations, and tourist attractions.

[1775] Output: Various reservation information (airline tickets, accommodation, tourist attraction ticket details)

[1776] Step 6:

[1777] The server integrates the arranged reservation information, generates it as a single document, and sends it to the user terminal.

[1778] Input: Various reservation information

[1779] How it works: The server consolidates reservation information, organizes it into a single, easy-to-read document, and sends it to the user's terminal.

[1780] Output: Consolidated reservation information displayed on the user's terminal

[1781] Step 7:

[1782] While traveling, the user uses the device to check the best route from their current location to their destination.

[1783] Input: User's current location (GPS)

[1784] How it works: The device uses GPS to determine its current location and sends it to the server. The server calculates the optimal route and sends directions to the destination to the device.

[1785] Output: Optimal route displayed on the terminal

[1786] Step 8:

[1787] The server generates recommended restaurants in the area to be visited based on the user's travel plan data and transmits them to the user's terminal.

[1788] Input: Travel planning data

[1789] How it works: The server uses generative artificial intelligence to generate a list of restaurant recommendations based on travel planning data, for example, a list of vegetarian restaurants while in Paris.

[1790] Output: A list of recommended restaurants displayed on the user's device

[1791] Step 9:

[1792] The user selects delivery from a list of recommended restaurants and arranges the order through the server.

[1793] Input: The restaurant and delivery details selected by the user

[1794] How it works: The server receives the selected information and uses the reservation service API to arrange delivery.

[1795] Output: Delivery arrangement confirmation information

[1796] Step 10:

[1797] Users can upload photos, videos, and notes taken using their device while traveling to the cloud.

[1798] Input: Files taken or recorded by the user

[1799] How it works: A user uses their device to upload photos, videos, and notes to a cloud service.

[1800] Output: User's travel history stored in the cloud

[1801] Step 11:

[1802] The server organizes the data stored in the cloud, generates a travel record, and sends it to the user's device.

[1803] Input: File data stored in the cloud

[1804] How it works: The server organizes the data chronologically, generates a travel diary or photo album, and sends the results to the user's device.

[1805] Output: Trip log displayed on user's terminal

[1806] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1807] The present invention provides a system that consistently supports planning, preparing, experiencing, and recording a trip, and combines an emotion engine that recognizes a user's emotions. A specific embodiment of this system is described below.

[1808] Travel plan suggestions

[1809] The user inputs desired conditions such as travel dates, budget, and desired activities. For example, consider a case where a user inputs "five days starting April 10, 2023, budget of 200,000 yen, visiting art museums." These conditions are sent to the server via the device. The server analyzes the received input information and generates an optimal travel plan using generative artificial intelligence. This AI collects information on tourist destinations, accommodations, transportation, etc. from a database and creates multiple candidate plans.

[1810] Furthermore, the emotion engine recognizes the user's emotions from their input and interaction and reflects them in the generated travel plan. For example, if the user is tired, a plan that includes many relaxing tourist spots and spa facilities will be suggested. The generated plan includes destinations such as Paris, Amsterdam, and London, along with their respective museums, accommodations, and transportation options. The generated plan is sent to the user's device, and the user can choose from multiple plans.

[1811] Travel preparation and arrangements

[1812] The user reviews the proposed plans and selects the one they want. For example, suppose they select a plan for Paris and Amsterdam. Based on the selected plan, the server automatically arranges airfare, accommodation, and tickets to tourist attractions. The server makes these arrangements through the APIs of various reservation services and integrates the reservation information to generate a single document. This reservation information includes airfare details, hotel reservation number, ticket information for tourist attractions, etc. The generated reservation information is sent to the user's device so that it can be viewed.

[1813] Experience support during your trip

[1814] While traveling, users can use their device to check their next destination and the best route. For example, if a user wants to go to the Eiffel Tower in Paris, they can check its location in the app. The device uses GPS to obtain its current location and sends it to the server. The server then calculates the best route to the destination based on the received current location information and sends it to the device. In addition, real-time traffic and weather information is also displayed.

[1815] The emotion engine monitors the user's emotional state in real time and can change guidance and suggestions during the trip. For example, if the user is feeling stressed, the server will suggest quieter roads and less crowded tourist spots.

[1816] If a problem occurs, for example if a train is delayed, the user can use the chat function in the app to send a message to the server, which will then use AI to suggest alternative routes and solutions. The emotion engine will analyze the user's emotional state and suggest measures to reduce stress.

[1817] Travel Records

[1818] Users can upload photos, videos, and notes taken during their trip to the app. This data is sent to the server via their device. The server organizes the uploaded data chronologically and integrates it in the form of a travel diary or photo album. For example, photos taken and videos recorded during a trip are organized chronologically and edited for easy viewing. The server generates a travel record that reflects the overview and highlights of the trip and sends it to the user's device. The generated travel record becomes a digital album or travel diary that can be saved as memories, making it convenient for users to look back on later.

[1819] The emotion engine can also add comments and tags that reflect the user's emotions to travel photos, allowing users to vividly record their memories, including changes in their emotions during their trip.

[1820] In this way, the present invention not only provides users with consistent support throughout the entire process of planning, preparing, experiencing, and recording their trip, but also allows them to receive suggestions and support that respond to changes in their emotions through the emotion engine, making it possible for them to have a more fulfilling travel experience.

[1821] The processing flow will be explained below.

[1822] Step 1:

[1823] The user inputs desired conditions such as travel dates, budget, and desired activities into the terminal.

[1824] Example: A user enters the following conditions: "5 days from April 10, 2023, budget 200,000 yen, visiting art museums."

[1825] Step 2:

[1826] The terminal transmits the input information to the server.

[1827] The input data is converted to an appropriate format on the terminal and transferred to the server.

[1828] Step 3:

[1829] The server analyzes the received desired conditions.

[1830] The server processes each item such as schedule, budget, activities, etc. and retrieves the necessary data from the database.

[1831] Step 4:

[1832] The server uses an emotion engine to recognize the user's emotion.

[1833] It analyzes emotions from user input and past data to determine the user's current emotional state.

[1834] Step 5:

[1835] The server uses generative artificial intelligence to generate the optimal travel plan.

[1836] The AI ​​takes into account the user's desired conditions and emotional state, collects information on tourist spots, accommodation, transportation, etc. from a database, and creates multiple candidate plans.

[1837] Step 6:

[1838] The server transmits the generated plan to the user's terminal.

[1839] The terminal displays the received plans to the user, allowing the user to select from a plurality of plans.

[1840] Step 7:

[1841] The user checks the proposed plans and selects the one they want.

[1842] The user selects a plan for Paris and Amsterdam.

[1843] Step 8:

[1844] The terminal transmits the selected plan information to the server.

[1845] The selection result is retransmitted from the terminal to the server.

[1846] Step 9:

[1847] The server automatically arranges air tickets, accommodations, and tickets for sightseeing spots based on the selected plan.

[1848] The server connects with each reservation service through its API and carries out the necessary reservation procedures.

[1849] Step 10:

[1850] The server aggregates the reservation information and generates a document.

[1851] Compile all your flight, accommodation, and tourist ticket information into one document.

[1852] Step 11:

[1853] The server transmits the generated reservation information to the user's terminal.

[1854] The user uses the terminal to confirm reservation information and complete travel planning.

[1855] Step 12:

[1856] During the trip, the user uses the terminal to check the next destination.

[1857] If a user is in Paris and wants to go to the Eiffel Tower, they can check its location in the app.

[1858] Step 13:

[1859] The device uses GPS to obtain its current location and sends it to the server.

[1860] The current location information is sent to the server and used as material for the next calculation.

[1861] Step 14:

[1862] The server calculates the optimal route to the destination and sends it to the device.

[1863] Based on the requested route and mode of transportation, the server generates the optimal directions.

[1864] Step 15:

[1865] The device displays the optimal route based on real-time traffic and weather information.

[1866] Users can choose the most suitable mode of transportation for their current situation.

[1867] Step 16:

[1868] An emotion engine monitors the user's emotional state in real time and adjusts guidance during the journey.

[1869] If the user is feeling stressed, the server will suggest quieter roads and less crowded tourist spots.

[1870] Step 17:

[1871] If a user has a problem or question, they can use the chat function within the app to send a message to the server.

[1872] Example: Report that the train is delayed.

[1873] Step 18:

[1874] The server uses AI to suggest alternative routes and solutions and respond to the user.

[1875] The emotion engine analyzes the user's emotional state and suggests measures to reduce stress.

[1876] Step 19:

[1877] Users upload photos, videos, and notes they take while traveling to the app.

[1878] These data are transmitted to the server via the terminal.

[1879] Step 20:

[1880] The server organizes the uploaded data chronologically and generates a travel record.

[1881] The data is integrated and provided to users in the form of a travel diary or photo album.

[1882] Step 21:

[1883] The emotion engine adds comments and tags to photos and videos that reflect the user's emotions.

[1884] This allows users to record their memories, including changes in their emotions during their trip.

[1885] Step 22:

[1886] The server transmits the generated travel record to the user terminal.

[1887] Users can check their travel records through the device and save them as an electronic album or travel diary.

[1888] Example 2

[1889] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1890] Conventional travel planning support systems are limited to proposing travel plans that take into account the user's desired conditions. This often results in a fixed plan that ignores the user's emotions, resulting in a poor quality travel experience. Furthermore, support for dealing with troubles during the trip and responding to emotions is insufficient, causing significant stress and burden for users. Furthermore, travel records are limited to simple data uploads, and are not saved in the form of emotionally relevant memories, which is an issue.

[1891] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for a user to input desired conditions such as travel itinerary, budget, and desired activities; means for receiving the input information and generating an optimal travel plan using a generative AI model; means for recognizing emotions from the input information and reflecting them in the generated plan; means for sending the generated plan to the user's terminal and making it selectable; means for automatically arranging air tickets, accommodations, and tickets for tourist attractions based on the selected plan; means for integrating the arranged reservation information and sending it to the user's terminal; means for acquiring the user's location information during the trip and calculating and displaying the optimal route to the destination; means for responding in real time to problems and questions from the user; means for uploading images, videos, and notes taken by the user during the trip; and means for organizing the uploaded data, generating a travel record, and sending it to the user's terminal. This makes it possible to provide a travel plan that reflects the user's emotions, improve flexibility in dealing with problems, and generate a travel record that reflects the user's emotions.

[1892] A "user" is an entity that uses the system to plan, prepare, experience, and record a trip.

[1893] "Travel itinerary" is information indicating the period from the start date to the end date of the trip.

[1894] "Budget" is information indicating the upper limit of expenses that can be spent on a trip.

[1895] "Desired activities" is information indicating specific activities and conditions for destinations that the user wants to do during the trip.

[1896] "Input information" refers to information provided by the user via the terminal as conditions including travel schedule, budget, desired activities, and the like.

[1897] A "generative AI model" is an artificial intelligence platform that analyzes input information and generates optimal travel plans.

[1898] "Emotion" is information that indicates the user's current emotional state and is the subject of recognition and analysis by the system.

[1899] A "travel plan" is a proposal that includes destinations, accommodations, transportation, activities, etc., created based on the user's desired conditions and feelings.

[1900] A "terminal" is a device through which a user accesses the system and enters and receives information.

[1901] An "air ticket" is information used to reserve a seat on an airplane during a trip.

[1902] "Accommodation" is information about facilities where the user stays during the trip.

[1903] A "tourist attraction ticket" is information indicating the right to enter a tourist attraction.

[1904] "Location information" is information that indicates geographical data of the user's current location.

[1905] An "optimal route" is a travel route that optimizes conditions such as time and distance when...

Claims

1. A means for the user to input desired travel conditions such as travel dates, budget, desired activities, etc.; a means for receiving input information and generating an optimal travel plan using generative artificial intelligence; means for transmitting the generated plan to a user's terminal and making the plan selectable; A means to automatically arrange air tickets, accommodations, and tourist attraction tickets based on the selected plan; a means for integrating the arranged reservation information and transmitting it to a user terminal; A means for acquiring location information of a user during a trip and calculating and displaying the optimal route to the destination; A means of responding to user problems and questions in real time, A way for users to upload photos, videos, and notes taken during their trip; means for organizing the uploaded data, generating a travel record, and transmitting the travel record to a user terminal; A system including:

2. 2. The system according to claim 1, further comprising means for automatically arranging related air tickets, accommodations, and tickets to tourist attractions based on a user's selected travel plan.

3. 2. The system according to claim 1, further comprising means for acquiring location information of a user who is traveling, and calculating and displaying an optimal route from a current location to a destination in real time.

Images