System

Abstract

A system is provided.SOLUTION: Means for receiving travel request information from a user as an input, means for transmitting the travel request information to a server for processing, means for collecting travel destination information based on the travel request information received by the server, means for generating a plurality of travel plans based on the collected travel destination information, means for proposing the plurality of generated travel plans to the user, means for allowing the user to select or correct one of the proposed travel plans, means for making a reservation for a transportation means, an accommodation facility, or a tourist spot based on the selected travel plan, and means for making a payment for the reservation; Means for generating and providing a final itinerary to the user.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] When traveling or going on a business trip, people often find it troublesome to plan their trips due to unfamiliarity with the area. Especially now, when many transportation-related companies are focusing on attracting tourists, support for efficiently enjoying trips is needed. However, existing travel planning systems require manual research and reservation procedures on multiple sites, which places a heavy burden on users. Furthermore, there is also the issue of not being able to provide optimal travel plans due to the difficulty in taking into account real-time reviews and traffic congestion forecast information. [Means for solving the problem]

[0005] The present invention provides a system that includes: a means for receiving travel preference information as input; a means for transmitting the travel preference information to a server for processing; a means for collecting travel destination information based on the travel preference information received by the server; a means for generating multiple travel plans based on the collected travel destination information; a means for proposing the generated multiple travel plans to a user; a means for the user to select or modify one of the proposed travel plans; a means for reserving transportation, accommodation, and tourist attractions based on the selected travel plan; a means for making payment for the reservation; and a means for generating and providing a final itinerary to the user. This allows users to easily plan their trips, and centralizes reservations and payments, enabling efficient and stress-free travel planning. Furthermore, the collected information includes tourist destination information, transportation information, accommodation information, word-of-mouth information, and traffic congestion forecast information, allowing for the system to propose optimal travel plans in real time.

[0006] "Travel preference information" refers to specific information such as destination, departure date, budget, and special requests that a user inputs to plan a trip.

[0007] "Server" refers to a computer system that processes travel information received from users, collects travel destination information, and creates and manages travel plans.

[0008] "Destination information" refers to various data related to the destination, such as tourist information, transportation information, accommodation information, reviews, and traffic congestion forecast information.

[0009] A "travel plan" refers to a plan that includes a specific schedule, places to visit, means of transportation, and accommodation, and is generated based on the user's desired travel information and travel destination information.

[0010] "Transportation" refers to the means of transportation used in travel, such as airplanes, trains, buses, and taxis.

[0011] "Accommodation" refers to facilities such as hotels, guesthouses, resorts, etc. where users can stay while traveling.

[0012] "Reservation" refers to the process of securing transportation, accommodation, visits to tourist attractions, etc. in advance.

[0013] "Payment" refers to the process of making payment for a reservation.

[0014] "Itinerary" refers to the detailed travel plan including all booking information, schedule, and contact information that is ultimately generated and provided to the user. [Brief explanation of the drawings]

[0015] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0016] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0017] First, the terms used in the following description will be explained.

[0018] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0019] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0020] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0021] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0023] [First embodiment]

[0024] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0025] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0026] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0027] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0028] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0030] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0031] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0032] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0033] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0034] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0035] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0036] This invention relates to a travel plan creation system that allows users to easily plan their trips and unifies reservations and payments. The user inputs desired travel information using a terminal, and the server uses that information to collect travel destination information and create and propose multiple travel plans. The user then makes reservations for transportation, accommodations, and tourist attractions based on the plan selected or modified, and finally generates an itinerary and completes payment.

[0037] The specific program processing flow is as follows:

[0038] Getting and Sending User Input

[0039] 1. The user inputs desired travel information using a terminal, including information such as destination (e.g., Hokkaido), departure date, return date, budget, and special requests (e.g., tourist spots, restaurants, activities).

[0040] 2. The device sends the acquired travel preference information to the server in a structured format (e.g., JSON).

[0041] Collecting travel destination information

[0042] 3. Based on the travel preference information received by the server, the generative AI model is used to collect the following information:

[0043] Tourist information

[0044] Transportation information

[0045] Accommodation information

[0046] Reviews

[0047] Traffic congestion forecast information

[0048] Generate a travel plan

[0049] 4. Based on the collected information, the server generates an optimal travel plan within the user's budget, including combinations of tourist destinations and transportation options, and selection of highly rated spots.

[0050] Plan proposal and confirmation

[0051] 5. The server sends the generated travel plans to the terminal, which then displays the plans to the user.

[0052] 6. The user reviews the proposed travel plans, selects the most suitable plan, and enters any corrections or additions as necessary.

[0053] Transportation and sightseeing reservations

[0054] 7. The terminal transmits the user's final selected or modified travel plan to the server.

[0055] 8. The server connects with MaaS and makes the following reservation:

[0056] Transportation (plane, train, bus, etc.)

[0057] Accommodation

[0058] Tickets to attractions and events

[0059] Payment and itinerary generation

[0060] 9. The server interacts with the payment system to complete the user's payment.

[0061] 10. Once the server has confirmed all reservations, it generates a final itinerary and sends it to the terminal.

[0062] Specific examples

[0063] For example, if a user enters "I want to travel to Hokkaido from June 1st to June 3rd, and I like Western-style restaurants," the server will do the following:

[0064] We collected information on famous tourist spots in Sapporo, night view spots in Hakodate, and Asahiyama Zoo.

[0065] Get a list of top-rated Western-style restaurants.

[0066] Check flight information for major airlines, as well as train and bus schedules within cities.

[0067] Get information on hotels with high reviews.

[0068] The server then generates a plan based on the collected information, including sightseeing in Sapporo on the first day, sightseeing in Hakodate on the second day, and visiting Asahiyama Zoo on the last day, and selects transportation and accommodation options within the budget.The user then confirms and selects the plan, and after completing the reservation and payment, the server provides the final itinerary.

[0069] This allows users to plan their trip efficiently and without stress.

[0070] The processing flow will be explained below.

[0071] Step 1:

[0072] The user inputs desired travel information using a terminal, including the destination, departure and return dates, budget, and special requests (such as sightseeing spots, restaurants, and activities).

[0073] Step 2:

[0074] The travel preference information acquired by the device is sent to the server in a structured format (e.g., JSON).

[0075] Step 3:

[0076] Based on the travel preference information received by the server, the information is input into the generative AI model to collect information on travel destinations, including tourist destination information, transportation information, accommodation information, reviews, and traffic congestion forecast information.

[0077] Step 4:

[0078] The server generates the optimal travel plan within the user's budget based on the travel destination information obtained from the AI ​​model, including the optimal combination of tourist spots and transportation methods, and the selection of spots with high reviews.

[0079] Step 5:

[0080] The server transmits the generated travel plans to the terminal, which displays them to the user.

[0081] Step 6:

[0082] The user reviews the proposed travel plans and selects the most suitable one. If necessary, the user can modify the plan or enter additional requests.

[0083] Step 7:

[0084] The device sends the user's selections and modifications to the server.

[0085] Step 8:

[0086] Based on the final plan, the server will work with MaaS to make reservations for transportation, accommodation, and tourist attractions, including air tickets, train tickets, hotel reservations, and tourist attraction tickets.

[0087] Step 9:

[0088] The server works with the payment system to complete the payment using the user's credit card information or electronic payment service.

[0089] Step 10:

[0090] Once the server has confirmed all reservations, it generates a final itinerary and sends it to the terminal.

[0091] Step 11:

[0092] The terminal displays or makes available for download the final itinerary to the user, who can review it and request corrections if necessary.

[0093] Example 1

[0094] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0095] Current travel planning systems do not allow users to create comprehensive travel plans effortlessly, and the process from collecting destination information to booking and payment is cumbersome. This requires users to individually check various websites and make reservations, which takes a lot of time and effort. It can also be difficult to find the best plan within a budget, making the process of travel planning itself a burden.

[0096] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0097] In this invention, the server includes a means for receiving desired travel information from a user in a structured format, a means for collecting information on travel destinations using a generative AI model, and a means for generating an optimal travel plan based on the collected information. This allows users to easily create an optimal travel plan within their budget using a unified system, and to efficiently make reservations and payments.

[0098] "User" refers to an individual or organization that uses this system.

[0099] "Travel preference information" refers to a dataset that includes information such as a traveler's desired travel destination, departure date, return date, budget, and any special requests.

[0100] "Terminal" refers to the device a user uses to enter information or view results, including smartphones, computers, tablets, etc.

[0101] "Server" refers to a central computer system that receives data sent from the terminals, processes it, and produces a final result.

[0102] "Structured" refers to data that is neatly organized in a specific format (e.g., JSON, XML, CSV, etc.).

[0103] A "generative AI model" refers to an algorithm that uses artificial intelligence techniques to analyze data and make predictions or classifications.

[0104] "Means of collecting information" refers to the processes and functions that the server uses to obtain the necessary information from various APIs and databases.

[0105] "Means for generating a travel plan" refers to the process or function by which the server designs and creates an optimal travel plan based on the collected information.

[0106] "Transportation" refers to the means of transportation used by a user during a trip, including airplanes, trains, buses, taxis, etc.

[0107] "Accommodation facilities" refers to hotels, inns, guesthouses, etc. where travelers can stay.

[0108] "Tourist destinations" refer to spots and facilities visited during travel, including tourist attractions, theme parks, museums, etc.

[0109] The "payment system" is a system for users to pay for services they have reserved, and it handles credit cards, electronic money, etc.

[0110] "Itinerary" refers to a document that contains detailed travel schedule and reservation information.

[0111] A "centralized system" refers to a system in which different types of information and functions are integrated and can be managed and used consistently by users in one place.

[0112] "RESTful API" refers to a web service interface designed based on four principles, making it easy to exchange data using representative protocols.

[0113] "PDF Generation Library" means a software component that allows programs to create and manipulate documents in PDF format.

[0114] This invention relates to a travel plan creation system that allows users to easily plan their trips and unifies reservations and payments. In this system, users input desired travel information using a terminal, and a server collects travel destination information based on that information and creates and proposes multiple travel plans. The system also makes reservations for transportation, accommodations, and tourist attractions based on the plan selected or modified by the user, and finally generates an itinerary and completes payment.

[0115] Specifically, this system operates as follows.

[0116] The user inputs desired travel information using a device. This includes information such as destination (e.g., Hokkaido), departure date, return date, budget, and special requests (e.g., tourist spots, restaurants, activities). The device sends this input information to the server in a structured format (e.g., JSON). The device communicates with the server using a RESTful API.

[0117] The server uses a generative AI model to collect the necessary information based on the travel preference information it receives. Specifically, it obtains information on tourist destinations, transportation options, accommodations, reviews, and traffic congestion forecasts through various APIs (e.g., Google Places API, accommodation booking site API, and transportation API). The server analyzes the data using AI libraries such as Python to generate the optimal travel plan. In this process, the AI ​​model uses an optimization algorithm to combine tourist destinations and transportation options and select highly rated spots.

[0118] The generated travel plan is sent from the server to the terminal and displayed to the user. The user reviews the proposed plans and selects the most suitable one. They can also enter any corrections or additions to the plan as needed. The terminal then sends the final travel plan back to the server.

[0119] The server, which receives the final plan, works with MaaS to reserve transportation (planes, trains, buses, etc.), accommodations, and tickets to tourist attractions and events. It also completes the user's payment using a payment system (e.g., Stripe or PayPal). Finally, once all reservations have been confirmed, the server generates a final itinerary and sends it to the terminal in PDF format. A library such as PDFKit is used to generate the PDF.

[0120] As a concrete example, if a user inputs, "I would like to travel to Hokkaido from June 1st to June 3rd, my budget is 100,000 yen, and I like Western-style restaurants," the following process will occur: The server collects information on tourist attractions in Sapporo, night view spots in Hakodate, and Asahiyama Zoo, and obtains a list of highly rated Western-style restaurants, flight information for major airlines, train and bus schedules within the city, and information on highly rated hotels. The generative AI model then generates a plan that includes sightseeing in Sapporo on the first day, sightseeing in Hakodate on the second day, and a visit to Asahiyama Zoo on the last day, and selects the optimal transportation and accommodation options. The final itinerary is then provided after the user confirms and selects the plan and completes the reservation and payment.

[0121] Example prompt: "I'd like to travel to Hokkaido from June 1st to June 3rd. My budget is 100,000 yen, and I like Western-style restaurants. What are some recommended travel plans?"

[0122] This system allows users to plan their trips efficiently and stress-free.

[0123] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0124] Step 1:

[0125] The user inputs travel preference information using a terminal. Specifically, the user inputs information such as destination, departure date, return date, budget, and special requests into a form on the terminal. The input information is saved on the terminal in a structured format (e.g., JSON). Input: destination, departure date, return date, budget, special requests. Output: structured travel preference information (JSON format).

[0126] Step 2:

[0127] The device sends the saved travel preference information (JSON format) to the server. The device communicates with the server via RESTful API using the HTTP POST method. Input: Structured travel preference information. Output: Travel preference information sent to the server.

[0128] Step 3:

[0129] The server analyzes the travel preference information it receives. It then uses a generative AI model to collect tourist destination information, transportation information, accommodation information, reviews, and traffic congestion forecast information. Specifically, the server calls various APIs to obtain the necessary information. Input: Travel preference information. Output: Collected travel destination information (tourist destinations, transportation information, accommodation information, reviews, traffic congestion forecast).

[0130] Step 4:

[0131] The server processes the collected travel destination information and generates the optimal travel plan within the budget. A generative AI model is used to find the best combination of tourist destinations and transportation methods. Specifically, the AI ​​algorithm performs data analysis and optimization. Input: Collected travel destination information. Output: Multiple travel plans.

[0132] Step 5:

[0133] The server sends multiple itineraries generated by the server to the terminal, which displays them to the user. The terminal analyzes the received data and displays it in a user-friendly UI. Input: Multiple itineraries. Output: Itineraries displayed to the user.

[0134] Step 6:

[0135] The user reviews the proposed travel plans and selects the most suitable one. They also input any corrections or additions they wish to make, if necessary. This information is sent to the server via the terminal. Input: User's selection or corrections. Output: Final travel plan.

[0136] Step 7:

[0137] The terminal sends the travel plan that the user has finally selected or modified to the server. Input: Final travel plan. Output: Information sent to the server.

[0138] Step 8:

[0139] The server works with MaaS to make reservations for transportation (planes, trains, buses, etc.), accommodations, and tickets to tourist spots and events. Specifically, the server communicates with the APIs of each reservation site to confirm the reservation. Input: Final travel plan. Output: Reservation confirmation information.

[0140] Step 9:

[0141] The server works with the payment system to complete the user's payment. The transaction is carried out using a payment gateway. Input: Reservation confirmation information, payment information. Output: Payment completion notification.

[0142] Step 10:

[0143] Once the server has completed all reservation confirmations, it generates the final itinerary and sends it to the terminal. A PDF generation library is used to generate the itinerary in PDF format. Input: Reservation confirmation information. Output: Final itinerary (PDF format).

[0144] By going through these steps, users can plan their trip efficiently and without stress.

[0145] (Application example 1)

[0146] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0147] Today, users face challenges when planning trips, including the complexity of information and the difficulty of centrally managing a variety of reservation procedures. Collecting information on tourist destinations, transportation options, accommodations, and other information from various sources to create optimal travel plans is a time-consuming process. Furthermore, users must access each reservation system and complete payment procedures separately, which is extremely cumbersome and time-consuming. Furthermore, the guide functions and real-time information updates required during sightseeing require the use of separate applications. There is a need for a system that solves these problems and allows users to easily plan trips and centralize the use of reservations, payments, and guide functions.

[0148] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0149] In this invention, the server includes means for receiving travel preference information from a user as input, means for transmitting the travel preference information to the server for processing, means for collecting travel destination information based on the travel preference information received by the server, means for generating multiple travel plans based on the collected travel destination information, means for proposing the generated multiple travel plans to the user, means for the user to select or modify from the proposed travel plans, means for reserving transportation, accommodation, and tourist attractions based on the selected travel plan, means for making payment for the reservation, means for generating and providing a final itinerary to the user, means for customizing a user profile, means for generating and proposing an optimal travel plan based on the collected information and the generation AI model, means for updating tourist attractions and transportation information in real time, and means for displaying guidance at actual tourist attractions using augmented reality technology. This allows users to easily plan their trip, centrally manage reservation procedures and payments, and further utilize real-time information updates and on-site guide functions.

[0150] "User" means an individual or corporation that utilizes the system to input travel plan information and receive travel plan proposals and reservations.

[0151] "Travel preference information" refers to a series of travel-related information entered by the user, such as destination, departure date, return date, budget, and preferred tourist spots and activities.

[0152] "Server" means a central processing device or system that receives travel preference information, processes and analyzes the information, generates a travel plan, and provides it to the user.

[0153] "Travel destination information" refers to all information necessary for travel planning, such as tourist spots, transportation options, accommodations, reviews, and traffic congestion forecasts.

[0154] A "travel plan" is a specific travel schedule or itinerary created based on collected travel destination information and in accordance with the user's budget and wishes.

[0155] "Reservation" means the process of confirming the use of transportation, accommodation and tourist attractions based on a travel plan.

[0156] "Payment" refers to the process of paying the fees required for a reservation.

[0157] An "itinerary" is a document or display item that shows the finalized travel plan and is provided to the user.

[0158] A "user profile" is personal information that includes a user's preferences, past travel history, and so on.

[0159] A "generative AI model" is an algorithm or system that uses artificial intelligence to generate information based on a user's preferences and create an optimal travel plan.

[0160] "Real-time updates" refers to a function that instantly reflects current conditions and changes, and is particularly applicable to traffic information and tourist information.

[0161] "Augmented reality technology" is a technology that displays digital information overlaid on real-world scenery, and is used for tourist guides, etc.

[0162] To implement this invention, the following system configuration is required. The system is composed of a user's terminal, a server, and an external API in cooperation with each other. The user inputs desired travel information using the terminal, and the server generates a travel plan based on that information and ultimately provides it to the user.

[0163] The travel information entered by the user on their device includes the destination, departure date, return date, budget, preferred tourist spots and activities, etc. The device sends the acquired information to the server in a structured format (e.g., JSON). The server uses a generative AI model to collect tourist spot information, transportation information, accommodation information, reviews, traffic congestion forecast information, etc. from various APIs.

[0164] Based on the information collected by the server, the server generates an optimal travel plan within the user's budget. The server then proposes multiple travel plans to the user, who can then select or modify the most appropriate one. Based on the selected travel plan, the server then connects with MaaS (Mobility as a Service) and performs the necessary reservation procedures. This includes reservations for transportation, accommodation, and tickets to tourist attractions.

[0165] After the reservation is finalized, the server connects with the payment system to complete the user's payment, generates a final itinerary, and provides it to the user. Using augmented reality technology, users can also receive real-time tourist information on-site via smart glasses or smartphones.

[0166] Specifically, the following program is included: If a user inputs "I want to travel to Kyoto from December 25th to December 30th, and I like visiting temples," the program will operate as follows:

[0167] 1. Obtaining user input: The user inputs travel preferences using a terminal.

[0168] 2. Data collection: The server uses an external API to collect information on Kyoto's tourist attractions, transportation options, accommodation, reviews, and traffic congestion forecasts.

[0169] 3. Travel plan generation: The server uses a generative AI model to generate the optimal travel plan within the budget based on the collected information.

[0170] 4. Plan proposal and reservation: The user selects and modifies the proposed plan, and the server then completes the reservation procedure.

[0171] 5. Payment and itinerary generation: The server connects with the payment system to complete the payment, generate the final itinerary, and provide it to the user.

[0172] Examples of prompts:

[0173] "I'd like to travel to Kyoto from December 25th to December 30th. I love visiting temples."

[0174] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0175] Step 1:

[0176] The user uses a terminal to input travel preferences, including destination, departure date, return date, budget, and preferred sightseeing spots and activities, which are then recorded in a structured format by the terminal.

[0177] Input: Destination, departure date, return date, budget, preferred sightseeing spots and activities

[0178] Output: Structured travel preference information (e.g., JSON format)

[0179] Step 2:

[0180] The terminal transmits the acquired travel preference information to the server. The server generates a travel plan based on this information, so it is important that all parameters are transmitted correctly.

[0181] Input: Structured travel wishes

[0182] Output: Data sent to server completed

[0183] Step 3:

[0184] The server collects travel destination information based on the travel preference information received. The server uses APIs to collect tourist destination information, transportation information, accommodation information, reviews, and traffic congestion forecast information. This process involves obtaining data from external databases and third-party services.

[0185] Input: Travel information

[0186] Output: Collected travel destination information (tourist information, transportation information, accommodation information, reviews, traffic congestion forecast information)

[0187] Step 4:

[0188] Based on the information collected by the server, a generative AI model is used to generate the optimal travel plan within the user's budget. The generative AI model analyzes the user's input information and collected information as prompts to create multiple optimized travel plans.

[0189] Input: Collected travel destination information, travel preference information

[0190] Output: Multiple generated itineraries

[0191] Step 5:

[0192] The server sends the generated itineraries to the terminal, which displays them to the user. The user can then review the proposed itineraries and enter any corrections or additions they require.

[0193] Input: Multiple generated itineraries

[0194] Output: Plan presented to user, user's correction requests

[0195] Step 6:

[0196] The terminal sends the user's final selected or revised travel plan to the server, which then makes reservations for transportation, accommodation, and sightseeing spots based on the received plan.

[0197] Input: revised itinerary

[0198] Output: Data sent to server completed, reservation accepted

[0199] Step 7:

[0200] The server works with MaaS to reserve transportation, accommodations, and tickets for tourist spots and events. The collaboration with MaaS here includes a function to communicate with the reservation systems of various transportation and accommodations in real time and secure availability information.

[0201] Input: Final travel plan

[0202] Output: Confirmed reservation information

[0203] Step 8:

[0204] The server then connects to the payment system to complete the user's payment, using credit card information or other payment methods. Once this process is complete, the entire reservation process is finalized.

[0205] Input: reservation confirmation information, user payment information

[0206] Output: Payment completed

[0207] Step 9:

[0208] Once the server has confirmed all reservations, it generates a final itinerary and sends it to the device, which displays it to the user and also provides local guidance using augmented reality technology.

[0209] Input: Payment completion information, reservation confirmation information

[0210] Output: Generate the final itinerary and provide it to the user

[0211] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0212] This invention relates to a travel plan generation system that allows users to easily plan their trips and integrates reservations and payments. In particular, by combining it with an emotion engine, it has the function of proposing optimal travel plans that take into account the user's emotional state. The user inputs desired travel information using a terminal, and the server uses that information to collect travel destination information and generate and propose multiple travel plans. The server then selects and modifies the plan, taking into account the user's emotional state, and makes reservations for transportation, accommodations, and tourist attractions. Finally, the system generates an itinerary and completes payment.

[0213] Program processing flow

[0214] 1. Getting and sending user input

[0215] The user uses the terminal to input travel preferences, including destination, departure and return dates, budget, and special requests (such as sightseeing spots, restaurants, and activities).

[0216] The travel preference information acquired by the device is sent to the server in a structured format (e.g., JSON).

[0217] 2. Emotional state analysis

[0218] The device recognizes and analyzes the user's emotional state using an emotion engine, analyzing facial expressions, voice tone, text nuances, etc. to identify the user's current emotional state (e.g., relaxed, excited, fatigue, etc.).

[0219] 3. Collecting travel destination information

[0220] Based on the travel preference information received by the server, the information is input into the generative AI model to collect information on travel destinations, including tourist destination information, transportation information, accommodation information, reviews, and traffic congestion forecast information.

[0221] 4. Generate a travel plan

[0222] Based on the information collected by the server, the system generates the optimal travel plan within the user's budget. This includes the optimal combination of tourist destinations and transportation methods, and the selection of highly rated spots. Furthermore, the system takes into account the emotional information provided by the emotion engine to propose a plan that suits the user's emotional state.

[0223] 5. Propose and confirm the plan

[0224] The server transmits the generated travel plans to the terminal, which displays them to the user.

[0225] The user reviews the proposed travel plans and selects the most suitable one. If necessary, the user can modify the plan or enter additional requests.

[0226] 6. Final decision and submission

[0227] The device sends the user's selections and modifications to the server.

[0228] 7. Transportation and sightseeing reservations

[0229] Based on the final plan, the server will work with MaaS to make reservations for transportation, accommodation, and tourist attractions, including air tickets, train tickets, hotel reservations, and tourist attraction tickets.

[0230] 8. Payment and itinerary generation

[0231] The server works with the payment system to complete the user's payment.

[0232] Once the server has confirmed all reservations, it generates a final itinerary and sends it to the terminal.

[0233] 9. Providing itinerary

[0234] The terminal displays or makes available for download the final itinerary to the user, who can review it and request corrections if necessary.

[0235] Specific examples

[0236] For example, if a user inputs "I want to travel to Hokkaido from June 1st to June 3rd, I like Western-style restaurants" and the emotional state is recognized as "Relaxed", the server will do the following:

[0237] We will collect information on famous tourist spots in Sapporo, Hokkaido, night view spots in Hakodate, and Asahiyama Zoo.

[0238] Get a list of highly rated Western-style restaurants and choose a tranquil spot that suits your relaxed mood.

[0239] The system investigates flight information for major airlines and train and bus operations within the city, and adjusts transportation methods taking into account traffic congestion forecasts.

[0240] Get information on hotels with great reviews and a relaxing atmosphere.

[0241] The server then generates a plan based on the collected information, including sightseeing in Sapporo on the first day, sightseeing in Hakodate on the second day, and visiting Asahiyama Zoo on the last day, and selects transportation and accommodation options within the budget.The user then confirms and selects the plan, and after completing the reservation and payment, the server provides the final itinerary.

[0242] In this way, the introduction of an emotion engine makes it possible to propose travel plans that are more suited to the user's current emotional state, thereby providing a more personalized travel experience.

[0243] The processing flow will be explained below.

[0244] Step 1:

[0245] The user uses the terminal to enter travel preferences, including destination, departure and return dates, budget, and special preferences (e.g., sightseeing spots, restaurants, activities).

[0246] Step 2:

[0247] The travel preference information acquired by the device is sent to the server in a structured format (e.g., JSON).

[0248] Step 3:

[0249] The device activates an emotion engine to recognize the user's emotional state. The emotion engine analyzes the user's facial expressions, voice tone, text nuances, etc. to identify the user's current emotional state (e.g., relaxed, excited, tired).

[0250] Step 4:

[0251] Based on the travel preference information received by the server and the emotional state from the emotion engine, the information is input into the generative AI model to collect travel destination information, including tourist destination information, transportation information, accommodation information, reviews, and traffic congestion forecast information.

[0252] Step 5:

[0253] Based on the information collected by the server, the system generates an optimal travel plan that fits the user's emotional state and fits within their budget. The plan includes an optimal combination of sightseeing spots, transportation options, and accommodations, as well as the selection of highly rated spots.

[0254] Step 6:

[0255] The server transmits the generated travel plans to the terminal, which displays them to the user.

[0256] Step 7:

[0257] The user reviews the proposed travel plans and selects the most suitable one. If necessary, the user can modify the plan or enter additional requests.

[0258] Step 8:

[0259] The device sends the user's selections and modifications to the server.

[0260] Step 9:

[0261] Based on the final plan, the server works with MaaS to make reservations for transportation, accommodation, and tourist attractions. Specific examples include airline tickets, train tickets, hotel reservations, and tourist attraction tickets.

[0262] Step 10:

[0263] The server works with the payment system to complete the user's payment, using the user's credit card details or electronic payment service to pay for all reservations.

[0264] Step 11:

[0265] Once the server has confirmed all reservations, it generates a final itinerary and sends it to the terminal.

[0266] Step 12:

[0267] The terminal displays or makes available for download the final itinerary to the user, who can review it and request further corrections if necessary.

[0268] Example 2

[0269] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0270] Modern travel planning systems struggle to create optimal itineraries that reflect users' emotions and state of mind. Furthermore, few systems offer a unified approach for all steps, including gathering destination information, generating multiple itineraries, reserving transportation and accommodations, and completing payment procedures. As a result, users must navigate multiple websites and services, complicating and stressing the planning process. Furthermore, there is a lack of plan suggestions that take users' emotional state into account, leaving individual needs unmet.

[0271] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for receiving travel preference information from a user as input; means for structuring the travel preference information and transmitting it to the server; means for analyzing the user's emotional state using the travel preference information received by the server and an emotion engine; means for inputting prompt sentences to a generative AI model based on the analyzed emotional state and travel preference information and collecting travel destination information; means for generating multiple travel plans based on the collected travel destination information and the user's emotional state; means for proposing the multiple generated travel plans to the user; means for the user to select or modify one of the proposed travel plans; means for reserving transportation, accommodations, and tourist attractions based on the selected travel plan; means for paying for the reservation; and means for generating and providing a final itinerary to the user. This allows the user to easily and efficiently plan an optimal travel plan based on their emotional state and preferences.

[0272] "Travel preference information" indicates information about the trip the user is planning, such as the destination, departure date, return date, budget, and special requests (tourist spots, restaurants, activities, etc.).

[0273] "Structuring" refers to organizing and converting information into a specific format (e.g., JSON) to facilitate communication between databases and systems.

[0274] "Server" refers to a computer system for processing, storing, and providing data over a network.

[0275] An "emotion engine" refers to a combination of software or hardware that analyzes a user's facial expressions, tone of voice, text nuances, etc. to identify the user's emotional state.

[0276] A "generative AI model" refers to an artificial intelligence system (e.g., GPT, BERT) that performs natural language analysis and generation based on large amounts of data.

[0277] A "prompt" is an instruction given to a generative AI model to generate specific information.

[0278] "Travel destination information" is a general term for data necessary for a planned trip, such as tourist attractions, transportation options, accommodations, reviews, and traffic congestion forecasts.

[0279] A "travel plan" refers to a plan that includes a user's travel itinerary and activities, created based on desired travel information and travel destination information.

[0280] "Transportation" refers to the means of travel used during a trip (airplane tickets, train tickets, bus schedule information, etc.).

[0281] "Accommodation" refers to hotels and lodgings where you stay during your trip.

[0282] "Tourist destinations" refer to tourist spots and areas that are visited during a trip.

[0283] "Payment" refers to the payment process carried out in exchange for a service or product.

[0284] An "itinerary" is a document or digital file that contains detailed travel plans.

[0285] This invention relates to a travel plan generation system that allows users to easily plan their trips and integrates reservations and payments. In particular, by combining it with an emotion engine, it has the function of proposing optimal travel plans that take into account the user's emotional state. The processing content of the program of this system is explained in detail below.

[0286] First, a user uses a terminal to input desired travel information, including the destination, departure and return dates, budget, and special requests (such as tourist spots, restaurants, and activities). For example, the user might input information such as "I would like to travel to Hokkaido from June 1st to June 3rd, and I like Western-style restaurants."

[0287] Next, the device converts the input travel preference information into a structured format (e.g., JSON) and sends it to the server. At the same time, the device uses an emotion engine to recognize the user's emotional state. Specifically, it performs facial recognition, voice analysis, and text analysis to identify emotional states such as "relaxed."

[0288] Based on the travel preference information received by the server and the analyzed emotional state, a prompt sentence is input to a generative AI model (e.g., GPT, BERT). This prompt sentence includes specific instructions such as, "I would like to travel to Hokkaido from June 1st to June 3rd, I like Western-style restaurants, and I am feeling relaxed right now."

[0289] The server collects travel destination information obtained from the generative AI model. This information includes tourist spot information, transportation information, accommodation information, reviews, and traffic congestion forecast information. For example, it collects information on tourist spots in Sapporo, night view spots in Hakodate, and Asahiyama Zoo, and obtains a list of Western-style restaurants. It also investigates flight information from major airlines and train and bus information within the city to select a mode of transportation.

[0290] Based on the collected information, the server generates a travel plan, selecting spots that match the user's emotional state, as well as the best transportation and accommodation options within the user's budget. For example, a plan could be generated that includes sightseeing in Sapporo on the first day, sightseeing in Hakodate on the second day, and a visit to Asahiyama Zoo on the last day.

[0291] The device will then propose multiple travel plans to the user. The user can review these plans, select the most suitable one, and modify them as needed. For example, they can input modifications such as "I'd like more night view spots on the second day."

[0292] Finally, based on the selected travel plan, the server will cooperate with MaaS and other reservation systems to make reservations for transportation, accommodation, and tourist attractions, including air tickets, train tickets, hotel reservations, and tourist attraction tickets.

[0293] Once the server has completed the user's payment in cooperation with the payment system and all reservation confirmations have been completed, it will generate a final itinerary. The terminal will display this final itinerary to the user and make it available for download. The user can review it and request further corrections if necessary.

[0294] In this way, the present invention allows users to easily and efficiently plan an optimal trip based on their emotional state and desires.

[0295] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0296] Step 1:

[0297] The user inputs desired travel information into the terminal. This includes the destination, departure date, return date, budget, and special requests (e.g., tourist spots, restaurants, activities, etc.). The input information is saved in a dedicated application on the terminal. For example, data such as "I want to travel to Hokkaido from June 1st to June 3rd, and I like Western-style restaurants" is input. Input data: Travel desired information. Output data: Saved travel desired information.

[0298] Step 2:

[0299] The device converts the input travel preference information into a structured format (e.g., JSON). The converted information is saved in the following format, for example: {"destination": "Hokkaido", "departure_date": "2023-06-01", "return_date": "2023-06-03", "budget": "100000", "preferences": "Western-style restaurant"}. Input data: Saved travel preference information. Output data: Structured travel preference information.

[0300] Step 3:

[0301] The terminal sends structured travel preference information to the server. This transmission is carried out using a data communication protocol. The server receives and records the information. Example: Input data: Structured travel preference information. Output data: Travel preference information sent to the server.

[0302] Step 4:

[0303] The device uses an emotion engine to recognize the user's emotional state. This process uses the device's camera and microphone, and utilizes facial recognition software, voice analysis software, and text analysis tools. The device analyzes the user's facial expressions, tone of voice, and the nuances of the input string to identify the emotional state. As a result, the emotional state "relaxed" may be identified, for example. Input data: User's facial expressions, voice, and text. Output data: Identified emotional state.

[0304] Step 5:

[0305] Based on the travel desire information received by the server and the user's emotional state, a prompt sentence is input into the generative AI model. For example, a prompt sentence such as "I would like to travel to Hokkaido from June 1st to June 3rd. I like Western-style restaurants. I am feeling relaxed right now" is generated. Travel destination information is collected using a generative AI model (e.g. GPT, BERT). Input data: Structured travel desire information and identified emotional state. Output data: Generated prompt sentence.

[0306] Step 6:

[0307] The server receives and analyzes information obtained from the generative AI model. This includes tourist destination information, transportation information, accommodation information, reviews, and traffic congestion forecast information. Specifically, it collects information on tourist destinations in Sapporo, night view spots in Hakodate, Asahiyama Zoo, flights of major airlines, train and bus information within the city, and a list of highly rated Western-style restaurants. Input data: prompt text. Output data: travel destination information.

[0308] Step 7:

[0309] Based on the information collected by the server, the optimal travel plan is generated within the user's budget. During this process, the emotional information provided by the emotion engine is taken into consideration and a plan appropriate for the user's emotional state is proposed. For example, a plan may be generated that includes sightseeing in Sapporo city on the first day, sightseeing in Hakodate city on the second day, and a visit to Asahiyama Zoo on the last day. Input data: travel destination information, identified emotional state. Output data: generated travel plan.

[0310] Step 8:

[0311] The server sends multiple travel plans generated by the server to the terminal. Input data: Generated travel plans. Output data: Travel plans sent to the terminal.

[0312] Step 9:

[0313] The terminal displays the travel plan to the user, who then checks it. The user selects the most suitable plan and inputs modifications as necessary. For example, the user may input "I would like more night view spots on the second day." Input data: The submitted travel plan. Output data: User selection and modification information.

[0314] Step 10:

[0315] The terminal sends the user's selections and modifications to the server. Input data: User selections and modifications. Output data: Selections and modifications sent to the server.

[0316] Step 11:

[0317] Based on the finalized travel plan, the server will link with MaaS and other reservation systems to make reservations for transportation, accommodation, and tourist attractions, including air tickets, train tickets, hotel reservations, and tourist attraction tickets. Input data: Selection and modification information sent to the server. Output data: Reservation information.

[0318] Step 12:

[0319] The server works with the payment system to complete the user's payment. After the reservation is confirmed, a final itinerary is generated. Input data: Reservation information. Output data: Final itinerary.

[0320] Step 13:

[0321] The terminal displays the final itinerary to the user and makes it available for download. The user can check it and request any further corrections required. Input data: Final itinerary. Output data: Final itinerary provided to the user.

[0322] (Application example 2)

[0323] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0324] Conventional travel planning systems propose travel plans based on the user's desired information, but because they do not take the user's emotional state into account when generating plans, they are unable to provide a travel plan that best suits the user's current mood. Furthermore, they lack the functionality for immersive travel plan confirmation and selection using virtual reality (VR) technology, making it difficult for users to realistically experience the trip in advance.

[0325] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0326] In this invention, the server includes means for recognizing and analyzing the user's emotional state, means for collecting travel destination information based on travel desire information received by the information processing device, and means for generating multiple travel plans based on the collected travel destination information and the user's emotional state, thereby proposing travel plans that are optimal for the user's current emotional state and enabling the user to confirm and select travel plans using virtual reality technology.

[0327] A "user" is someone who inputs information to plan a trip and receives suggestions from the system.

[0328] "Travel Desired Information" refers to information such as travel destination, budget, departure date, return date, and special requests that the user inputs into the system.

[0329] An "information processing device" is a server or computer system that collects information about travel destinations and generates a travel plan based on travel desire information received from a user.

[0330] "Emotional state" refers to the user's current emotional state and is information that is identified by analyzing facial expressions, voice, text nuances, and the like.

[0331] A "travel plan" is a combination of tourist destinations, transportation, accommodations, and activities generated by the system based on the user's travel preferences and emotional state.

[0332] "Reservation" is the process of securing transportation, accommodation, and tourist attractions based on the travel plan selected by the user.

[0333] "Payment" refers to the process of making payment for the travel plan or reservation selected by the user, using a credit card or electronic payment method.

[0334] An "itinerary" is a document that summarizes the final travel plan and reservation details, and is used by users to confirm the details of their travel plans.

[0335] "Tourist destination information" refers to information about tourist attractions and famous places at travel destinations, and is used as a reference when creating travel plans.

[0336] "Transportation information" is information about travel to a travel destination, and is data about available transportation methods such as airplanes, trains, buses, and taxis.

[0337] "Accommodation Information" means information about hotels and accommodations available at a travel destination, and may include reviews and ratings.

[0338] "Reputation information" refers to reviews and word-of-mouth about tourist spots, transportation options, accommodations, etc. provided by other users, and is used as a reference when creating travel plans.

[0339] "Traffic forecast information" is information predicting congestion and congestion at travel destinations and travel routes, and is data used to optimize travel plans.

[0340] "Virtual reality technology" is a technology that allows users to have an immersive experience in a virtual space, and can be used to check and select travel plans.

[0341] This invention is a system used by users to make travel plans, and its main function is to propose optimal travel plans taking into account the user's emotional state, and to centrally manage reservations and payments based on the travel plans. This system has the function of recognizing and analyzing the user's emotional state, and generating and proposing travel plans based on the collected information.

[0342] The main components are a terminal for inputting travel information, an emotion engine for recognizing emotional states, an information processing device (server) for collecting travel destination information, an interface for displaying travel plans, and a module for making reservations and payments.

[0343] Specifically, it operates as follows.

[0344] First, the user inputs their travel preferences using a device. This information includes the destination, departure and return dates, budget, and special requests. The device then sends the acquired travel preferences to the server in a structured format (e.g., JSON).

[0345] Next, the device recognizes and analyzes the user's emotional state using an emotion engine. This involves analyzing facial expressions, voice tone, text nuances, and other factors to determine the user's current emotional state. The emotion engine uses FaceAPI (Microsoft Azure) and Amazon Rekognition.

[0346] The server inputs the received travel information into a generative AI model to collect information on travel destinations. This information includes tourist destination information, transportation information, accommodation information, reputation information, and traffic prediction information. Generative AI such as the GPT-4 model is used to collect the information.

[0347] The server generates multiple travel plans based on the collected information and the user's emotional state. It determines the optimal combination of sightseeing spots and transportation within the user's budget and adjusts the plan based on the user's emotional state. The generated travel plans are sent to the device, where the user can review and select them in the VR environment.

[0348] The VR interface uses Unity 3D and Oculus Unity SDK, allowing users to check plan details through an immersive experience. After the user selects a plan, the device sends the information back to the server.

[0349] Based on the selected plan, the server will make reservations for transportation, accommodations, and tourist attractions in cooperation with MaaS APIs, etc. After this, payment will be made using Stripe API or Google Pay API, and once all reservations have been confirmed, a final itinerary will be generated and sent to the terminal for provision to the user.

[0350] For example, if a user inputs "I want to travel to France from February 10th to February 15th, and I like visiting museums," and the emotional state is recognized as "excited," the following processing will occur. The server creates a travel plan based on famous museums and tourist spots in Paris, and incorporates the most suitable museum-hopping activity based on reviews and reputation information. The travel plan is visually confirmed by the user through a VR interface, and selections and modifications can be made.

[0351] Example prompt sentence:

[0352] Please suggest the best travel plan based on the following information:

[0353] Destination: France

[0354] Departure date: February 10th

[0355] Return date: February 15th

[0356] Budget: 200,000 yen

[0357] Special request: Visiting museums

[0358] Emotional state: Excited

[0359] The system can provide optimal travel plans that fit the user's current emotional state, improving the user experience.

[0360] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0361] Step 1:

[0362] The user uses a terminal to input travel information, including the destination, departure and return dates, budget, and special requests. The input information is sent to the server in a structured format (e.g., JSON). Once the user has completed the input, the terminal processes the data and converts it into an external format for transmission to the server.

[0363] Step 2:

[0364] The device activates the emotion engine, which recognizes and analyzes the user's emotional state. Facial expressions, voice tone, and text nuances are used as input data. The emotion engine performs analysis using FaceAPI and Amazon Rekognition to identify the user's current emotional state as "relaxed" or "excited," for example. The analysis results are sent to the server.

[0365] Step 3:

[0366] Based on the travel preference information and the user's emotional state received by the server, this information is input into a generative AI model (e.g., GPT-4). The generative AI model collects tourist destination information, transportation information, accommodation information, reputation information, and traffic forecast information. This generative AI model obtains information from internet resources and internal databases and generates the collected results.

[0367] Step 4:

[0368] The server generates a travel plan based on the collected data and the user's emotional state. The generated travel plan includes the optimal combination of sightseeing spots and transportation methods within the budget. It also makes adjustments appropriate for the user's emotional state. The plan generation process involves running an algorithm that reflects the user's requirements and the results of emotion analysis.

[0369] Step 5:

[0370] The server sends the generated travel plans to the device. The device displays the travel plans on a VR interface for the user to review and select. The user selects or modifies the plan using hand gestures or voice input. During this process, the device collects user operation information.

[0371] Step 6:

[0372] The terminal sends the travel plan selected or modified by the user to the server, which then initiates the final reservation process based on the received plan information. The selected travel plan data is used as input.

[0373] Step 7:

[0374] The server uses MaaS APIs and other tools to reserve transportation, accommodations, and tourist attractions based on the selected travel plan. This reservation process uses various APIs to connect with external services and obtain the necessary reservation information. Successful reservation information is saved on the server, and reservation confirmation data is generated.

[0375] Step 8:

[0376] The server processes the payment using the Stripe API or Google Pay API. The payment request includes the user's payment information and reservation information. If the payment is successful, payment confirmation information is generated and saved on the server.

[0377] Step 9:

[0378] Once all reservations and payments are complete, the server generates the final itinerary and sends it to the device, where it can be viewed or downloaded by the user in the VR interface.

[0379] In this way, an optimal travel plan that matches the user's emotional state is provided, and reservations and payments based on this plan are managed in a unified manner.

[0380] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0381] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0382] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0383] [Second embodiment]

[0384] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0385] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0386] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0387] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0388] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0389] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0390] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0391] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0392] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0393] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0394] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0395] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0396] This invention relates to a travel plan creation system that allows users to easily plan their trips and unifies reservations and payments. The user inputs desired travel information using a terminal, and the server uses that information to collect travel destination information and create and propose multiple travel plans. The user then makes reservations for transportation, accommodations, and tourist attractions based on the plan selected or modified, and finally generates an itinerary and completes payment.

[0397] The specific program processing flow is as follows:

[0398] Getting and Sending User Input

[0399] 1. The user inputs desired travel information using a terminal, including information such as destination (e.g., Hokkaido), departure date, return date, budget, and special requests (e.g., tourist spots, restaurants, activities).

[0400] 2. The device sends the acquired travel preference information to the server in a structured format (e.g., JSON).

[0401] Collecting travel destination information

[0402] 3. Based on the travel preference information received by the server, the generative AI model is used to collect the following information:

[0403] Tourist information

[0404] Transportation information

[0405] Accommodation information

[0406] Reviews

[0407] Traffic congestion forecast information

[0408] Generate a travel plan

[0409] 4. Based on the collected information, the server generates an optimal travel plan within the user's budget, including combinations of tourist destinations and transportation options, and selection of highly rated spots.

[0410] Plan proposal and confirmation

[0411] 5. The server sends the generated travel plans to the terminal, which then displays the plans to the user.

[0412] 6. The user reviews the proposed travel plans, selects the most suitable plan, and enters any corrections or additions as necessary.

[0413] Transportation and sightseeing reservations

[0414] 7. The terminal transmits the user's final selected or modified travel plan to the server.

[0415] 8. The server connects with MaaS and makes the following reservation:

[0416] Transportation (plane, train, bus, etc.)

[0417] Accommodation

[0418] Tickets to attractions and events

[0419] Payment and itinerary generation

[0420] 9. The server interacts with the payment system to complete the user's payment.

[0421] 10. Once the server has confirmed all reservations, it generates a final itinerary and sends it to the terminal.

[0422] Specific examples

[0423] For example, if a user enters "I want to travel to Hokkaido from June 1st to June 3rd, and I like Western-style restaurants," the server will do the following:

[0424] We collected information on famous tourist spots in Sapporo, night view spots in Hakodate, and Asahiyama Zoo.

[0425] Get a list of top-rated Western-style restaurants.

[0426] Check flight information for major airlines, as well as train and bus schedules within cities.

[0427] Get information on hotels with high reviews.

[0428] The server then generates a plan based on the collected information, including sightseeing in Sapporo on the first day, sightseeing in Hakodate on the second day, and visiting Asahiyama Zoo on the last day, and selects transportation and accommodation options within the budget.The user then confirms and selects the plan, and after completing the reservation and payment, the server provides the final itinerary.

[0429] This allows users to plan their trip efficiently and without stress.

[0430] The processing flow will be explained below.

[0431] Step 1:

[0432] The user inputs desired travel information using a terminal, including the destination, departure and return dates, budget, and special requests (such as sightseeing spots, restaurants, and activities).

[0433] Step 2:

[0434] The travel preference information acquired by the device is sent to the server in a structured format (e.g., JSON).

[0435] Step 3:

[0436] Based on the travel preference information received by the server, the information is input into the generative AI model to collect information on travel destinations, including tourist destination information, transportation information, accommodation information, reviews, and traffic congestion forecast information.

[0437] Step 4:

[0438] The server generates the optimal travel plan within the user's budget based on the travel destination information obtained from the AI ​​model, including the optimal combination of tourist spots and transportation methods, and the selection of spots with high reviews.

[0439] Step 5:

[0440] The server transmits the generated travel plans to the terminal, which displays them to the user.

[0441] Step 6:

[0442] The user reviews the proposed travel plans and selects the most suitable one. If necessary, the user can modify the plan or enter additional requests.

[0443] Step 7:

[0444] The device sends the user's selections and modifications to the server.

[0445] Step 8:

[0446] Based on the final plan, the server will work with MaaS to make reservations for transportation, accommodation, and tourist attractions, including air tickets, train tickets, hotel reservations, and tourist attraction tickets.

[0447] Step 9:

[0448] The server works with the payment system to complete the payment using the user's credit card information or electronic payment service.

[0449] Step 10:

[0450] Once the server has confirmed all reservations, it generates a final itinerary and sends it to the terminal.

[0451] Step 11:

[0452] The terminal displays or makes available for download the final itinerary to the user, who can review it and request corrections if necessary.

[0453] Example 1

[0454] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0455] Current travel planning systems do not allow users to create comprehensive travel plans effortlessly, and the process from collecting destination information to booking and payment is cumbersome. This requires users to individually check various websites and make reservations, which takes a lot of time and effort. It can also be difficult to find the best plan within a budget, making the process of travel planning itself a burden.

[0456] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0457] In this invention, the server includes a means for receiving desired travel information from a user in a structured format, a means for collecting information on travel destinations using a generative AI model, and a means for generating an optimal travel plan based on the collected information. This allows users to easily create an optimal travel plan within their budget using a unified system, and to efficiently make reservations and payments.

[0458] "User" refers to an individual or organization that uses this system.

[0459] "Travel preference information" refers to a dataset that includes information such as a traveler's desired travel destination, departure date, return date, budget, and any special requests.

[0460] "Terminal" refers to the device a user uses to enter information or view results, including smartphones, computers, tablets, etc.

[0461] "Server" refers to a central computer system that receives data sent from the terminals, processes it, and produces a final result.

[0462] "Structured" refers to data that is neatly organized in a specific format (e.g., JSON, XML, CSV, etc.).

[0463] A "generative AI model" refers to an algorithm that uses artificial intelligence techniques to analyze data and make predictions or classifications.

[0464] "Means of collecting information" refers to the processes and functions that the server uses to obtain the necessary information from various APIs and databases.

[0465] "Means for generating a travel plan" refers to the process or function by which the server designs and creates an optimal travel plan based on the collected information.

[0466] "Transportation" refers to the means of transportation used by a user during a trip, including airplanes, trains, buses, taxis, etc.

[0467] "Accommodation facilities" refers to hotels, inns, guesthouses, etc. where travelers can stay.

[0468] "Tourist destinations" refer to spots and facilities visited during travel, including tourist attractions, theme parks, museums, etc.

[0469] The "payment system" is a system for users to pay for services they have reserved, and it handles credit cards, electronic money, etc.

[0470] "Itinerary" refers to a document that contains detailed travel schedule and reservation information.

[0471] A "centralized system" refers to a system in which different types of information and functions are integrated and can be managed and used consistently by users in one place.

[0472] "RESTful API" refers to a web service interface designed based on four principles, making it easy to exchange data using representative protocols.

[0473] "PDF Generation Library" means a software component that allows programs to create and manipulate documents in PDF format.

[0474] This invention relates to a travel plan creation system that allows users to easily plan their trips and unifies reservations and payments. In this system, users input desired travel information using a terminal, and a server collects travel destination information based on that information and creates and proposes multiple travel plans. The system also makes reservations for transportation, accommodations, and tourist attractions based on the plan selected or modified by the user, and finally generates an itinerary and completes payment.

[0475] Specifically, this system operates as follows.

[0476] The user inputs desired travel information using a device. This includes information such as destination (e.g., Hokkaido), departure date, return date, budget, and special requests (e.g., tourist spots, restaurants, activities). The device sends this input information to the server in a structured format (e.g., JSON). The device communicates with the server using a RESTful API.

[0477] The server uses a generative AI model to collect the necessary information based on the travel preference information it receives. Specifically, it obtains information on tourist destinations, transportation options, accommodations, reviews, and traffic congestion forecasts through various APIs (e.g., Google Places API, accommodation booking site API, and transportation API). The server analyzes the data using AI libraries such as Python to generate the optimal travel plan. In this process, the AI ​​model uses an optimization algorithm to combine tourist destinations and transportation options and select highly rated spots.

[0478] The generated travel plan is sent from the server to the terminal and displayed to the user. The user reviews the proposed plans and selects the most suitable one. They can also enter any corrections or additions to the plan as needed. The terminal then sends the final travel plan back to the server.

[0479] The server, which receives the final plan, works with MaaS to reserve transportation (planes, trains, buses, etc.), accommodations, and tickets to tourist attractions and events. It also completes the user's payment using a payment system (e.g., Stripe or PayPal). Finally, once all reservations have been confirmed, the server generates a final itinerary and sends it to the terminal in PDF format. A library such as PDFKit is used to generate the PDF.

[0480] As a concrete example, if a user inputs, "I would like to travel to Hokkaido from June 1st to June 3rd, my budget is 100,000 yen, and I like Western-style restaurants," the following process will occur: The server collects information on tourist attractions in Sapporo, night view spots in Hakodate, and Asahiyama Zoo, and obtains a list of highly rated Western-style restaurants, flight information for major airlines, train and bus schedules within the city, and information on highly rated hotels. The generative AI model then generates a plan that includes sightseeing in Sapporo on the first day, sightseeing in Hakodate on the second day, and a visit to Asahiyama Zoo on the last day, and selects the optimal transportation and accommodation options. The final itinerary is then provided after the user confirms and selects the plan and completes the reservation and payment.

[0481] Example prompt: "I'd like to travel to Hokkaido from June 1st to June 3rd. My budget is 100,000 yen, and I like Western-style restaurants. What are some recommended travel plans?"

[0482] This system allows users to plan their trips efficiently and stress-free.

[0483] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0484] Step 1:

[0485] The user inputs travel preference information using a terminal. Specifically, the user inputs information such as destination, departure date, return date, budget, and special requests into a form on the terminal. The input information is saved on the terminal in a structured format (e.g., JSON). Input: destination, departure date, return date, budget, special requests. Output: structured travel preference information (JSON format).

[0486] Step 2:

[0487] The device sends the saved travel preference information (JSON format) to the server. The device communicates with the server via RESTful API using the HTTP POST method. Input: Structured travel preference information. Output: Travel preference information sent to the server.

[0488] Step 3:

[0489] The server analyzes the travel preference information it receives. It then uses a generative AI model to collect tourist destination information, transportation information, accommodation information, reviews, and traffic congestion forecast information. Specifically, the server calls various APIs to obtain the necessary information. Input: Travel preference information. Output: Collected travel destination information (tourist destinations, transportation information, accommodation information, reviews, traffic congestion forecast).

[0490] Step 4:

[0491] The server processes the collected travel destination information and generates the optimal travel plan within the budget. A generative AI model is used to find the best combination of tourist destinations and transportation methods. Specifically, the AI ​​algorithm performs data analysis and optimization. Input: Collected travel destination information. Output: Multiple travel plans.

[0492] Step 5:

[0493] The server sends multiple itineraries generated by the server to the terminal, which displays them to the user. The terminal analyzes the received data and displays it in a user-friendly UI. Input: Multiple itineraries. Output: Itineraries displayed to the user.

[0494] Step 6:

[0495] The user reviews the proposed travel plans and selects the most suitable one. They also input any corrections or additions they wish to make, if necessary. This information is sent to the server via the terminal. Input: User's selection or corrections. Output: Final travel plan.

[0496] Step 7:

[0497] The terminal sends the travel plan that the user has finally selected or modified to the server. Input: Final travel plan. Output: Information sent to the server.

[0498] Step 8:

[0499] The server works with MaaS to make reservations for transportation (planes, trains, buses, etc.), accommodations, and tickets to tourist spots and events. Specifically, the server communicates with the APIs of each reservation site to confirm the reservation. Input: Final travel plan. Output: Reservation confirmation information.

[0500] Step 9:

[0501] The server works with the payment system to complete the user's payment. The transaction is carried out using a payment gateway. Input: Reservation confirmation information, payment information. Output: Payment completion notification.

[0502] Step 10:

[0503] Once the server has completed all reservation confirmations, it generates the final itinerary and sends it to the terminal. A PDF generation library is used to generate the itinerary in PDF format. Input: Reservation confirmation information. Output: Final itinerary (PDF format).

[0504] By going through these steps, users can plan their trip efficiently and without stress.

[0505] (Application example 1)

[0506] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0507] Today, users face challenges when planning trips, including the complexity of information and the difficulty of centrally managing a variety of reservation procedures. Collecting information on tourist destinations, transportation options, accommodations, and other information from various sources to create optimal travel plans is a time-consuming process. Furthermore, users must access each reservation system and complete payment procedures separately, which is extremely cumbersome and time-consuming. Furthermore, the guide functions and real-time information updates required during sightseeing require the use of separate applications. There is a need for a system that solves these problems and allows users to easily plan trips and centralize the use of reservations, payments, and guide functions.

[0508] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0509] In this invention, the server includes means for receiving travel preference information from a user as input, means for transmitting the travel preference information to the server for processing, means for collecting travel destination information based on the travel preference information received by the server, means for generating multiple travel plans based on the collected travel destination information, means for proposing the generated multiple travel plans to the user, means for the user to select or modify from the proposed travel plans, means for reserving transportation, accommodation, and tourist attractions based on the selected travel plan, means for making payment for the reservation, means for generating and providing a final itinerary to the user, means for customizing a user profile, means for generating and proposing an optimal travel plan based on the collected information and the generation AI model, means for updating tourist attractions and transportation information in real time, and means for displaying guidance at actual tourist attractions using augmented reality technology. This allows users to easily plan their trip, centrally manage reservation procedures and payments, and further utilize real-time information updates and on-site guide functions.

[0510] "User" means an individual or corporation that utilizes the system to input travel plan information and receive travel plan proposals and reservations.

[0511] "Travel preference information" refers to a series of travel-related information entered by the user, such as destination, departure date, return date, budget, and preferred tourist spots and activities.

[0512] "Server" means a central processing device or system that receives travel preference information, processes and analyzes the information, generates a travel plan, and provides it to the user.

[0513] "Travel destination information" refers to all information necessary for travel planning, such as tourist spots, transportation options, accommodations, reviews, and traffic congestion forecasts.

[0514] A "travel plan" is a specific travel schedule or itinerary created based on collected travel destination information and in accordance with the user's budget and wishes.

[0515] "Reservation" means the process of confirming the use of transportation, accommodation and tourist attractions based on a travel plan.

[0516] "Payment" refers to the process of paying the fees required for a reservation.

[0517] An "itinerary" is a document or display item that shows the finalized travel plan and is provided to the user.

[0518] A "user profile" is personal information that includes a user's preferences, past travel history, and so on.

[0519] A "generative AI model" is an algorithm or system that uses artificial intelligence to generate information based on a user's preferences and create an optimal travel plan.

[0520] "Real-time updates" refers to a function that instantly reflects current conditions and changes, and is particularly applicable to traffic information and tourist information.

[0521] "Augmented reality technology" is a technology that displays digital information overlaid on real-world scenery, and is used for tourist guides, etc.

[0522] To implement this invention, the following system configuration is required. The system is composed of a user's terminal, a server, and an external API in cooperation with each other. The user inputs desired travel information using the terminal, and the server generates a travel plan based on that information and ultimately provides it to the user.

[0523] The travel information entered by the user on their device includes the destination, departure date, return date, budget, preferred tourist spots and activities, etc. The device sends the acquired information to the server in a structured format (e.g., JSON). The server uses a generative AI model to collect tourist spot information, transportation information, accommodation information, reviews, traffic congestion forecast information, etc. from various APIs.

[0524] Based on the information collected by the server, the server generates an optimal travel plan within the user's budget. The server then proposes multiple travel plans to the user, who can then select or modify the most appropriate one. Based on the selected travel plan, the server then connects with MaaS (Mobility as a Service) and performs the necessary reservation procedures. This includes reservations for transportation, accommodation, and tickets to tourist attractions.

[0525] After the reservation is finalized, the server connects with the payment system to complete the user's payment, generates a final itinerary, and provides it to the user. Using augmented reality technology, users can also receive real-time tourist information on-site via smart glasses or smartphones.

[0526] Specifically, the following program is included: If a user inputs "I want to travel to Kyoto from December 25th to December 30th, and I like visiting temples," the program will operate as follows:

[0527] 1. Obtaining user input: The user inputs travel preferences using a terminal.

[0528] 2. Data collection: The server uses an external API to collect information on Kyoto's tourist attractions, transportation options, accommodation, reviews, and traffic congestion forecasts.

[0529] 3. Travel plan generation: The server uses a generative AI model to generate the optimal travel plan within the budget based on the collected information.

[0530] 4. Plan proposal and reservation: The user selects and modifies the proposed plan, and the server then completes the reservation procedure.

[0531] 5. Payment and itinerary generation: The server connects with the payment system to complete the payment, generate the final itinerary, and provide it to the user.

[0532] Examples of prompts:

[0533] "I'd like to travel to Kyoto from December 25th to December 30th. I love visiting temples."

[0534] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0535] Step 1:

[0536] The user uses a terminal to input travel preferences, including destination, departure date, return date, budget, and preferred sightseeing spots and activities, which are then recorded in a structured format by the terminal.

[0537] Input: Destination, departure date, return date, budget, preferred sightseeing spots and activities

[0538] Output: Structured travel preference information (e.g., JSON format)

[0539] Step 2:

[0540] The terminal transmits the acquired travel preference information to the server. The server generates a travel plan based on this information, so it is important that all parameters are transmitted correctly.

[0541] Input: Structured travel wishes

[0542] Output: Data sent to server completed

[0543] Step 3:

[0544] The server collects travel destination information based on the travel preference information received. The server uses APIs to collect tourist destination information, transportation information, accommodation information, reviews, and traffic congestion forecast information. This process involves obtaining data from external databases and third-party services.

[0545] Input: Travel information

[0546] Output: Collected travel destination information (tourist information, transportation information, accommodation information, reviews, traffic congestion forecast information)

[0547] Step 4:

[0548] Based on the information collected by the server, a generative AI model is used to generate the optimal travel plan within the user's budget. The generative AI model analyzes the user's input information and collected information as prompts to create multiple optimized travel plans.

[0549] Input: Collected travel destination information, travel preference information

[0550] Output: Multiple generated itineraries

[0551] Step 5:

[0552] The server sends the generated itineraries to the terminal, which displays them to the user. The user can then review the proposed itineraries and enter any corrections or additions they require.

[0553] Input: Multiple generated itineraries

[0554] Output: Plan presented to user, user's correction requests

[0555] Step 6:

[0556] The terminal sends the user's final selected or revised travel plan to the server, which then makes reservations for transportation, accommodation, and sightseeing spots based on the received plan.

[0557] Input: revised itinerary

[0558] Output: Data sent to server completed, reservation accepted

[0559] Step 7:

[0560] The server works with MaaS to reserve transportation, accommodations, and tickets for tourist spots and events. The collaboration with MaaS here includes a function to communicate with the reservation systems of various transportation and accommodations in real time and secure availability information.

[0561] Input: Final travel plan

[0562] Output: Confirmed reservation information

[0563] Step 8:

[0564] The server then connects to the payment system to complete the user's payment, using credit card information or other payment methods. Once this process is complete, the entire reservation process is finalized.

[0565] Input: reservation confirmation information, user payment information

[0566] Output: Payment completed

[0567] Step 9:

[0568] Once the server has confirmed all reservations, it generates a final itinerary and sends it to the device, which displays it to the user and also provides local guidance using augmented reality technology.

[0569] Input: Payment completion information, reservation confirmation information

[0570] Output: Generate the final itinerary and provide it to the user

[0571] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0572] This invention relates to a travel plan generation system that allows users to easily plan their trips and integrates reservations and payments. In particular, by combining it with an emotion engine, it has the function of proposing optimal travel plans that take into account the user's emotional state. The user inputs desired travel information using a terminal, and the server uses that information to collect travel destination information and generate and propose multiple travel plans. The server then selects and modifies the plan, taking into account the user's emotional state, and makes reservations for transportation, accommodations, and tourist attractions. Finally, the system generates an itinerary and completes payment.

[0573] Program processing flow

[0574] 1. Getting and sending user input

[0575] The user uses the terminal to input travel preferences, including destination, departure and return dates, budget, and special requests (such as sightseeing spots, restaurants, and activities).

[0576] The travel preference information acquired by the device is sent to the server in a structured format (e.g., JSON).

[0577] 2. Emotional state analysis

[0578] The device recognizes and analyzes the user's emotional state using an emotion engine, analyzing facial expressions, voice tone, text nuances, etc. to identify the user's current emotional state (e.g., relaxed, excited, fatigue, etc.).

[0579] 3. Collecting travel destination information

[0580] Based on the travel preference information received by the server, the information is input into the generative AI model to collect information on travel destinations, including tourist destination information, transportation information, accommodation information, reviews, and traffic congestion forecast information.

[0581] 4. Generate a travel plan

[0582] Based on the information collected by the server, the system generates the optimal travel plan within the user's budget. This includes the optimal combination of tourist destinations and transportation methods, and the selection of highly rated spots. Furthermore, the system takes into account the emotional information provided by the emotion engine to propose a plan that suits the user's emotional state.

[0583] 5. Propose and confirm the plan

[0584] The server transmits the generated travel plans to the terminal, which displays them to the user.

[0585] The user reviews the proposed travel plans and selects the most suitable one. If necessary, the user can modify the plan or enter additional requests.

[0586] 6. Final decision and submission

[0587] The device sends the user's selections and modifications to the server.

[0588] 7. Transportation and sightseeing reservations

[0589] Based on the final plan, the server will work with MaaS to make reservations for transportation, accommodation, and tourist attractions, including air tickets, train tickets, hotel reservations, and tourist attraction tickets.

[0590] 8. Payment and itinerary generation

[0591] The server works with the payment system to complete the user's payment.

[0592] Once the server has confirmed all reservations, it generates a final itinerary and sends it to the terminal.

[0593] 9. Providing itinerary

[0594] The terminal displays or makes available for download the final itinerary to the user, who can review it and request corrections if necessary.

[0595] Specific examples

[0596] For example, if a user inputs "I want to travel to Hokkaido from June 1st to June 3rd, I like Western-style restaurants" and the emotional state is recognized as "Relaxed", the server will do the following:

[0597] We will collect information on famous tourist spots in Sapporo, Hokkaido, night view spots in Hakodate, and Asahiyama Zoo.

[0598] Get a list of highly rated Western-style restaurants and choose a tranquil spot that suits your relaxed mood.

[0599] The system investigates flight information for major airlines and train and bus operations within the city, and adjusts transportation methods taking into account traffic congestion forecasts.

[0600] Get information on hotels with great reviews and a relaxing atmosphere.

[0601] The server then generates a plan based on the collected information, including sightseeing in Sapporo on the first day, sightseeing in Hakodate on the second day, and visiting Asahiyama Zoo on the last day, and selects transportation and accommodation options within the budget.The user then confirms and selects the plan, and after completing the reservation and payment, the server provides the final itinerary.

[0602] In this way, the introduction of an emotion engine makes it possible to propose travel plans that are more suited to the user's current emotional state, thereby providing a more personalized travel experience.

[0603] The processing flow will be explained below.

[0604] Step 1:

[0605] The user uses the terminal to enter travel preferences, including destination, departure and return dates, budget, and special preferences (e.g., sightseeing spots, restaurants, activities).

[0606] Step 2:

[0607] The travel preference information acquired by the device is sent to the server in a structured format (e.g., JSON).

[0608] Step 3:

[0609] The device activates an emotion engine to recognize the user's emotional state. The emotion engine analyzes the user's facial expressions, voice tone, text nuances, etc. to identify the user's current emotional state (e.g., relaxed, excited, tired).

[0610] Step 4:

[0611] Based on the travel preference information received by the server and the emotional state from the emotion engine, the information is input into the generative AI model to collect travel destination information, including tourist destination information, transportation information, accommodation information, reviews, and traffic congestion forecast information.

[0612] Step 5:

[0613] Based on the information collected by the server, the system generates an optimal travel plan that fits the user's emotional state and fits within their budget. The plan includes an optimal combination of sightseeing spots, transportation options, and accommodations, as well as the selection of highly rated spots.

[0614] Step 6:

[0615] The server transmits the generated travel plans to the terminal, which displays them to the user.

[0616] Step 7:

[0617] The user reviews the proposed travel plans and selects the most suitable one. If necessary, the user can modify the plan or enter additional requests.

[0618] Step 8:

[0619] The device sends the user's selections and modifications to the server.

[0620] Step 9:

[0621] Based on the final plan, the server works with MaaS to make reservations for transportation, accommodation, and tourist attractions. Specific examples include airline tickets, train tickets, hotel reservations, and tourist attraction tickets.

[0622] Step 10:

[0623] The server works with the payment system to complete the user's payment, using the user's credit card details or electronic payment service to pay for all reservations.

[0624] Step 11:

[0625] Once the server has confirmed all reservations, it generates a final itinerary and sends it to the terminal.

[0626] Step 12:

[0627] The terminal displays or makes available for download the final itinerary to the user, who can review it and request further corrections if necessary.

[0628] Example 2

[0629] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0630] Modern travel planning systems struggle to create optimal itineraries that reflect users' emotions and state of mind. Furthermore, few systems offer a unified approach for all steps, including gathering destination information, generating multiple itineraries, reserving transportation and accommodations, and completing payment procedures. As a result, users must navigate multiple websites and services, complicating and stressing the planning process. Furthermore, there is a lack of plan suggestions that take users' emotional state into account, leaving individual needs unmet.

[0631] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for receiving travel preference information from a user as input; means for structuring the travel preference information and transmitting it to the server; means for analyzing the user's emotional state using the travel preference information received by the server and an emotion engine; means for inputting prompt sentences to a generative AI model based on the analyzed emotional state and travel preference information and collecting travel destination information; means for generating multiple travel plans based on the collected travel destination information and the user's emotional state; means for proposing the multiple generated travel plans to the user; means for the user to select or modify one of the proposed travel plans; means for reserving transportation, accommodations, and tourist attractions based on the selected travel plan; means for paying for the reservation; and means for generating and providing a final itinerary to the user. This allows the user to easily and efficiently plan an optimal travel plan based on their emotional state and preferences.

[0632] "Travel preference information" indicates information about the trip the user is planning, such as the destination, departure date, return date, budget, and special requests (tourist spots, restaurants, activities, etc.).

[0633] "Structuring" refers to organizing and converting information into a specific format (e.g., JSON) to facilitate communication between databases and systems.

[0634] "Server" refers to a computer system for processing, storing, and providing data over a network.

[0635] An "emotion engine" refers to a combination of software or hardware that analyzes a user's facial expressions, tone of voice, text nuances, etc. to identify the user's emotional state.

[0636] A "generative AI model" refers to an artificial intelligence system (e.g., GPT, BERT) that performs natural language analysis and generation based on large amounts of data.

[0637] A "prompt" is an instruction given to a generative AI model to generate specific information.

[0638] "Travel destination information" is a general term for data necessary for a planned trip, such as tourist attractions, transportation options, accommodations, reviews, and traffic congestion forecasts.

[0639] A "travel plan" refers to a plan that includes a user's travel itinerary and activities, created based on desired travel information and travel destination information.

[0640] "Transportation" refers to the means of travel used during a trip (airplane tickets, train tickets, bus schedule information, etc.).

[0641] "Accommodation" refers to hotels and lodgings where you stay during your trip.

[0642] "Tourist destinations" refer to tourist spots and areas that are visited during a trip.

[0643] "Payment" refers to the payment process carried out in exchange for a service or product.

[0644] An "itinerary" is a document or digital file that contains detailed travel plans.

[0645] This invention relates to a travel plan generation system that allows users to easily plan their trips and integrates reservations and payments. In particular, by combining it with an emotion engine, it has the function of proposing optimal travel plans that take into account the user's emotional state. The processing content of the program of this system is explained in detail below.

[0646] First, a user uses a terminal to input desired travel information, including the destination, departure and return dates, budget, and special requests (such as tourist spots, restaurants, and activities). For example, the user might input information such as "I would like to travel to Hokkaido from June 1st to June 3rd, and I like Western-style restaurants."

[0647] Next, the device converts the input travel preference information into a structured format (e.g., JSON) and sends it to the server. At the same time, the device uses an emotion engine to recognize the user's emotional state. Specifically, it performs facial recognition, voice analysis, and text analysis to identify emotional states such as "relaxed."

[0648] Based on the travel preference information received by the server and the analyzed emotional state, a prompt sentence is input to a generative AI model (e.g., GPT, BERT). This prompt sentence includes specific instructions such as, "I would like to travel to Hokkaido from June 1st to June 3rd, I like Western-style restaurants, and I am feeling relaxed right now."

[0649] The server collects travel destination information obtained from the generative AI model. This information includes tourist spot information, transportation information, accommodation information, reviews, and traffic congestion forecast information. For example, it collects information on tourist spots in Sapporo, night view spots in Hakodate, and Asahiyama Zoo, and obtains a list of Western-style restaurants. It also investigates flight information from major airlines and train and bus information within the city to select a mode of transportation.

[0650] Based on the collected information, the server generates a travel plan, selecting spots that match the user's emotional state, as well as the best transportation and accommodation options within the user's budget. For example, a plan could be generated that includes sightseeing in Sapporo on the first day, sightseeing in Hakodate on the second day, and a visit to Asahiyama Zoo on the last day.

[0651] The device will then propose multiple travel plans to the user. The user can review these plans, select the most suitable one, and modify them as needed. For example, they can input modifications such as "I'd like more night view spots on the second day."

[0652] Finally, based on the selected travel plan, the server will cooperate with MaaS and other reservation systems to make reservations for transportation, accommodation, and tourist attractions, including air tickets, train tickets, hotel reservations, and tourist attraction tickets.

[0653] Once the server has completed the user's payment in cooperation with the payment system and all reservation confirmations have been completed, it will generate a final itinerary. The terminal will display this final itinerary to the user and make it available for download. The user can review it and request further corrections if necessary.

[0654] In this way, the present invention allows users to easily and efficiently plan an optimal trip based on their emotional state and desires.

[0655] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0656] Step 1:

[0657] The user inputs desired travel information into the terminal. This includes the destination, departure date, return date, budget, and special requests (e.g., tourist spots, restaurants, activities, etc.). The input information is saved in a dedicated application on the terminal. For example, data such as "I want to travel to Hokkaido from June 1st to June 3rd, and I like Western-style restaurants" is input. Input data: Travel desired information. Output data: Saved travel desired information.

[0658] Step 2:

[0659] The device converts the input travel preference information into a structured format (e.g., JSON). The converted information is saved in the following format, for example: {"destination": "Hokkaido", "departure_date": "2023-06-01", "return_date": "2023-06-03", "budget": "100000", "preferences": "Western-style restaurant"}. Input data: Saved travel preference information. Output data: Structured travel preference information.

[0660] Step 3:

[0661] The terminal sends structured travel preference information to the server. This transmission is carried out using a data communication protocol. The server receives and records the information. Example: Input data: Structured travel preference information. Output data: Travel preference information sent to the server.

[0662] Step 4:

[0663] The device uses an emotion engine to recognize the user's emotional state. This process uses the device's camera and microphone, and utilizes facial recognition software, voice analysis software, and text analysis tools. The device analyzes the user's facial expressions, tone of voice, and the nuances of the input string to identify the emotional state. As a result, the emotional state "relaxed" may be identified, for example. Input data: User's facial expressions, voice, and text. Output data: Identified emotional state.

[0664] Step 5:

[0665] Based on the travel desire information received by the server and the user's emotional state, a prompt sentence is input into the generative AI model. For example, a prompt sentence such as "I would like to travel to Hokkaido from June 1st to June 3rd. I like Western-style restaurants. I am feeling relaxed right now" is generated. Travel destination information is collected using a generative AI model (e.g. GPT, BERT). Input data: Structured travel desire information and identified emotional state. Output data: Generated prompt sentence.

[0666] Step 6:

[0667] The server receives and analyzes information obtained from the generative AI model. This includes tourist destination information, transportation information, accommodation information, reviews, and traffic congestion forecast information. Specifically, it collects information on tourist destinations in Sapporo, night view spots in Hakodate, Asahiyama Zoo, flights of major airlines, train and bus information within the city, and a list of highly rated Western-style restaurants. Input data: prompt text. Output data: travel destination information.

[0668] Step 7:

[0669] Based on the information collected by the server, the optimal travel plan is generated within the user's budget. During this process, the emotional information provided by the emotion engine is taken into consideration and a plan appropriate for the user's emotional state is proposed. For example, a plan may be generated that includes sightseeing in Sapporo city on the first day, sightseeing in Hakodate city on the second day, and a visit to Asahiyama Zoo on the last day. Input data: travel destination information, identified emotional state. Output data: generated travel plan.

[0670] Step 8:

[0671] The server sends multiple travel plans generated by the server to the terminal. Input data: Generated travel plans. Output data: Travel plans sent to the terminal.

[0672] Step 9:

[0673] The terminal displays the travel plan to the user, who then checks it. The user selects the most suitable plan and inputs modifications as necessary. For example, the user may input "I would like more night view spots on the second day." Input data: The submitted travel plan. Output data: User selection and modification information.

[0674] Step 10:

[0675] The terminal sends the user's selections and modifications to the server. Input data: User selections and modifications. Output data: Selections and modifications sent to the server.

[0676] Step 11:

[0677] Based on the finalized travel plan, the server will link with MaaS and other reservation systems to make reservations for transportation, accommodation, and tourist attractions, including air tickets, train tickets, hotel reservations, and tourist attraction tickets. Input data: Selection and modification information sent to the server. Output data: Reservation information.

[0678] Step 12:

[0679] The server works with the payment system to complete the user's payment. After the reservation is confirmed, a final itinerary is generated. Input data: Reservation information. Output data: Final itinerary.

[0680] Step 13:

[0681] The terminal displays the final itinerary to the user and makes it available for download. The user can check it and request any further corrections required. Input data: Final itinerary. Output data: Final itinerary provided to the user.

[0682] (Application example 2)

[0683] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0684] Conventional travel planning systems propose travel plans based on the user's desired information, but because they do not take the user's emotional state into account when generating plans, they are unable to provide a travel plan that best suits the user's current mood. Furthermore, they lack the functionality for immersive travel plan confirmation and selection using virtual reality (VR) technology, making it difficult for users to realistically experience the trip in advance.

[0685] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0686] In this invention, the server includes means for recognizing and analyzing the user's emotional state, means for collecting travel destination information based on travel desire information received by the information processing device, and means for generating multiple travel plans based on the collected travel destination information and the user's emotional state, thereby proposing travel plans that are optimal for the user's current emotional state and enabling the user to confirm and select travel plans using virtual reality technology.

[0687] A "user" is someone who inputs information to plan a trip and receives suggestions from the system.

[0688] "Travel Desired Information" refers to information such as travel destination, budget, departure date, return date, and special requests that the user inputs into the system.

[0689] An "information processing device" is a server or computer system that collects information about travel destinations and generates a travel plan based on travel desire information received from a user.

[0690] "Emotional state" refers to the user's current emotional state and is information that is identified by analyzing facial expressions, voice, text nuances, and the like.

[0691] A "travel plan" is a combination of tourist destinations, transportation, accommodations, and activities generated by the system based on the user's travel preferences and emotional state.

[0692] "Reservation" is the process of securing transportation, accommodation, and tourist attractions based on the travel plan selected by the user.

[0693] "Payment" refers to the process of making payment for the travel plan or reservation selected by the user, using a credit card or electronic payment method.

[0694] An "itinerary" is a document that summarizes the final travel plan and reservation details, and is used by users to confirm the details of their travel plans.

[0695] "Tourist destination information" refers to information about tourist attractions and famous places at travel destinations, and is used as a reference when creating travel plans.

[0696] "Transportation information" is information about travel to a travel destination, and is data about available transportation methods such as airplanes, trains, buses, and taxis.

[0697] "Accommodation Information" means information about hotels and accommodations available at a travel destination, and may include reviews and ratings.

[0698] "Reputation information" refers to reviews and word-of-mouth about tourist spots, transportation options, accommodations, etc. provided by other users, and is used as a reference when creating travel plans.

[0699] "Traffic forecast information" is information predicting congestion and congestion at travel destinations and travel routes, and is data used to optimize travel plans.

[0700] "Virtual reality technology" is a technology that allows users to have an immersive experience in a virtual space, and can be used to check and select travel plans.

[0701] This invention is a system used by users to make travel plans, and its main function is to propose optimal travel plans taking into account the user's emotional state, and to centrally manage reservations and payments based on the travel plans. This system has the function of recognizing and analyzing the user's emotional state, and generating and proposing travel plans based on the collected information.

[0702] The main components are a terminal for inputting travel information, an emotion engine for recognizing emotional states, an information processing device (server) for collecting travel destination information, an interface for displaying travel plans, and a module for making reservations and payments.

[0703] Specifically, it operates as follows.

[0704] First, the user inputs their travel preferences using a device. This information includes the destination, departure and return dates, budget, and special requests. The device then sends the acquired travel preferences to the server in a structured format (e.g., JSON).

[0705] Next, the device recognizes and analyzes the user's emotional state using an emotion engine. This involves analyzing facial expressions, voice tone, text nuances, and other factors to determine the user's current emotional state. The emotion engine uses FaceAPI (Microsoft Azure) and Amazon Rekognition.

[0706] The server inputs the received travel information into a generative AI model to collect information on travel destinations. This information includes tourist destination information, transportation information, accommodation information, reputation information, and traffic prediction information. Generative AI such as the GPT-4 model is used to collect the information.

[0707] The server generates multiple travel plans based on the collected information and the user's emotional state. It determines the optimal combination of sightseeing spots and transportation within the user's budget and adjusts the plan based on the user's emotional state. The generated travel plans are sent to the device, where the user can review and select them in the VR environment.

[0708] The VR interface uses Unity 3D and Oculus Unity SDK, allowing users to check plan details through an immersive experience. After the user selects a plan, the device sends the information back to the server.

[0709] Based on the selected plan, the server will make reservations for transportation, accommodations, and tourist attractions in cooperation with MaaS APIs, etc. After this, payment will be made using Stripe API or Google Pay API, and once all reservations have been confirmed, a final itinerary will be generated and sent to the terminal for provision to the user.

[0710] For example, if a user inputs "I want to travel to France from February 10th to February 15th, and I like visiting museums," and the emotional state is recognized as "excited," the following processing will occur. The server creates a travel plan based on famous museums and tourist spots in Paris, and incorporates the most suitable museum-hopping activity based on reviews and reputation information. The travel plan is visually confirmed by the user through a VR interface, and selections and modifications can be made.

[0711] Example prompt sentence:

[0712] Please suggest the best travel plan based on the following information:

[0713] Destination: France

[0714] Departure date: February 10th

[0715] Return date: February 15th

[0716] Budget: 200,000 yen

[0717] Special request: Visiting museums

[0718] Emotional state: Excited

[0719] The system can provide optimal travel plans that fit the user's current emotional state, improving the user experience.

[0720] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0721] Step 1:

[0722] The user uses a terminal to input travel information, including the destination, departure and return dates, budget, and special requests. The input information is sent to the server in a structured format (e.g., JSON). Once the user has completed the input, the terminal processes the data and converts it into an external format for transmission to the server.

[0723] Step 2:

[0724] The device activates the emotion engine, which recognizes and analyzes the user's emotional state. Facial expressions, voice tone, and text nuances are used as input data. The emotion engine performs analysis using FaceAPI and Amazon Rekognition to identify the user's current emotional state as "relaxed" or "excited," for example. The analysis results are sent to the server.

[0725] Step 3:

[0726] Based on the travel preference information and the user's emotional state received by the server, this information is input into a generative AI model (e.g., GPT-4). The generative AI model collects tourist destination information, transportation information, accommodation information, reputation information, and traffic forecast information. This generative AI model obtains information from internet resources and internal databases and generates the collected results.

[0727] Step 4:

[0728] The server generates a travel plan based on the collected data and the user's emotional state. The generated travel plan includes the optimal combination of sightseeing spots and transportation methods within the budget. It also makes adjustments appropriate for the user's emotional state. The plan generation process involves running an algorithm that reflects the user's requirements and the results of emotion analysis.

[0729] Step 5:

[0730] The server sends the generated travel plans to the device. The device displays the travel plans on a VR interface for the user to review and select. The user selects or modifies the plan using hand gestures or voice input. During this process, the device collects user operation information.

[0731] Step 6:

[0732] The terminal sends the travel plan selected or modified by the user to the server, which then initiates the final reservation process based on the received plan information. The selected travel plan data is used as input.

[0733] Step 7:

[0734] The server uses MaaS APIs and other tools to reserve transportation, accommodations, and tourist attractions based on the selected travel plan. This reservation process uses various APIs to connect with external services and obtain the necessary reservation information. Successful reservation information is saved on the server, and reservation confirmation data is generated.

[0735] Step 8:

[0736] The server processes the payment using the Stripe API or Google Pay API. The payment request includes the user's payment information and reservation information. If the payment is successful, payment confirmation information is generated and saved on the server.

[0737] Step 9:

[0738] Once all reservations and payments are complete, the server generates the final itinerary and sends it to the device, where it can be viewed or downloaded by the user in the VR interface.

[0739] In this way, an optimal travel plan that matches the user's emotional state is provided, and reservations and payments based on this plan are managed in a unified manner.

[0740] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0741] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0742] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0743] [Third embodiment]

[0744] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0745] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0746] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0747] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0748] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0749] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0750] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0751] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0752] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0753] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0754] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0755] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0756] This invention relates to a travel plan creation system that allows users to easily plan their trips and unifies reservations and payments. The user inputs desired travel information using a terminal, and the server uses that information to collect travel destination information and create and propose multiple travel plans. The user then makes reservations for transportation, accommodations, and tourist attractions based on the plan selected or modified, and finally generates an itinerary and completes payment.

[0757] The specific program processing flow is as follows:

[0758] Getting and Sending User Input

[0759] 1. The user inputs desired travel information using a terminal, including information such as destination (e.g., Hokkaido), departure date, return date, budget, and special requests (e.g., tourist spots, restaurants, activities).

[0760] 2. The device sends the acquired travel preference information to the server in a structured format (e.g., JSON).

[0761] Collecting travel destination information

[0762] 3. Based on the travel preference information received by the server, the generative AI model is used to collect the following information:

[0763] Tourist information

[0764] Transportation information

[0765] Accommodation information

[0766] Reviews

[0767] Traffic congestion forecast information

[0768] Generate a travel plan

[0769] 4. Based on the collected information, the server generates an optimal travel plan within the user's budget, including combinations of tourist destinations and transportation options, and selection of highly rated spots.

[0770] Plan proposal and confirmation

[0771] 5. The server sends the generated travel plans to the terminal, which then displays the plans to the user.

[0772] 6. The user reviews the proposed travel plans, selects the most suitable plan, and enters any corrections or additions as necessary.

[0773] Transportation and sightseeing reservations

[0774] 7. The terminal transmits the user's final selected or modified travel plan to the server.

[0775] 8. The server connects with MaaS and makes the following reservation:

[0776] Transportation (plane, train, bus, etc.)

[0777] Accommodation

[0778] Tickets to attractions and events

[0779] Payment and itinerary generation

[0780] 9. The server interacts with the payment system to complete the user's payment.

[0781] 10. Once the server has confirmed all reservations, it generates a final itinerary and sends it to the terminal.

[0782] Specific examples

[0783] For example, if a user enters "I want to travel to Hokkaido from June 1st to June 3rd, and I like Western-style restaurants," the server will do the following:

[0784] We collected information on famous tourist spots in Sapporo, night view spots in Hakodate, and Asahiyama Zoo.

[0785] Get a list of top-rated Western-style restaurants.

[0786] Check flight information for major airlines, as well as train and bus schedules within cities.

[0787] Get information on hotels with high reviews.

[0788] The server then generates a plan based on the collected information, including sightseeing in Sapporo on the first day, sightseeing in Hakodate on the second day, and visiting Asahiyama Zoo on the last day, and selects transportation and accommodation options within the budget.The user then confirms and selects the plan, and after completing the reservation and payment, the server provides the final itinerary.

[0789] This allows users to plan their trip efficiently and without stress.

[0790] The processing flow will be explained below.

[0791] Step 1:

[0792] The user inputs desired travel information using a terminal, including the destination, departure and return dates, budget, and special requests (such as sightseeing spots, restaurants, and activities).

[0793] Step 2:

[0794] The travel preference information acquired by the device is sent to the server in a structured format (e.g., JSON).

[0795] Step 3:

[0796] Based on the travel preference information received by the server, the information is input into the generative AI model to collect information on travel destinations, including tourist destination information, transportation information, accommodation information, reviews, and traffic congestion forecast information.

[0797] Step 4:

[0798] The server generates the optimal travel plan within the user's budget based on the travel destination information obtained from the AI ​​model, including the optimal combination of tourist spots and transportation methods, and the selection of spots with high reviews.

[0799] Step 5:

[0800] The server transmits the generated travel plans to the terminal, which displays them to the user.

[0801] Step 6:

[0802] The user reviews the proposed travel plans and selects the most suitable one. If necessary, the user can modify the plan or enter additional requests.

[0803] Step 7:

[0804] The device sends the user's selections and modifications to the server.

[0805] Step 8:

[0806] Based on the final plan, the server will work with MaaS to make reservations for transportation, accommodation, and tourist attractions, including air tickets, train tickets, hotel reservations, and tourist attraction tickets.

[0807] Step 9:

[0808] The server works with the payment system to complete the payment using the user's credit card information or electronic payment service.

[0809] Step 10:

[0810] Once the server has confirmed all reservations, it generates a final itinerary and sends it to the terminal.

[0811] Step 11:

[0812] The terminal displays or makes available for download the final itinerary to the user, who can review it and request corrections if necessary.

[0813] Example 1

[0814] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0815] Current travel planning systems do not allow users to create comprehensive travel plans effortlessly, and the process from collecting destination information to booking and payment is cumbersome. This requires users to individually check various websites and make reservations, which takes a lot of time and effort. It can also be difficult to find the best plan within a budget, making the process of travel planning itself a burden.

[0816] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0817] In this invention, the server includes a means for receiving desired travel information from a user in a structured format, a means for collecting information on travel destinations using a generative AI model, and a means for generating an optimal travel plan based on the collected information. This allows users to easily create an optimal travel plan within their budget using a unified system, and to efficiently make reservations and payments.

[0818] "User" refers to an individual or organization that uses this system.

[0819] "Travel preference information" refers to a dataset that includes information such as a traveler's desired travel destination, departure date, return date, budget, and any special requests.

[0820] "Terminal" refers to the device a user uses to enter information or view results, including smartphones, computers, tablets, etc.

[0821] "Server" refers to a central computer system that receives data sent from the terminals, processes it, and produces a final result.

[0822] "Structured" refers to data that is neatly organized in a specific format (e.g., JSON, XML, CSV, etc.).

[0823] A "generative AI model" refers to an algorithm that uses artificial intelligence techniques to analyze data and make predictions or classifications.

[0824] "Means of collecting information" refers to the processes and functions that the server uses to obtain the necessary information from various APIs and databases.

[0825] "Means for generating a travel plan" refers to the process or function by which the server designs and creates an optimal travel plan based on the collected information.

[0826] "Transportation" refers to the means of transportation used by a user during a trip, including airplanes, trains, buses, taxis, etc.

[0827] "Accommodation facilities" refers to hotels, inns, guesthouses, etc. where travelers can stay.

[0828] "Tourist destinations" refer to spots and facilities visited during travel, including tourist attractions, theme parks, museums, etc.

[0829] The "payment system" is a system for users to pay for services they have reserved, and it handles credit cards, electronic money, etc.

[0830] "Itinerary" refers to a document that contains detailed travel schedule and reservation information.

[0831] A "centralized system" refers to a system in which different types of information and functions are integrated and can be managed and used consistently by users in one place.

[0832] "RESTful API" refers to a web service interface designed based on four principles, making it easy to exchange data using representative protocols.

[0833] "PDF Generation Library" means a software component that allows programs to create and manipulate documents in PDF format.

[0834] This invention relates to a travel plan creation system that allows users to easily plan their trips and unifies reservations and payments. In this system, users input desired travel information using a terminal, and a server collects travel destination information based on that information and creates and proposes multiple travel plans. The system also makes reservations for transportation, accommodations, and tourist attractions based on the plan selected or modified by the user, and finally generates an itinerary and completes payment.

[0835] Specifically, this system operates as follows.

[0836] The user inputs desired travel information using a device. This includes information such as destination (e.g., Hokkaido), departure date, return date, budget, and special requests (e.g., tourist spots, restaurants, activities). The device sends this input information to the server in a structured format (e.g., JSON). The device communicates with the server using a RESTful API.

[0837] The server uses a generative AI model to collect the necessary information based on the travel preference information it receives. Specifically, it obtains information on tourist destinations, transportation options, accommodations, reviews, and traffic congestion forecasts through various APIs (e.g., Google Places API, accommodation booking site API, and transportation API). The server analyzes the data using AI libraries such as Python to generate the optimal travel plan. In this process, the AI ​​model uses an optimization algorithm to combine tourist destinations and transportation options and select highly rated spots.

[0838] The generated travel plan is sent from the server to the terminal and displayed to the user. The user reviews the proposed plans and selects the most suitable one. They can also enter any corrections or additions to the plan as needed. The terminal then sends the final travel plan back to the server.

[0839] The server, which receives the final plan, works with MaaS to reserve transportation (planes, trains, buses, etc.), accommodations, and tickets to tourist attractions and events. It also completes the user's payment using a payment system (e.g., Stripe or PayPal). Finally, once all reservations have been confirmed, the server generates a final itinerary and sends it to the terminal in PDF format. A library such as PDFKit is used to generate the PDF.

[0840] As a concrete example, if a user inputs, "I would like to travel to Hokkaido from June 1st to June 3rd, my budget is 100,000 yen, and I like Western-style restaurants," the following process will occur: The server collects information on tourist attractions in Sapporo, night view spots in Hakodate, and Asahiyama Zoo, and obtains a list of highly rated Western-style restaurants, flight information for major airlines, train and bus schedules within the city, and information on highly rated hotels. The generative AI model then generates a plan that includes sightseeing in Sapporo on the first day, sightseeing in Hakodate on the second day, and a visit to Asahiyama Zoo on the last day, and selects the optimal transportation and accommodation options. The final itinerary is then provided after the user confirms and selects the plan and completes the reservation and payment.

[0841] Example prompt: "I'd like to travel to Hokkaido from June 1st to June 3rd. My budget is 100,000 yen, and I like Western-style restaurants. What are some recommended travel plans?"

[0842] This system allows users to plan their trips efficiently and stress-free.

[0843] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0844] Step 1:

[0845] The user inputs travel preference information using a terminal. Specifically, the user inputs information such as destination, departure date, return date, budget, and special requests into a form on the terminal. The input information is saved on the terminal in a structured format (e.g., JSON). Input: destination, departure date, return date, budget, special requests. Output: structured travel preference information (JSON format).

[0846] Step 2:

[0847] The device sends the saved travel preference information (JSON format) to the server. The device communicates with the server via RESTful API using the HTTP POST method. Input: Structured travel preference information. Output: Travel preference information sent to the server.

[0848] Step 3:

[0849] The server analyzes the travel preference information it receives. It then uses a generative AI model to collect tourist destination information, transportation information, accommodation information, reviews, and traffic congestion forecast information. Specifically, the server calls various APIs to obtain the necessary information. Input: Travel preference information. Output: Collected travel destination information (tourist destinations, transportation information, accommodation information, reviews, traffic congestion forecast).

[0850] Step 4:

[0851] The server processes the collected travel destination information and generates the optimal travel plan within the budget. A generative AI model is used to find the best combination of tourist destinations and transportation methods. Specifically, the AI ​​algorithm performs data analysis and optimization. Input: Collected travel destination information. Output: Multiple travel plans.

[0852] Step 5:

[0853] The server sends multiple itineraries generated by the server to the terminal, which displays them to the user. The terminal analyzes the received data and displays it in a user-friendly UI. Input: Multiple itineraries. Output: Itineraries displayed to the user.

[0854] Step 6:

[0855] The user reviews the proposed travel plans and selects the most suitable one. They also input any corrections or additions they wish to make, if necessary. This information is sent to the server via the terminal. Input: User's selection or corrections. Output: Final travel plan.

[0856] Step 7:

[0857] The terminal sends the travel plan that the user has finally selected or modified to the server. Input: Final travel plan. Output: Information sent to the server.

[0858] Step 8:

[0859] The server works with MaaS to make reservations for transportation (planes, trains, buses, etc.), accommodations, and tickets to tourist spots and events. Specifically, the server communicates with the APIs of each reservation site to confirm the reservation. Input: Final travel plan. Output: Reservation confirmation information.

[0860] Step 9:

[0861] The server works with the payment system to complete the user's payment. The transaction is carried out using a payment gateway. Input: Reservation confirmation information, payment information. Output: Payment completion notification.

[0862] Step 10:

[0863] Once the server has completed all reservation confirmations, it generates the final itinerary and sends it to the terminal. A PDF generation library is used to generate the itinerary in PDF format. Input: Reservation confirmation information. Output: Final itinerary (PDF format).

[0864] By going through these steps, users can plan their trip efficiently and without stress.

[0865] (Application example 1)

[0866] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0867] Today, users face challenges when planning trips, including the complexity of information and the difficulty of centrally managing a variety of reservation procedures. Collecting information on tourist destinations, transportation options, accommodations, and other information from various sources to create optimal travel plans is a time-consuming process. Furthermore, users must access each reservation system and complete payment procedures separately, which is extremely cumbersome and time-consuming. Furthermore, the guide functions and real-time information updates required during sightseeing require the use of separate applications. There is a need for a system that solves these problems and allows users to easily plan trips and centralize the use of reservations, payments, and guide functions.

[0868] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0869] In this invention, the server includes means for receiving travel preference information from a user as input, means for transmitting the travel preference information to the server for processing, means for collecting travel destination information based on the travel preference information received by the server, means for generating multiple travel plans based on the collected travel destination information, means for proposing the generated multiple travel plans to the user, means for the user to select or modify from the proposed travel plans, means for reserving transportation, accommodation, and tourist attractions based on the selected travel plan, means for making payment for the reservation, means for generating and providing a final itinerary to the user, means for customizing a user profile, means for generating and proposing an optimal travel plan based on the collected information and the generation AI model, means for updating tourist attractions and transportation information in real time, and means for displaying guidance at actual tourist attractions using augmented reality technology. This allows users to easily plan their trip, centrally manage reservation procedures and payments, and further utilize real-time information updates and on-site guide functions.

[0870] "User" means an individual or corporation that utilizes the system to input travel plan information and receive travel plan proposals and reservations.

[0871] "Travel preference information" refers to a series of travel-related information entered by the user, such as destination, departure date, return date, budget, and preferred tourist spots and activities.

[0872] "Server" means a central processing device or system that receives travel preference information, processes and analyzes the information, generates a travel plan, and provides it to the user.

[0873] "Travel destination information" refers to all information necessary for travel planning, such as tourist spots, transportation options, accommodations, reviews, and traffic congestion forecasts.

[0874] A "travel plan" is a specific travel schedule or itinerary created based on collected travel destination information and in accordance with the user's budget and wishes.

[0875] "Reservation" means the process of confirming the use of transportation, accommodation and tourist attractions based on a travel plan.

[0876] "Payment" refers to the process of paying the fees required for a reservation.

[0877] An "itinerary" is a document or display item that shows the finalized travel plan and is provided to the user.

[0878] A "user profile" is personal information that includes a user's preferences, past travel history, and so on.

[0879] A "generative AI model" is an algorithm or system that uses artificial intelligence to generate information based on a user's preferences and create an optimal travel plan.

[0880] "Real-time updates" refers to a function that instantly reflects current conditions and changes, and is particularly applicable to traffic information and tourist information.

[0881] "Augmented reality technology" is a technology that displays digital information overlaid on real-world scenery, and is used for tourist guides, etc.

[0882] To implement this invention, the following system configuration is required. The system is composed of a user's terminal, a server, and an external API in cooperation with each other. The user inputs desired travel information using the terminal, and the server generates a travel plan based on that information and ultimately provides it to the user.

[0883] The travel information entered by the user on their device includes the destination, departure date, return date, budget, preferred tourist spots and activities, etc. The device sends the acquired information to the server in a structured format (e.g., JSON). The server uses a generative AI model to collect tourist spot information, transportation information, accommodation information, reviews, traffic congestion forecast information, etc. from various APIs.

[0884] Based on the information collected by the server, the server generates an optimal travel plan within the user's budget. The server then proposes multiple travel plans to the user, who can then select or modify the most appropriate one. Based on the selected travel plan, the server then connects with MaaS (Mobility as a Service) and performs the necessary reservation procedures. This includes reservations for transportation, accommodation, and tickets to tourist attractions.

[0885] After the reservation is finalized, the server connects with the payment system to complete the user's payment, generates a final itinerary, and provides it to the user. Using augmented reality technology, users can also receive real-time tourist information on-site via smart glasses or smartphones.

[0886] Specifically, the following program is included: If a user inputs "I want to travel to Kyoto from December 25th to December 30th, and I like visiting temples," the program will operate as follows:

[0887] 1. Obtaining user input: The user inputs travel preferences using a terminal.

[0888] 2. Data collection: The server uses an external API to collect information on Kyoto's tourist attractions, transportation options, accommodation, reviews, and traffic congestion forecasts.

[0889] 3. Travel plan generation: The server uses a generative AI model to generate the optimal travel plan within the budget based on the collected information.

[0890] 4. Plan proposal and reservation: The user selects and modifies the proposed plan, and the server then completes the reservation procedure.

[0891] 5. Payment and itinerary generation: The server connects with the payment system to complete the payment, generate the final itinerary, and provide it to the user.

[0892] Examples of prompts:

[0893] "I'd like to travel to Kyoto from December 25th to December 30th. I love visiting temples."

[0894] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0895] Step 1:

[0896] The user uses a terminal to input travel preferences, including destination, departure date, return date, budget, and preferred sightseeing spots and activities, which are then recorded in a structured format by the terminal.

[0897] Input: Destination, departure date, return date, budget, preferred sightseeing spots and activities

[0898] Output: Structured travel preference information (e.g., JSON format)

[0899] Step 2:

[0900] The terminal transmits the acquired travel preference information to the server. The server generates a travel plan based on this information, so it is important that all parameters are transmitted correctly.

[0901] Input: Structured travel wishes

[0902] Output: Data sent to server completed

[0903] Step 3:

[0904] The server collects travel destination information based on the travel preference information received. The server uses APIs to collect tourist destination information, transportation information, accommodation information, reviews, and traffic congestion forecast information. This process involves obtaining data from external databases and third-party services.

[0905] Input: Travel information

[0906] Output: Collected travel destination information (tourist information, transportation information, accommodation information, reviews, traffic congestion forecast information)

[0907] Step 4:

[0908] Based on the information collected by the server, a generative AI model is used to generate the optimal travel plan within the user's budget. The generative AI model analyzes the user's input information and collected information as prompts to create multiple optimized travel plans.

[0909] Input: Collected travel destination information, travel preference information

[0910] Output: Multiple generated itineraries

[0911] Step 5:

[0912] The server sends the generated itineraries to the terminal, which displays them to the user. The user can then review the proposed itineraries and enter any corrections or additions they require.

[0913] Input: Multiple generated itineraries

[0914] Output: Plan presented to user, user's correction requests

[0915] Step 6:

[0916] The terminal sends the user's final selected or revised travel plan to the server, which then makes reservations for transportation, accommodation, and sightseeing spots based on the received plan.

[0917] Input: revised itinerary

[0918] Output: Data sent to server completed, reservation accepted

[0919] Step 7:

[0920] The server works with MaaS to reserve transportation, accommodations, and tickets for tourist spots and events. The collaboration with MaaS here includes a function to communicate with the reservation systems of various transportation and accommodations in real time and secure availability information.

[0921] Input: Final travel plan

[0922] Output: Confirmed reservation information

[0923] Step 8:

[0924] The server then connects to the payment system to complete the user's payment, using credit card information or other payment methods. Once this process is complete, the entire reservation process is finalized.

[0925] Input: reservation confirmation information, user payment information

[0926] Output: Payment completed

[0927] Step 9:

[0928] Once the server has confirmed all reservations, it generates a final itinerary and sends it to the device, which displays it to the user and also provides local guidance using augmented reality technology.

[0929] Input: Payment completion information, reservation confirmation information

[0930] Output: Generate the final itinerary and provide it to the user

[0931] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0932] This invention relates to a travel plan generation system that allows users to easily plan their trips and integrates reservations and payments. In particular, by combining it with an emotion engine, it has the function of proposing optimal travel plans that take into account the user's emotional state. The user inputs desired travel information using a terminal, and the server uses that information to collect travel destination information and generate and propose multiple travel plans. The server then selects and modifies the plan, taking into account the user's emotional state, and makes reservations for transportation, accommodations, and tourist attractions. Finally, the system generates an itinerary and completes payment.

[0933] Program processing flow

[0934] 1. Getting and sending user input

[0935] The user uses the terminal to input travel preferences, including destination, departure and return dates, budget, and special requests (such as sightseeing spots, restaurants, and activities).

[0936] The travel preference information acquired by the device is sent to the server in a structured format (e.g., JSON).

[0937] 2. Emotional state analysis

[0938] The device recognizes and analyzes the user's emotional state using an emotion engine, analyzing facial expressions, voice tone, text nuances, etc. to identify the user's current emotional state (e.g., relaxed, excited, fatigue, etc.).

[0939] 3. Collecting travel destination information

[0940] Based on the travel preference information received by the server, the information is input into the generative AI model to collect information on travel destinations, including tourist destination information, transportation information, accommodation information, reviews, and traffic congestion forecast information.

[0941] 4. Generate a travel plan

[0942] Based on the information collected by the server, the system generates the optimal travel plan within the user's budget. This includes the optimal combination of tourist destinations and transportation methods, and the selection of highly rated spots. Furthermore, the system takes into account the emotional information provided by the emotion engine to propose a plan that suits the user's emotional state.

[0943] 5. Propose and confirm the plan

[0944] The server transmits the generated travel plans to the terminal, which displays them to the user.

[0945] The user reviews the proposed travel plans and selects the most suitable one. If necessary, the user can modify the plan or enter additional requests.

[0946] 6. Final decision and submission

[0947] The device sends the user's selections and modifications to the server.

[0948] 7. Transportation and sightseeing reservations

[0949] Based on the final plan, the server will work with MaaS to make reservations for transportation, accommodation, and tourist attractions, including air tickets, train tickets, hotel reservations, and tourist attraction tickets.

[0950] 8. Payment and itinerary generation

[0951] The server works with the payment system to complete the user's payment.

[0952] Once the server has confirmed all reservations, it generates a final itinerary and sends it to the terminal.

[0953] 9. Providing itinerary

[0954] The terminal displays or makes available for download the final itinerary to the user, who can review it and request corrections if necessary.

[0955] Specific examples

[0956] For example, if a user inputs "I want to travel to Hokkaido from June 1st to June 3rd, I like Western-style restaurants" and the emotional state is recognized as "Relaxed", the server will do the following:

[0957] We will collect information on famous tourist spots in Sapporo, Hokkaido, night view spots in Hakodate, and Asahiyama Zoo.

[0958] Get a list of highly rated Western-style restaurants and choose a tranquil spot that suits your relaxed mood.

[0959] The system investigates flight information for major airlines and train and bus operations within the city, and adjusts transportation methods taking into account traffic congestion forecasts.

[0960] Get information on hotels with great reviews and a relaxing atmosphere.

[0961] The server then generates a plan based on the collected information, including sightseeing in Sapporo on the first day, sightseeing in Hakodate on the second day, and visiting Asahiyama Zoo on the last day, and selects transportation and accommodation options within the budget.The user then confirms and selects the plan, and after completing the reservation and payment, the server provides the final itinerary.

[0962] In this way, the introduction of an emotion engine makes it possible to propose travel plans that are more suited to the user's current emotional state, thereby providing a more personalized travel experience.

[0963] The processing flow will be explained below.

[0964] Step 1:

[0965] The user uses the terminal to enter travel preferences, including destination, departure and return dates, budget, and special preferences (e.g., sightseeing spots, restaurants, activities).

[0966] Step 2:

[0967] The travel preference information acquired by the device is sent to the server in a structured format (e.g., JSON).

[0968] Step 3:

[0969] The device activates an emotion engine to recognize the user's emotional state. The emotion engine analyzes the user's facial expressions, voice tone, text nuances, etc. to identify the user's current emotional state (e.g., relaxed, excited, tired).

[0970] Step 4:

[0971] Based on the travel preference information received by the server and the emotional state from the emotion engine, the information is input into the generative AI model to collect travel destination information, including tourist destination information, transportation information, accommodation information, reviews, and traffic congestion forecast information.

[0972] Step 5:

[0973] Based on the information collected by the server, the system generates an optimal travel plan that fits the user's emotional state and fits within their budget. The plan includes an optimal combination of sightseeing spots, transportation options, and accommodations, as well as the selection of highly rated spots.

[0974] Step 6:

[0975] The server transmits the generated travel plans to the terminal, which displays them to the user.

[0976] Step 7:

[0977] The user reviews the proposed travel plans and selects the most suitable one. If necessary, the user can modify the plan or enter additional requests.

[0978] Step 8:

[0979] The device sends the user's selections and modifications to the server.

[0980] Step 9:

[0981] Based on the final plan, the server works with MaaS to make reservations for transportation, accommodation, and tourist attractions. Specific examples include airline tickets, train tickets, hotel reservations, and tourist attraction tickets.

[0982] Step 10:

[0983] The server works with the payment system to complete the user's payment, using the user's credit card details or electronic payment service to pay for all reservations.

[0984] Step 11:

[0985] Once the server has confirmed all reservations, it generates a final itinerary and sends it to the terminal.

[0986] Step 12:

[0987] The terminal displays or makes available for download the final itinerary to the user, who can review it and request further corrections if necessary.

[0988] Example 2

[0989] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0990] Modern travel planning systems struggle to create optimal itineraries that reflect users' emotions and state of mind. Furthermore, few systems offer a unified approach for all steps, including gathering destination information, generating multiple itineraries, reserving transportation and accommodations, and completing payment procedures. As a result, users must navigate multiple websites and services, complicating and stressing the planning process. Furthermore, there is a lack of plan suggestions that take users' emotional state into account, leaving individual needs unmet.

[0991] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for receiving travel preference information from a user as input; means for structuring the travel preference information and transmitting it to the server; means for analyzing the user's emotional state using the travel preference information received by the server and an emotion engine; means for inputting prompt sentences to a generative AI model based on the analyzed emotional state and travel preference information and collecting travel destination information; means for generating multiple travel plans based on the collected travel destination information and the user's emotional state; means for proposing the multiple generated travel plans to the user; means for the user to select or modify one of the proposed travel plans; means for reserving transportation, accommodations, and tourist attractions based on the selected travel plan; means for paying for the reservation; and means for generating and providing a final itinerary to the user. This allows the user to easily and efficiently plan an optimal travel plan based on their emotional state and preferences.

[0992] "Travel preference information" indicates information about the trip the user is planning, such as the destination, departure date, return date, budget, and special requests (tourist spots, restaurants, activities, etc.).

[0993] "Structuring" refers to organizing and converting information into a specific format (e.g., JSON) to facilitate communication between databases and systems.

[0994] "Server" refers to a computer system for processing, storing, and providing data over a network.

[0995] An "emotion engine" refers to a combination of software or hardware that analyzes a user's facial expressions, tone of voice, text nuances, etc. to identify the user's emotional state.

[0996] A "generative AI model" refers to an artificial intelligence system (e.g., GPT, BERT) that performs natural language analysis and generation based on large amounts of data.

[0997] A "prompt" is an instruction given to a generative AI model to generate specific information.

[0998] "Travel destination information" is a general term for data necessary for a planned trip, such as tourist attractions, transportation options, accommodations, reviews, and traffic congestion forecasts.

[0999] A "travel plan" refers to a plan that includes a user's travel itinerary and activities, created based on desired travel information and travel destination information.

[1000] "Transportation" refers to the means of travel used during a trip (airplane tickets, train tickets, bus schedule information, etc.).

[1001] "Accommodation" refers to hotels and lodgings where you stay during your trip.

[1002] "Tourist destinations" refer to tourist spots and areas that are visited during a trip.

[1003] "Payment" refers to the payment process carried out in exchange for a service or product.

[1004] An "itinerary" is a document or digital file that contains detailed travel plans.

[1005] This invention relates to a travel plan generation system that allows users to easily plan their trips and integrates reservations and payments. In particular, by combining it with an emotion engine, it has the function of proposing optimal travel plans that take into account the user's emotional state. The processing content of the program of this system is explained in detail below.

[1006] First, a user uses a terminal to input desired travel information, including the destination, departure and return dates, budget, and special requests (such as tourist spots, restaurants, and activities). For example, the user might input information such as "I would like to travel to Hokkaido from June 1st to June 3rd, and I like Western-style restaurants."

[1007] Next, the device converts the input travel preference information into a structured format (e.g., JSON) and sends it to the server. At the same time, the device uses an emotion engine to recognize the user's emotional state. Specifically, it performs facial recognition, voice analysis, and text analysis to identify emotional states such as "relaxed."

[1008] Based on the travel preference information received by the server and the analyzed emotional state, a prompt sentence is input to a generative AI model (e.g., GPT, BERT). This prompt sentence includes specific instructions such as, "I would like to travel to Hokkaido from June 1st to June 3rd, I like Western-style restaurants, and I am feeling relaxed right now."

[1009] The server collects travel destination information obtained from the generative AI model. This information includes tourist spot information, transportation information, accommodation information, reviews, and traffic congestion forecast information. For example, it collects information on tourist spots in Sapporo, night view spots in Hakodate, and Asahiyama Zoo, and obtains a list of Western-style restaurants. It also investigates flight information from major airlines and train and bus information within the city to select a mode of transportation.

[1010] Based on the collected information, the server generates a travel plan, selecting spots that match the user's emotional state, as well as the best transportation and accommodation options within the user's budget. For example, a plan could be generated that includes sightseeing in Sapporo on the first day, sightseeing in Hakodate on the second day, and a visit to Asahiyama Zoo on the last day.

[1011] The device will then propose multiple travel plans to the user. The user can review these plans, select the most suitable one, and modify them as needed. For example, they can input modifications such as "I'd like more night view spots on the second day."

[1012] Finally, based on the selected travel plan, the server will cooperate with MaaS and other reservation systems to make reservations for transportation, accommodation, and tourist attractions, including air tickets, train tickets, hotel reservations, and tourist attraction tickets.

[1013] Once the server has completed the user's payment in cooperation with the payment system and all reservation confirmations have been completed, it will generate a final itinerary. The terminal will display this final itinerary to the user and make it available for download. The user can review it and request further corrections if necessary.

[1014] In this way, the present invention allows users to easily and efficiently plan an optimal trip based on their emotional state and desires.

[1015] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1016] Step 1:

[1017] The user inputs desired travel information into the terminal. This includes the destination, departure date, return date, budget, and special requests (e.g., tourist spots, restaurants, activities, etc.). The input information is saved in a dedicated application on the terminal. For example, data such as "I want to travel to Hokkaido from June 1st to June 3rd, and I like Western-style restaurants" is input. Input data: Travel desired information. Output data: Saved travel desired information.

[1018] Step 2:

[1019] The device converts the input travel preference information into a structured format (e.g., JSON). The converted information is saved in the following format, for example: {"destination": "Hokkaido", "departure_date": "2023-06-01", "return_date": "2023-06-03", "budget": "100000", "preferences": "Western-style restaurant"}. Input data: Saved travel preference information. Output data: Structured travel preference information.

[1020] Step 3:

[1021] The terminal sends structured travel preference information to the server. This transmission is carried out using a data communication protocol. The server receives and records the information. Example: Input data: Structured travel preference information. Output data: Travel preference information sent to the server.

[1022] Step 4:

[1023] The device uses an emotion engine to recognize the user's emotional state. This process uses the device's camera and microphone, and utilizes facial recognition software, voice analysis software, and text analysis tools. The device analyzes the user's facial expressions, tone of voice, and the nuances of the input string to identify the emotional state. As a result, the emotional state "relaxed" may be identified, for example. Input data: User's facial expressions, voice, and text. Output data: Identified emotional state.

[1024] Step 5:

[1025] Based on the travel desire information received by the server and the user's emotional state, a prompt sentence is input into the generative AI model. For example, a prompt sentence such as "I would like to travel to Hokkaido from June 1st to June 3rd. I like Western-style restaurants. I am feeling relaxed right now" is generated. Travel destination information is collected using a generative AI model (e.g. GPT, BERT). Input data: Structured travel desire information and identified emotional state. Output data: Generated prompt sentence.

[1026] Step 6:

[1027] The server receives and analyzes information obtained from the generative AI model. This includes tourist destination information, transportation information, accommodation information, reviews, and traffic congestion forecast information. Specifically, it collects information on tourist destinations in Sapporo, night view spots in Hakodate, Asahiyama Zoo, flights of major airlines, train and bus information within the city, and a list of highly rated Western-style restaurants. Input data: prompt text. Output data: travel destination information.

[1028] Step 7:

[1029] Based on the information collected by the server, the optimal travel plan is generated within the user's budget. During this process, the emotional information provided by the emotion engine is taken into consideration and a plan appropriate for the user's emotional state is proposed. For example, a plan may be generated that includes sightseeing in Sapporo city on the first day, sightseeing in Hakodate city on the second day, and a visit to Asahiyama Zoo on the last day. Input data: travel destination information, identified emotional state. Output data: generated travel plan.

[1030] Step 8:

[1031] The server sends multiple travel plans generated by the server to the terminal. Input data: Generated travel plans. Output data: Travel plans sent to the terminal.

[1032] Step 9:

[1033] The terminal displays the travel plan to the user, who then checks it. The user selects the most suitable plan and inputs modifications as necessary. For example, the user may input "I would like more night view spots on the second day." Input data: The submitted travel plan. Output data: User selection and modification information.

[1034] Step 10:

[1035] The terminal sends the user's selections and modifications to the server. Input data: User selections and modifications. Output data: Selections and modifications sent to the server.

[1036] Step 11:

[1037] Based on the finalized travel plan, the server will link with MaaS and other reservation systems to make reservations for transportation, accommodation, and tourist attractions, including air tickets, train tickets, hotel reservations, and tourist attraction tickets. Input data: Selection and modification information sent to the server. Output data: Reservation information.

[1038] Step 12:

[1039] The server works with the payment system to complete the user's payment. After the reservation is confirmed, a final itinerary is generated. Input data: Reservation information. Output data: Final itinerary.

[1040] Step 13:

[1041] The terminal displays the final itinerary to the user and makes it available for download. The user can check it and request any further corrections required. Input data: Final itinerary. Output data: Final itinerary provided to the user.

[1042] (Application example 2)

[1043] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1044] Conventional travel planning systems propose travel plans based on the user's desired information, but because they do not take the user's emotional state into account when generating plans, they are unable to provide a travel plan that best suits the user's current mood. Furthermore, they lack the functionality for immersive travel plan confirmation and selection using virtual reality (VR) technology, making it difficult for users to realistically experience the trip in advance.

[1045] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1046] In this invention, the server includes means for recognizing and analyzing the user's emotional state, means for collecting travel destination information based on travel desire information received by the information processing device, and means for generating multiple travel plans based on the collected travel destination information and the user's emotional state, thereby proposing travel plans that are optimal for the user's current emotional state and enabling the user to confirm and select travel plans using virtual reality technology.

[1047] A "user" is someone who inputs information to plan a trip and receives suggestions from the system.

[1048] "Travel Desired Information" refers to information such as travel destination, budget, departure date, return date, and special requests that the user inputs into the system.

[1049] An "information processing device" is a server or computer system that collects information about travel destinations and generates a travel plan based on travel desire information received from a user.

[1050] "Emotional state" refers to the user's current emotional state and is information that is identified by analyzing facial expressions, voice, text nuances, and the like.

[1051] A "travel plan" is a combination of tourist destinations, transportation, accommodations, and activities generated by the system based on the user's travel preferences and emotional state.

[1052] "Reservation" is the process of securing transportation, accommodation, and tourist attractions based on the travel plan selected by the user.

[1053] "Payment" refers to the process of making payment for the travel plan or reservation selected by the user, using a credit card or electronic payment method.

[1054] An "itinerary" is a document that summarizes the final travel plan and reservation details, and is used by users to confirm the details of their travel plans.

[1055] "Tourist destination information" refers to information about tourist attractions and famous places at travel destinations, and is used as a reference when creating travel plans.

[1056] "Transportation information" is information about travel to a travel destination, and is data about available transportation methods such as airplanes, trains, buses, and taxis.

[1057] "Accommodation Information" means information about hotels and accommodations available at a travel destination, and may include reviews and ratings.

[1058] "Reputation information" refers to reviews and word-of-mouth about tourist spots, transportation options, accommodations, etc. provided by other users, and is used as a reference when creating travel plans.

[1059] "Traffic forecast information" is information predicting congestion and congestion at travel destinations and travel routes, and is data used to optimize travel plans.

[1060] "Virtual reality technology" is a technology that allows users to have an immersive experience in a virtual space, and can be used to check and select travel plans.

[1061] This invention is a system used by users to make travel plans, and its main function is to propose optimal travel plans taking into account the user's emotional state, and to centrally manage reservations and payments based on the travel plans. This system has the function of recognizing and analyzing the user's emotional state, and generating and proposing travel plans based on the collected information.

[1062] The main components are a terminal for inputting travel information, an emotion engine for recognizing emotional states, an information processing device (server) for collecting travel destination information, an interface for displaying travel plans, and a module for making reservations and payments.

[1063] Specifically, it operates as follows.

[1064] First, the user inputs their travel preferences using a device. This information includes the destination, departure and return dates, budget, and special requests. The device then sends the acquired travel preferences to the server in a structured format (e.g., JSON).

[1065] Next, the device recognizes and analyzes the user's emotional state using an emotion engine. This involves analyzing facial expressions, voice tone, text nuances, and other factors to determine the user's current emotional state. The emotion engine uses FaceAPI (Microsoft Azure) and Amazon Rekognition.

[1066] The server inputs the received travel information into a generative AI model to collect information on travel destinations. This information includes tourist destination information, transportation information, accommodation information, reputation information, and traffic prediction information. Generative AI such as the GPT-4 model is used to collect the information.

[1067] The server generates multiple travel plans based on the collected information and the user's emotional state. It determines the optimal combination of sightseeing spots and transportation within the user's budget and adjusts the plan based on the user's emotional state. The generated travel plans are sent to the device, where the user can review and select them in the VR environment.

[1068] The VR interface uses Unity 3D and Oculus Unity SDK, allowing users to check plan details through an immersive experience. After the user selects a plan, the device sends the information back to the server.

[1069] Based on the selected plan, the server will make reservations for transportation, accommodations, and tourist attractions in cooperation with MaaS APIs, etc. After this, payment will be made using Stripe API or Google Pay API, and once all reservations have been confirmed, a final itinerary will be generated and sent to the terminal for provision to the user.

[1070] For example, if a user inputs "I want to travel to France from February 10th to February 15th, and I like visiting museums," and the emotional state is recognized as "excited," the following processing will occur. The server creates a travel plan based on famous museums and tourist spots in Paris, and incorporates the most suitable museum-hopping activity based on reviews and reputation information. The travel plan is visually confirmed by the user through a VR interface, and selections and modifications can be made.

[1071] Example prompt sentence:

[1072] Please suggest the best travel plan based on the following information:

[1073] Destination: France

[1074] Departure date: February 10th

[1075] Return date: February 15th

[1076] Budget: 200,000 yen

[1077] Special request: Visiting museums

[1078] Emotional state: Excited

[1079] The system can provide optimal travel plans that fit the user's current emotional state, improving the user experience.

[1080] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1081] Step 1:

[1082] The user uses a terminal to input travel information, including the destination, departure and return dates, budget, and special requests. The input information is sent to the server in a structured format (e.g., JSON). Once the user has completed the input, the terminal processes the data and converts it into an external format for transmission to the server.

[1083] Step 2:

[1084] The device activates the emotion engine, which recognizes and analyzes the user's emotional state. Facial expressions, voice tone, and text nuances are used as input data. The emotion engine performs analysis using FaceAPI and Amazon Rekognition to identify the user's current emotional state as "relaxed" or "excited," for example. The analysis results are sent to the server.

[1085] Step 3:

[1086] Based on the travel preference information and the user's emotional state received by the server, this information is input into a generative AI model (e.g., GPT-4). The generative AI model collects tourist destination information, transportation information, accommodation information, reputation information, and traffic forecast information. This generative AI model obtains information from internet resources and internal databases and generates the collected results.

[1087] Step 4:

[1088] The server generates a travel plan based on the collected data and the user's emotional state. The generated travel plan includes the optimal combination of sightseeing spots and transportation methods within the budget. It also makes adjustments appropriate for the user's emotional state. The plan generation process involves running an algorithm that reflects the user's requirements and the results of emotion analysis.

[1089] Step 5:

[1090] The server sends the generated travel plans to the device. The device displays the travel plans on a VR interface for the user to review and select. The user selects or modifies the plan using hand gestures or voice input. During this process, the device collects user operation information.

[1091] Step 6:

[1092] The terminal sends the travel plan selected or modified by the user to the server, which then initiates the final reservation process based on the received plan information. The selected travel plan data is used as input.

[1093] Step 7:

[1094] The server uses MaaS APIs and other tools to reserve transportation, accommodations, and tourist attractions based on the selected travel plan. This reservation process uses various APIs to connect with external services and obtain the necessary reservation information. Successful reservation information is saved on the server, and reservation confirmation data is generated.

[1095] Step 8:

[1096] The server processes the payment using the Stripe API or Google Pay API. The payment request includes the user's payment information and reservation information. If the payment is successful, payment confirmation information is generated and saved on the server.

[1097] Step 9:

[1098] Once all reservations and payments are complete, the server generates the final itinerary and sends it to the device, where it can be viewed or downloaded by the user in the VR interface.

[1099] In this way, an optimal travel plan that matches the user's emotional state is provided, and reservations and payments based on this plan are managed in a unified manner.

[1100] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1101] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1102] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1103] [Fourth embodiment]

[1104] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1105] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1106] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1107] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1108] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1109] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1110] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1111] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1112] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1113] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1114] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1115] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1116] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1117] This invention relates to a travel plan creation system that allows users to easily plan their trips and unifies reservations and payments. The user inputs desired travel information using a terminal, and the server uses that information to collect travel destination information and create and propose multiple travel plans. The user then makes reservations for transportation, accommodations, and tourist attractions based on the plan selected or modified, and finally generates an itinerary and completes payment.

[1118] The specific program processing flow is as follows:

[1119] Getting and Sending User Input

[1120] 1. The user inputs desired travel information using a terminal, including information such as destination (e.g., Hokkaido), departure date, return date, budget, and special requests (e.g., tourist spots, restaurants, activities).

[1121] 2. The device sends the acquired travel preference information to the server in a structured format (e.g., JSON).

[1122] Collecting travel destination information

[1123] 3. Based on the travel preference information received by the server, the generative AI model is used to collect the following information:

[1124] Tourist information

[1125] Transportation information

[1126] Accommodation information

[1127] Reviews

[1128] Traffic congestion forecast information

[1129] Generate a travel plan

[1130] 4. Based on the collected information, the server generates an optimal travel plan within the user's budget, including combinations of tourist destinations and transportation options, and selection of highly rated spots.

[1131] Plan proposal and confirmation

[1132] 5. The server sends the generated travel plans to the terminal, which then displays the plans to the user.

[1133] 6. The user reviews the proposed travel plans, selects the most suitable plan, and enters any corrections or additions as necessary.

[1134] Transportation and sightseeing reservations

[1135] 7. The terminal transmits the user's final selected or modified travel plan to the server.

[1136] 8. The server connects with MaaS and makes the following reservation:

[1137] Transportation (plane, train, bus, etc.)

[1138] Accommodation

[1139] Tickets to attractions and events

[1140] Payment and itinerary generation

[1141] 9. The server interacts with the payment system to complete the user's payment.

[1142] 10. Once the server has confirmed all reservations, it generates a final itinerary and sends it to the terminal.

[1143] Specific examples

[1144] For example, if a user enters "I want to travel to Hokkaido from June 1st to June 3rd, and I like Western-style restaurants," the server will do the following:

[1145] We collected information on famous tourist spots in Sapporo, night view spots in Hakodate, and Asahiyama Zoo.

[1146] Get a list of top-rated Western-style restaurants.

[1147] Check flight information for major airlines, as well as train and bus schedules within cities.

[1148] Get information on hotels with high reviews.

[1149] The server then generates a plan based on the collected information, including sightseeing in Sapporo on the first day, sightseeing in Hakodate on the second day, and visiting Asahiyama Zoo on the last day, and selects transportation and accommodation options within the budget.The user then confirms and selects the plan, and after completing the reservation and payment, the server provides the final itinerary.

[1150] This allows users to plan their trip efficiently and without stress.

[1151] The processing flow will be explained below.

[1152] Step 1:

[1153] The user inputs desired travel information using a terminal, including the destination, departure and return dates, budget, and special requests (such as sightseeing spots, restaurants, and activities).

[1154] Step 2:

[1155] The travel preference information acquired by the device is sent to the server in a structured format (e.g., JSON).

[1156] Step 3:

[1157] Based on the travel preference information received by the server, the information is input into the generative AI model to collect information on travel destinations, including tourist destination information, transportation information, accommodation information, reviews, and traffic congestion forecast information.

[1158] Step 4:

[1159] The server generates the optimal travel plan within the user's budget based on the travel destination information obtained from the AI ​​model, including the optimal combination of tourist spots and transportation methods, and the selection of spots with high reviews.

[1160] Step 5:

[1161] The server transmits the generated travel plans to the terminal, which displays them to the user.

[1162] Step 6:

[1163] The user reviews the proposed travel plans and selects the most suitable one. If necessary, the user can modify the plan or enter additional requests.

[1164] Step 7:

[1165] The device sends the user's selections and modifications to the server.

[1166] Step 8:

[1167] Based on the final plan, the server will work with MaaS to make reservations for transportation, accommodation, and tourist attractions, including air tickets, train tickets, hotel reservations, and tourist attraction tickets.

[1168] Step 9:

[1169] The server works with the payment system to complete the payment using the user's credit card information or electronic payment service.

[1170] Step 10:

[1171] Once the server has confirmed all reservations, it generates a final itinerary and sends it to the terminal.

[1172] Step 11:

[1173] The terminal displays or makes available for download the final itinerary to the user, who can review it and request corrections if necessary.

[1174] Example 1

[1175] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1176] Current travel planning systems do not allow users to create comprehensive travel plans effortlessly, and the process from collecting destination information to booking and payment is cumbersome. This requires users to individually check various websites and make reservations, which takes a lot of time and effort. It can also be difficult to find the best plan within a budget, making the process of travel planning itself a burden.

[1177] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1178] In this invention, the server includes a means for receiving desired travel information from a user in a structured format, a means for collecting information on travel destinations using a generative AI model, and a means for generating an optimal travel plan based on the collected information. This allows users to easily create an optimal travel plan within their budget using a unified system, and to efficiently make reservations and payments.

[1179] "User" refers to an individual or organization that uses this system.

[1180] "Travel preference information" refers to a dataset that includes information such as a traveler's desired travel destination, departure date, return date, budget, and any special requests.

[1181] "Terminal" refers to the device a user uses to enter information or view results, including smartphones, computers, tablets, etc.

[1182] "Server" refers to a central computer system that receives data sent from the terminals, processes it, and produces a final result.

[1183] "Structured" refers to data that is neatly organized in a specific format (e.g., JSON, XML, CSV, etc.).

[1184] A "generative AI model" refers to an algorithm that uses artificial intelligence techniques to analyze data and make predictions or classifications.

[1185] "Means of collecting information" refers to the processes and functions that the server uses to obtain the necessary information from various APIs and databases.

[1186] "Means for generating a travel plan" refers to the process or function by which the server designs and creates an optimal travel plan based on the collected information.

[1187] "Transportation" refers to the means of transportation used by a user during a trip, including airplanes, trains, buses, taxis, etc.

[1188] "Accommodation facilities" refers to hotels, inns, guesthouses, etc. where travelers can stay.

[1189] "Tourist destinations" refer to spots and facilities visited during travel, including tourist attractions, theme parks, museums, etc.

[1190] The "payment system" is a system for users to pay for services they have reserved, and it handles credit cards, electronic money, etc.

[1191] "Itinerary" refers to a document that contains detailed travel schedule and reservation information.

[1192] A "centralized system" refers to a system in which different types of information and functions are integrated and can be managed and used consistently by users in one place.

[1193] "RESTful API" refers to a web service interface designed based on four principles, making it easy to exchange data using representative protocols.

[1194] "PDF Generation Library" means a software component that allows programs to create and manipulate documents in PDF format.

[1195] This invention relates to a travel plan creation system that allows users to easily plan their trips and unifies reservations and payments. In this system, users input desired travel information using a terminal, and a server collects travel destination information based on that information and creates and proposes multiple travel plans. The system also makes reservations for transportation, accommodations, and tourist attractions based on the plan selected or modified by the user, and finally generates an itinerary and completes payment.

[1196] Specifically, this system operates as follows.

[1197] The user inputs desired travel information using a device. This includes information such as destination (e.g., Hokkaido), departure date, return date, budget, and special requests (e.g., tourist spots, restaurants, activities). The device sends this input information to the server in a structured format (e.g., JSON). The device communicates with the server using a RESTful API.

[1198] The server uses a generative AI model to collect the necessary information based on the travel preference information it receives. Specifically, it obtains information on tourist destinations, transportation options, accommodations, reviews, and traffic congestion forecasts through various APIs (e.g., Google Places API, accommodation booking site API, and transportation API). The server analyzes the data using AI libraries such as Python to generate the optimal travel plan. In this process, the AI ​​model uses an optimization algorithm to combine tourist destinations and transportation options and select highly rated spots.

[1199] The generated travel plan is sent from the server to the terminal and displayed to the user. The user reviews the proposed plans and selects the most suitable one. They can also enter any corrections or additions to the plan as needed. The terminal then sends the final travel plan back to the server.

[1200] The server, which receives the final plan, works with MaaS to reserve transportation (planes, trains, buses, etc.), accommodations, and tickets to tourist attractions and events. It also completes the user's payment using a payment system (e.g., Stripe or PayPal). Finally, once all reservations have been confirmed, the server generates a final itinerary and sends it to the terminal in PDF format. A library such as PDFKit is used to generate the PDF.

[1201] As a concrete example, if a user inputs, "I would like to travel to Hokkaido from June 1st to June 3rd, my budget is 100,000 yen, and I like Western-style restaurants," the following process will occur: The server collects information on tourist attractions in Sapporo, night view spots in Hakodate, and Asahiyama Zoo, and obtains a list of highly rated Western-style restaurants, flight information for major airlines, train and bus schedules within the city, and information on highly rated hotels. The generative AI model then generates a plan that includes sightseeing in Sapporo on the first day, sightseeing in Hakodate on the second day, and a visit to Asahiyama Zoo on the last day, and selects the optimal transportation and accommodation options. The final itinerary is then provided after the user confirms and selects the plan and completes the reservation and payment.

[1202] Example prompt: "I'd like to travel to Hokkaido from June 1st to June 3rd. My budget is 100,000 yen, and I like Western-style restaurants. What are some recommended travel plans?"

[1203] This system allows users to plan their trips efficiently and stress-free.

[1204] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1205] Step 1:

[1206] The user inputs travel preference information using a terminal. Specifically, the user inputs information such as destination, departure date, return date, budget, and special requests into a form on the terminal. The input information is saved on the terminal in a structured format (e.g., JSON). Input: destination, departure date, return date, budget, special requests. Output: structured travel preference information (JSON format).

[1207] Step 2:

[1208] The device sends the saved travel preference information (JSON format) to the server. The device communicates with the server via RESTful API using the HTTP POST method. Input: Structured travel preference information. Output: Travel preference information sent to the server.

[1209] Step 3:

[1210] The server analyzes the travel preference information it receives. It then uses a generative AI model to collect tourist destination information, transportation information, accommodation information, reviews, and traffic congestion forecast information. Specifically, the server calls various APIs to obtain the necessary information. Input: Travel preference information. Output: Collected travel destination information (tourist destinations, transportation information, accommodation information, reviews, traffic congestion forecast).

[1211] Step 4:

[1212] The server processes the collected travel destination information and generates the optimal travel plan within the budget. A generative AI model is used to find the best combination of tourist destinations and transportation methods. Specifically, the AI ​​algorithm performs data analysis and optimization. Input: Collected travel destination information. Output: Multiple travel plans.

[1213] Step 5:

[1214] The server sends multiple itineraries generated by the server to the terminal, which displays them to the user. The terminal analyzes the received data and displays it in a user-friendly UI. Input: Multiple itineraries. Output: Itineraries displayed to the user.

[1215] Step 6:

[1216] The user reviews the proposed travel plans and selects the most suitable one. They also input any corrections or additions they wish to make, if necessary. This information is sent to the server via the terminal. Input: User's selection or corrections. Output: Final travel plan.

[1217] Step 7:

[1218] The terminal sends the travel plan that the user has finally selected or modified to the server. Input: Final travel plan. Output: Information sent to the server.

[1219] Step 8:

[1220] The server works with MaaS to make reservations for transportation (planes, trains, buses, etc.), accommodations, and tickets to tourist spots and events. Specifically, the server communicates with the APIs of each reservation site to confirm the reservation. Input: Final travel plan. Output: Reservation confirmation information.

[1221] Step 9:

[1222] The server works with the payment system to complete the user's payment. The transaction is carried out using a payment gateway. Input: Reservation confirmation information, payment information. Output: Payment completion notification.

[1223] Step 10:

[1224] Once the server has completed all reservation confirmations, it generates the final itinerary and sends it to the terminal. A PDF generation library is used to generate the itinerary in PDF format. Input: Reservation confirmation information. Output: Final itinerary (PDF format).

[1225] By going through these steps, users can plan their trip efficiently and without stress.

[1226] (Application example 1)

[1227] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1228] Today, users face challenges when planning trips, including the complexity of information and the difficulty of centrally managing a variety of reservation procedures. Collecting information on tourist destinations, transportation options, accommodations, and other information from various sources to create optimal travel plans is a time-consuming process. Furthermore, users must access each reservation system and complete payment procedures separately, which is extremely cumbersome and time-consuming. Furthermore, the guide functions and real-time information updates required during sightseeing require the use of separate applications. There is a need for a system that solves these problems and allows users to easily plan trips and centralize the use of reservations, payments, and guide functions.

[1229] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1230] In this invention, the server includes means for receiving travel preference information from a user as input, means for transmitting the travel preference information to the server for processing, means for collecting travel destination information based on the travel preference information received by the server, means for generating multiple travel plans based on the collected travel destination information, means for proposing the generated multiple travel plans to the user, means for the user to select or modify from the proposed travel plans, means for reserving transportation, accommodation, and tourist attractions based on the selected travel plan, means for making payment for the reservation, means for generating and providing a final itinerary to the user, means for customizing a user profile, means for generating and proposing an optimal travel plan based on the collected information and the generation AI model, means for updating tourist attractions and transportation information in real time, and means for displaying guidance at actual tourist attractions using augmented reality technology. This allows users to easily plan their trip, centrally manage reservation procedures and payments, and further utilize real-time information updates and on-site guide functions.

[1231] "User" means an individual or corporation that utilizes the system to input travel plan information and receive travel plan proposals and reservations.

[1232] "Travel preference information" refers to a series of travel-related information entered by the user, such as destination, departure date, return date, budget, and preferred tourist spots and activities.

[1233] "Server" means a central processing device or system that receives travel preference information, processes and analyzes the information, generates a travel plan, and provides it to the user.

[1234] "Travel destination information" refers to all information necessary for travel planning, such as tourist spots, transportation options, accommodations, reviews, and traffic congestion forecasts.

[1235] A "travel plan" is a specific travel schedule or itinerary created based on collected travel destination information and in accordance with the user's budget and wishes.

[1236] "Reservation" means the process of confirming the use of transportation, accommodation and tourist attractions based on a travel plan.

[1237] "Payment" refers to the process of paying the fees required for a reservation.

[1238] An "itinerary" is a document or display item that shows the finalized travel plan and is provided to the user.

[1239] A "user profile" is personal information that includes a user's preferences, past travel history, and so on.

[1240] A "generative AI model" is an algorithm or system that uses artificial intelligence to generate information based on a user's preferences and create an optimal travel plan.

[1241] "Real-time updates" refers to a function that instantly reflects current conditions and changes, and is particularly applicable to traffic information and tourist information.

[1242] "Augmented reality technology" is a technology that displays digital information overlaid on real-world scenery, and is used for tourist guides, etc.

[1243] To implement this invention, the following system configuration is required. The system is composed of a user's terminal, a server, and an external API in cooperation with each other. The user inputs desired travel information using the terminal, and the server generates a travel plan based on that information and ultimately provides it to the user.

[1244] The travel information entered by the user on their device includes the destination, departure date, return date, budget, preferred tourist spots and activities, etc. The device sends the acquired information to the server in a structured format (e.g., JSON). The server uses a generative AI model to collect tourist spot information, transportation information, accommodation information, reviews, traffic congestion forecast information, etc. from various APIs.

[1245] Based on the information collected by the server, the server generates an optimal travel plan within the user's budget. The server then proposes multiple travel plans to the user, who can then select or modify the most appropriate one. Based on the selected travel plan, the server then connects with MaaS (Mobility as a Service) and performs the necessary reservation procedures. This includes reservations for transportation, accommodation, and tickets to tourist attractions.

[1246] After the reservation is finalized, the server connects with the payment system to complete the user's payment, generates a final itinerary, and provides it to the user. Using augmented reality technology, users can also receive real-time tourist information on-site via smart glasses or smartphones.

[1247] Specifically, the following program is included: If a user inputs "I want to travel to Kyoto from December 25th to December 30th, and I like visiting temples," the program will operate as follows:

[1248] 1. Obtaining user input: The user inputs travel preferences using a terminal.

[1249] 2. Data collection: The server uses an external API to collect information on Kyoto's tourist attractions, transportation options, accommodation, reviews, and traffic congestion forecasts.

[1250] 3. Travel plan generation: The server uses a generative AI model to generate the optimal travel plan within the budget based on the collected information.

[1251] 4. Plan proposal and reservation: The user selects and modifies the proposed plan, and the server then completes the reservation procedure.

[1252] 5. Payment and itinerary generation: The server connects with the payment system to complete the payment, generate the final itinerary, and provide it to the user.

[1253] Examples of prompts:

[1254] "I'd like to travel to Kyoto from December 25th to December 30th. I love visiting temples."

[1255] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1256] Step 1:

[1257] The user uses a terminal to input travel preferences, including destination, departure date, return date, budget, and preferred sightseeing spots and activities, which are then recorded in a structured format by the terminal.

[1258] Input: Destination, departure date, return date, budget, preferred sightseeing spots and activities

[1259] Output: Structured travel preference information (e.g., JSON format)

[1260] Step 2:

[1261] The terminal transmits the acquired travel preference information to the server. The server generates a travel plan based on this information, so it is important that all parameters are transmitted correctly.

[1262] Input: Structured travel wishes

[1263] Output: Data sent to server completed

[1264] Step 3:

[1265] The server collects travel destination information based on the travel preference information received. The server uses APIs to collect tourist destination information, transportation information, accommodation information, reviews, and traffic congestion forecast information. This process involves obtaining data from external databases and third-party services.

[1266] Input: Travel information

[1267] Output: Collected travel destination information (tourist information, transportation information, accommodation information, reviews, traffic congestion forecast information)

[1268] Step 4:

[1269] Based on the information collected by the server, a generative AI model is used to generate the optimal travel plan within the user's budget. The generative AI model analyzes the user's input information and collected information as prompts to create multiple optimized travel plans.

[1270] Input: Collected travel destination information, travel preference information

[1271] Output: Multiple generated itineraries

[1272] Step 5:

[1273] The server sends the generated itineraries to the terminal, which displays them to the user. The user can then review the proposed itineraries and enter any corrections or additions they require.

[1274] Input: Multiple generated itineraries

[1275] Output: Plan presented to user, user's correction requests

[1276] Step 6:

[1277] The terminal sends the user's final selected or revised travel plan to the server, which then makes reservations for transportation, accommodation, and sightseeing spots based on the received plan.

[1278] Input: revised itinerary

[1279] Output: Data sent to server completed, reservation accepted

[1280] Step 7:

[1281] The server works with MaaS to reserve transportation, accommodations, and tickets for tourist spots and events. The collaboration with MaaS here includes a function to communicate with the reservation systems of various transportation and accommodations in real time and secure availability information.

[1282] Input: Final travel plan

[1283] Output: Confirmed reservation information

[1284] Step 8:

[1285] The server then connects to the payment system to complete the user's payment, using credit card information or other payment methods. Once this process is complete, the entire reservation process is finalized.

[1286] Input: reservation confirmation information, user payment information

[1287] Output: Payment completed

[1288] Step 9:

[1289] Once the server has confirmed all reservations, it generates a final itinerary and sends it to the device, which displays it to the user and also provides local guidance using augmented reality technology.

[1290] Input: Payment completion information, reservation confirmation information

[1291] Output: Generate the final itinerary and provide it to the user

[1292] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1293] This invention relates to a travel plan generation system that allows users to easily plan their trips and integrates reservations and payments. In particular, by combining it with an emotion engine, it has the function of proposing optimal travel plans that take into account the user's emotional state. The user inputs desired travel information using a terminal, and the server uses that information to collect travel destination information and generate and propose multiple travel plans. The server then selects and modifies the plan, taking into account the user's emotional state, and makes reservations for transportation, accommodations, and tourist attractions. Finally, the system generates an itinerary and completes payment.

[1294] Program processing flow

[1295] 1. Getting and sending user input

[1296] The user uses the terminal to input travel preferences, including destination, departure and return dates, budget, and special requests (such as sightseeing spots, restaurants, and activities).

[1297] The travel preference information acquired by the device is sent to the server in a structured format (e.g., JSON).

[1298] 2. Emotional state analysis

[1299] The device recognizes and analyzes the user's emotional state using an emotion engine, analyzing facial expressions, voice tone, text nuances, etc. to identify the user's current emotional state (e.g., relaxed, excited, fatigue, etc.).

[1300] 3. Collecting travel destination information

[1301] Based on the travel preference information received by the server, the information is input into the generative AI model to collect information on travel destinations, including tourist destination information, transportation information, accommodation information, reviews, and traffic congestion forecast information.

[1302] 4. Generate a travel plan

[1303] Based on the information collected by the server, the system generates the optimal travel plan within the user's budget. This includes the optimal combination of tourist destinations and transportation methods, and the selection of highly rated spots. Furthermore, the system takes into account the emotional information provided by the emotion engine to propose a plan that suits the user's emotional state.

[1304] 5. Propose and confirm the plan

[1305] The server transmits the generated travel plans to the terminal, which displays them to the user.

[1306] The user reviews the proposed travel plans and selects the most suitable one. If necessary, the user can modify the plan or enter additional requests.

[1307] 6. Final decision and submission

[1308] The device sends the user's selections and modifications to the server.

[1309] 7. Transportation and sightseeing reservations

[1310] Based on the final plan, the server will work with MaaS to make reservations for transportation, accommodation, and tourist attractions, including air tickets, train tickets, hotel reservations, and tourist attraction tickets.

[1311] 8. Payment and itinerary generation

[1312] The server works with the payment system to complete the user's payment.

[1313] Once the server has confirmed all reservations, it generates a final itinerary and sends it to the terminal.

[1314] 9. Providing itinerary

[1315] The terminal displays or makes available for download the final itinerary to the user, who can review it and request corrections if necessary.

[1316] Specific examples

[1317] For example, if a user inputs "I want to travel to Hokkaido from June 1st to June 3rd, I like Western-style restaurants" and the emotional state is recognized as "Relaxed", the server will do the following:

[1318] We will collect information on famous tourist spots in Sapporo, Hokkaido, night view spots in Hakodate, and Asahiyama Zoo.

[1319] Get a list of highly rated Western-style restaurants and choose a tranquil spot that suits your relaxed mood.

[1320] The system investigates flight information for major airlines and train and bus operations within the city, and adjusts transportation methods taking into account traffic congestion forecasts.

[1321] Get information on hotels with great reviews and a relaxing atmosphere.

[1322] The server then generates a plan based on the collected information, including sightseeing in Sapporo on the first day, sightseeing in Hakodate on the second day, and visiting Asahiyama Zoo on the last day, and selects transportation and accommodation options within the budget.The user then confirms and selects the plan, and after completing the reservation and payment, the server provides the final itinerary.

[1323] In this way, the introduction of an emotion engine makes it possible to propose travel plans that are more suited to the user's current emotional state, thereby providing a more personalized travel experience.

[1324] The processing flow will be explained below.

[1325] Step 1:

[1326] The user uses the terminal to enter travel preferences, including destination, departure and return dates, budget, and special preferences (e.g., sightseeing spots, restaurants, activities).

[1327] Step 2:

[1328] The travel preference information acquired by the device is sent to the server in a structured format (e.g., JSON).

[1329] Step 3:

[1330] The device activates an emotion engine to recognize the user's emotional state. The emotion engine analyzes the user's facial expressions, voice tone, text nuances, etc. to identify the user's current emotional state (e.g., relaxed, excited, tired).

[1331] Step 4:

[1332] Based on the travel preference information received by the server and the emotional state from the emotion engine, the information is input into the generative AI model to collect travel destination information, including tourist destination information, transportation information, accommodation information, reviews, and traffic congestion forecast information.

[1333] Step 5:

[1334] Based on the information collected by the server, the system generates an optimal travel plan that fits the user's emotional state and fits within their budget. The plan includes an optimal combination of sightseeing spots, transportation options, and accommodations, as well as the selection of highly rated spots.

[1335] Step 6:

[1336] The server transmits the generated travel plans to the terminal, which displays them to the user.

[1337] Step 7:

[1338] The user reviews the proposed travel plans and selects the most suitable one. If necessary, the user can modify the plan or enter additional requests.

[1339] Step 8:

[1340] The device sends the user's selections and modifications to the server.

[1341] Step 9:

[1342] Based on the final plan, the server works with MaaS to make reservations for transportation, accommodation, and tourist attractions. Specific examples include airline tickets, train tickets, hotel reservations, and tourist attraction tickets.

[1343] Step 10:

[1344] The server works with the payment system to complete the user's payment, using the user's credit card details or electronic payment service to pay for all reservations.

[1345] Step 11:

[1346] Once the server has confirmed all reservations, it generates a final itinerary and sends it to the terminal.

[1347] Step 12:

[1348] The terminal displays or makes available for download the final itinerary to the user, who can review it and request further corrections if necessary.

[1349] Example 2

[1350] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1351] Modern travel planning systems struggle to create optimal itineraries that reflect users' emotions and state of mind. Furthermore, few systems offer a unified approach for all steps, including gathering destination information, generating multiple itineraries, reserving transportation and accommodations, and completing payment procedures. As a result, users must navigate multiple websites and services, complicating and stressing the planning process. Furthermore, there is a lack of plan suggestions that take users' emotional state into account, leaving individual needs unmet.

[1352] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes: means for receiving travel preference information from a user as input; means for structuring the travel preference information and transmitting it to the server; means for analyzing the user's emotional state using the travel preference information received by the server and an emotion engine; means for inputting prompt sentences to a generative AI model based on the analyzed emotional state and travel preference information and collecting travel destination information; means for generating multiple travel plans based on the collected travel destination information and the user's emotional state; means for proposing the multiple generated travel plans to the user; means for the user to select or modify one of the proposed travel plans; means for reserving transportation, accommodations, and tourist attractions based on the selected travel plan; means for paying for the reservation; and means for generating and providing a final itinerary to the user. This allows the user to easily and efficiently plan an optimal travel plan based on their emotional state and preferences.

[1353] "Travel preference information" indicates information about the trip the user is planning, such as the destination, departure date, return date, budget, and special requests (tourist spots, restaurants, activities, etc.).

[1354] "Structuring" refers to organizing and converting information into a specific format (e.g., JSON) to facilitate communication between databases and systems.

[1355] "Server" refers to a computer system for processing, storing, and providing data over a network.

[1356] An "emotion engine" refers to a combination of software or hardware that analyzes a user's facial expressions, tone of voice, text nuances, etc. to identify the user's emotional state.

[1357] A "generative AI model" refers to an artificial intelligence system (e.g., GPT, BERT) that performs natural language analysis and generation based on large amounts of data.

[1358] A "prompt" is an instruction given to a generative AI model to generate specific information.

[1359] "Travel destination information" is a general term for data necessary for a planned trip, such as tourist attractions, transportation options, accommodations, reviews, and traffic congestion forecasts.

[1360] A "travel plan" refers to a plan that includes a user's travel itinerary and activities, created based on desired travel information and travel destination information.

[1361] "Transportation" refers to the means of travel used during a trip (airplane tickets, train tickets, bus schedule information, etc.).

[1362] "Accommodation" refers to hotels and lodgings where you stay during your trip.

[1363] "Tourist destinations" refer to tourist spots and areas that are visited during a trip.

[1364] "Payment" refers to the payment process carried out in exchange for a service or product.

[1365] An "itinerary" is a document or digital file that contains detailed travel plans.

[1366] This invention relates to a travel plan generation system that allows users to easily plan their trips and integrates reservations and payments. In particular, by combining it with an emotion engine, it has the function of proposing optimal travel plans that take into account the user's emotional state. The processing content of the program of this system is explained in detail below.

[1367] First, a user uses a terminal to input desired travel information, including the destination, departure and return dates, budget, and special requests (such as tourist spots, restaurants, and activities). For example, the user might input information such as "I would like to travel to Hokkaido from June 1st to June 3rd, and I like Western-style restaurants."

[1368] Next, the device converts the input travel preference information into a structured format (e.g., JSON) and sends it to the server. At the same time, the device uses an emotion engine to recognize the user's emotional state. Specifically, it performs facial recognition, voice analysis, and text analysis to identify emotional states such as "relaxed."

[1369] Based on the travel preference information received by the server and the analyzed emotional state, a prompt sentence is input to a generative AI model (e.g., GPT, BERT). This prompt sentence includes specific instructions such as, "I would like to travel to Hokkaido from June 1st to June 3rd, I like Western-style restaurants, and I am feeling relaxed right now."

[1370] The server collects travel destination information obtained from the generative AI model. This information includes tourist spot information, transportation information, accommodation information, reviews, and traffic congestion forecast information. For example, it collects information on tourist spots in Sapporo, night view spots in Hakodate, and Asahiyama Zoo, and obtains a list of Western-style restaurants. It also investigates flight information from major airlines and train and bus information within the city to select a mode of transportation.

[1371] Based on the collected information, the server generates a travel plan, selecting spots that match the user's emotional state, as well as the best transportation and accommodation options within the user's budget. For example, a plan could be generated that includes sightseeing in Sapporo on the first day, sightseeing in Hakodate on the second day, and a visit to Asahiyama Zoo on the last day.

[1372] The device will then propose multiple travel plans to the user. The user can review these plans, select the most suitable one, and modify them as needed. For example, they can input modifications such as "I'd like more night view spots on the second day."

[1373] Finally, based on the selected travel plan, the server will cooperate with MaaS and other reservation systems to make reservations for transportation, accommodation, and tourist attractions, including air tickets, train tickets, hotel reservations, and tourist attraction tickets.

[1374] Once the server has completed the user's payment in cooperation with the payment system and all reservation confirmations have been completed, it will generate a final itinerary. The terminal will display this final itinerary to the user and make it available for download. The user can review it and request further corrections if necessary.

[1375] In this way, the present invention allows users to easily and efficiently plan an optimal trip based on their emotional state and desires.

[1376] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1377] Step 1:

[1378] The user inputs desired travel information into the terminal. This includes the destination, departure date, return date, budget, and special requests (e.g., tourist spots, restaurants, activities, etc.). The input information is saved in a dedicated application on the terminal. For example, data such as "I want to travel to Hokkaido from June 1st to June 3rd, and I like Western-style restaurants" is input. Input data: Travel desired information. Output data: Saved travel desired information.

[1379] Step 2:

[1380] The device converts the input travel preference information into a structured format (e.g., JSON). The converted information is saved in the following format, for example: {"destination": "Hokkaido", "departure_date": "2023-06-01", "return_date": "2023-06-03", "budget": "100000", "preferences": "Western-style restaurant"}. Input data: Saved travel preference information. Output data: Structured travel preference information.

[1381] Step 3:

[1382] The terminal sends structured travel preference information to the server. This transmission is carried out using a data communication protocol. The server receives and records the information. Example: Input data: Structured travel preference information. Output data: Travel preference information sent to the server.

[1383] Step 4:

[1384] The device uses an emotion engine to recognize the user's emotional state. This process uses the device's camera and microphone, and utilizes facial recognition software, voice analysis software, and text analysis tools. The device analyzes the user's facial expressions, tone of voice, and the nuances of the input string to identify the emotional state. As a result, the emotional state "relaxed" may be identified, for example. Input data: User's facial expressions, voice, and text. Output data: Identified emotional state.

[1385] Step 5:

[1386] Based on the travel desire information received by the server and the user's emotional state, a prompt sentence is input into the generative AI model. For example, a prompt sentence such as "I would like to travel to Hokkaido from June 1st to June 3rd. I like Western-style restaurants. I am feeling relaxed right now" is generated. Travel destination information is collected using a generative AI model (e.g. GPT, BERT). Input data: Structured travel desire information and identified emotional state. Output data: Generated prompt sentence.

[1387] Step 6:

[1388] The server receives and analyzes information obtained from the generative AI model. This includes tourist destination information, transportation information, accommodation information, reviews, and traffic congestion forecast information. Specifically, it collects information on tourist destinations in Sapporo, night view spots in Hakodate, Asahiyama Zoo, flights of major airlines, train and bus information within the city, and a list of highly rated Western-style restaurants. Input data: prompt text. Output data: travel destination information.

[1389] Step 7:

[1390] Based on the information collected by the server, the optimal travel plan is generated within the user's budget. During this process, the emotional information provided by the emotion engine is taken into consideration and a plan appropriate for the user's emotional state is proposed. For example, a plan may be generated that includes sightseeing in Sapporo city on the first day, sightseeing in Hakodate city on the second day, and a visit to Asahiyama Zoo on the last day. Input data: travel destination information, identified emotional state. Output data: generated travel plan.

[1391] Step 8:

[1392] The server sends multiple travel plans generated by the server to the terminal. Input data: Generated travel plans. Output data: Travel plans sent to the terminal.

[1393] Step 9:

[1394] The terminal displays the travel plan to the user, who then checks it. The user selects the most suitable plan and inputs modifications as necessary. For example, the user may input "I would like more night view spots on the second day." Input data: The submitted travel plan. Output data: User selection and modification information.

[1395] Step 10:

[1396] The terminal sends the user's selections and modifications to the server. Input data: User selections and modifications. Output data: Selections and modifications sent to the server.

[1397] Step 11:

[1398] Based on the finalized travel plan, the server will link with MaaS and other reservation systems to make reservations for transportation, accommodation, and tourist attractions, including air tickets, train tickets, hotel reservations, and tourist attraction tickets. Input data: Selection and modification information sent to the server. Output data: Reservation information.

[1399] Step 12:

[1400] The server works with the payment system to complete the user's payment. After the reservation is confirmed, a final itinerary is generated. Input data: Reservation information. Output data: Final itinerary.

[1401] Step 13:

[1402] The terminal displays the final itinerary to the user and makes it available for download. The user can check it and request any further corrections required. Input data: Final itinerary. Output data: Final itinerary provided to the user.

[1403] (Application example 2)

[1404] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1405] Conventional travel planning systems propose travel plans based on the user's desired information, but because they do not take the user's emotional state into account when generating plans, they are unable to provide a travel plan that best suits the user's current mood. Furthermore, they lack the functionality for immersive travel plan confirmation and selection using virtual reality (VR) technology, making it difficult for users to realistically experience the trip in advance.

[1406] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1407] In this invention, the server includes means for recognizing and analyzing the user's emotional state, means for collecting travel destination information based on travel desire information received by the information processing device, and means for generating multiple travel plans based on the collected travel destination information and the user's emotional state, thereby proposing travel plans that are optimal for the user's current emotional state and enabling the user to confirm and select travel plans using virtual reality technology.

[1408] A "user" is someone who inputs information to plan a trip and receives suggestions from the system.

[1409] "Travel Desired Information" refers to information such as travel destination, budget, departure date, return date, and special requests that the user inputs into the system.

[1410] An "information processing device" is a server or computer system that collects information about travel destinations and generates a travel plan based on travel desire information received from a user.

[1411] "Emotional state" refers to the user's current emotional state and is information that is identified by analyzing facial expressions, voice, text nuances, and the like.

[1412] A "travel plan" is a combination of tourist destinations, transportation, accommodations, and activities generated by the system based on the user's travel preferences and emotional state.

[1413] "Reservation" is the process of securing transportation, accommodation, and tourist attractions based on the travel plan selected by the user.

[1414] "Payment" refers to the process of making payment for the travel plan or reservation selected by the user, using a credit card or electronic payment method.

[1415] An "itinerary" is a document that summarizes the final travel plan and reservation details, and is used by users to confirm the details of their travel plans.

[1416] "Tourist destination information" refers to information about tourist attractions and famous places at travel destinations, and is used as a reference when creating travel plans.

[1417] "Transportation information" is information about travel to a travel destination, and is data about available transportation methods such as airplanes, trains, buses, and taxis.

[1418] "Accommodation Information" means information about hotels and accommodations available at a travel destination, and may include reviews and ratings.

[1419] "Reputation information" refers to reviews and word-of-mouth about tourist spots, transportation options, accommodations, etc. provided by other users, and is used as a reference when creating travel plans.

[1420] "Traffic forecast information" is information predicting congestion and congestion at travel destinations and travel routes, and is data used to optimize travel plans.

[1421] "Virtual reality technology" is a technology that allows users to have an immersive experience in a virtual space, and can be used to check and select travel plans.

[1422] This invention is a system used by users to make travel plans, and its main function is to propose optimal travel plans taking into account the user's emotional state, and to centrally manage reservations and payments based on the travel plans. This system has the function of recognizing and analyzing the user's emotional state, and generating and proposing travel plans based on the collected information.

[1423] The main components are a terminal for inputting travel information, an emotion engine for recognizing emotional states, an information processing device (server) for collecting travel destination information, an interface for displaying travel plans, and a module for making reservations and payments.

[1424] Specifically, it operates as follows.

[1425] First, the user inputs their travel preferences using a device. This information includes the destination, departure and return dates, budget, and special requests. The device then sends the acquired travel preferences to the server in a structured format (e.g., JSON).

[1426] Next, the device recognizes and analyzes the user's emotional state using an emotion engine. This involves analyzing facial expressions, voice tone, text nuances, and other factors to determine the user's current emotional state. The emotion engine uses FaceAPI (Microsoft Azure) and Amazon Rekognition.

[1427] The server inputs the received travel information into a generative AI model to collect information on travel destinations. This information includes tourist destination information, transportation information, accommodation information, reputation information, and traffic prediction information. Generative AI such as the GPT-4 model is used to collect the information.

[1428] The server generates multiple travel plans based on the collected information and the user's emotional state. It determines the optimal combination of sightseeing spots and transportation within the user's budget and adjusts the plan based on the user's emotional state. The generated travel plans are sent to the device, where the user can review and select them in the VR environment.

[1429] The VR interface uses Unity 3D and Oculus Unity SDK, allowing users to check plan details through an immersive experience. After the user selects a plan, the device sends the information back to the server.

[1430] Based on the selected plan, the server will make reservations for transportation, accommodations, and tourist attractions in cooperation with MaaS APIs, etc. After this, payment will be made using Stripe API or Google Pay API, and once all reservations have been confirmed, a final itinerary will be generated and sent to the terminal for provision to the user.

[1431] For example, if a user inputs "I want to travel to France from February 10th to February 15th, and I like visiting museums," and the emotional state is recognized as "excited," the following processing will occur. The server creates a travel plan based on famous museums and tourist spots in Paris, and incorporates the most suitable museum-hopping activity based on reviews and reputation information. The travel plan is visually confirmed by the user through a VR interface, and selections and modifications can be made.

[1432] Example prompt sentence:

[1433] Please suggest the best travel plan based on the following information:

[1434] Destination: France

[1435] Departure date: February 10th

[1436] Return date: February 15th

[1437] Budget: 200,000 yen

[1438] Special request: Visiting museums

[1439] Emotional state: Excited

[1440] The system can provide optimal travel plans that fit the user's current emotional state, improving the user experience.

[1441] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1442] Step 1:

[1443] The user uses a terminal to input travel information, including the destination, departure and return dates, budget, and special requests. The input information is sent to the server in a structured format (e.g., JSON). Once the user has completed the input, the terminal processes the data and converts it into an external format for transmission to the server.

[1444] Step 2:

[1445] The device activates the emotion engine, which recognizes and analyzes the user's emotional state. Facial expressions, voice tone, and text nuances are used as input data. The emotion engine performs analysis using FaceAPI and Amazon Rekognition to identify the user's current emotional state as "relaxed" or "excited," for example. The analysis results are sent to the server.

[1446] Step 3:

[1447] Based on the travel preference information and the user's emotional state received by the server, this information is input into a generative AI model (e.g., GPT-4). The generative AI model collects tourist destination information, transportation information, accommodation information, reputation information, and traffic forecast information. This generative AI model obtains information from internet resources and internal databases and generates the collected results.

[1448] Step 4:

[1449] The server generates a travel plan based on the collected data and the user's emotional state. The generated travel plan includes the optimal combination of sightseeing spots and transportation methods within the budget. It also makes adjustments appropriate for the user's emotional state. The plan generation process involves running an algorithm that reflects the user's requirements and the results of emotion analysis.

[1450] Step 5:

[1451] The server sends the generated travel plans to the device. The device displays the travel plans on a VR interface for the user to review and select. The user selects or modifies the plan using hand gestures or voice input. During this process, the device collects user operation information.

[1452] Step 6:

[1453] The terminal sends the travel plan selected or modified by the user to the server, which then initiates the final reservation process based on the received plan information. The selected travel plan data is used as input.

[1454] Step 7:

[1455] The server uses MaaS APIs and other tools to reserve transportation, accommodations, and tourist attractions based on the selected travel plan. This reservation process uses various APIs to connect with external services and obtain the necessary reservation information. Successful reservation information is saved on the server, and reservation confirmation data is generated.

[1456] Step 8:

[1457] The server processes the payment using the Stripe API or Google Pay API. The payment request includes the user's payment information and reservation information. If the payment is successful, payment confirmation information is generated and saved on the server.

[1458] Step 9:

[1459] Once all reservations and payments are complete, the server generates the final itinerary and sends it to the device, where it can be viewed or downloaded by the user in the VR interface.

[1460] In this way, an optimal travel plan that matches the user's emotional state is provided, and reservations and payments based on this plan are managed in a unified manner.

[1461] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1462] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1463] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1464] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1465] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1466] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1467] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1468] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1469] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1470] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1471] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1472] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1473] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1474] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1475] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1476] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1477] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1478] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1479] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1480] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1481] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1482] The following is further disclosed regarding the above embodiment.

[1483] (Claim 1)

[1484] means for receiving travel preference information from a user as input;

[1485] means for transmitting the travel preference information to a server for processing;

[1486] a means for collecting information on travel destinations based on the travel desire information received by the server;

[1487] A means for generating a plurality of travel plans based on the collected travel destination information;

[1488] means for proposing the generated plurality of travel plans to a user;

[1489] means for the user to select or modify the proposed itinerary;

[1490] A means to make reservations for transportation, accommodation and sightseeing spots based on the selected travel plan;

[1491] a means of making payment for the reservation;

[1492] The system includes a means for generating and providing a final itinerary to the user.

[1493] (Claim 2)

[1494] 2. The system according to claim 1, wherein the collected travel destination information includes tourist spot information, transportation information, accommodation information, word-of-mouth information, and traffic congestion forecast information.

[1495] (Claim 3)

[1496] 2. The system according to claim 1, wherein the travel plan generated by the server determines and generates the optimal combination of tourist destinations and means of transportation within a budget.

[1497] "Example 1"

[1498] (Claim 1)

[1499] means for receiving travel preference information from a user as input;

[1500] means for transmitting the travel preference information to a server in a structured format;

[1501] A means for collecting travel destination information using a generative AI model based on the travel desire information received by the server;

[1502] A means for generating a plurality of travel plans based on the collected travel destination information;

[1503] means for proposing the generated plurality of travel plans to a user;

[1504] means for the user to select or modify the proposed itinerary;

[1505] A means of booking transportation, accommodation and attractions based on the selected or revised travel plans;

[1506] a means of making payment for the reservation;

[1507] The system includes a means for generating and providing a final itinerary to the user.

[1508] (Claim 2)

[1509] The system according to claim 1, characterized in that the collected travel destination information includes tourist spot information, transportation method information, accommodation information, rating information, and congestion forecast information.

[1510] (Claim 3)

[1511] 2. The system according to claim 1, wherein the travel plan generated by the server determines and generates the optimal combination of tourist destinations and means of transportation within a budget.

[1512] "Application Example 1"

[1513] (Claim 1)

[1514] means for receiving travel preference information from a user as input;

[1515] means for transmitting the travel preference information to a server for processing;

[1516] a means for collecting information on travel destinations based on the travel desire information received by the server;

[1517] A means for generating a plurality of travel plans based on the collected travel destination information;

[1518] means for proposing the generated plurality of travel plans to a user;

[1519] means for the user to select or modify the proposed itinerary;

[1520] A means to make reservations for transportation, accommodation and sightseeing spots based on the selected travel plan;

[1521] a means of making payment for the reservation;

[1522] means for generating and providing a final itinerary to the user;

[1523] a means for customizing your user profile;

[1524] A means to generate and propose optimal travel plans based on collected information and generative AI models;

[1525] A means of updating tourist destinations and transportation information in real time,

[1526] A means of displaying guidance at actual tourist spots using augmented reality technology;

[1527] A system including:

[1528] (Claim 2)

[1529] 2. The system according to claim 1, wherein the collected travel destination information includes tourist spot information, transportation information, accommodation information, word-of-mouth information, traffic congestion forecast information, and real-time update information.

[1530] (Claim 3)

[1531] 2. The system according to claim 1, wherein the travel plan generated by the server determines and generates the optimal combination of tourist destinations and means of transportation within a budget.

[1532] "Example 2: Combining Emotion Engines"

[1533] (Claim 1)

[1534] means for receiving travel preference information from a user as input;

[1535] means for structuring the travel desire information and transmitting it to a server;

[1536] A means for analyzing the user's emotional state using the travel desire information and the emotion engine received by the server;

[1537] A means for inputting prompt sentences into a generative AI model based on the analyzed emotional state and travel desire information to collect travel destination information;

[1538] means for generating a plurality of travel plans based on the collected travel destination information and the user's emotional state;

[1539] means for proposing the generated plurality of travel plans to a user;

[1540] means for the user to select or modify the proposed itinerary;

[1541] A means to make reservations for transportation, accommodation and sightseeing spots based on the selected travel plan;

[1542] a means of making payment for the reservation;

[1543] The system includes a means for generating and providing a final itinerary to the user.

[1544] (Claim 2)

[1545] 2. The system according to claim 1, wherein the collected travel destination information includes tourist spot information, transportation information, accommodation information, word-of-mouth information, and traffic congestion forecast information.

[1546] (Claim 3)

[1547] 2. The system according to claim 1, wherein the travel plan generated by the server determines and generates the optimal combination of tourist destinations and means of transportation within a budget.

[1548] "Application example 2 when combining emotion engines"

[1549] (Claim 1)

[1550] means for receiving travel preference information from a user as input;

[1551] means for transmitting the travel preference information to an information processing device for processing;

[1552] means for collecting information on travel destinations based on the travel desire information received by the information processing device;

[1553] means for recognizing and analyzing the emotional state of a user;

[1554] A means for generating a plurality of travel plans based on the collected travel destination information and the user's emotional state;

[1555] means for proposing the generated plurality of travel plans to a user;

[1556] means for the user to select or modify the proposed itinerary;

[1557] A means to make reservations for transportation, accommodation and sightseeing spots based on the selected travel plan;

[1558] a means of making payment for the reservation;

[1559] The system includes a means for generating and providing a final itinerary to the user.

[1560] (Claim 2)

[1561] 2. The system according to claim 1, wherein the collected travel destination information includes tourist spot information, transportation information, accommodation information, reputation information, and traffic forecast information.

[1562] (Claim 3)

[1563] 2. The system according to claim 1, wherein the travel plan generated by the information processing device determines and generates an optimal combination of tourist destinations and transportation means within a budget. [Explanation of symbols]

[1564] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. means for receiving travel preference information from a user as input; means for transmitting the travel preference information to a server for processing; a means for collecting information on travel destinations based on the travel desire information received by the server; A means for generating a plurality of travel plans based on the collected travel destination information; means for proposing the generated plurality of travel plans to a user; means for the user to select or modify the proposed itinerary; A means to make reservations for transportation, accommodation and sightseeing spots based on the selected travel plan; a means of making payment for the reservation; The system includes a means for generating and providing a final itinerary to the user.

2. 2. The system according to claim 1, wherein the collected travel destination information includes tourist spot information, transportation information, accommodation information, word-of-mouth information, and traffic congestion forecast information.

3. 2. The system according to claim 1, wherein the travel plan generated by the server determines and generates the optimal combination of tourist destinations and means of transportation within a budget.

Images