System

Abstract

A system is provided.SOLUTION: A system comprising: interface means for inputting a desire of a traveler; means for acquiring information of transportation facilities, accommodation facilities, and tourist sites based on the input desire; means for generating a travel plan based on the acquired information; means for displaying the generated travel plan to the traveler; means for allowing the traveler to modify the displayed travel plan; means for regenerating the modified travel plan; means for making a reservation of the regenerated travel plan; and means for notifying the traveler of details of the reserved travel plan.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Currently, when planning a trip, people have to either join a travel agency's expensive tour or book transportation, accommodation, and sightseeing spots individually. This makes travel procedures complicated and time-consuming, and it is difficult to provide an integrated travel plan. Furthermore, there are issues such as insufficient consideration of dispersing congestion on travel days due to reservation status, and inconvenient navigation during the trip. [Means for solving the problem]

[0005] To solve the above problems, the present invention provides the following means. First, an interface means for inputting traveler preferences is provided. Next, a means for acquiring information on transportation, accommodations, and tourist attractions based on the input preferences is provided. A means for generating an itinerary based on the acquired information and displaying the generated itinerary to the traveler is provided. Furthermore, a means for allowing the traveler to modify the displayed itinerary is provided, and a means for regenerating the modified itinerary is provided. Finally, a system is provided that includes a means for making reservations for the regenerated itinerary and notifying the traveler of details of the booked itinerary. This reduces the hassle of traveling and makes it possible to provide an integrated itinerary optimized to individual needs. Furthermore, by acquiring real-time availability and price information, costs can be reduced and travel dates can be spread out. Furthermore, by generating and displaying transportation transfer information, convenience during travel is improved.

[0006] "Traveller" refers to an individual who plans and undertakes a trip.

[0007] An "interface means" is a function or device through which a user inputs information and interacts with a system.

[0008] "Means of obtaining information" refers to means of collecting necessary data from external databases, APIs, etc.

[0009] The "means for generating a travel plan" is a function or system that creates an optimal travel plan based on the acquired data.

[0010] The "means for displaying a travel plan" is a function or device for visually presenting the generated travel plan to the user.

[0011] A "means for modification" is an interface or system that allows a user to make changes to a proposed travel plan.

[0012] The "regeneration means" is a function or system that regenerates a new travel plan based on the corrected data.

[0013] "Means for making reservations" refers to a function or system that processes reservations for various services (transportation, accommodation, tourist attractions) required to execute a confirmed travel plan.

[0014] "Notification means" refers to a function or device for communicating confirmed reservation information to travelers.

[0015] "Real-time availability and pricing information" refers to data that instantly captures the current availability status and pricing of services.

[0016] "Transportation transfer information" means detailed instructions and information about connections between modes of transportation used during a journey. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8]FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0018] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0021] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0022] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0023] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0025] [First embodiment]

[0026] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0027] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0030] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0033] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0037] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0038] This invention relates to a system that integrates travel plans according to travelers' wishes and distributes travel dates and destinations according to reservation status. Furthermore, this system also provides integrated navigation functions such as transportation transfer information.

[0039] System configuration

[0040] The system mainly consists of the following components:

[0041] 1. User terminal: A device (e.g., smartphone, tablet, PC) through which travelers input their preferences and receive travel plan suggestions.

[0042] 2. Server: The central system for handling travel plan generation, modification and booking.

[0043] 3. Database: Data storage for storing information on transportation, accommodation and tourist destinations.

[0044] 4. External API: Interface for obtaining real-time information such as transportation and accommodation.

[0045] Program processing

[0046] 1. User preference input

[0047] The user uses the device to input their travel preferences (e.g., destination, budget, dates, preferred activities).

[0048] The terminal transmits the input data to the server.

[0049] 2. Data Receipt and Storage

[0050] The server stores the received data in a database.

[0051] 3. Generate a travel plan

[0052] The server retrieves information on transportation, accommodation, and tourist spots that match the traveler's preferences from the database.

[0053] The server calls an external API to retrieve real-time availability and pricing information.

[0054] Based on the acquired information, the optimal travel plan is generated.

[0055] 4. View your plan

[0056] The server transmits the generated travel plan to the user terminal.

[0057] The device will then display the received plan, including a detailed itinerary, transportation schedules, accommodation information, and details of tourist attractions.

[0058] 5. Amendments to the Plan

[0059] The user checks the proposed plan and makes any necessary modifications (e.g., changing the order of the tourist attractions to be visited, changing the number of nights to stay, etc.).

[0060] The terminal transmits the correction data to the server.

[0061] The server regenerates a new travel plan and transmits it again to the user terminal.

[0062] 6. Confirmation of reservation

[0063] The user instructs the reservation of the confirmed plan.

[0064] The terminal sends a reservation request to the server.

[0065] The server sends a request to various services (transportation, accommodation, tourist attractions) via an external API to confirm the reservation.

[0066] 7. Notification of Details

[0067] The server transmits the confirmed reservation information to the user terminal.

[0068] The terminal displays detailed travel itinerary and transport transfer information to the user.

[0069] Specific examples

[0070] When a user plans a "three-night, four-day trip from Tokyo to Kyoto," the system operates as follows:

[0071] 1. The user uses the terminal to input "Tokyo to Kyoto, 3 nights and 4 days trip, budget 150,000 yen, temple visit."

[0072] 2. The device sends this data to the server.

[0073] 3. The server saves the input data in a database and calls an external API to obtain information on transportation, accommodation, and temple tours.

[0074] 4. Based on the information obtained by the server, it generates a travel plan such as "Take the Shinkansen from Tokyo Station, stay at Hotel ABC in Kyoto City, and visit Kiyomizu-dera Temple, Kinkaku-ji Temple, and Ginkaku-ji Temple."

[0075] 5. The server sends this plan to the user's terminal, which displays it to the user.

[0076] 6. Since the day the user visits Kinkakuji Temple is crowded, the itinerary for the second and third days is swapped.

[0077] 7. The device sends the corrected data to the server, and the server generates and resends a new plan.

[0078] 8. The user is satisfied with the final plan and confirms the reservation.

[0079] 9. The device sends a reservation request to the server, and the server confirms the reservation with transportation, accommodation, and tourist attractions through the reservation API.

[0080] 10. The server sends the confirmed reservation information to the user's terminal, and the terminal notifies the user of the travel itinerary and transfer information.

[0081] In this way, this system will provide travelers with highly convenient travel plans, while also helping to resolve social issues such as reducing congestion.

[0082] The processing flow will be explained below.

[0083] Step 1:

[0084] A user launches a travel plan generation application on a terminal and inputs travel preferences (e.g., origin, destination, budget, dates, preferred activities) into the interface.

[0085] Step 2:

[0086] The terminal converts the input data into JSON format and sends it to the server as an HTTP POST request.

[0087] Step 3:

[0088] The server analyzes the received data and stores it in a database.

[0089] Step 4:

[0090] The server executes a query from the database to obtain transportation, accommodation, and tourist attraction information relevant to the traveler's preferences.

[0091] Step 5:

[0092] Based on the initial data acquired by the server, external APIs (e.g., transport booking API, hotel booking API, tourist destination information API) are called to obtain real-time availability and price information. The response to each API request is received and analyzed.

[0093] Step 6:

[0094] Based on the real-time information acquired by the server, the system generates an optimal travel plan that meets the traveler's needs, including determining the travel schedule, accommodation, and order of visits.

[0095] Step 7:

[0096] The travel plan generated by the server is converted into JSON format and sent to the terminal.

[0097] Step 8:

[0098] The device then converts the itinerary into a human-readable format and displays it in the application's interface, including an itinerary, transport schedules, accommodation information and details of tourist attractions.

[0099] Step 9:

[0100] The user checks the displayed travel plan and makes any necessary corrections (e.g., changing the order of visits, number of nights, etc.) on the interface.

[0101] Step 10:

[0102] The terminal converts the modified data from the user into JSON format and sends it back to the server.

[0103] Step 11:

[0104] The server receives the modified data and regenerates a new itinerary reflecting the necessary modifications.

[0105] Step 12:

[0106] The server sends the regenerated travel plan to the terminal, which displays it to the user.

[0107] Step 13:

[0108] The user finally decides on a plan that satisfies them and issues a reservation instruction via the interface.

[0109] Step 14:

[0110] The device sends a reservation request in JSON format to the server.

[0111] Step 15:

[0112] The server sends reservation requests through the reservation APIs of various service providers (e.g., transportation, accommodation, tourist attractions). If the reservation is confirmed, the information is stored in the database.

[0113] Step 16:

[0114] After the reservation request is completed, the server sends the confirmed reservation information in JSON format to the terminal.

[0115] Step 17:

[0116] The terminal presents detailed schedules for each travel date and transportation transfer information, and notifies the user of this.

[0117] Through the above processing steps, travelers can easily create an integrated travel plan and enjoy it in the most optimal way.

[0118] Example 1

[0119] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0120] Today's travelers want to create, modify, and book optimal travel plans that fit their individual preferences easily and quickly. However, these tasks typically require the use of multiple platforms and services, making them time-consuming and laborious. Furthermore, automating travel planning has been difficult due to the complex elements involved, such as obtaining real-time availability and pricing information, and providing transportation transfer information. Furthermore, travel plan suggestions using generative AI models have not performed satisfactorily, so there is a need to provide services that provide high user satisfaction.

[0121] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0122] In this invention, the server includes an interface for inputting traveler preferences, a means for acquiring information on transportation, accommodations, and tourist attractions based on the input preferences, a means for generating a travel plan based on the acquired information, a means for displaying the generated travel plan to the traveler, a means for the traveler to modify the displayed travel plan, a means for regenerating the modified travel plan, a means for making reservations for the regenerated travel plan, a means for notifying the traveler of details of the booked travel plan, an external API call means for acquiring real-time availability and price information, and a means for generating and displaying transfer information for the transportation modes included in the travel plan. This allows users to easily input their travel preferences, suggest and modify optimal travel plans, and automatically generate travel plans that reflect real-time reservation status and price information. Furthermore, by automatically generating and using prompt sentences from the generative AI model, efficient and high-quality travel plans can be provided.

[0123] An "interface means for inputting traveler preferences" is a digital interface (e.g., smartphone app, website, etc.) through which travelers input their preferences, such as travel destination, budget, dates, and preferred activities.

[0124] "Means for obtaining information on transportation, accommodation, and tourist attractions" refers to a mechanism for collecting information on relevant transportation, accommodation, and tourist attractions based on the input preferences.

[0125] The "means for generating a travel plan" is an algorithm that automatically creates a travel schedule and itinerary that best suits the traveler's wishes based on the acquired information.

[0126] "Means for displaying to travelers" refers to a mechanism for visually providing the generated travel plan to travelers (e.g., displaying on a screen, generating a PDF, etc.).

[0127] "Means for modification" refers to the functionality that allows a traveler to make changes to the displayed itinerary.

[0128] The "means for regenerating a revised itinerary" is an algorithm for regenerating a new itinerary that reflects the changes made by the traveler.

[0129] A "means for making reservations for travel plans" is a system for automatically making reservations based on the finalized travel plan.

[0130] "Means of notifying travelers of details of booked travel plans" refers to a function for notifying travelers of confirmed reservation information (e.g., email notification, app notification, etc.).

[0131] "Means for calling external APIs to obtain availability and price information in real time" refers to a mechanism for obtaining real-time availability and price information using external data provision services (e.g., APIs).

[0132] The "means for generating and displaying transfer guide information for the means of transportation included in the travel plan" is a mechanism for generating detailed transfer guide information for the means of transportation included in the travel plan and displaying it.

[0133] A "generative AI model" is an artificial intelligence algorithm used to generate travel plans, proposing optimal plans based on a given prompt.

[0134] A "prompt" is an instruction or question that is input to a generative AI model, and serves as the basis for the model to generate an optimal response.

[0135] The present invention relates to a system that generates optimal travel plans based on travelers' preferences, and then modifies and reserves the plans. This system is configured using a user terminal, a server, a database, and an external API. Specific embodiments of this system are described in detail below.

[0136] System Configuration

[0137] User device: A device used by a user to input travel preferences, generate travel plans, and make corrections. Specific devices include smartphones, tablets, and PCs.

[0138] Server: The central system for handling travel plan generation, modifications, and reservations.

[0139] Database: Data storage for storing information about transport, accommodation and tourist destinations.

[0140] External API: API interface used to obtain real-time availability and pricing information.

[0141] Program processing

[0142] In this system, the user inputs their travel preferences using a terminal, and the system generates and displays the optimal travel plan based on that information. If the user modifies the plan, the system generates a new plan reflecting the modifications, and finally confirms the reservation. The process is as follows:

[0143] 1. The user enters their preference

[0144] The user uses the terminal to input their preferences, such as "Destination: Kyoto, budget: 150,000 yen, 3 nights, 4 days, temple tour desired." The terminal then sends this data to the server.

[0145] 2. The server receives and stores the data

[0146] The server stores the received data in a database, for example in a "user preferences" table using an SQL query.

[0147] 3. The server generates the itinerary

[0148] The server retrieves information on transportation, accommodation, and tourist destinations from the database, and uses external APIs to obtain real-time availability and price information. This information is then integrated to generate the optimal travel plan.

[0149] 4. Display the travel plan on the user's device

[0150] The server sends the generated itinerary in JSON format to the device, which then visually displays it, including a detailed itinerary, transport schedules, accommodation information, and details of tourist attractions.

[0151] 5. The user modifies the plan

[0152] The user can make corrections to the displayed plan, such as "Kinkakuji Temple is crowded, so I'd like to switch the itinerary for the second and third days." The device then sends the correction data to the server.

[0153] 6. The server generates a new plan that reflects the changes.

[0154] The server again generates a plan based on the corrected data and transmits it to the terminal again.

[0155] 7. The user confirms the booking

[0156] The user instructs the device to reserve the confirmed plan, and the device sends the request to the server. The server confirms the reservation via an external API and sends the details to the device. The device then notifies the user of the detailed travel itinerary and transportation transfer information.

[0157] Specific examples

[0158] When a user plans a "three-night, four-day trip from Tokyo to Kyoto," the system operates as follows: The user enters "destination: Kyoto, budget: 150,000 yen, three-night, four-day trip, temple visit desired," and the device sends this information to the server. The server retrieves information from the database and collects real-time data using an external API. For example, it generates a plan such as "Shinkansen from Tokyo Station, accommodation: hotel in Kyoto City, sightseeing spots: Kiyomizu-dera Temple, Kinkaku-ji Temple, Ginkaku-ji Temple."

[0159] The user amends the itinerary by saying, "The day we visit Kinkaku-ji Temple is crowded, so I'd like to switch the itinerary between the second and third days," and the device sends this information to the server. The server generates a new plan and sends it back to the user's device. When the user is satisfied with the final plan, they instruct the server to confirm the reservation. The device then sends a reservation request to the server, which confirms the reservation via an external API. The confirmed reservation information is then sent to the user's device, and the user is notified of the detailed travel itinerary and transfer information. In this way, travelers can efficiently plan their trips.

[0160] Example prompt sentence:

[0161] "I'd like to create a 3-night, 4-day itinerary for a trip from Tokyo to Kyoto. My budget is 150,000 yen, and I'd like to visit temples. I'd like you to suggest the best plan for me based on information about transportation, accommodations, and tourist spots."

[0162] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0163] Step 1:

[0164] The user inputs their travel preferences.

[0165] Input: The user uses a terminal to input their preferences, such as "Destination Kyoto, budget 150,000 yen, 3 nights, 4 days, hope to visit temples."

[0166] How it works: The device receives user input data. It collects data through a form or interface. This data is organized in a structured format (e.g., JSON).

[0167] Output: The organized input data is ready to be sent to the server.

[0168] Step 2:

[0169] The terminal sends the input data to the server.

[0170] Input: User preference data collected in step 1.

[0171] How it works: The device sends data to the server over the internet by making a POST request using the REST API and sending the input data to the server in JSON format.

[0172] Output: The server receives the POST request and retrieves the input data.

[0173] Step 3:

[0174] The server stores the received data in a database.

[0175] Input: User preference data sent from the device.

[0176] What it does: The server extracts the necessary information from the request body, executes a SQL query, and saves the data into a "user preferences" table in the database.

[0177] Output: User preference data stored in a database.

[0178] Step 4:

[0179] The server retrieves information that matches the traveler's preferences from the database.

[0180] Input: User preference data stored in the database.

[0181] How it works: The server executes SQL queries to retrieve information about transportation, accommodation, and tourist attractions from a database.

[0182] Output: Retrieved transport, accommodation and tourist destination data.

[0183] Step 5:

[0184] The server calls an external API to retrieve real-time availability and pricing information.

[0185] Input: Transport, accommodation and tourist destination data taken from databases.

[0186] How it works: The server calls an external API (e.g., Google Maps API, hotel booking site API) to get real-time reservation status and pricing information. The data is returned in JSON format.

[0187] Output: Real-time availability and pricing information.

[0188] Step 6:

[0189] The server generates an optimal travel plan based on the acquired information.

[0190] Input: Information from databases and real-time information from external APIs.

[0191] How it works: The server analyzes this data with an algorithm to generate an optimal travel plan, calculating the fastest route and optimizing the time spent at each tourist spot.

[0192] Output: Optimal travel plan.

[0193] Step 7:

[0194] The server transmits the generated travel plan to the user terminal.

[0195] Input: The generated itinerary.

[0196] Operation: The server generates a plan and sends it to the device as a response. The data is structured in JSON format and sent via the REST API.

[0197] Output: The trip plan data received by the device.

[0198] Step 8:

[0199] Displays the plan received by the device.

[0200] Input: Travel plan data sent from the server.

[0201] How it works: The device analyzes the data it receives and displays it on its screen, including specific itineraries, transport schedules, accommodation information and details about tourist attractions.

[0202] Output: A visually displayed itinerary.

[0203] Step 9:

[0204] The user reviews the proposed plan and makes any necessary corrections.

[0205] Input: The displayed itinerary.

[0206] Operation: The user checks the plan and makes some changes, such as "Kinkakuji Temple is crowded, so I'd like to switch the itinerary between the second and third days." The device collects the changes.

[0207] Output: The modified data is saved to the device.

[0208] Step 10:

[0209] The terminal transmits the correction data to the server.

[0210] Input: User-modified data.

[0211] How it works: The device structures the correction data in JSON format and resends it to the server, using the REST API to send the data in a POST request.

[0212] Output: The correction data received by the server.

[0213] Step 11:

[0214] The server regenerates a new travel plan and transmits it again to the user terminal.

[0215] Input: Correction data.

[0216] Operation: The server recalculates based on the changes and generates a new itinerary, which is then sent to the device again.

[0217] Output: The new travel plan data is sent to the device.

[0218] Step 12:

[0219] The user instructs the reservation of the confirmed plan.

[0220] Input: The final displayed itinerary.

[0221] Operation: The user confirms the final plan and indicates that they want to confirm the reservation. The device prepares a reservation confirmation request.

[0222] Output: A booking confirmation request is prepared on the terminal.

[0223] Step 13:

[0224] The terminal sends a reservation request to the server.

[0225] Input: Confirmed booking request.

[0226] How it works: The device structures the reservation information in JSON format and sends it to the server via a POST request.

[0227] Output: The reservation request received by the server.

[0228] Step 14:

[0229] The server sends a request to various services via an external API to confirm the reservation.

[0230] Input: Booking request data.

[0231] How it works: The server calls an external transport booking API or accommodation booking API to confirm the reservation. The external API returns a reservation ID, confirmation number, etc.

[0232] Output: Confirmed booking information.

[0233] Step 15:

[0234] The server transmits the confirmed reservation information to the user terminal.

[0235] Input: Confirmed booking information.

[0236] How it works: The server structures the reservation information into JSON format and sends it to the device via the REST API.

[0237] Output: Confirmed reservation information received by the terminal.

[0238] Step 16:

[0239] The terminal displays detailed travel itinerary and transport transfer information to the user.

[0240] Input: Confirmed reservation information sent from the server.

[0241] How it works: The device analyzes the data it receives and displays detailed travel itineraries, transport route information, reservation IDs and confirmation numbers to the user.

[0242] Output: Detailed trip plan and confirmation information displayed to the user.

[0243] (Application example 1)

[0244] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0245] Modern travelers face a lot of hassle, from planning their trips to booking reservations and navigating the local area. They also lack a means to easily check local tourist and transportation information in real time. This forces travelers to frequently use their smartphones while traveling, reducing the enjoyment and convenience of their trip. Furthermore, there is a demand for an efficient travel experience that utilizes visual and audio interfaces.

[0246] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0247] In this invention, the server includes an interface means for inputting traveler preferences, a means for acquiring information on transportation, accommodations, and tourist attractions based on the input preferences, a means for generating a travel plan based on the acquired information, a means for displaying the generated travel plan to the traveler, a means for the traveler to modify the displayed travel plan, a means for regenerating the modified travel plan, a means for making reservations for the regenerated travel plan, a means for notifying the traveler of details of the booked travel plan, a display means for displaying visual information in real time based on the travel plan, and an input means for operating the visual information in response to voice commands. This allows travelers to receive consistent support from generating travel plans to making reservations and navigating on site, and also allows them to intuitively and efficiently refer to information on site.

[0248] "Traveller" refers to an individual who plans and undertakes a trip.

[0249] "Desired" refers to the specific conditions that a traveler desires in their travel plans, such as destination, duration, budget, and activities.

[0250] "Interface means" refers to devices and software that allow travelers to input preferences and exchange information.

[0251] "Transportation" refers to all means of transportation used by travelers to get around (e.g., trains, buses, airplanes, etc.).

[0252] "Accommodation" refers to a place where travelers stay (e.g., hotel, inn, guesthouse, etc.).

[0253] "Tourist destinations" refer to tourist spots and famous places that tourists want to visit.

[0254] "Travel Plan" means a travel schedule and list of destinations organized based on a traveler's preferences.

[0255] "Regeneration" refers to a traveler recreating a new travel plan based on their revised preferences.

[0256] "Reservation" refers to the act of reserving in advance the visit and use of transportation, accommodation, and tourist attractions included in a travel plan.

[0257] "Details" refers to specific information about the booked travel plan (e.g., transportation departure times, accommodation check-in times, etc.).

[0258] "Notification" refers to the act of informing travelers of details or changes to their travel plans.

[0259] "Display means" refers to display devices and display technologies used to provide visual information to travelers.

[0260] "Input means" refers to devices and software that allow travelers to input and operate information.

[0261] "Voice command" refers to an instruction that a traveler gives to the system using voice.

[0262] The present invention relates to a system for generating a travel plan according to a traveler's wishes and providing on-site navigation and information. Hereinafter, an embodiment of the present invention will be described in detail.

[0263] System configuration

[0264] The system mainly consists of the following components:

[0265] User terminal: A device (e.g., smartphone, tablet, smart glasses) through which a traveler inputs their preferences and receives travel plan suggestions.

[0266] Server: The central system that handles travel plan generation, modification, and booking.

[0267] Database: Data storage for transport, accommodation and tourist destination information.

[0268] External API: Interface for obtaining real-time information on transport, accommodation etc.

[0269] Display means: A device for displaying local information using a HUD (head-up display) such as smart glasses.

[0270] Input means: Devices and software that recognize voice commands and perform operations (e.g., voice recognition engine).

[0271] Program processing

[0272] The server performs the following process: The user uses the device to input their travel preferences (e.g., destination, budget, dates, activities). This data is sent to the server, which then generates a travel plan through the database and external API. The plan is displayed on the user's device and is regenerated if the user makes any changes. The finalized plan is then processed for booking, and the details are sent to the user's device.

[0273] Operating Procedure

[0274] The steps in generating a travel plan by the server are as follows: When the user inputs their travel preferences, the server receives them and retrieves the necessary information from the database and external APIs. Next, it generates a travel plan based on that information and sends it to the user's device for display. If the user wants to modify the displayed plan, it receives that information, generates a new plan, and sends it again.

[0275] Hardware and software used

[0276] Hardware:

[0277] Smart glasses (e.g., general-purpose head-mounted displays)

[0278] Built-in GPS

[0279] Speaker and microphone

[0280] software:

[0281] GPS API: A program to get your current location

[0282] External API (e.g., general-purpose data acquisition API): Acquire information on tourist attractions and accommodations

[0283] HUD: Providing visual information to travelers

[0284] Speech recognition engine (e.g., general-purpose voice recognition software): Recognizes voice commands

[0285] Specific examples

[0286] This shows the process when a user plans a "three-night, four-day trip from Tokyo to Kyoto." The user puts on smart glasses and can input by voice, "Tokyo to Kyoto, three-night, four-day trip, budget 150,000 yen, temple visits." The server generates an optimal travel plan based on that information and displays it on the user's smart glasses. The displayed plan includes transportation, accommodation, and tourist attractions, and when the user issues a voice command for "next tourist attraction," navigation information for the next tourist attraction is displayed on the HUD. In this way, the user can enjoy their trip intuitively.

[0287] Specific examples of prompts are as follows:

[0288] "Please tell me the best route from my current location to the next tourist spot I want to visit."

[0289] This system allows travelers to receive consistent support at every stage of their trip and makes it possible to refer to information on-site in an intuitive and efficient manner.

[0290] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0291] Step 1: User preference input

[0292] The user uses the terminal to input travel preferences (destination, budget, schedule, activities, etc.) through voice commands or an input interface. This data is sent from the terminal to the server.

[0293] Input: Destination, Budget, Dates, Activities

[0294] Data processing: Format conversion of input data (audio to text)

[0295] Output: Sending the formatted input data

[0296] Step 2: Receiving and storing data

[0297] The server receives the desired data sent from the device and stores it in a database. At the same time, it calls an external API to obtain the necessary information (information on transportation, accommodation, and tourist spots).

[0298] Input: Desired data sent from the terminal

[0299] Data processing: saving desired data, calling external API

[0300] Output: Save to database, retrieve information from external API

[0301] Step 3: Generate a travel plan

[0302] The server generates a travel plan optimized for the traveler's wishes based on information obtained from the database and external APIs. The generated plan includes information such as transportation timetables, accommodation reservations, and the order in which to visit tourist attractions.

[0303] Input: Information obtained from databases and external APIs

[0304] Data processing: Optimization calculation of travel plans

[0305] Output: Generated itinerary

[0306] Step 4: View your plan

[0307] The server sends the generated itinerary to the terminal and displays it on the HUD of the smart glasses or other terminal, allowing the user to visually check the itinerary.

[0308] Input: Generated itinerary

[0309] Data processing: Data transmission

[0310] Output: Trip plan displayed on HUD

[0311] Step 5: Modify the plan

[0312] If the user views the displayed itinerary and finds it necessary to make any corrections, he or she inputs the correction information into the terminal using a voice command or an input interface, and the terminal transmits the correction data to the server.

[0313] Input: User request for travel plan to be modified

[0314] Data processing: Format conversion of corrected data (audio to text)

[0315] Output: Send corrected data

[0316] Step 6: Regenerate the revised plan

[0317] The server receives the modified data from the user, optimizes the travel plan again, and regenerates the new travel plan, which is then sent to the terminal again.

[0318] Input: Correction data

[0319] Data processing: Reoptimization calculation

[0320] Output: Regenerated itinerary

[0321] Step 7: Confirm your booking

[0322] When the user is satisfied with the final travel plan, he / she issues a voice command or an input interface to confirm the reservation of the plan. The server processes the reservation request and confirms the reservation for various services.

[0323] Input: Final travel plan booking confirmation instructions

[0324] Data processing: Reservation procedure execution

[0325] Output: Send reservation confirmation data

[0326] Step 8: Notification of details

[0327] The server sends the confirmed reservation information to the terminal, which then notifies the user of the details. The user can then check the detailed itinerary and transportation transfer information on the smart glasses HUD or other terminal.

[0328] Input: Confirmed reservation information

[0329] Data processing: Data transmission

[0330] Output: Detailed travel itinerary and transit directions displayed on a HUD

[0331] This allows travelers to receive intuitive and efficient support throughout the entire travel process.

[0332] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0333] The present invention relates to a system that generates a travel plan based on a traveler's wishes and combines it with an emotion engine that recognizes the user's emotions to provide the traveler with the optimal travel plan. This system includes the following main components:

[0334] System configuration

[0335] The system mainly consists of the following components:

[0336] 1. User terminal: A device (e.g., smartphone, tablet, PC) through which travelers input their preferences and receive travel plan suggestions.

[0337] 2. Server: A central system for handling travel plan generation, modification, booking, and sentiment analysis.

[0338] 3. Database: Data storage for storing information on transportation, accommodation, tourist attractions, and user sentiment data.

[0339] 4. External API: Interface for obtaining real-time information such as transportation and accommodation.

[0340] 5. Emotion Engine: A module for recognizing and analyzing user emotions.

[0341] Program processing

[0342] 1. User preference input

[0343] The user uses the device to input travel preferences (e.g., origin, destination, budget, dates, preferred activities) into the interface.

[0344] The terminal transmits the input data to the server.

[0345] 2. Data Receipt and Storage

[0346] The server analyzes the received data and stores it in a database.

[0347] 3. Generate a travel plan

[0348] The server executes a query from the database to obtain information on transportation, accommodation, and tourist attractions that meet the traveler's preferences.

[0349] Based on the initial data acquired by the server, external APIs (e.g., transport booking API, hotel booking API, tourist destination information API) are called to obtain real-time availability and price information.

[0350] Based on the acquired information, the optimal travel plan is generated.

[0351] 4. User Emotion Recognition

[0352] The emotion engine acquires emotion data (e.g., facial expression recognition data, voice tone data) from the user's device.

[0353] The server analyzes the received emotional data and reflects it in the travel plan.

[0354] The server modifies or regenerates the itinerary based on the analysis results.

[0355] 5. View your plan

[0356] The server transmits the generated or modified travel plan to the user terminal.

[0357] The device displays the received plan to the user, including a specific itinerary, transportation schedules, accommodation information, and details of tourist attractions.

[0358] 6. Amendments to the Plan

[0359] The user reviews the proposed plan and makes any necessary modifications (e.g., changing the order of the destinations, changing the number of nights spent, etc.) on the interface.

[0360] The terminal transmits the correction data to the server.

[0361] The server regenerates a new travel plan and transmits it again to the user terminal.

[0362] 7. Confirmation of reservation

[0363] The user instructs the reservation of the confirmed plan.

[0364] The terminal sends a reservation request to the server.

[0365] The server sends reservation requests through the reservation APIs of various service providers (e.g., transportation, accommodation, tourist attractions). If the reservation is confirmed, the information is stored in the database.

[0366] 8. Notification of Details

[0367] The server transmits the confirmed reservation information to the user terminal.

[0368] The terminal will present the user with detailed schedules for each travel date and transportation transfer information.

[0369] Specific examples

[0370] When a user plans a "three-night, four-day trip from Tokyo to Kyoto," the system operates as follows:

[0371] 1. The user uses the terminal to input "Tokyo to Kyoto, 3 nights and 4 days trip, budget 150,000 yen, temple visit."

[0372] 2. The device sends this data to the server.

[0373] 3. The server saves the input data in a database and calls an external API to obtain information on transportation, accommodation, and temple tours.

[0374] 4. Based on the information obtained by the server, it generates a travel plan such as "Take the Shinkansen from Tokyo Station, stay at Hotel ABC in Kyoto City, and visit Kiyomizu-dera Temple, Kinkaku-ji Temple, and Ginkaku-ji Temple."

[0375] 5. The emotion engine analyzes the user's emotions from facial expression data and voice tone and evaluates the user's satisfaction with the travel plan.

[0376] 6. The server modifies the travel plan as needed based on the emotion data.

[0377] 7. The server sends the travel plan to the terminal, which displays it to the user.

[0378] 8. The user is dissatisfied with the crowds on the day they visit Kinkakuji Temple, so they make a modification to swap the itinerary for the second and third days.

[0379] 9. The device sends the corrected data to the server, and the server generates and resends a new plan.

[0380] 10. The user confirms the final plan that they are satisfied with and instructs the reservation to be confirmed.

[0381] 11. The device sends a reservation request to the server, and the server confirms the reservation with transportation, accommodation, and tourist attractions through the reservation API.

[0382] 12. The server sends this reservation information to the terminal, and the terminal notifies the user of the travel itinerary and transfer information.

[0383] In this way, the system takes into account the user's emotions and provides a travel plan optimized for individual needs. Travelers can easily create an integrated travel plan and enjoy their trip in the most optimal way. The emotion engine also enables flexible responses to increase satisfaction during the trip.

[0384] The processing flow will be explained below.

[0385] Program processing

[0386] Step 1:

[0387] A user launches a travel plan generation application on a terminal and inputs travel preferences (e.g., origin, destination, budget, dates, preferred activities) into the interface.

[0388] Step 2:

[0389] The terminal converts the input data into JSON format and sends it to the server as an HTTP POST request.

[0390] Step 3:

[0391] The server analyzes the received data and stores it in a database.

[0392] Step 4:

[0393] The server executes a query from the database to obtain information on transportation, accommodation, and tourist attractions related to the traveler's preferences.

[0394] Step 5:

[0395] Based on the initial data acquired by the server, external APIs (e.g., transport booking API, hotel booking API, tourist destination information API) are called to obtain real-time availability and price information. The response to each API request is received and analyzed.

[0396] Step 6:

[0397] Based on the real-time information acquired by the server, the system generates an optimal travel plan that meets the traveler's needs, including determining the travel schedule, accommodation, and order of visits.

[0398] Step 7:

[0399] The emotion engine transmits emotion data (e.g., facial expression recognition data, voice tone data) acquired from the user's device to the server.

[0400] Step 8:

[0401] The server analyzes the received emotion data and evaluates the user's emotion regarding the travel plan.

[0402] Step 9:

[0403] The server then modifies the itinerary as needed based on the results of the emotion analysis, for example adding relaxing activities if the emotion engine detects that the user is stressed.

[0404] Step 10:

[0405] The server converts the generated or modified travel plan into JSON format and sends it to the terminal.

[0406] Step 11:

[0407] The device then converts the itinerary into a human-readable format and displays it in the application's interface, including an itinerary, transport schedules, accommodation information and details of tourist attractions.

[0408] Step 12:

[0409] The user checks the displayed travel plan and makes any necessary modifications (e.g., changing the order of the destinations, the number of nights, etc.) on the interface.

[0410] Step 13:

[0411] The terminal converts the modified data from the user into JSON format and sends it back to the server.

[0412] Step 14:

[0413] The server receives the modified data and regenerates a new itinerary reflecting the necessary modifications.

[0414] Step 15:

[0415] The server sends the regenerated travel plan to the terminal, which displays it to the user.

[0416] Step 16:

[0417] The user finally decides on a plan that satisfies them and issues a reservation instruction via the interface.

[0418] Step 17:

[0419] The device sends a reservation request in JSON format to the server.

[0420] Step 18:

[0421] The server sends reservation requests through the reservation APIs of various service providers (e.g., transportation, accommodation, tourist attractions). If the reservation is confirmed, the information is stored in the database.

[0422] Step 19:

[0423] After the reservation request is completed, the server sends the confirmed reservation information in JSON format to the terminal.

[0424] Step 20:

[0425] The terminal presents detailed schedules for each travel date and transportation transfer information, and notifies the user of this.

[0426] The above processing steps allow travelers to easily create an integrated itinerary and enjoy it in the most optimal way. In addition, by using an emotion engine in combination, it becomes possible to flexibly modify the itinerary while taking into account the user's emotions during the trip, thereby improving user satisfaction.

[0427] Example 2

[0428] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0429] Conventional travel plan generation systems were unable to fully consider users' emotions and real-time situations when generating travel plans based on travelers' preferences. As a result, the proposed travel plans may not match the user's true needs and emotions, potentially resulting in low satisfaction. In addition, modifying and optimizing travel plans is cumbersome, leaving the user experience in need of significant improvement.

[0430] The specification processing by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes an interface means for inputting the traveler's preferences, a means for acquiring information on transportation, accommodations, and tourist attractions based on the input preferences, a means for generating a travel plan based on the acquired information, an emotion recognition means for acquiring and analyzing the user's emotion data, a means for optimizing the travel plan based on the analysis results of the emotion recognition means, a means for displaying the generated or revised travel plan to the traveler, a means for the traveler to modify the displayed travel plan, a means for regenerating the revised travel plan, a means for booking the regenerated travel plan, and a means for notifying the traveler of details of the booked travel plan. This makes it possible to propose an optimal travel plan to the traveler taking into account the user's emotions and real-time information, thereby significantly improving the user experience.

[0431] "Interface means" means an input device or software that allows a traveler to input their preferences and communicate them to the system.

[0432] "Means of obtaining information on transportation, accommodation, and tourist destinations" refers to technical means for collecting detailed information on transportation, accommodation, and tourist destinations via the Internet, etc.

[0433] The "means for generating a travel plan" is an algorithm or software for creating a travel plan based on the acquired information according to the traveler's wishes.

[0434] "Emotion recognition means" refers to a technical means for acquiring emotional data such as facial expressions and tone of voice of a traveler and analyzing it to determine the emotional state of the traveler.

[0435] The "means for optimizing the travel plan" is an algorithm or software for further adjusting or improving the travel plan by taking into account the emotional state of the traveler based on the analysis results of the emotion recognition means.

[0436] The "means for displaying the itinerary to the traveler" refers to an output device or software for outputting the generated or modified itinerary to a user terminal and visually displaying it.

[0437] A "Traveler Modification Instrument" is an input device or software that allows a traveler to make necessary changes to the displayed itinerary.

[0438] A "means for regenerating a revised itinerary" is an algorithm or software that generates a new itinerary based on the traveler's revisions.

[0439] "Means for making reservations for travel plans" refers to the technical means for making reservations for transportation, accommodation, tourist attractions, etc. based on the generated or modified travel plan.

[0440] "Means for notifying travel plan details" means the technical means for notifying travelers of confirmed travel plan details and reservation information.

[0441] This invention relates to a system that generates travel plans based on the traveler's wishes and combines them with an emotion engine that recognizes the user's emotions to provide the traveler with the most suitable travel plan. This system can centrally manage travel plan generation, user emotion recognition, plan modification and optimization, and reservation confirmation.

[0442] System configuration

[0443] The system consists of the following main components:

[0444] 1. User terminal: A device such as a smartphone, tablet, or PC that allows travelers to input their preferences and receive travel plan suggestions.

[0445] 2. Server: This is the central system for processing itinerary creation, modification, booking, and sentiment analysis. The server software uses Apache, an SQL database, and a sentiment analysis module.

[0446] 3. Database: This is data storage for storing information on transportation, accommodation, and tourist spots, as well as user emotion data. Specifically, a relational database such as MySQL or PostgreSQL is used.

[0447] 4. External API: An interface for obtaining real-time information on transportation, accommodation, etc. Examples include public transportation API, hotel reservation API, tourist destination information API, etc.

[0448] 5. Emotion Engine: This is a module for recognizing and analyzing user emotions. Specific software used is the Microsoft Azure emotion recognition API and the Google Cloud emotion analysis API.

[0449] Program processing

[0450] 1. User preference input

[0451] The user uses the terminal to input their travel preferences (origin, destination, budget, dates, preferred activities) into the interface.

[0452] The terminal transmits the input data to the server.

[0453] 2. Data Receipt and Storage

[0454] The server analyzes the received data and stores it in a database.

[0455] 3. Generate a travel plan

[0456] The server executes a query from the database to obtain information on transportation, accommodation, and tourist attractions that meet the traveler's preferences.

[0457] Based on the initial data acquired by the server, external APIs (transportation booking API, hotel booking API, tourist destination information API) are called to obtain real-time availability and price information.

[0458] Generate the optimal travel plan based on the acquired information.

[0459] 4. User Emotion Recognition

[0460] The emotion engine acquires emotion data (facial expression recognition data, voice tone data) from the user's device.

[0461] The server analyzes the received emotional data and reflects it in the travel plan.

[0462] 5. View your plan

[0463] The server transmits the generated or modified travel plan to the user terminal.

[0464] The device displays the received plan to the user, including a specific itinerary, transportation schedules, accommodation information, and details of tourist attractions.

[0465] 6. Amendments to the Plan

[0466] The user checks the proposed plan and makes any necessary modifications (such as changing the order of the destinations or the number of nights) on the interface.

[0467] The terminal transmits the correction data to the server.

[0468] The server regenerates a new travel plan and transmits it again to the user terminal.

[0469] 7. Confirmation of reservation

[0470] The user instructs the reservation of the confirmed plan.

[0471] The terminal sends a reservation request to the server.

[0472] The server sends reservation requests through the reservation APIs of various service providers (transportation, accommodation, tourist destinations). If the reservation is confirmed, the information is stored in the database.

[0473] 8. Notification of Details

[0474] The server transmits the confirmed reservation information to the user terminal.

[0475] The terminal will present the user with detailed schedules for each travel date and transportation transfer information.

[0476] Specific examples

[0477] When a user plans a "three-night, four-day trip from Tokyo to Kyoto," the system operates as follows:

[0478] 1. The user uses the terminal to input "Tokyo to Kyoto, 3 nights and 4 days trip, budget 150,000 yen, temple visit."

[0479] 2. The device sends this data to the server.

[0480] 3. The server saves the input data in a database and calls an external API to obtain information on transportation, accommodation, and temple tours.

[0481] 4. Based on the information obtained by the server, it generates a travel plan such as "Take the Shinkansen from Tokyo Station, stay at Hotel ABC in Kyoto City, and visit Kiyomizu-dera Temple, Kinkaku-ji Temple, and Ginkaku-ji Temple."

[0482] 5. The emotion engine analyzes the user's emotions from facial expression data and voice tone and evaluates the user's satisfaction with the travel plan.

[0483] 6. The server modifies the travel plan as needed based on the emotion data.

[0484] 7. The server sends the travel plan to the terminal, which displays it to the user.

[0485] 8. The user is dissatisfied with the crowds on the day they visit Kinkakuji Temple, so they make a modification to swap the itinerary for the second and third days.

[0486] 9. The device sends the corrected data to the server, and the server generates and resends a new plan.

[0487] 10. The user confirms the final plan that they are satisfied with and instructs the reservation to be confirmed.

[0488] 11. The device sends a reservation request to the server, and the server confirms the reservation with transportation, accommodation, and tourist attractions through the reservation API.

[0489] 12. The server sends this reservation information to the terminal, and the terminal notifies the user of the travel itinerary and transfer information.

[0490] In this way, the system takes into account the user's emotions and provides a travel plan optimized for individual needs. Travelers can easily create an integrated travel plan and enjoy their trip in the most optimal way. The emotion engine also enables flexible responses to increase satisfaction during the trip.

[0491] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0492] Step 1: Enter your desired data

[0493] The user inputs their travel preferences (origin, destination, budget, dates, desired activities, etc.) into the terminal.

[0494] Input: The user enters their preference for each item on the app screen.

[0495] Output: The input value is retained on the terminal as the desired data.

[0496] Specific steps: The user opens the app on their smartphone and enters their preferences in each field, such as "Departure: Tokyo," "Destination: Kyoto," "Budget: 150,000 yen," "Schedule: 3 nights, 4 days," and "Activity: Temple tour."

[0497] Step 2: Submit your desired data

[0498] The terminal transmits the input desired data to the server.

[0499] Input: The desired data entered in step 1.

[0500] Output: The desired data is sent over the network to the server.

[0501] Specific operation: When the user presses the "Send" button, the device sends the desired data to the server as an HTTP request.

[0502] Step 3: Receiving and storing data

[0503] The server receives the desired data sent from the terminal, analyzes it, and stores it in a database.

[0504] Input: An HTTP request containing the desired data.

[0505] Output: Desired data stored in a database.

[0506] What happens: The server receives the request, parses the data in JSON format, and executes a SQL query to insert it into a relational database.

[0507] Step 4: Generate your travel plan

[0508] The server queries the database to obtain information on transportation, accommodation, and tourist attractions that match the traveler's preferences.

[0509] Input: Desired data.

[0510] Output: Initial dataset (transportation, accommodation, tourist destination information).

[0511] Specific operation: The server queries the transportation table for the conditions "Departure: Tokyo" and "Destination: Kyoto" to obtain the best Shinkansen flight, then queries the accommodation table to obtain information on available hotels in Kyoto City.

[0512] Step 5: Get real-time information

[0513] The server calls an external API to retrieve real-time availability and pricing information.

[0514] Input: Information on transportation, accommodation, and tourist destinations contained in the initial dataset.

[0515] Output: Travel plan suggestions combined with real-time information.

[0516] Specific operation: The server calls the Shinkansen reservation API to obtain availability and prices for the entered flight, then calls the hotel reservation API to obtain availability and prices.

[0517] Step 6: Generate your travel plan

[0518] The server generates an optimal travel plan based on the information acquired.

[0519] Input: Travel plan suggestions combined with real-time information.

[0520] Output: Trip plan.

[0521] Specific operation: The server creates a travel plan taking into account the departure times of public transport and the check-in times of accommodations. For example, "Day 1: Tokyo to Kyoto, Shinkansen Nozomi flight 12, accommodation: Hotel ABC in Kyoto city."

[0522] Step 7: Obtaining emotion data

[0523] The emotion engine acquires emotion data (facial expression recognition data, voice tone data) from the user terminal.

[0524] Input: User's facial expression data and voice data.

[0525] Output: Parsed emotion data.

[0526] How it works: The device uses a camera and microphone to capture the user's facial expressions and voice. The emotion engine analyzes this data and generates a score such as "Satisfaction: High" or "Dissatisfaction: Low."

[0527] Step 8: Analyze and reflect on emotional data

[0528] The server analyzes the emotional data and reflects it in the travel plan.

[0529] Input: Emotion data.

[0530] Output: Optimized trip plan.

[0531] Specific operation: The server receives the emotional data and evaluates the user's emotional state for each part of the plan. If necessary, it adjusts the visit order and activity time allocation.

[0532] Step 9: View your travel plans

[0533] The server transmits the generated or modified travel plan to the terminal, which displays it to the user.

[0534] Input: Optimized itinerary data.

[0535] Output: The itinerary displayed on the user's device.

[0536] Specific operation: The server sends the travel plan data in JSON format to the device. The device parses the received JSON data and displays it visually on the app screen.

[0537] Step 10: Modify the plan

[0538] The user modifies the displayed itinerary.

[0539] Input: Data modified by the user.

[0540] Output: A modification request is sent from the device to the server.

[0541] Specific operation: The user enters "Change the date of visit to Kinkaku-ji Temple from the second day to the third day" in the app and presses the send button. The device then sends this corrected data to the server.

[0542] Step 11: Regenerate the revised plan

[0543] The server regenerates the revised travel plan and transmits it again to the user terminal.

[0544] Input: User modified data.

[0545] Output: The regenerated itinerary.

[0546] Specific operation: The server queries the database and external API again based on the newly revised data, generates and sends the revised itinerary.

[0547] Step 12: Confirm your booking

[0548] The user instructs the reservation of the confirmed plan, and the terminal transmits a reservation request to the server.

[0549] Input: Data that the user has indicated to be confirmed.

[0550] Output: Booking request sent to the Booking API.

[0551] Specific operation: The user selects "Book this plan" and presses the confirmation button. The device sends a reservation request to the server. The server calls the reservation API and confirms the reservation of transportation, accommodation, etc.

[0552] Step 13: Notification of details

[0553] The server transmits the confirmed reservation information to the user terminal, and the terminal notifies the user of the details.

[0554] Input: Confirmed reservation information.

[0555] Output: Travel itinerary and details.

[0556] Specific operation: The server sends reservation details in JSON format to the device. The device parses the JSON data and notifies the user of the travel itinerary, transfer information, hotel check-in information, etc. on the app.

[0557] In this way, the system can generate and provide optimal travel plans that take into account the user's wishes and feelings.

[0558] (Application example 2)

[0559] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0560] Conventional travel plan generation systems only create plans based on the traveler's wishes and do not dynamically modify them to take into account the traveler's emotions and satisfaction, making it impossible to reduce the stress and dissatisfaction felt by travelers. Similarly, shopping experiences in brick-and-mortar stores are also unable to dynamically modify plans to take into account the user's emotions, which can lead to a decrease in satisfaction. There is a need for a system that solves these problems and improves the satisfaction of travelers and users in brick-and-mortar stores.

[0561] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: an interface means for inputting the traveler's preferences; a means for acquiring information on transportation, accommodations, and tourist attractions based on the input preferences; a means for generating a travel plan based on the acquired information; a means for displaying the generated travel plan to the traveler; a means for the traveler to modify the displayed travel plan; a means for regenerating the modified travel plan; a means for making a reservation for the regenerated travel plan; a means for notifying the traveler of details of the reserved travel plan; a sentiment analysis means for recognizing and analyzing the user's emotions; and a means for dynamically modifying the travel plan based on the emotion data analyzed by the sentiment analysis means. This makes it possible to dynamically modify travel plans and shopping plans taking the user's emotions into consideration, thereby improving the satisfaction of travelers and users at physical stores.

[0562] 1. "Interface means" means the interface part of a device or software through which a traveler inputs his / her desired conditions or requests.

[0563] 2. "Means for acquiring information" refers to system components for collecting and processing data on transportation, accommodation, tourist attractions, etc.

[0564] 3. "Means for generating a travel plan" means an algorithm or process that uses the acquired information to create a travel plan based on the preferences entered by the user.

[0565] 4. "Display means" refers to a display or output device that visually shows the generated travel plan to the user.

[0566] 5. "Means for Modification" means an interface or software feature that allows a user to make changes to a generated itinerary.

[0567] 6. "Regenerating means" is an algorithm or process for updating the original travel plan based on user modifications.

[0568] 7. "Means for making reservations" refers to the part of the system that executes reservations for transportation and accommodation based on the finalized travel plan.

[0569] 8. "Means of Notification" means a messaging system or notification mechanism used to inform travelers of the details of their confirmed travel plans.

[0570] 9. "Emotion analysis means" refers to software modules or algorithms used to collect and analyze emotional data from users' facial expressions, voice, etc.

[0571] 10. "Dynamic Modification Means" means an algorithm or process that dynamically adjusts current travel or shopping plans based on emotional data obtained by the Emotion Analysis Means.

[0572] This invention is a system that generates travel plans and shopping plans based on the wishes of travelers and users in physical stores, and provides the optimal plans for users by combining it with an emotion engine that recognizes the user's emotions. This system includes the following main components:

[0573] System configuration

[0574] The system mainly consists of the following components:

[0575] 1. User terminal: A device (e.g., smartphone, tablet, PC) through which travelers and shoppers enter their preferences and receive generated plan proposals.

[0576] 2. Server: A central system for handling travel and shopping plan generation, modification, booking, and sentiment analysis.

[0577] 3. Database: Data storage for storing information on transportation, accommodation, tourist attractions, and physical store products, as well as user sentiment data.

[0578] 4. External API: An interface for obtaining real-time information on transportation, accommodation, products in physical stores, etc.

[0579] 5. Sentiment analysis means: A module for recognizing and analyzing user emotions.

[0580] Program processing

[0581] 1. User preference input

[0582] Enter your travel and shopping preferences (e.g., destination, budget, dates, preferred activities and brands) on your device.

[0583] The user terminal transmits the input data to the server.

[0584] 2. Data Receipt and Storage

[0585] The server analyzes the received data and stores it in a database.

[0586] 3. Generate a plan

[0587] The server executes a query from the database to obtain product information on transportation, accommodation, tourist spots, and brick-and-mortar stores that match the user's preferences.

[0588] Based on the initial data acquired by the server, external APIs (e.g., transport booking APIs, hotel booking APIs, physical store product information APIs) are called to obtain real-time availability and price information.

[0589] Based on the information obtained, optimal travel and shopping plans are generated.

[0590] 4. User Emotion Recognition

[0591] The emotion analysis means acquires emotion data (e.g., facial expression recognition data, voice tone data) from the user's terminal.

[0592] The server analyzes the received emotional data and reflects it in travel and shopping plans.

[0593] The server modifies or regenerates the plan based on the analysis results.

[0594] 5. View your plan

[0595] The server transmits the generated or modified plan to the user terminal.

[0596] The user terminal displays the received plan to the user, including a specific itinerary, transportation schedules, accommodation information, tourist attractions, and shopping plans.

[0597] 6. Amendments to the Plan

[0598] The user checks the proposed plan and makes any necessary modifications (e.g., changing the order of destinations, number of nights, shopping items, etc.) on the interface.

[0599] The user terminal transmits the correction data to the server.

[0600] The server regenerates a new plan and sends it to the user terminal again.

[0601] Specific examples

[0602] Travel Planner

[0603] When a user plans a "three-night, four-day trip from Tokyo to Kyoto," the system operates as follows:

[0604] The user uses the terminal and inputs "Tokyo to Kyoto, 3 nights and 4 days trip, budget 150,000 yen, temple visit."

[0605] The user terminal transmits this data to the server.

[0606] The server stores the input data in a database and calls an external API to retrieve information on transportation, accommodation, and temple tours.

[0607] The server generates a travel plan based on the obtained information.

[0608] The emotion analysis means analyzes the user's emotions from facial expression data and voice tone, and evaluates the user's satisfaction with the travel plan.

[0609] The server modifies the travel plan as needed based on the emotion data.

[0610] Shopping Plan

[0611] A similar process can be applied if a user plans to "find a bag of a specific brand with a budget of 20,000 yen."

[0612] The user enters into the app, "I'm looking for a bag from a specific brand with a budget of 20,000 yen."

[0613] The app retrieves store inventory information in real time and generates a plan such as, "This bag is on the second floor, on the right side."

[0614] If a user becomes dissatisfied while browsing bags, emotional data is obtained through facial expressions and a new bag is recommended.

[0615] An example of a prompt is:

[0616] User: "I'm looking for a new bag from a specific brand with a budget of ¥20,000."

[0617] System: "The following item was found. It's on the second floor, on the right."

[0618] (User is dissatisfied with the bag)

[0619] System: "Analyzing sentiment...Recommend other similar products."

[0620] In this way, the system takes into account the user's emotions and provides travel and shopping plans optimized to individual needs. Users can easily create integrated plans and enjoy them with a sense of satisfaction. In addition, the emotion analysis means allows for flexible responses to increase user satisfaction.

[0621] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0622] Step 1:

[0623] The user uses the device to input their travel and shopping preferences. The input data includes the destination, budget, dates, preferred activities and brands. An example input might be, "I'm looking for a bag from a specific brand with a budget of 20,000 yen." This data is sent from the device to the server.

[0624] Step 2:

[0625] The server analyzes the received user preference data and stores it in a database. For example, data is stored as "Search criteria: budget 20,000 yen, brand: specific brand." Database management software is used for this analysis and storage process.

[0626] Step 3:

[0627] The server executes a query from the database to obtain information on transportation, accommodation, tourist attractions, and physical store products that match the user's preferences. Based on this query, the necessary information is extracted from the database.

[0628] Step 4:

[0629] Based on the initial data acquired by the server, external APIs (e.g., transport reservation APIs, hotel reservation APIs, and physical store product information APIs) are called to obtain real-time availability and price information. For example, an API is used to obtain "stock information for a specific brand of bag." This acquired data is also stored on the server.

[0630] Step 5:

[0631] Based on the information acquired by the server, optimal travel plans and shopping plans are generated. Travel plan generation algorithms and shopping plan generation algorithms are used to generate travel plans. An example of a generated plan is a specific plan such as "Bag A is located on the right side of the second floor."

[0632] Step 6:

[0633] Emotion analysis means acquires emotion data (e.g., facial expression recognition data, voice tone data) from the user terminal. This data is sent from the terminal to the server, and the server receives it. For example, if the user shows a "dissatisfied expression," the facial expression data is analyzed.

[0634] Step 7:

[0635] The server analyzes the received emotional data and reflects it in travel plans and shopping plans. An example of emotional data is the analysis result, which may be "dissatisfied state." The server modifies or regenerates the plan based on this data. A dynamic plan modification algorithm is used to modify the plan.

[0636] Step 8:

[0637] The server sends the generated or modified plan to the user terminal. The user terminal displays the received plan to the user. For example, a specific plan such as "We recommend other similar products" is presented.

[0638] Step 9:

[0639] The user checks the proposed plan and makes any necessary modifications (e.g., changing the order of destinations, number of nights, shopping items, etc.) on the interface. The modified data is sent from the user's device to the server. An example of input is a modification such as "I would also like to see bag B."

[0640] Step 10:

[0641] The server regenerates a new plan and sends it to the user's device again. The regenerated plan is displayed to the user, and this process is repeated until the user is satisfied. For example, a specific new plan such as "Bag B is on the third floor" is presented.

[0642] Through the above processing steps, the system can take into account the user's wishes and feelings and provide travel and shopping plans optimized to individual needs.

[0643] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0644] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0645] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0646] [Second embodiment]

[0647] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0648] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0649] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0650] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0651] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0652] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0653] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0654] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0655] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0656] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0657] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0658] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0659] This invention relates to a system that integrates travel plans according to travelers' wishes and distributes travel dates and destinations according to reservation status. Furthermore, this system also provides integrated navigation functions such as transportation transfer information.

[0660] System configuration

[0661] The system mainly consists of the following components:

[0662] 1. User terminal: A device (e.g., smartphone, tablet, PC) through which travelers input their preferences and receive travel plan suggestions.

[0663] 2. Server: The central system for handling travel plan generation, modification and booking.

[0664] 3. Database: Data storage for storing information on transportation, accommodation and tourist destinations.

[0665] 4. External API: Interface for obtaining real-time information such as transportation and accommodation.

[0666] Program processing

[0667] 1. User preference input

[0668] The user uses the device to input their travel preferences (e.g., destination, budget, dates, preferred activities).

[0669] The terminal transmits the input data to the server.

[0670] 2. Data Receipt and Storage

[0671] The server stores the received data in a database.

[0672] 3. Generate a travel plan

[0673] The server retrieves information on transportation, accommodation, and tourist spots that match the traveler's preferences from the database.

[0674] The server calls an external API to retrieve real-time availability and pricing information.

[0675] Based on the acquired information, the optimal travel plan is generated.

[0676] 4. View your plan

[0677] The server transmits the generated travel plan to the user terminal.

[0678] The device will then display the received plan, including a detailed itinerary, transportation schedules, accommodation information, and details of tourist attractions.

[0679] 5. Amendments to the Plan

[0680] The user checks the proposed plan and makes any necessary modifications (e.g., changing the order of the tourist attractions to be visited, changing the number of nights to stay, etc.).

[0681] The terminal transmits the correction data to the server.

[0682] The server regenerates a new travel plan and transmits it again to the user terminal.

[0683] 6. Confirmation of reservation

[0684] The user instructs the reservation of the confirmed plan.

[0685] The terminal sends a reservation request to the server.

[0686] The server sends a request to various services (transportation, accommodation, tourist attractions) via an external API to confirm the reservation.

[0687] 7. Notification of Details

[0688] The server transmits the confirmed reservation information to the user terminal.

[0689] The terminal displays detailed travel itinerary and transport transfer information to the user.

[0690] Specific examples

[0691] When a user plans a "three-night, four-day trip from Tokyo to Kyoto," the system operates as follows:

[0692] 1. The user uses the terminal to input "Tokyo to Kyoto, 3 nights and 4 days trip, budget 150,000 yen, temple visit."

[0693] 2. The device sends this data to the server.

[0694] 3. The server saves the input data in a database and calls an external API to obtain information on transportation, accommodation, and temple tours.

[0695] 4. Based on the information obtained by the server, it generates a travel plan such as "Take the Shinkansen from Tokyo Station, stay at Hotel ABC in Kyoto City, and visit Kiyomizu-dera Temple, Kinkaku-ji Temple, and Ginkaku-ji Temple."

[0696] 5. The server sends this plan to the user's terminal, which displays it to the user.

[0697] 6. Since the day the user visits Kinkakuji Temple is crowded, the itinerary for the second and third days is swapped.

[0698] 7. The device sends the corrected data to the server, and the server generates and resends a new plan.

[0699] 8. The user is satisfied with the final plan and confirms the reservation.

[0700] 9. The device sends a reservation request to the server, and the server confirms the reservation with transportation, accommodation, and tourist attractions through the reservation API.

[0701] 10. The server sends the confirmed reservation information to the user's terminal, and the terminal notifies the user of the travel itinerary and transfer information.

[0702] In this way, this system will provide travelers with highly convenient travel plans, while also helping to resolve social issues such as reducing congestion.

[0703] The processing flow will be explained below.

[0704] Step 1:

[0705] A user launches a travel plan generation application on a terminal and inputs travel preferences (e.g., origin, destination, budget, dates, preferred activities) into the interface.

[0706] Step 2:

[0707] The terminal converts the input data into JSON format and sends it to the server as an HTTP POST request.

[0708] Step 3:

[0709] The server analyzes the received data and stores it in a database.

[0710] Step 4:

[0711] The server executes a query from the database to obtain transportation, accommodation, and tourist attraction information relevant to the traveler's preferences.

[0712] Step 5:

[0713] Based on the initial data acquired by the server, external APIs (e.g., transport booking API, hotel booking API, tourist destination information API) are called to obtain real-time availability and price information. The response to each API request is received and analyzed.

[0714] Step 6:

[0715] Based on the real-time information acquired by the server, the system generates an optimal travel plan that meets the traveler's needs, including determining the travel schedule, accommodation, and order of visits.

[0716] Step 7:

[0717] The travel plan generated by the server is converted into JSON format and sent to the terminal.

[0718] Step 8:

[0719] The device then converts the itinerary into a human-readable format and displays it in the application's interface, including an itinerary, transport schedules, accommodation information and details of tourist attractions.

[0720] Step 9:

[0721] The user checks the displayed travel plan and makes any necessary corrections (e.g., changing the order of visits, number of nights, etc.) on the interface.

[0722] Step 10:

[0723] The terminal converts the modified data from the user into JSON format and sends it back to the server.

[0724] Step 11:

[0725] The server receives the modified data and regenerates a new itinerary reflecting the necessary modifications.

[0726] Step 12:

[0727] The server sends the regenerated travel plan to the terminal, which displays it to the user.

[0728] Step 13:

[0729] The user finally decides on a plan that satisfies them and issues a reservation instruction via the interface.

[0730] Step 14:

[0731] The device sends a reservation request in JSON format to the server.

[0732] Step 15:

[0733] The server sends reservation requests through the reservation APIs of various service providers (e.g., transportation, accommodation, tourist attractions). If the reservation is confirmed, the information is stored in the database.

[0734] Step 16:

[0735] After the reservation request is completed, the server sends the confirmed reservation information in JSON format to the terminal.

[0736] Step 17:

[0737] The terminal presents detailed schedules for each travel date and transportation transfer information, and notifies the user of this.

[0738] Through the above processing steps, travelers can easily create an integrated travel plan and enjoy it in the most optimal way.

[0739] Example 1

[0740] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0741] Today's travelers want to create, modify, and book optimal travel plans that fit their individual preferences easily and quickly. However, these tasks typically require the use of multiple platforms and services, making them time-consuming and laborious. Furthermore, automating travel planning has been difficult due to the complex elements involved, such as obtaining real-time availability and pricing information, and providing transportation transfer information. Furthermore, travel plan suggestions using generative AI models have not performed satisfactorily, so there is a need to provide services that provide high user satisfaction.

[0742] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0743] In this invention, the server includes an interface for inputting traveler preferences, a means for acquiring information on transportation, accommodations, and tourist attractions based on the input preferences, a means for generating a travel plan based on the acquired information, a means for displaying the generated travel plan to the traveler, a means for the traveler to modify the displayed travel plan, a means for regenerating the modified travel plan, a means for making reservations for the regenerated travel plan, a means for notifying the traveler of details of the booked travel plan, an external API call means for acquiring real-time availability and price information, and a means for generating and displaying transfer information for the transportation modes included in the travel plan. This allows users to easily input their travel preferences, suggest and modify optimal travel plans, and automatically generate travel plans that reflect real-time reservation status and price information. Furthermore, by automatically generating and using prompt sentences from the generative AI model, efficient and high-quality travel plans can be provided.

[0744] An "interface means for inputting traveler preferences" is a digital interface (e.g., smartphone app, website, etc.) through which travelers input their preferences, such as travel destination, budget, dates, and preferred activities.

[0745] "Means for obtaining information on transportation, accommodation, and tourist attractions" refers to a mechanism for collecting information on relevant transportation, accommodation, and tourist attractions based on the input preferences.

[0746] The "means for generating a travel plan" is an algorithm that automatically creates a travel schedule and itinerary that best suits the traveler's wishes based on the acquired information.

[0747] "Means for displaying to travelers" refers to a mechanism for visually providing the generated travel plan to travelers (e.g., displaying on a screen, generating a PDF, etc.).

[0748] "Means for modification" refers to the functionality that allows a traveler to make changes to the displayed itinerary.

[0749] The "means for regenerating a revised itinerary" is an algorithm for regenerating a new itinerary that reflects the changes made by the traveler.

[0750] A "means for making reservations for travel plans" is a system for automatically making reservations based on the finalized travel plan.

[0751] "Means of notifying travelers of details of booked travel plans" refers to a function for notifying travelers of confirmed reservation information (e.g., email notification, app notification, etc.).

[0752] "Means for calling external APIs to obtain availability and price information in real time" refers to a mechanism for obtaining real-time availability and price information using external data provision services (e.g., APIs).

[0753] The "means for generating and displaying transfer guide information for the means of transportation included in the travel plan" is a mechanism for generating detailed transfer guide information for the means of transportation included in the travel plan and displaying it.

[0754] A "generative AI model" is an artificial intelligence algorithm used to generate travel plans, proposing optimal plans based on a given prompt.

[0755] A "prompt" is an instruction or question that is input to a generative AI model, and serves as the basis for the model to generate an optimal response.

[0756] The present invention relates to a system that generates optimal travel plans based on travelers' preferences, and then modifies and reserves the plans. This system is configured using a user terminal, a server, a database, and an external API. Specific embodiments of this system are described in detail below.

[0757] System Configuration

[0758] User device: A device used by a user to input travel preferences, generate travel plans, and make corrections. Specific devices include smartphones, tablets, and PCs.

[0759] Server: The central system for handling travel plan generation, modifications, and reservations.

[0760] Database: Data storage for storing information about transport, accommodation and tourist destinations.

[0761] External API: API interface used to obtain real-time availability and pricing information.

[0762] Program processing

[0763] In this system, the user inputs their travel preferences using a terminal, and the system generates and displays the optimal travel plan based on that information. If the user modifies the plan, the system generates a new plan reflecting the modifications, and finally confirms the reservation. The process is as follows:

[0764] 1. The user enters their preference

[0765] The user uses the terminal to input their preferences, such as "Destination: Kyoto, budget: 150,000 yen, 3 nights, 4 days, temple tour desired." The terminal then sends this data to the server.

[0766] 2. The server receives and stores the data

[0767] The server stores the received data in a database, for example in a "user preferences" table using an SQL query.

[0768] 3. The server generates the itinerary

[0769] The server retrieves information on transportation, accommodation, and tourist destinations from the database, and uses external APIs to obtain real-time availability and price information. This information is then integrated to generate the optimal travel plan.

[0770] 4. Display the travel plan on the user's device

[0771] The server sends the generated itinerary in JSON format to the device, which then visually displays it, including a detailed itinerary, transport schedules, accommodation information, and details of tourist attractions.

[0772] 5. The user modifies the plan

[0773] The user can make corrections to the displayed plan, such as "Kinkakuji Temple is crowded, so I'd like to switch the itinerary for the second and third days." The device then sends the correction data to the server.

[0774] 6. The server generates a new plan that reflects the changes.

[0775] The server again generates a plan based on the corrected data and transmits it to the terminal again.

[0776] 7. The user confirms the booking

[0777] The user instructs the device to reserve the confirmed plan, and the device sends the request to the server. The server confirms the reservation via an external API and sends the details to the device. The device then notifies the user of the detailed travel itinerary and transportation transfer information.

[0778] Specific examples

[0779] When a user plans a "three-night, four-day trip from Tokyo to Kyoto," the system operates as follows: The user enters "destination: Kyoto, budget: 150,000 yen, three-night, four-day trip, temple visit desired," and the device sends this information to the server. The server retrieves information from the database and collects real-time data using an external API. For example, it generates a plan such as "Shinkansen from Tokyo Station, accommodation: hotel in Kyoto City, sightseeing spots: Kiyomizu-dera Temple, Kinkaku-ji Temple, Ginkaku-ji Temple."

[0780] The user amends the itinerary by saying, "The day we visit Kinkaku-ji Temple is crowded, so I'd like to switch the itinerary between the second and third days," and the device sends this information to the server. The server generates a new plan and sends it back to the user's device. When the user is satisfied with the final plan, they instruct the server to confirm the reservation. The device then sends a reservation request to the server, which confirms the reservation via an external API. The confirmed reservation information is then sent to the user's device, and the user is notified of the detailed travel itinerary and transfer information. In this way, travelers can efficiently plan their trips.

[0781] Example prompt sentence:

[0782] "I'd like to create a 3-night, 4-day itinerary for a trip from Tokyo to Kyoto. My budget is 150,000 yen, and I'd like to visit temples. I'd like you to suggest the best plan for me based on information about transportation, accommodations, and tourist spots."

[0783] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0784] Step 1:

[0785] The user inputs their travel preferences.

[0786] Input: The user uses a terminal to input their preferences, such as "Destination Kyoto, budget 150,000 yen, 3 nights, 4 days, hope to visit temples."

[0787] How it works: The device receives user input data. It collects data through a form or interface. This data is organized in a structured format (e.g., JSON).

[0788] Output: The organized input data is ready to be sent to the server.

[0789] Step 2:

[0790] The terminal sends the input data to the server.

[0791] Input: User preference data collected in step 1.

[0792] How it works: The device sends data to the server over the internet by making a POST request using the REST API and sending the input data to the server in JSON format.

[0793] Output: The server receives the POST request and retrieves the input data.

[0794] Step 3:

[0795] The server stores the received data in a database.

[0796] Input: User preference data sent from the device.

[0797] What it does: The server extracts the necessary information from the request body, executes a SQL query, and saves the data into a "user preferences" table in the database.

[0798] Output: User preference data stored in a database.

[0799] Step 4:

[0800] The server retrieves information that matches the traveler's preferences from the database.

[0801] Input: User preference data stored in the database.

[0802] How it works: The server executes SQL queries to retrieve information about transportation, accommodation, and tourist attractions from a database.

[0803] Output: Retrieved transport, accommodation and tourist destination data.

[0804] Step 5:

[0805] The server calls an external API to retrieve real-time availability and pricing information.

[0806] Input: Transport, accommodation and tourist destination data taken from databases.

[0807] How it works: The server calls an external API (e.g., Google Maps API, hotel booking site API) to get real-time reservation status and pricing information. The data is returned in JSON format.

[0808] Output: Real-time availability and pricing information.

[0809] Step 6:

[0810] The server generates an optimal travel plan based on the acquired information.

[0811] Input: Information from databases and real-time information from external APIs.

[0812] How it works: The server analyzes this data with an algorithm to generate an optimal travel plan, calculating the fastest route and optimizing the time spent at each tourist spot.

[0813] Output: Optimal travel plan.

[0814] Step 7:

[0815] The server transmits the generated travel plan to the user terminal.

[0816] Input: The generated itinerary.

[0817] Operation: The server generates a plan and sends it to the device as a response. The data is structured in JSON format and sent via the REST API.

[0818] Output: The trip plan data received by the device.

[0819] Step 8:

[0820] Displays the plan received by the device.

[0821] Input: Travel plan data sent from the server.

[0822] How it works: The device analyzes the data it receives and displays it on its screen, including specific itineraries, transport schedules, accommodation information and details about tourist attractions.

[0823] Output: A visually displayed itinerary.

[0824] Step 9:

[0825] The user reviews the proposed plan and makes any necessary corrections.

[0826] Input: The displayed itinerary.

[0827] Operation: The user checks the plan and makes some changes, such as "Kinkakuji Temple is crowded, so I'd like to switch the itinerary between the second and third days." The device collects the changes.

[0828] Output: The modified data is saved to the device.

[0829] Step 10:

[0830] The terminal transmits the correction data to the server.

[0831] Input: User-modified data.

[0832] How it works: The device structures the correction data in JSON format and resends it to the server, using the REST API to send the data in a POST request.

[0833] Output: The correction data received by the server.

[0834] Step 11:

[0835] The server regenerates a new travel plan and transmits it again to the user terminal.

[0836] Input: Correction data.

[0837] Operation: The server recalculates based on the changes and generates a new itinerary, which is then sent to the device again.

[0838] Output: The new travel plan data is sent to the device.

[0839] Step 12:

[0840] The user instructs the reservation of the confirmed plan.

[0841] Input: The final displayed itinerary.

[0842] Operation: The user confirms the final plan and indicates that they want to confirm the reservation. The device prepares a reservation confirmation request.

[0843] Output: A booking confirmation request is prepared on the terminal.

[0844] Step 13:

[0845] The terminal sends a reservation request to the server.

[0846] Input: Confirmed booking request.

[0847] How it works: The device structures the reservation information in JSON format and sends it to the server via a POST request.

[0848] Output: The reservation request received by the server.

[0849] Step 14:

[0850] The server sends a request to various services via an external API to confirm the reservation.

[0851] Input: Booking request data.

[0852] How it works: The server calls an external transport booking API or accommodation booking API to confirm the reservation. The external API returns a reservation ID, confirmation number, etc.

[0853] Output: Confirmed booking information.

[0854] Step 15:

[0855] The server transmits the confirmed reservation information to the user terminal.

[0856] Input: Confirmed booking information.

[0857] How it works: The server structures the reservation information into JSON format and sends it to the device via the REST API.

[0858] Output: Confirmed reservation information received by the terminal.

[0859] Step 16:

[0860] The terminal displays detailed travel itinerary and transport transfer information to the user.

[0861] Input: Confirmed reservation information sent from the server.

[0862] How it works: The device analyzes the data it receives and displays detailed travel itineraries, transport route information, reservation IDs and confirmation numbers to the user.

[0863] Output: Detailed trip plan and confirmation information displayed to the user.

[0864] (Application example 1)

[0865] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0866] Modern travelers face a lot of hassle, from planning their trips to booking reservations and navigating the local area. They also lack a means to easily check local tourist and transportation information in real time. This forces travelers to frequently use their smartphones while traveling, reducing the enjoyment and convenience of their trip. Furthermore, there is a demand for an efficient travel experience that utilizes visual and audio interfaces.

[0867] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0868] In this invention, the server includes an interface means for inputting traveler preferences, a means for acquiring information on transportation, accommodations, and tourist attractions based on the input preferences, a means for generating a travel plan based on the acquired information, a means for displaying the generated travel plan to the traveler, a means for the traveler to modify the displayed travel plan, a means for regenerating the modified travel plan, a means for making reservations for the regenerated travel plan, a means for notifying the traveler of details of the booked travel plan, a display means for displaying visual information in real time based on the travel plan, and an input means for operating the visual information in response to voice commands. This allows travelers to receive consistent support from generating travel plans to making reservations and navigating on site, and also allows them to intuitively and efficiently refer to information on site.

[0869] "Traveller" refers to an individual who plans and undertakes a trip.

[0870] "Desired" refers to the specific conditions that a traveler desires in their travel plans, such as destination, duration, budget, and activities.

[0871] "Interface means" refers to devices and software that allow travelers to input preferences and exchange information.

[0872] "Transportation" refers to all means of transportation used by travelers to get around (e.g., trains, buses, airplanes, etc.).

[0873] "Accommodation" refers to a place where travelers stay (e.g., hotel, inn, guesthouse, etc.).

[0874] "Tourist destinations" refer to tourist spots and famous places that tourists want to visit.

[0875] "Travel Plan" means a travel schedule and list of destinations organized based on a traveler's preferences.

[0876] "Regeneration" refers to a traveler recreating a new travel plan based on their revised preferences.

[0877] "Reservation" refers to the act of reserving in advance the visit and use of transportation, accommodation, and tourist attractions included in a travel plan.

[0878] "Details" refers to specific information about the booked travel plan (e.g., transportation departure times, accommodation check-in times, etc.).

[0879] "Notification" refers to the act of informing travelers of details or changes to their travel plans.

[0880] "Display means" refers to display devices and display technologies used to provide visual information to travelers.

[0881] "Input means" refers to devices and software that allow travelers to input and operate information.

[0882] "Voice command" refers to an instruction that a traveler gives to the system using voice.

[0883] The present invention relates to a system for generating a travel plan according to a traveler's wishes and providing on-site navigation and information. Hereinafter, an embodiment of the present invention will be described in detail.

[0884] System configuration

[0885] The system mainly consists of the following components:

[0886] User terminal: A device (e.g., smartphone, tablet, smart glasses) through which a traveler inputs their preferences and receives travel plan suggestions.

[0887] Server: The central system that handles travel plan generation, modification, and booking.

[0888] Database: Data storage for transport, accommodation and tourist destination information.

[0889] External API: Interface for obtaining real-time information on transport, accommodation etc.

[0890] Display means: A device for displaying local information using a HUD (head-up display) such as smart glasses.

[0891] Input means: Devices and software that recognize voice commands and perform operations (e.g., voice recognition engine).

[0892] Program processing

[0893] The server performs the following process: The user uses the device to input their travel preferences (e.g., destination, budget, dates, activities). This data is sent to the server, which then generates a travel plan through the database and external API. The plan is displayed on the user's device and is regenerated if the user makes any changes. The finalized plan is then processed for booking, and the details are sent to the user's device.

[0894] Operating Procedure

[0895] The steps in generating a travel plan by the server are as follows: When the user inputs their travel preferences, the server receives them and retrieves the necessary information from the database and external APIs. Next, it generates a travel plan based on that information and sends it to the user's device for display. If the user wants to modify the displayed plan, it receives that information, generates a new plan, and sends it again.

[0896] Hardware and software used

[0897] Hardware:

[0898] Smart glasses (e.g., general-purpose head-mounted displays)

[0899] Built-in GPS

[0900] Speaker and microphone

[0901] software:

[0902] GPS API: A program to get your current location

[0903] External API (e.g., general-purpose data acquisition API): Acquire information on tourist attractions and accommodations

[0904] HUD: Providing visual information to travelers

[0905] Speech recognition engine (e.g., general-purpose voice recognition software): Recognizes voice commands

[0906] Specific examples

[0907] This shows the process when a user plans a "three-night, four-day trip from Tokyo to Kyoto." The user puts on smart glasses and can input by voice, "Tokyo to Kyoto, three-night, four-day trip, budget 150,000 yen, temple visits." The server generates an optimal travel plan based on that information and displays it on the user's smart glasses. The displayed plan includes transportation, accommodation, and tourist attractions, and when the user issues a voice command for "next tourist attraction," navigation information for the next tourist attraction is displayed on the HUD. In this way, the user can enjoy their trip intuitively.

[0908] Specific examples of prompts are as follows:

[0909] "Please tell me the best route from my current location to the next tourist spot I want to visit."

[0910] This system allows travelers to receive consistent support at every stage of their trip and makes it possible to refer to information on-site in an intuitive and efficient manner.

[0911] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0912] Step 1: User preference input

[0913] The user uses the terminal to input travel preferences (destination, budget, schedule, activities, etc.) through voice commands or an input interface. This data is sent from the terminal to the server.

[0914] Input: Destination, Budget, Dates, Activities

[0915] Data processing: Format conversion of input data (audio to text)

[0916] Output: Sending the formatted input data

[0917] Step 2: Receiving and storing data

[0918] The server receives the desired data sent from the device and stores it in a database. At the same time, it calls an external API to obtain the necessary information (information on transportation, accommodation, and tourist spots).

[0919] Input: Desired data sent from the terminal

[0920] Data processing: saving desired data, calling external API

[0921] Output: Save to database, retrieve information from external API

[0922] Step 3: Generate a travel plan

[0923] The server generates a travel plan optimized for the traveler's wishes based on information obtained from the database and external APIs. The generated plan includes information such as transportation timetables, accommodation reservations, and the order in which to visit tourist attractions.

[0924] Input: Information obtained from databases and external APIs

[0925] Data processing: Optimization calculation of travel plans

[0926] Output: Generated itinerary

[0927] Step 4: View your plan

[0928] The server sends the generated itinerary to the terminal and displays it on the HUD of the smart glasses or other terminal, allowing the user to visually check the itinerary.

[0929] Input: Generated itinerary

[0930] Data processing: Data transmission

[0931] Output: Trip plan displayed on HUD

[0932] Step 5: Modify the plan

[0933] If the user views the displayed itinerary and finds it necessary to make any corrections, he or she inputs the correction information into the terminal using a voice command or an input interface, and the terminal transmits the correction data to the server.

[0934] Input: User request for travel plan to be modified

[0935] Data processing: Format conversion of corrected data (audio to text)

[0936] Output: Send corrected data

[0937] Step 6: Regenerate the revised plan

[0938] The server receives the modified data from the user, optimizes the travel plan again, and regenerates the new travel plan, which is then sent to the terminal again.

[0939] Input: Correction data

[0940] Data processing: Reoptimization calculation

[0941] Output: Regenerated itinerary

[0942] Step 7: Confirm your booking

[0943] When the user is satisfied with the final travel plan, he / she issues a voice command or an input interface to confirm the reservation of the plan. The server processes the reservation request and confirms the reservation for various services.

[0944] Input: Final travel plan booking confirmation instructions

[0945] Data processing: Reservation procedure execution

[0946] Output: Send reservation confirmation data

[0947] Step 8: Notification of details

[0948] The server sends the confirmed reservation information to the terminal, which then notifies the user of the details. The user can then check the detailed itinerary and transportation transfer information on the smart glasses HUD or other terminal.

[0949] Input: Confirmed reservation information

[0950] Data processing: Data transmission

[0951] Output: Detailed travel itinerary and transit directions displayed on a HUD

[0952] This allows travelers to receive intuitive and efficient support throughout the entire travel process.

[0953] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0954] The present invention relates to a system that generates a travel plan based on a traveler's wishes and combines it with an emotion engine that recognizes the user's emotions to provide the traveler with the optimal travel plan. This system includes the following main components:

[0955] System configuration

[0956] The system mainly consists of the following components:

[0957] 1. User terminal: A device (e.g., smartphone, tablet, PC) through which travelers input their preferences and receive travel plan suggestions.

[0958] 2. Server: A central system for handling travel plan generation, modification, booking, and sentiment analysis.

[0959] 3. Database: Data storage for storing information on transportation, accommodation, tourist attractions, and user sentiment data.

[0960] 4. External API: Interface for obtaining real-time information such as transportation and accommodation.

[0961] 5. Emotion Engine: A module for recognizing and analyzing user emotions.

[0962] Program processing

[0963] 1. User preference input

[0964] The user uses the device to input travel preferences (e.g., origin, destination, budget, dates, preferred activities) into the interface.

[0965] The terminal transmits the input data to the server.

[0966] 2. Data Receipt and Storage

[0967] The server analyzes the received data and stores it in a database.

[0968] 3. Generate a travel plan

[0969] The server executes a query from the database to obtain information on transportation, accommodation, and tourist attractions that meet the traveler's preferences.

[0970] Based on the initial data acquired by the server, external APIs (e.g., transport booking API, hotel booking API, tourist destination information API) are called to obtain real-time availability and price information.

[0971] Based on the acquired information, the optimal travel plan is generated.

[0972] 4. User Emotion Recognition

[0973] The emotion engine acquires emotion data (e.g., facial expression recognition data, voice tone data) from the user's device.

[0974] The server analyzes the received emotional data and reflects it in the travel plan.

[0975] The server modifies or regenerates the itinerary based on the analysis results.

[0976] 5. View your plan

[0977] The server transmits the generated or modified travel plan to the user terminal.

[0978] The device displays the received plan to the user, including a specific itinerary, transportation schedules, accommodation information, and details of tourist attractions.

[0979] 6. Amendments to the Plan

[0980] The user reviews the proposed plan and makes any necessary modifications (e.g., changing the order of the destinations, changing the number of nights spent, etc.) on the interface.

[0981] The terminal transmits the correction data to the server.

[0982] The server regenerates a new travel plan and transmits it again to the user terminal.

[0983] 7. Confirmation of reservation

[0984] The user instructs the reservation of the confirmed plan.

[0985] The terminal sends a reservation request to the server.

[0986] The server sends reservation requests through the reservation APIs of various service providers (e.g., transportation, accommodation, tourist attractions). If the reservation is confirmed, the information is stored in the database.

[0987] 8. Notification of Details

[0988] The server transmits the confirmed reservation information to the user terminal.

[0989] The terminal will present the user with detailed schedules for each travel date and transportation transfer information.

[0990] Specific examples

[0991] When a user plans a "three-night, four-day trip from Tokyo to Kyoto," the system operates as follows:

[0992] 1. The user uses the terminal to input "Tokyo to Kyoto, 3 nights and 4 days trip, budget 150,000 yen, temple visit."

[0993] 2. The device sends this data to the server.

[0994] 3. The server saves the input data in a database and calls an external API to obtain information on transportation, accommodation, and temple tours.

[0995] 4. Based on the information obtained by the server, it generates a travel plan such as "Take the Shinkansen from Tokyo Station, stay at Hotel ABC in Kyoto City, and visit Kiyomizu-dera Temple, Kinkaku-ji Temple, and Ginkaku-ji Temple."

[0996] 5. The emotion engine analyzes the user's emotions from facial expression data and voice tone and evaluates the user's satisfaction with the travel plan.

[0997] 6. The server modifies the travel plan as needed based on the emotion data.

[0998] 7. The server sends the travel plan to the terminal, which displays it to the user.

[0999] 8. The user is dissatisfied with the crowds on the day they visit Kinkakuji Temple, so they make a modification to swap the itinerary for the second and third days.

[1000] 9. The device sends the corrected data to the server, and the server generates and resends a new plan.

[1001] 10. The user confirms the final plan that they are satisfied with and instructs the reservation to be confirmed.

[1002] 11. The device sends a reservation request to the server, and the server confirms the reservation with transportation, accommodation, and tourist attractions through the reservation API.

[1003] 12. The server sends this reservation information to the terminal, and the terminal notifies the user of the travel itinerary and transfer information.

[1004] In this way, the system takes into account the user's emotions and provides a travel plan optimized for individual needs. Travelers can easily create an integrated travel plan and enjoy their trip in the most optimal way. The emotion engine also enables flexible responses to increase satisfaction during the trip.

[1005] The processing flow will be explained below.

[1006] Program processing

[1007] Step 1:

[1008] A user launches a travel plan generation application on a terminal and inputs travel preferences (e.g., origin, destination, budget, dates, preferred activities) into the interface.

[1009] Step 2:

[1010] The terminal converts the input data into JSON format and sends it to the server as an HTTP POST request.

[1011] Step 3:

[1012] The server analyzes the received data and stores it in a database.

[1013] Step 4:

[1014] The server executes a query from the database to obtain information on transportation, accommodation, and tourist attractions related to the traveler's preferences.

[1015] Step 5:

[1016] Based on the initial data acquired by the server, external APIs (e.g., transport booking API, hotel booking API, tourist destination information API) are called to obtain real-time availability and price information. The response to each API request is received and analyzed.

[1017] Step 6:

[1018] Based on the real-time information acquired by the server, the system generates an optimal travel plan that meets the traveler's needs, including determining the travel schedule, accommodation, and order of visits.

[1019] Step 7:

[1020] The emotion engine transmits emotion data (e.g., facial expression recognition data, voice tone data) acquired from the user's device to the server.

[1021] Step 8:

[1022] The server analyzes the received emotion data and evaluates the user's emotion regarding the travel plan.

[1023] Step 9:

[1024] The server then modifies the itinerary as needed based on the results of the emotion analysis, for example adding relaxing activities if the emotion engine detects that the user is stressed.

[1025] Step 10:

[1026] The server converts the generated or modified travel plan into JSON format and sends it to the terminal.

[1027] Step 11:

[1028] The device then converts the itinerary into a human-readable format and displays it in the application's interface, including an itinerary, transport schedules, accommodation information and details of tourist attractions.

[1029] Step 12:

[1030] The user checks the displayed travel plan and makes any necessary modifications (e.g., changing the order of the destinations, the number of nights, etc.) on the interface.

[1031] Step 13:

[1032] The terminal converts the modified data from the user into JSON format and sends it back to the server.

[1033] Step 14:

[1034] The server receives the modified data and regenerates a new itinerary reflecting the necessary modifications.

[1035] Step 15:

[1036] The server sends the regenerated travel plan to the terminal, which displays it to the user.

[1037] Step 16:

[1038] The user finally decides on a plan that satisfies them and issues a reservation instruction via the interface.

[1039] Step 17:

[1040] The device sends a reservation request in JSON format to the server.

[1041] Step 18:

[1042] The server sends reservation requests through the reservation APIs of various service providers (e.g., transportation, accommodation, tourist attractions). If the reservation is confirmed, the information is stored in the database.

[1043] Step 19:

[1044] After the reservation request is completed, the server sends the confirmed reservation information in JSON format to the terminal.

[1045] Step 20:

[1046] The terminal presents detailed schedules for each travel date and transportation transfer information, and notifies the user of this.

[1047] The above processing steps allow travelers to easily create an integrated itinerary and enjoy it in the most optimal way. In addition, by using an emotion engine in combination, it becomes possible to flexibly modify the itinerary while taking into account the user's emotions during the trip, thereby improving user satisfaction.

[1048] Example 2

[1049] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1050] Conventional travel plan generation systems were unable to fully consider users' emotions and real-time situations when generating travel plans based on travelers' preferences. As a result, the proposed travel plans may not match the user's true needs and emotions, potentially resulting in low satisfaction. In addition, modifying and optimizing travel plans is cumbersome, leaving the user experience in need of significant improvement.

[1051] The specification processing by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes an interface means for inputting the traveler's preferences, a means for acquiring information on transportation, accommodations, and tourist attractions based on the input preferences, a means for generating a travel plan based on the acquired information, an emotion recognition means for acquiring and analyzing the user's emotion data, a means for optimizing the travel plan based on the analysis results of the emotion recognition means, a means for displaying the generated or revised travel plan to the traveler, a means for the traveler to modify the displayed travel plan, a means for regenerating the revised travel plan, a means for booking the regenerated travel plan, and a means for notifying the traveler of details of the booked travel plan. This makes it possible to propose an optimal travel plan to the traveler taking into account the user's emotions and real-time information, thereby significantly improving the user experience.

[1052] "Interface means" means an input device or software that allows a traveler to input their preferences and communicate them to the system.

[1053] "Means of obtaining information on transportation, accommodation, and tourist destinations" refers to technical means for collecting detailed information on transportation, accommodation, and tourist destinations via the Internet, etc.

[1054] The "means for generating a travel plan" is an algorithm or software for creating a travel plan based on the acquired information according to the traveler's wishes.

[1055] "Emotion recognition means" refers to a technical means for acquiring emotional data such as facial expressions and tone of voice of a traveler and analyzing it to determine the emotional state of the traveler.

[1056] The "means for optimizing the travel plan" is an algorithm or software for further adjusting or improving the travel plan by taking into account the emotional state of the traveler based on the analysis results of the emotion recognition means.

[1057] The "means for displaying the itinerary to the traveler" refers to an output device or software for outputting the generated or modified itinerary to a user terminal and visually displaying it.

[1058] A "Traveler Modification Instrument" is an input device or software that allows a traveler to make necessary changes to the displayed itinerary.

[1059] A "means for regenerating a revised itinerary" is an algorithm or software that generates a new itinerary based on the traveler's revisions.

[1060] "Means for making reservations for travel plans" refers to the technical means for making reservations for transportation, accommodation, tourist attractions, etc. based on the generated or modified travel plan.

[1061] "Means for notifying travel plan details" means the technical means for notifying travelers of confirmed travel plan details and reservation information.

[1062] This invention relates to a system that generates travel plans based on the traveler's wishes and combines them with an emotion engine that recognizes the user's emotions to provide the traveler with the most suitable travel plan. This system can centrally manage travel plan generation, user emotion recognition, plan modification and optimization, and reservation confirmation.

[1063] System configuration

[1064] The system consists of the following main components:

[1065] 1. User terminal: A device such as a smartphone, tablet, or PC that allows travelers to input their preferences and receive travel plan suggestions.

[1066] 2. Server: This is the central system for processing itinerary creation, modification, booking, and sentiment analysis. The server software uses Apache, an SQL database, and a sentiment analysis module.

[1067] 3. Database: This is data storage for storing information on transportation, accommodation, and tourist spots, as well as user emotion data. Specifically, a relational database such as MySQL or PostgreSQL is used.

[1068] 4. External API: An interface for obtaining real-time information on transportation, accommodation, etc. Examples include public transportation API, hotel reservation API, tourist destination information API, etc.

[1069] 5. Emotion Engine: This is a module for recognizing and analyzing user emotions. Specific software used is the Microsoft Azure emotion recognition API and the Google Cloud emotion analysis API.

[1070] Program processing

[1071] 1. User preference input

[1072] The user uses the terminal to input their travel preferences (origin, destination, budget, dates, preferred activities) into the interface.

[1073] The terminal transmits the input data to the server.

[1074] 2. Data Receipt and Storage

[1075] The server analyzes the received data and stores it in a database.

[1076] 3. Generate a travel plan

[1077] The server executes a query from the database to obtain information on transportation, accommodation, and tourist attractions that meet the traveler's preferences.

[1078] Based on the initial data acquired by the server, external APIs (transportation booking API, hotel booking API, tourist destination information API) are called to obtain real-time availability and price information.

[1079] Generate the optimal travel plan based on the acquired information.

[1080] 4. User Emotion Recognition

[1081] The emotion engine acquires emotion data (facial expression recognition data, voice tone data) from the user's device.

[1082] The server analyzes the received emotional data and reflects it in the travel plan.

[1083] 5. View your plan

[1084] The server transmits the generated or modified travel plan to the user terminal.

[1085] The device displays the received plan to the user, including a specific itinerary, transportation schedules, accommodation information, and details of tourist attractions.

[1086] 6. Amendments to the Plan

[1087] The user checks the proposed plan and makes any necessary modifications (such as changing the order of the destinations or the number of nights) on the interface.

[1088] The terminal transmits the correction data to the server.

[1089] The server regenerates a new travel plan and transmits it again to the user terminal.

[1090] 7. Confirmation of reservation

[1091] The user instructs the reservation of the confirmed plan.

[1092] The terminal sends a reservation request to the server.

[1093] The server sends reservation requests through the reservation APIs of various service providers (transportation, accommodation, tourist destinations). If the reservation is confirmed, the information is stored in the database.

[1094] 8. Notification of Details

[1095] The server transmits the confirmed reservation information to the user terminal.

[1096] The terminal will present the user with detailed schedules for each travel date and transportation transfer information.

[1097] Specific examples

[1098] When a user plans a "three-night, four-day trip from Tokyo to Kyoto," the system operates as follows:

[1099] 1. The user uses the terminal to input "Tokyo to Kyoto, 3 nights and 4 days trip, budget 150,000 yen, temple visit."

[1100] 2. The device sends this data to the server.

[1101] 3. The server saves the input data in a database and calls an external API to obtain information on transportation, accommodation, and temple tours.

[1102] 4. Based on the information obtained by the server, it generates a travel plan such as "Take the Shinkansen from Tokyo Station, stay at Hotel ABC in Kyoto City, and visit Kiyomizu-dera Temple, Kinkaku-ji Temple, and Ginkaku-ji Temple."

[1103] 5. The emotion engine analyzes the user's emotions from facial expression data and voice tone and evaluates the user's satisfaction with the travel plan.

[1104] 6. The server modifies the travel plan as needed based on the emotion data.

[1105] 7. The server sends the travel plan to the terminal, which displays it to the user.

[1106] 8. The user is dissatisfied with the crowds on the day they visit Kinkakuji Temple, so they make a modification to swap the itinerary for the second and third days.

[1107] 9. The device sends the corrected data to the server, and the server generates and resends a new plan.

[1108] 10. The user confirms the final plan that they are satisfied with and instructs the reservation to be confirmed.

[1109] 11. The device sends a reservation request to the server, and the server confirms the reservation with transportation, accommodation, and tourist attractions through the reservation API.

[1110] 12. The server sends this reservation information to the terminal, and the terminal notifies the user of the travel itinerary and transfer information.

[1111] In this way, the system takes into account the user's emotions and provides a travel plan optimized for individual needs. Travelers can easily create an integrated travel plan and enjoy their trip in the most optimal way. The emotion engine also enables flexible responses to increase satisfaction during the trip.

[1112] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1113] Step 1: Enter your desired data

[1114] The user inputs their travel preferences (origin, destination, budget, dates, desired activities, etc.) into the terminal.

[1115] Input: The user enters their preference for each item on the app screen.

[1116] Output: The input value is retained on the terminal as the desired data.

[1117] Specific steps: The user opens the app on their smartphone and enters their preferences in each field, such as "Departure: Tokyo," "Destination: Kyoto," "Budget: 150,000 yen," "Schedule: 3 nights, 4 days," and "Activity: Temple tour."

[1118] Step 2: Submit your desired data

[1119] The terminal transmits the input desired data to the server.

[1120] Input: The desired data entered in step 1.

[1121] Output: The desired data is sent over the network to the server.

[1122] Specific operation: When the user presses the "Send" button, the device sends the desired data to the server as an HTTP request.

[1123] Step 3: Receiving and storing data

[1124] The server receives the desired data sent from the terminal, analyzes it, and stores it in a database.

[1125] Input: An HTTP request containing the desired data.

[1126] Output: Desired data stored in a database.

[1127] What happens: The server receives the request, parses the data in JSON format, and executes a SQL query to insert it into a relational database.

[1128] Step 4: Generate your travel plan

[1129] The server queries the database to obtain information on transportation, accommodation, and tourist attractions that match the traveler's preferences.

[1130] Input: Desired data.

[1131] Output: Initial dataset (transportation, accommodation, tourist destination information).

[1132] Specific operation: The server queries the transportation table for the conditions "Departure: Tokyo" and "Destination: Kyoto" to obtain the best Shinkansen flight, then queries the accommodation table to obtain information on available hotels in Kyoto City.

[1133] Step 5: Get real-time information

[1134] The server calls an external API to retrieve real-time availability and pricing information.

[1135] Input: Information on transportation, accommodation, and tourist destinations contained in the initial dataset.

[1136] Output: Travel plan suggestions combined with real-time information.

[1137] Specific operation: The server calls the Shinkansen reservation API to obtain availability and prices for the entered flight, then calls the hotel reservation API to obtain availability and prices.

[1138] Step 6: Generate your travel plan

[1139] The server generates an optimal travel plan based on the information acquired.

[1140] Input: Travel plan suggestions combined with real-time information.

[1141] Output: Trip plan.

[1142] Specific operation: The server creates a travel plan taking into account the departure times of public transport and the check-in times of accommodations. For example, "Day 1: Tokyo to Kyoto, Shinkansen Nozomi flight 12, accommodation: Hotel ABC in Kyoto city."

[1143] Step 7: Obtaining emotion data

[1144] The emotion engine acquires emotion data (facial expression recognition data, voice tone data) from the user terminal.

[1145] Input: User's facial expression data and voice data.

[1146] Output: Parsed emotion data.

[1147] How it works: The device uses a camera and microphone to capture the user's facial expressions and voice. The emotion engine analyzes this data and generates a score such as "Satisfaction: High" or "Dissatisfaction: Low."

[1148] Step 8: Analyze and reflect on emotional data

[1149] The server analyzes the emotional data and reflects it in the travel plan.

[1150] Input: Emotion data.

[1151] Output: Optimized trip plan.

[1152] Specific operation: The server receives the emotional data and evaluates the user's emotional state for each part of the plan. If necessary, it adjusts the visit order and activity time allocation.

[1153] Step 9: View your travel plans

[1154] The server transmits the generated or modified travel plan to the terminal, which displays it to the user.

[1155] Input: Optimized itinerary data.

[1156] Output: The itinerary displayed on the user's device.

[1157] Specific operation: The server sends the travel plan data in JSON format to the device. The device parses the received JSON data and displays it visually on the app screen.

[1158] Step 10: Modify the plan

[1159] The user modifies the displayed itinerary.

[1160] Input: Data modified by the user.

[1161] Output: A modification request is sent from the device to the server.

[1162] Specific operation: The user enters "Change the date of visit to Kinkaku-ji Temple from the second day to the third day" in the app and presses the send button. The device then sends this corrected data to the server.

[1163] Step 11: Regenerate the revised plan

[1164] The server regenerates the revised travel plan and transmits it again to the user terminal.

[1165] Input: User modified data.

[1166] Output: The regenerated itinerary.

[1167] Specific operation: The server queries the database and external API again based on the newly revised data, generates and sends the revised itinerary.

[1168] Step 12: Confirm your booking

[1169] The user instructs the reservation of the confirmed plan, and the terminal transmits a reservation request to the server.

[1170] Input: Data that the user has indicated to be confirmed.

[1171] Output: Booking request sent to the Booking API.

[1172] Specific operation: The user selects "Book this plan" and presses the confirmation button. The device sends a reservation request to the server. The server calls the reservation API and confirms the reservation of transportation, accommodation, etc.

[1173] Step 13: Notification of details

[1174] The server transmits the confirmed reservation information to the user terminal, and the terminal notifies the user of the details.

[1175] Input: Confirmed reservation information.

[1176] Output: Travel itinerary and details.

[1177] Specific operation: The server sends reservation details in JSON format to the device. The device parses the JSON data and notifies the user of the travel itinerary, transfer information, hotel check-in information, etc. on the app.

[1178] In this way, the system can generate and provide optimal travel plans that take into account the user's wishes and feelings.

[1179] (Application example 2)

[1180] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1181] Conventional travel plan generation systems only create plans based on the traveler's wishes and do not dynamically modify them to take into account the traveler's emotions and satisfaction, making it impossible to reduce the stress and dissatisfaction felt by travelers. Similarly, shopping experiences in brick-and-mortar stores are also unable to dynamically modify plans to take into account the user's emotions, which can lead to a decrease in satisfaction. There is a need for a system that solves these problems and improves the satisfaction of travelers and users in brick-and-mortar stores.

[1182] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: an interface means for inputting the traveler's preferences; a means for acquiring information on transportation, accommodations, and tourist attractions based on the input preferences; a means for generating a travel plan based on the acquired information; a means for displaying the generated travel plan to the traveler; a means for the traveler to modify the displayed travel plan; a means for regenerating the modified travel plan; a means for making a reservation for the regenerated travel plan; a means for notifying the traveler of details of the reserved travel plan; a sentiment analysis means for recognizing and analyzing the user's emotions; and a means for dynamically modifying the travel plan based on the emotion data analyzed by the sentiment analysis means. This makes it possible to dynamically modify travel plans and shopping plans taking the user's emotions into consideration, thereby improving the satisfaction of travelers and users at physical stores.

[1183] 1. "Interface means" means the interface part of a device or software through which a traveler inputs his / her desired conditions or requests.

[1184] 2. "Means for acquiring information" refers to system components for collecting and processing data on transportation, accommodation, tourist attractions, etc.

[1185] 3. "Means for generating a travel plan" means an algorithm or process that uses the acquired information to create a travel plan based on the preferences entered by the user.

[1186] 4. "Display means" refers to a display or output device that visually shows the generated travel plan to the user.

[1187] 5. "Means for Modification" means an interface or software feature that allows a user to make changes to a generated itinerary.

[1188] 6. "Regenerating means" is an algorithm or process for updating the original travel plan based on user modifications.

[1189] 7. "Means for making reservations" refers to the part of the system that executes reservations for transportation and accommodation based on the finalized travel plan.

[1190] 8. "Means of Notification" means a messaging system or notification mechanism used to inform travelers of the details of their confirmed travel plans.

[1191] 9. "Emotion analysis means" refers to software modules or algorithms used to collect and analyze emotional data from users' facial expressions, voice, etc.

[1192] 10. "Dynamic Modification Means" means an algorithm or process that dynamically adjusts current travel or shopping plans based on emotional data obtained by the Emotion Analysis Means.

[1193] This invention is a system that generates travel plans and shopping plans based on the wishes of travelers and users in physical stores, and provides the optimal plans for users by combining it with an emotion engine that recognizes the user's emotions. This system includes the following main components:

[1194] System configuration

[1195] The system mainly consists of the following components:

[1196] 1. User terminal: A device (e.g., smartphone, tablet, PC) through which travelers and shoppers enter their preferences and receive generated plan proposals.

[1197] 2. Server: A central system for handling travel and shopping plan generation, modification, booking, and sentiment analysis.

[1198] 3. Database: Data storage for storing information on transportation, accommodation, tourist attractions, and physical store products, as well as user sentiment data.

[1199] 4. External API: An interface for obtaining real-time information on transportation, accommodation, products in physical stores, etc.

[1200] 5. Sentiment analysis means: A module for recognizing and analyzing user emotions.

[1201] Program processing

[1202] 1. User preference input

[1203] Enter your travel and shopping preferences (e.g., destination, budget, dates, preferred activities and brands) on your device.

[1204] The user terminal transmits the input data to the server.

[1205] 2. Data Receipt and Storage

[1206] The server analyzes the received data and stores it in a database.

[1207] 3. Generate a plan

[1208] The server executes a query from the database to obtain product information on transportation, accommodation, tourist spots, and brick-and-mortar stores that match the user's preferences.

[1209] Based on the initial data acquired by the server, external APIs (e.g., transport booking APIs, hotel booking APIs, physical store product information APIs) are called to obtain real-time availability and price information.

[1210] Based on the information obtained, optimal travel and shopping plans are generated.

[1211] 4. User Emotion Recognition

[1212] The emotion analysis means acquires emotion data (e.g., facial expression recognition data, voice tone data) from the user's terminal.

[1213] The server analyzes the received emotional data and reflects it in travel and shopping plans.

[1214] The server modifies or regenerates the plan based on the analysis results.

[1215] 5. View your plan

[1216] The server transmits the generated or modified plan to the user terminal.

[1217] The user terminal displays the received plan to the user, including a specific itinerary, transportation schedules, accommodation information, tourist attractions, and shopping plans.

[1218] 6. Amendments to the Plan

[1219] The user checks the proposed plan and makes any necessary modifications (e.g., changing the order of destinations, number of nights, shopping items, etc.) on the interface.

[1220] The user terminal transmits the correction data to the server.

[1221] The server regenerates a new plan and sends it to the user terminal again.

[1222] Specific examples

[1223] Travel Planner

[1224] When a user plans a "three-night, four-day trip from Tokyo to Kyoto," the system operates as follows:

[1225] The user uses the terminal and inputs "Tokyo to Kyoto, 3 nights and 4 days trip, budget 150,000 yen, temple visit."

[1226] The user terminal transmits this data to the server.

[1227] The server stores the input data in a database and calls an external API to retrieve information on transportation, accommodation, and temple tours.

[1228] The server generates a travel plan based on the obtained information.

[1229] The emotion analysis means analyzes the user's emotions from facial expression data and voice tone, and evaluates the user's satisfaction with the travel plan.

[1230] The server modifies the travel plan as needed based on the emotion data.

[1231] Shopping Plan

[1232] A similar process can be applied if a user plans to "find a bag of a specific brand with a budget of 20,000 yen."

[1233] The user enters into the app, "I'm looking for a bag from a specific brand with a budget of 20,000 yen."

[1234] The app retrieves store inventory information in real time and generates a plan such as, "This bag is on the second floor, on the right side."

[1235] If a user becomes dissatisfied while browsing bags, emotional data is obtained through facial expressions and a new bag is recommended.

[1236] An example of a prompt is:

[1237] User: "I'm looking for a new bag from a specific brand with a budget of ¥20,000."

[1238] System: "The following item was found. It's on the second floor, on the right."

[1239] (User is dissatisfied with the bag)

[1240] System: "Analyzing sentiment...Recommend other similar products."

[1241] In this way, the system takes into account the user's emotions and provides travel and shopping plans optimized to individual needs. Users can easily create integrated plans and enjoy them with a sense of satisfaction. In addition, the emotion analysis means allows for flexible responses to increase user satisfaction.

[1242] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1243] Step 1:

[1244] The user uses the device to input their travel and shopping preferences. The input data includes the destination, budget, dates, preferred activities and brands. An example input might be, "I'm looking for a bag from a specific brand with a budget of 20,000 yen." This data is sent from the device to the server.

[1245] Step 2:

[1246] The server analyzes the received user preference data and stores it in a database. For example, data is stored as "Search criteria: budget 20,000 yen, brand: specific brand." Database management software is used for this analysis and storage process.

[1247] Step 3:

[1248] The server executes a query from the database to obtain information on transportation, accommodation, tourist attractions, and physical store products that match the user's preferences. Based on this query, the necessary information is extracted from the database.

[1249] Step 4:

[1250] Based on the initial data acquired by the server, external APIs (e.g., transport reservation APIs, hotel reservation APIs, and physical store product information APIs) are called to obtain real-time availability and price information. For example, an API is used to obtain "stock information for a specific brand of bag." This acquired data is also stored on the server.

[1251] Step 5:

[1252] Based on the information acquired by the server, optimal travel plans and shopping plans are generated. Travel plan generation algorithms and shopping plan generation algorithms are used to generate travel plans. An example of a generated plan is a specific plan such as "Bag A is located on the right side of the second floor."

[1253] Step 6:

[1254] Emotion analysis means acquires emotion data (e.g., facial expression recognition data, voice tone data) from the user terminal. This data is sent from the terminal to the server, and the server receives it. For example, if the user shows a "dissatisfied expression," the facial expression data is analyzed.

[1255] Step 7:

[1256] The server analyzes the received emotional data and reflects it in travel plans and shopping plans. An example of emotional data is the analysis result, which may be "dissatisfied state." The server modifies or regenerates the plan based on this data. A dynamic plan modification algorithm is used to modify the plan.

[1257] Step 8:

[1258] The server sends the generated or modified plan to the user terminal. The user terminal displays the received plan to the user. For example, a specific plan such as "We recommend other similar products" is presented.

[1259] Step 9:

[1260] The user checks the proposed plan and makes any necessary modifications (e.g., changing the order of destinations, number of nights, shopping items, etc.) on the interface. The modified data is sent from the user's device to the server. An example of input is a modification such as "I would also like to see bag B."

[1261] Step 10:

[1262] The server regenerates a new plan and sends it to the user's device again. The regenerated plan is displayed to the user, and this process is repeated until the user is satisfied. For example, a specific new plan such as "Bag B is on the third floor" is presented.

[1263] Through the above processing steps, the system can take into account the user's wishes and feelings and provide travel and shopping plans optimized to individual needs.

[1264] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1265] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1266] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1267] [Third embodiment]

[1268] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1269] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1270] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1271] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1272] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1273] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1274] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1275] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1276] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1277] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1278] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1279] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1280] This invention relates to a system that integrates travel plans according to travelers' wishes and distributes travel dates and destinations according to reservation status. Furthermore, this system also provides integrated navigation functions such as transportation transfer information.

[1281] System configuration

[1282] The system mainly consists of the following components:

[1283] 1. User terminal: A device (e.g., smartphone, tablet, PC) through which travelers input their preferences and receive travel plan suggestions.

[1284] 2. Server: The central system for handling travel plan generation, modification and booking.

[1285] 3. Database: Data storage for storing information on transportation, accommodation and tourist destinations.

[1286] 4. External API: Interface for obtaining real-time information such as transportation and accommodation.

[1287] Program processing

[1288] 1. User preference input

[1289] The user uses the device to input their travel preferences (e.g., destination, budget, dates, preferred activities).

[1290] The terminal transmits the input data to the server.

[1291] 2. Data Receipt and Storage

[1292] The server stores the received data in a database.

[1293] 3. Generate a travel plan

[1294] The server retrieves information on transportation, accommodation, and tourist spots that match the traveler's preferences from the database.

[1295] The server calls an external API to retrieve real-time availability and pricing information.

[1296] Based on the acquired information, the optimal travel plan is generated.

[1297] 4. View your plan

[1298] The server transmits the generated travel plan to the user terminal.

[1299] The device will then display the received plan, including a detailed itinerary, transportation schedules, accommodation information, and details of tourist attractions.

[1300] 5. Amendments to the Plan

[1301] The user checks the proposed plan and makes any necessary modifications (e.g., changing the order of the tourist attractions to be visited, changing the number of nights to stay, etc.).

[1302] The terminal transmits the correction data to the server.

[1303] The server regenerates a new travel plan and transmits it again to the user terminal.

[1304] 6. Confirmation of reservation

[1305] The user instructs the reservation of the confirmed plan.

[1306] The terminal sends a reservation request to the server.

[1307] The server sends a request to various services (transportation, accommodation, tourist attractions) via an external API to confirm the reservation.

[1308] 7. Notification of Details

[1309] The server transmits the confirmed reservation information to the user terminal.

[1310] The terminal displays detailed travel itinerary and transport transfer information to the user.

[1311] Specific examples

[1312] When a user plans a "three-night, four-day trip from Tokyo to Kyoto," the system operates as follows:

[1313] 1. The user uses the terminal to input "Tokyo to Kyoto, 3 nights and 4 days trip, budget 150,000 yen, temple visit."

[1314] 2. The device sends this data to the server.

[1315] 3. The server saves the input data in a database and calls an external API to obtain information on transportation, accommodation, and temple tours.

[1316] 4. Based on the information obtained by the server, it generates a travel plan such as "Take the Shinkansen from Tokyo Station, stay at Hotel ABC in Kyoto City, and visit Kiyomizu-dera Temple, Kinkaku-ji Temple, and Ginkaku-ji Temple."

[1317] 5. The server sends this plan to the user's terminal, which displays it to the user.

[1318] 6. Since the day the user visits Kinkakuji Temple is crowded, the itinerary for the second and third days is swapped.

[1319] 7. The device sends the corrected data to the server, and the server generates and resends a new plan.

[1320] 8. The user is satisfied with the final plan and confirms the reservation.

[1321] 9. The device sends a reservation request to the server, and the server confirms the reservation with transportation, accommodation, and tourist attractions through the reservation API.

[1322] 10. The server sends the confirmed reservation information to the user's terminal, and the terminal notifies the user of the travel itinerary and transfer information.

[1323] In this way, this system will provide travelers with highly convenient travel plans, while also helping to resolve social issues such as reducing congestion.

[1324] The processing flow will be explained below.

[1325] Step 1:

[1326] A user launches a travel plan generation application on a terminal and inputs travel preferences (e.g., origin, destination, budget, dates, preferred activities) into the interface.

[1327] Step 2:

[1328] The terminal converts the input data into JSON format and sends it to the server as an HTTP POST request.

[1329] Step 3:

[1330] The server analyzes the received data and stores it in a database.

[1331] Step 4:

[1332] The server executes a query from the database to obtain transportation, accommodation, and tourist attraction information relevant to the traveler's preferences.

[1333] Step 5:

[1334] Based on the initial data acquired by the server, external APIs (e.g., transport booking API, hotel booking API, tourist destination information API) are called to obtain real-time availability and price information. The response to each API request is received and analyzed.

[1335] Step 6:

[1336] Based on the real-time information acquired by the server, the system generates an optimal travel plan that meets the traveler's needs, including determining the travel schedule, accommodation, and order of visits.

[1337] Step 7:

[1338] The travel plan generated by the server is converted into JSON format and sent to the terminal.

[1339] Step 8:

[1340] The device then converts the itinerary into a human-readable format and displays it in the application's interface, including an itinerary, transport schedules, accommodation information and details of tourist attractions.

[1341] Step 9:

[1342] The user checks the displayed travel plan and makes any necessary corrections (e.g., changing the order of visits, number of nights, etc.) on the interface.

[1343] Step 10:

[1344] The terminal converts the modified data from the user into JSON format and sends it back to the server.

[1345] Step 11:

[1346] The server receives the modified data and regenerates a new itinerary reflecting the necessary modifications.

[1347] Step 12:

[1348] The server sends the regenerated travel plan to the terminal, which displays it to the user.

[1349] Step 13:

[1350] The user finally decides on a plan that satisfies them and issues a reservation instruction via the interface.

[1351] Step 14:

[1352] The device sends a reservation request in JSON format to the server.

[1353] Step 15:

[1354] The server sends reservation requests through the reservation APIs of various service providers (e.g., transportation, accommodation, tourist attractions). If the reservation is confirmed, the information is stored in the database.

[1355] Step 16:

[1356] After the reservation request is completed, the server sends the confirmed reservation information in JSON format to the terminal.

[1357] Step 17:

[1358] The terminal presents detailed schedules for each travel date and transportation transfer information, and notifies the user of this.

[1359] Through the above processing steps, travelers can easily create an integrated travel plan and enjoy it in the most optimal way.

[1360] Example 1

[1361] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1362] Today's travelers want to create, modify, and book optimal travel plans that fit their individual preferences easily and quickly. However, these tasks typically require the use of multiple platforms and services, making them time-consuming and laborious. Furthermore, automating travel planning has been difficult due to the complex elements involved, such as obtaining real-time availability and pricing information, and providing transportation transfer information. Furthermore, travel plan suggestions using generative AI models have not performed satisfactorily, so there is a need to provide services that provide high user satisfaction.

[1363] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1364] In this invention, the server includes an interface for inputting traveler preferences, a means for acquiring information on transportation, accommodations, and tourist attractions based on the input preferences, a means for generating a travel plan based on the acquired information, a means for displaying the generated travel plan to the traveler, a means for the traveler to modify the displayed travel plan, a means for regenerating the modified travel plan, a means for making reservations for the regenerated travel plan, a means for notifying the traveler of details of the booked travel plan, an external API call means for acquiring real-time availability and price information, and a means for generating and displaying transfer information for the transportation modes included in the travel plan. This allows users to easily input their travel preferences, suggest and modify optimal travel plans, and automatically generate travel plans that reflect real-time reservation status and price information. Furthermore, by automatically generating and using prompt sentences from the generative AI model, efficient and high-quality travel plans can be provided.

[1365] An "interface means for inputting traveler preferences" is a digital interface (e.g., smartphone app, website, etc.) through which travelers input their preferences, such as travel destination, budget, dates, and preferred activities.

[1366] "Means for obtaining information on transportation, accommodation, and tourist attractions" refers to a mechanism for collecting information on relevant transportation, accommodation, and tourist attractions based on the input preferences.

[1367] The "means for generating a travel plan" is an algorithm that automatically creates a travel schedule and itinerary that best suits the traveler's wishes based on the acquired information.

[1368] "Means for displaying to travelers" refers to a mechanism for visually providing the generated travel plan to travelers (e.g., displaying on a screen, generating a PDF, etc.).

[1369] "Means for modification" refers to the functionality that allows a traveler to make changes to the displayed itinerary.

[1370] The "means for regenerating a revised itinerary" is an algorithm for regenerating a new itinerary that reflects the changes made by the traveler.

[1371] A "means for making reservations for travel plans" is a system for automatically making reservations based on the finalized travel plan.

[1372] "Means of notifying travelers of details of booked travel plans" refers to a function for notifying travelers of confirmed reservation information (e.g., email notification, app notification, etc.).

[1373] "Means for calling external APIs to obtain availability and price information in real time" refers to a mechanism for obtaining real-time availability and price information using external data provision services (e.g., APIs).

[1374] The "means for generating and displaying transfer guide information for the means of transportation included in the travel plan" is a mechanism for generating detailed transfer guide information for the means of transportation included in the travel plan and displaying it.

[1375] A "generative AI model" is an artificial intelligence algorithm used to generate travel plans, proposing optimal plans based on a given prompt.

[1376] A "prompt" is an instruction or question that is input to a generative AI model, and serves as the basis for the model to generate an optimal response.

[1377] The present invention relates to a system that generates optimal travel plans based on travelers' preferences, and then modifies and reserves the plans. This system is configured using a user terminal, a server, a database, and an external API. Specific embodiments of this system are described in detail below.

[1378] System Configuration

[1379] User device: A device used by a user to input travel preferences, generate travel plans, and make corrections. Specific devices include smartphones, tablets, and PCs.

[1380] Server: The central system for handling travel plan generation, modifications, and reservations.

[1381] Database: Data storage for storing information about transport, accommodation and tourist destinations.

[1382] External API: API interface used to obtain real-time availability and pricing information.

[1383] Program processing

[1384] In this system, the user inputs their travel preferences using a terminal, and the system generates and displays the optimal travel plan based on that information. If the user modifies the plan, the system generates a new plan reflecting the modifications, and finally confirms the reservation. The process is as follows:

[1385] 1. The user enters their preference

[1386] The user uses the terminal to input their preferences, such as "Destination: Kyoto, budget: 150,000 yen, 3 nights, 4 days, temple tour desired." The terminal then sends this data to the server.

[1387] 2. The server receives and stores the data

[1388] The server stores the received data in a database, for example in a "user preferences" table using an SQL query.

[1389] 3. The server generates the itinerary

[1390] The server retrieves information on transportation, accommodation, and tourist destinations from the database, and uses external APIs to obtain real-time availability and price information. This information is then integrated to generate the optimal travel plan.

[1391] 4. Display the travel plan on the user's device

[1392] The server sends the generated itinerary in JSON format to the device, which then visually displays it, including a detailed itinerary, transport schedules, accommodation information, and details of tourist attractions.

[1393] 5. The user modifies the plan

[1394] The user can make corrections to the displayed plan, such as "Kinkakuji Temple is crowded, so I'd like to switch the itinerary for the second and third days." The device then sends the correction data to the server.

[1395] 6. The server generates a new plan that reflects the changes.

[1396] The server again generates a plan based on the corrected data and transmits it to the terminal again.

[1397] 7. The user confirms the booking

[1398] The user instructs the device to reserve the confirmed plan, and the device sends the request to the server. The server confirms the reservation via an external API and sends the details to the device. The device then notifies the user of the detailed travel itinerary and transportation transfer information.

[1399] Specific examples

[1400] When a user plans a "three-night, four-day trip from Tokyo to Kyoto," the system operates as follows: The user enters "destination: Kyoto, budget: 150,000 yen, three-night, four-day trip, temple visit desired," and the device sends this information to the server. The server retrieves information from the database and collects real-time data using an external API. For example, it generates a plan such as "Shinkansen from Tokyo Station, accommodation: hotel in Kyoto City, sightseeing spots: Kiyomizu-dera Temple, Kinkaku-ji Temple, Ginkaku-ji Temple."

[1401] The user amends the itinerary by saying, "The day we visit Kinkaku-ji Temple is crowded, so I'd like to switch the itinerary between the second and third days," and the device sends this information to the server. The server generates a new plan and sends it back to the user's device. When the user is satisfied with the final plan, they instruct the server to confirm the reservation. The device then sends a reservation request to the server, which confirms the reservation via an external API. The confirmed reservation information is then sent to the user's device, and the user is notified of the detailed travel itinerary and transfer information. In this way, travelers can efficiently plan their trips.

[1402] Example prompt sentence:

[1403] "I'd like to create a 3-night, 4-day itinerary for a trip from Tokyo to Kyoto. My budget is 150,000 yen, and I'd like to visit temples. I'd like you to suggest the best plan for me based on information about transportation, accommodations, and tourist spots."

[1404] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1405] Step 1:

[1406] The user inputs their travel preferences.

[1407] Input: The user uses a terminal to input their preferences, such as "Destination Kyoto, budget 150,000 yen, 3 nights, 4 days, hope to visit temples."

[1408] How it works: The device receives user input data. It collects data through a form or interface. This data is organized in a structured format (e.g., JSON).

[1409] Output: The organized input data is ready to be sent to the server.

[1410] Step 2:

[1411] The terminal sends the input data to the server.

[1412] Input: User preference data collected in step 1.

[1413] How it works: The device sends data to the server over the internet by making a POST request using the REST API and sending the input data to the server in JSON format.

[1414] Output: The server receives the POST request and retrieves the input data.

[1415] Step 3:

[1416] The server stores the received data in a database.

[1417] Input: User preference data sent from the device.

[1418] What it does: The server extracts the necessary information from the request body, executes a SQL query, and saves the data into a "user preferences" table in the database.

[1419] Output: User preference data stored in a database.

[1420] Step 4:

[1421] The server retrieves information that matches the traveler's preferences from the database.

[1422] Input: User preference data stored in the database.

[1423] How it works: The server executes SQL queries to retrieve information about transportation, accommodation, and tourist attractions from a database.

[1424] Output: Retrieved transport, accommodation and tourist destination data.

[1425] Step 5:

[1426] The server calls an external API to retrieve real-time availability and pricing information.

[1427] Input: Transport, accommodation and tourist destination data taken from databases.

[1428] How it works: The server calls an external API (e.g., Google Maps API, hotel booking site API) to get real-time reservation status and pricing information. The data is returned in JSON format.

[1429] Output: Real-time availability and pricing information.

[1430] Step 6:

[1431] The server generates an optimal travel plan based on the acquired information.

[1432] Input: Information from databases and real-time information from external APIs.

[1433] How it works: The server analyzes this data with an algorithm to generate an optimal travel plan, calculating the fastest route and optimizing the time spent at each tourist spot.

[1434] Output: Optimal travel plan.

[1435] Step 7:

[1436] The server transmits the generated travel plan to the user terminal.

[1437] Input: The generated itinerary.

[1438] Operation: The server generates a plan and sends it to the device as a response. The data is structured in JSON format and sent via the REST API.

[1439] Output: The trip plan data received by the device.

[1440] Step 8:

[1441] Displays the plan received by the device.

[1442] Input: Travel plan data sent from the server.

[1443] How it works: The device analyzes the data it receives and displays it on its screen, including specific itineraries, transport schedules, accommodation information and details about tourist attractions.

[1444] Output: A visually displayed itinerary.

[1445] Step 9:

[1446] The user reviews the proposed plan and makes any necessary corrections.

[1447] Input: The displayed itinerary.

[1448] Operation: The user checks the plan and makes some changes, such as "Kinkakuji Temple is crowded, so I'd like to switch the itinerary between the second and third days." The device collects the changes.

[1449] Output: The modified data is saved to the device.

[1450] Step 10:

[1451] The terminal transmits the correction data to the server.

[1452] Input: User-modified data.

[1453] How it works: The device structures the correction data in JSON format and resends it to the server, using the REST API to send the data in a POST request.

[1454] Output: The correction data received by the server.

[1455] Step 11:

[1456] The server regenerates a new travel plan and transmits it again to the user terminal.

[1457] Input: Correction data.

[1458] Operation: The server recalculates based on the changes and generates a new itinerary, which is then sent to the device again.

[1459] Output: The new travel plan data is sent to the device.

[1460] Step 12:

[1461] The user instructs the reservation of the confirmed plan.

[1462] Input: The final displayed itinerary.

[1463] Operation: The user confirms the final plan and indicates that they want to confirm the reservation. The device prepares a reservation confirmation request.

[1464] Output: A booking confirmation request is prepared on the terminal.

[1465] Step 13:

[1466] The terminal sends a reservation request to the server.

[1467] Input: Confirmed booking request.

[1468] How it works: The device structures the reservation information in JSON format and sends it to the server via a POST request.

[1469] Output: The reservation request received by the server.

[1470] Step 14:

[1471] The server sends a request to various services via an external API to confirm the reservation.

[1472] Input: Booking request data.

[1473] How it works: The server calls an external transport booking API or accommodation booking API to confirm the reservation. The external API returns a reservation ID, confirmation number, etc.

[1474] Output: Confirmed booking information.

[1475] Step 15:

[1476] The server transmits the confirmed reservation information to the user terminal.

[1477] Input: Confirmed booking information.

[1478] How it works: The server structures the reservation information into JSON format and sends it to the device via the REST API.

[1479] Output: Confirmed reservation information received by the terminal.

[1480] Step 16:

[1481] The terminal displays detailed travel itinerary and transport transfer information to the user.

[1482] Input: Confirmed reservation information sent from the server.

[1483] How it works: The device analyzes the data it receives and displays detailed travel itineraries, transport route information, reservation IDs and confirmation numbers to the user.

[1484] Output: Detailed trip plan and confirmation information displayed to the user.

[1485] (Application example 1)

[1486] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1487] Modern travelers face a lot of hassle, from planning their trips to booking reservations and navigating the local area. They also lack a means to easily check local tourist and transportation information in real time. This forces travelers to frequently use their smartphones while traveling, reducing the enjoyment and convenience of their trip. Furthermore, there is a demand for an efficient travel experience that utilizes visual and audio interfaces.

[1488] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1489] In this invention, the server includes an interface means for inputting traveler preferences, a means for acquiring information on transportation, accommodations, and tourist attractions based on the input preferences, a means for generating a travel plan based on the acquired information, a means for displaying the generated travel plan to the traveler, a means for the traveler to modify the displayed travel plan, a means for regenerating the modified travel plan, a means for making reservations for the regenerated travel plan, a means for notifying the traveler of details of the booked travel plan, a display means for displaying visual information in real time based on the travel plan, and an input means for operating the visual information in response to voice commands. This allows travelers to receive consistent support from generating travel plans to making reservations and navigating on site, and also allows them to intuitively and efficiently refer to information on site.

[1490] "Traveller" refers to an individual who plans and undertakes a trip.

[1491] "Desired" refers to the specific conditions that a traveler desires in their travel plans, such as destination, duration, budget, and activities.

[1492] "Interface means" refers to devices and software that allow travelers to input preferences and exchange information.

[1493] "Transportation" refers to all means of transportation used by travelers to get around (e.g., trains, buses, airplanes, etc.).

[1494] "Accommodation" refers to a place where travelers stay (e.g., hotel, inn, guesthouse, etc.).

[1495] "Tourist destinations" refer to tourist spots and famous places that tourists want to visit.

[1496] "Travel Plan" means a travel schedule and list of destinations organized based on a traveler's preferences.

[1497] "Regeneration" refers to a traveler recreating a new travel plan based on their revised preferences.

[1498] "Reservation" refers to the act of reserving in advance the visit and use of transportation, accommodation, and tourist attractions included in a travel plan.

[1499] "Details" refers to specific information about the booked travel plan (e.g., transportation departure times, accommodation check-in times, etc.).

[1500] "Notification" refers to the act of informing travelers of details or changes to their travel plans.

[1501] "Display means" refers to display devices and display technologies used to provide visual information to travelers.

[1502] "Input means" refers to devices and software that allow travelers to input and operate information.

[1503] "Voice command" refers to an instruction that a traveler gives to the system using voice.

[1504] The present invention relates to a system for generating a travel plan according to a traveler's wishes and providing on-site navigation and information. Hereinafter, an embodiment of the present invention will be described in detail.

[1505] System configuration

[1506] The system mainly consists of the following components:

[1507] User terminal: A device (e.g., smartphone, tablet, smart glasses) through which a traveler inputs their preferences and receives travel plan suggestions.

[1508] Server: The central system that handles travel plan generation, modification, and booking.

[1509] Database: Data storage for transport, accommodation and tourist destination information.

[1510] External API: Interface for obtaining real-time information on transport, accommodation etc.

[1511] Display means: A device for displaying local information using a HUD (head-up display) such as smart glasses.

[1512] Input means: Devices and software that recognize voice commands and perform operations (e.g., voice recognition engine).

[1513] Program processing

[1514] The server performs the following process: The user uses the device to input their travel preferences (e.g., destination, budget, dates, activities). This data is sent to the server, which then generates a travel plan through the database and external API. The plan is displayed on the user's device and is regenerated if the user makes any changes. The finalized plan is then processed for booking, and the details are sent to the user's device.

[1515] Operating Procedure

[1516] The steps in generating a travel plan by the server are as follows: When the user inputs their travel preferences, the server receives them and retrieves the necessary information from the database and external APIs. Next, it generates a travel plan based on that information and sends it to the user's device for display. If the user wants to modify the displayed plan, it receives that information, generates a new plan, and sends it again.

[1517] Hardware and software used

[1518] Hardware:

[1519] Smart glasses (e.g., general-purpose head-mounted displays)

[1520] Built-in GPS

[1521] Speaker and microphone

[1522] software:

[1523] GPS API: A program to get your current location

[1524] External API (e.g., general-purpose data acquisition API): Acquire information on tourist attractions and accommodations

[1525] HUD: Providing visual information to travelers

[1526] Speech recognition engine (e.g., general-purpose voice recognition software): Recognizes voice commands

[1527] Specific examples

[1528] This shows the process when a user plans a "three-night, four-day trip from Tokyo to Kyoto." The user puts on smart glasses and can input by voice, "Tokyo to Kyoto, three-night, four-day trip, budget 150,000 yen, temple visits." The server generates an optimal travel plan based on that information and displays it on the user's smart glasses. The displayed plan includes transportation, accommodation, and tourist attractions, and when the user issues a voice command for "next tourist attraction," navigation information for the next tourist attraction is displayed on the HUD. In this way, the user can enjoy their trip intuitively.

[1529] Specific examples of prompts are as follows:

[1530] "Please tell me the best route from my current location to the next tourist spot I want to visit."

[1531] This system allows travelers to receive consistent support at every stage of their trip and makes it possible to refer to information on-site in an intuitive and efficient manner.

[1532] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1533] Step 1: User preference input

[1534] The user uses the terminal to input travel preferences (destination, budget, schedule, activities, etc.) through voice commands or an input interface. This data is sent from the terminal to the server.

[1535] Input: Destination, Budget, Dates, Activities

[1536] Data processing: Format conversion of input data (audio to text)

[1537] Output: Sending the formatted input data

[1538] Step 2: Receiving and storing data

[1539] The server receives the desired data sent from the device and stores it in a database. At the same time, it calls an external API to obtain the necessary information (information on transportation, accommodation, and tourist spots).

[1540] Input: Desired data sent from the terminal

[1541] Data processing: saving desired data, calling external API

[1542] Output: Save to database, retrieve information from external API

[1543] Step 3: Generate a travel plan

[1544] The server generates a travel plan optimized for the traveler's wishes based on information obtained from the database and external APIs. The generated plan includes information such as transportation timetables, accommodation reservations, and the order in which to visit tourist attractions.

[1545] Input: Information obtained from databases and external APIs

[1546] Data processing: Optimization calculation of travel plans

[1547] Output: Generated itinerary

[1548] Step 4: View your plan

[1549] The server sends the generated itinerary to the terminal and displays it on the HUD of the smart glasses or other terminal, allowing the user to visually check the itinerary.

[1550] Input: Generated itinerary

[1551] Data processing: Data transmission

[1552] Output: Trip plan displayed on HUD

[1553] Step 5: Modify the plan

[1554] If the user views the displayed itinerary and finds it necessary to make any corrections, he or she inputs the correction information into the terminal using a voice command or an input interface, and the terminal transmits the correction data to the server.

[1555] Input: User request for travel plan to be modified

[1556] Data processing: Format conversion of corrected data (audio to text)

[1557] Output: Send corrected data

[1558] Step 6: Regenerate the revised plan

[1559] The server receives the modified data from the user, optimizes the travel plan again, and regenerates the new travel plan, which is then sent to the terminal again.

[1560] Input: Correction data

[1561] Data processing: Reoptimization calculation

[1562] Output: Regenerated itinerary

[1563] Step 7: Confirm your booking

[1564] When the user is satisfied with the final travel plan, he / she issues a voice command or an input interface to confirm the reservation of the plan. The server processes the reservation request and confirms the reservation for various services.

[1565] Input: Final travel plan booking confirmation instructions

[1566] Data processing: Reservation procedure execution

[1567] Output: Send reservation confirmation data

[1568] Step 8: Notification of details

[1569] The server sends the confirmed reservation information to the terminal, which then notifies the user of the details. The user can then check the detailed itinerary and transportation transfer information on the smart glasses HUD or other terminal.

[1570] Input: Confirmed reservation information

[1571] Data processing: Data transmission

[1572] Output: Detailed travel itinerary and transit directions displayed on a HUD

[1573] This allows travelers to receive intuitive and efficient support throughout the entire travel process.

[1574] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1575] The present invention relates to a system that generates a travel plan based on a traveler's wishes and combines it with an emotion engine that recognizes the user's emotions to provide the traveler with the optimal travel plan. This system includes the following main components:

[1576] System configuration

[1577] The system mainly consists of the following components:

[1578] 1. User terminal: A device (e.g., smartphone, tablet, PC) through which travelers input their preferences and receive travel plan suggestions.

[1579] 2. Server: A central system for handling travel plan generation, modification, booking, and sentiment analysis.

[1580] 3. Database: Data storage for storing information on transportation, accommodation, tourist attractions, and user sentiment data.

[1581] 4. External API: Interface for obtaining real-time information such as transportation and accommodation.

[1582] 5. Emotion Engine: A module for recognizing and analyzing user emotions.

[1583] Program processing

[1584] 1. User preference input

[1585] The user uses the device to input travel preferences (e.g., origin, destination, budget, dates, preferred activities) into the interface.

[1586] The terminal transmits the input data to the server.

[1587] 2. Data Receipt and Storage

[1588] The server analyzes the received data and stores it in a database.

[1589] 3. Generate a travel plan

[1590] The server executes a query from the database to obtain information on transportation, accommodation, and tourist attractions that meet the traveler's preferences.

[1591] Based on the initial data acquired by the server, external APIs (e.g., transport booking API, hotel booking API, tourist destination information API) are called to obtain real-time availability and price information.

[1592] Based on the acquired information, the optimal travel plan is generated.

[1593] 4. User Emotion Recognition

[1594] The emotion engine acquires emotion data (e.g., facial expression recognition data, voice tone data) from the user's device.

[1595] The server analyzes the received emotional data and reflects it in the travel plan.

[1596] The server modifies or regenerates the itinerary based on the analysis results.

[1597] 5. View your plan

[1598] The server transmits the generated or modified travel plan to the user terminal.

[1599] The device displays the received plan to the user, including a specific itinerary, transportation schedules, accommodation information, and details of tourist attractions.

[1600] 6. Amendments to the Plan

[1601] The user reviews the proposed plan and makes any necessary modifications (e.g., changing the order of the destinations, changing the number of nights spent, etc.) on the interface.

[1602] The terminal transmits the correction data to the server.

[1603] The server regenerates a new travel plan and transmits it again to the user terminal.

[1604] 7. Confirmation of reservation

[1605] The user instructs the reservation of the confirmed plan.

[1606] The terminal sends a reservation request to the server.

[1607] The server sends reservation requests through the reservation APIs of various service providers (e.g., transportation, accommodation, tourist attractions). If the reservation is confirmed, the information is stored in the database.

[1608] 8. Notification of Details

[1609] The server transmits the confirmed reservation information to the user terminal.

[1610] The terminal will present the user with detailed schedules for each travel date and transportation transfer information.

[1611] Specific examples

[1612] When a user plans a "three-night, four-day trip from Tokyo to Kyoto," the system operates as follows:

[1613] 1. The user uses the terminal to input "Tokyo to Kyoto, 3 nights and 4 days trip, budget 150,000 yen, temple visit."

[1614] 2. The device sends this data to the server.

[1615] 3. The server saves the input data in a database and calls an external API to obtain information on transportation, accommodation, and temple tours.

[1616] 4. Based on the information obtained by the server, it generates a travel plan such as "Take the Shinkansen from Tokyo Station, stay at Hotel ABC in Kyoto City, and visit Kiyomizu-dera Temple, Kinkaku-ji Temple, and Ginkaku-ji Temple."

[1617] 5. The emotion engine analyzes the user's emotions from facial expression data and voice tone and evaluates the user's satisfaction with the travel plan.

[1618] 6. The server modifies the travel plan as needed based on the emotion data.

[1619] 7. The server sends the travel plan to the terminal, which displays it to the user.

[1620] 8. The user is dissatisfied with the crowds on the day they visit Kinkakuji Temple, so they make a modification to swap the itinerary for the second and third days.

[1621] 9. The device sends the corrected data to the server, and the server generates and resends a new plan.

[1622] 10. The user confirms the final plan that they are satisfied with and instructs the reservation to be confirmed.

[1623] 11. The device sends a reservation request to the server, and the server confirms the reservation with transportation, accommodation, and tourist attractions through the reservation API.

[1624] 12. The server sends this reservation information to the terminal, and the terminal notifies the user of the travel itinerary and transfer information.

[1625] In this way, the system takes into account the user's emotions and provides a travel plan optimized for individual needs. Travelers can easily create an integrated travel plan and enjoy their trip in the most optimal way. The emotion engine also enables flexible responses to increase satisfaction during the trip.

[1626] The processing flow will be explained below.

[1627] Program processing

[1628] Step 1:

[1629] A user launches a travel plan generation application on a terminal and inputs travel preferences (e.g., origin, destination, budget, dates, preferred activities) into the interface.

[1630] Step 2:

[1631] The terminal converts the input data into JSON format and sends it to the server as an HTTP POST request.

[1632] Step 3:

[1633] The server analyzes the received data and stores it in a database.

[1634] Step 4:

[1635] The server executes a query from the database to obtain information on transportation, accommodation, and tourist attractions related to the traveler's preferences.

[1636] Step 5:

[1637] Based on the initial data acquired by the server, external APIs (e.g., transport booking API, hotel booking API, tourist destination information API) are called to obtain real-time availability and price information. The response to each API request is received and analyzed.

[1638] Step 6:

[1639] Based on the real-time information acquired by the server, the system generates an optimal travel plan that meets the traveler's needs, including determining the travel schedule, accommodation, and order of visits.

[1640] Step 7:

[1641] The emotion engine transmits emotion data (e.g., facial expression recognition data, voice tone data) acquired from the user's device to the server.

[1642] Step 8:

[1643] The server analyzes the received emotion data and evaluates the user's emotion regarding the travel plan.

[1644] Step 9:

[1645] The server then modifies the itinerary as needed based on the results of the emotion analysis, for example adding relaxing activities if the emotion engine detects that the user is stressed.

[1646] Step 10:

[1647] The server converts the generated or modified travel plan into JSON format and sends it to the terminal.

[1648] Step 11:

[1649] The device then converts the itinerary into a human-readable format and displays it in the application's interface, including an itinerary, transport schedules, accommodation information and details of tourist attractions.

[1650] Step 12:

[1651] The user checks the displayed travel plan and makes any necessary modifications (e.g., changing the order of the destinations, the number of nights, etc.) on the interface.

[1652] Step 13:

[1653] The terminal converts the modified data from the user into JSON format and sends it back to the server.

[1654] Step 14:

[1655] The server receives the modified data and regenerates a new itinerary reflecting the necessary modifications.

[1656] Step 15:

[1657] The server sends the regenerated travel plan to the terminal, which displays it to the user.

[1658] Step 16:

[1659] The user finally decides on a plan that satisfies them and issues a reservation instruction via the interface.

[1660] Step 17:

[1661] The device sends a reservation request in JSON format to the server.

[1662] Step 18:

[1663] The server sends reservation requests through the reservation APIs of various service providers (e.g., transportation, accommodation, tourist attractions). If the reservation is confirmed, the information is stored in the database.

[1664] Step 19:

[1665] After the reservation request is completed, the server sends the confirmed reservation information in JSON format to the terminal.

[1666] Step 20:

[1667] The terminal presents detailed schedules for each travel date and transportation transfer information, and notifies the user of this.

[1668] The above processing steps allow travelers to easily create an integrated itinerary and enjoy it in the most optimal way. In addition, by using an emotion engine in combination, it becomes possible to flexibly modify the itinerary while taking into account the user's emotions during the trip, thereby improving user satisfaction.

[1669] Example 2

[1670] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1671] Conventional travel plan generation systems were unable to fully consider users' emotions and real-time situations when generating travel plans based on travelers' preferences. As a result, the proposed travel plans may not match the user's true needs and emotions, potentially resulting in low satisfaction. In addition, modifying and optimizing travel plans is cumbersome, leaving the user experience in need of significant improvement.

[1672] The specification processing by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes an interface means for inputting the traveler's preferences, a means for acquiring information on transportation, accommodations, and tourist attractions based on the input preferences, a means for generating a travel plan based on the acquired information, an emotion recognition means for acquiring and analyzing the user's emotion data, a means for optimizing the travel plan based on the analysis results of the emotion recognition means, a means for displaying the generated or revised travel plan to the traveler, a means for the traveler to modify the displayed travel plan, a means for regenerating the revised travel plan, a means for booking the regenerated travel plan, and a means for notifying the traveler of details of the booked travel plan. This makes it possible to propose an optimal travel plan to the traveler taking into account the user's emotions and real-time information, thereby significantly improving the user experience.

[1673] "Interface means" means an input device or software that allows a traveler to input their preferences and communicate them to the system.

[1674] "Means of obtaining information on transportation, accommodation, and tourist destinations" refers to technical means for collecting detailed information on transportation, accommodation, and tourist destinations via the Internet, etc.

[1675] The "means for generating a travel plan" is an algorithm or software for creating a travel plan based on the acquired information according to the traveler's wishes.

[1676] "Emotion recognition means" refers to a technical means for acquiring emotional data such as facial expressions and tone of voice of a traveler and analyzing it to determine the emotional state of the traveler.

[1677] The "means for optimizing the travel plan" is an algorithm or software for further adjusting or improving the travel plan by taking into account the emotional state of the traveler based on the analysis results of the emotion recognition means.

[1678] The "means for displaying the itinerary to the traveler" refers to an output device or software for outputting the generated or modified itinerary to a user terminal and visually displaying it.

[1679] A "Traveler Modification Instrument" is an input device or software that allows a traveler to make necessary changes to the displayed itinerary.

[1680] A "means for regenerating a revised itinerary" is an algorithm or software that generates a new itinerary based on the traveler's revisions.

[1681] "Means for making reservations for travel plans" refers to the technical means for making reservations for transportation, accommodation, tourist attractions, etc. based on the generated or modified travel plan.

[1682] "Means for notifying travel plan details" means the technical means for notifying travelers of confirmed travel plan details and reservation information.

[1683] This invention relates to a system that generates travel plans based on the traveler's wishes and combines them with an emotion engine that recognizes the user's emotions to provide the traveler with the most suitable travel plan. This system can centrally manage travel plan generation, user emotion recognition, plan modification and optimization, and reservation confirmation.

[1684] System configuration

[1685] The system consists of the following main components:

[1686] 1. User terminal: A device such as a smartphone, tablet, or PC that allows travelers to input their preferences and receive travel plan suggestions.

[1687] 2. Server: This is the central system for processing itinerary creation, modification, booking, and sentiment analysis. The server software uses Apache, an SQL database, and a sentiment analysis module.

[1688] 3. Database: This is data storage for storing information on transportation, accommodation, and tourist spots, as well as user emotion data. Specifically, a relational database such as MySQL or PostgreSQL is used.

[1689] 4. External API: An interface for obtaining real-time information on transportation, accommodation, etc. Examples include public transportation API, hotel reservation API, tourist destination information API, etc.

[1690] 5. Emotion Engine: This is a module for recognizing and analyzing user emotions. Specific software used is the Microsoft Azure emotion recognition API and the Google Cloud emotion analysis API.

[1691] Program processing

[1692] 1. User preference input

[1693] The user uses the terminal to input their travel preferences (origin, destination, budget, dates, preferred activities) into the interface.

[1694] The terminal transmits the input data to the server.

[1695] 2. Data Receipt and Storage

[1696] The server analyzes the received data and stores it in a database.

[1697] 3. Generate a travel plan

[1698] The server executes a query from the database to obtain information on transportation, accommodation, and tourist attractions that meet the traveler's preferences.

[1699] Based on the initial data acquired by the server, external APIs (transportation booking API, hotel booking API, tourist destination information API) are called to obtain real-time availability and price information.

[1700] Generate the optimal travel plan based on the acquired information.

[1701] 4. User Emotion Recognition

[1702] The emotion engine acquires emotion data (facial expression recognition data, voice tone data) from the user's device.

[1703] The server analyzes the received emotional data and reflects it in the travel plan.

[1704] 5. View your plan

[1705] The server transmits the generated or modified travel plan to the user terminal.

[1706] The device displays the received plan to the user, including a specific itinerary, transportation schedules, accommodation information, and details of tourist attractions.

[1707] 6. Amendments to the Plan

[1708] The user checks the proposed plan and makes any necessary modifications (such as changing the order of the destinations or the number of nights) on the interface.

[1709] The terminal transmits the correction data to the server.

[1710] The server regenerates a new travel plan and transmits it again to the user terminal.

[1711] 7. Confirmation of reservation

[1712] The user instructs the reservation of the confirmed plan.

[1713] The terminal sends a reservation request to the server.

[1714] The server sends reservation requests through the reservation APIs of various service providers (transportation, accommodation, tourist destinations). If the reservation is confirmed, the information is stored in the database.

[1715] 8. Notification of Details

[1716] The server transmits the confirmed reservation information to the user terminal.

[1717] The terminal will present the user with detailed schedules for each travel date and transportation transfer information.

[1718] Specific examples

[1719] When a user plans a "three-night, four-day trip from Tokyo to Kyoto," the system operates as follows:

[1720] 1. The user uses the terminal to input "Tokyo to Kyoto, 3 nights and 4 days trip, budget 150,000 yen, temple visit."

[1721] 2. The device sends this data to the server.

[1722] 3. The server saves the input data in a database and calls an external API to obtain information on transportation, accommodation, and temple tours.

[1723] 4. Based on the information obtained by the server, it generates a travel plan such as "Take the Shinkansen from Tokyo Station, stay at Hotel ABC in Kyoto City, and visit Kiyomizu-dera Temple, Kinkaku-ji Temple, and Ginkaku-ji Temple."

[1724] 5. The emotion engine analyzes the user's emotions from facial expression data and voice tone and evaluates the user's satisfaction with the travel plan.

[1725] 6. The server modifies the travel plan as needed based on the emotion data.

[1726] 7. The server sends the travel plan to the terminal, which displays it to the user.

[1727] 8. The user is dissatisfied with the crowds on the day they visit Kinkakuji Temple, so they make a modification to swap the itinerary for the second and third days.

[1728] 9. The device sends the corrected data to the server, and the server generates and resends a new plan.

[1729] 10. The user confirms the final plan that they are satisfied with and instructs the reservation to be confirmed.

[1730] 11. The device sends a reservation request to the server, and the server confirms the reservation with transportation, accommodation, and tourist attractions through the reservation API.

[1731] 12. The server sends this reservation information to the terminal, and the terminal notifies the user of the travel itinerary and transfer information.

[1732] In this way, the system takes into account the user's emotions and provides a travel plan optimized for individual needs. Travelers can easily create an integrated travel plan and enjoy their trip in the most optimal way. The emotion engine also enables flexible responses to increase satisfaction during the trip.

[1733] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1734] Step 1: Enter your desired data

[1735] The user inputs their travel preferences (origin, destination, budget, dates, desired activities, etc.) into the terminal.

[1736] Input: The user enters their preference for each item on the app screen.

[1737] Output: The input value is retained on the terminal as the desired data.

[1738] Specific steps: The user opens the app on their smartphone and enters their preferences in each field, such as "Departure: Tokyo," "Destination: Kyoto," "Budget: 150,000 yen," "Schedule: 3 nights, 4 days," and "Activity: Temple tour."

[1739] Step 2: Submit your desired data

[1740] The terminal transmits the input desired data to the server.

[1741] Input: The desired data entered in step 1.

[1742] Output: The desired data is sent over the network to the server.

[1743] Specific operation: When the user presses the "Send" button, the device sends the desired data to the server as an HTTP request.

[1744] Step 3: Receiving and storing data

[1745] The server receives the desired data sent from the terminal, analyzes it, and stores it in a database.

[1746] Input: An HTTP request containing the desired data.

[1747] Output: Desired data stored in a database.

[1748] What happens: The server receives the request, parses the data in JSON format, and executes a SQL query to insert it into a relational database.

[1749] Step 4: Generate your travel plan

[1750] The server queries the database to obtain information on transportation, accommodation, and tourist attractions that match the traveler's preferences.

[1751] Input: Desired data.

[1752] Output: Initial dataset (transportation, accommodation, tourist destination information).

[1753] Specific operation: The server queries the transportation table for the conditions "Departure: Tokyo" and "Destination: Kyoto" to obtain the best Shinkansen flight, then queries the accommodation table to obtain information on available hotels in Kyoto City.

[1754] Step 5: Get real-time information

[1755] The server calls an external API to retrieve real-time availability and pricing information.

[1756] Input: Information on transportation, accommodation, and tourist destinations contained in the initial dataset.

[1757] Output: Travel plan suggestions combined with real-time information.

[1758] Specific operation: The server calls the Shinkansen reservation API to obtain availability and prices for the entered flight, then calls the hotel reservation API to obtain availability and prices.

[1759] Step 6: Generate your travel plan

[1760] The server generates an optimal travel plan based on the information acquired.

[1761] Input: Travel plan suggestions combined with real-time information.

[1762] Output: Trip plan.

[1763] Specific operation: The server creates a travel plan taking into account the departure times of public transport and the check-in times of accommodations. For example, "Day 1: Tokyo to Kyoto, Shinkansen Nozomi flight 12, accommodation: Hotel ABC in Kyoto city."

[1764] Step 7: Obtaining emotion data

[1765] The emotion engine acquires emotion data (facial expression recognition data, voice tone data) from the user terminal.

[1766] Input: User's facial expression data and voice data.

[1767] Output: Parsed emotion data.

[1768] How it works: The device uses a camera and microphone to capture the user's facial expressions and voice. The emotion engine analyzes this data and generates a score such as "Satisfaction: High" or "Dissatisfaction: Low."

[1769] Step 8: Analyze and reflect on emotional data

[1770] The server analyzes the emotional data and reflects it in the travel plan.

[1771] Input: Emotion data.

[1772] Output: Optimized trip plan.

[1773] Specific operation: The server receives the emotional data and evaluates the user's emotional state for each part of the plan. If necessary, it adjusts the visit order and activity time allocation.

[1774] Step 9: View your travel plans

[1775] The server transmits the generated or modified travel plan to the terminal, which displays it to the user.

[1776] Input: Optimized itinerary data.

[1777] Output: The itinerary displayed on the user's device.

[1778] Specific operation: The server sends the travel plan data in JSON format to the device. The device parses the received JSON data and displays it visually on the app screen.

[1779] Step 10: Modify the plan

[1780] The user modifies the displayed itinerary.

[1781] Input: Data modified by the user.

[1782] Output: A modification request is sent from the device to the server.

[1783] Specific operation: The user enters "Change the date of visit to Kinkaku-ji Temple from the second day to the third day" in the app and presses the send button. The device then sends this corrected data to the server.

[1784] Step 11: Regenerate the revised plan

[1785] The server regenerates the revised travel plan and transmits it again to the user terminal.

[1786] Input: User modified data.

[1787] Output: The regenerated itinerary.

[1788] Specific operation: The server queries the database and external API again based on the newly revised data, generates and sends the revised itinerary.

[1789] Step 12: Confirm your booking

[1790] The user instructs the reservation of the confirmed plan, and the terminal transmits a reservation request to the server.

[1791] Input: Data that the user has indicated to be confirmed.

[1792] Output: Booking request sent to the Booking API.

[1793] Specific operation: The user selects "Book this plan" and presses the confirmation button. The device sends a reservation request to the server. The server calls the reservation API and confirms the reservation of transportation, accommodation, etc.

[1794] Step 13: Notification of details

[1795] The server transmits the confirmed reservation information to the user terminal, and the terminal notifies the user of the details.

[1796] Input: Confirmed reservation information.

[1797] Output: Travel itinerary and details.

[1798] Specific operation: The server sends reservation details in JSON format to the device. The device parses the JSON data and notifies the user of the travel itinerary, transfer information, hotel check-in information, etc. on the app.

[1799] In this way, the system can generate and provide optimal travel plans that take into account the user's wishes and feelings.

[1800] (Application example 2)

[1801] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1802] Conventional travel plan generation systems only create plans based on the traveler's wishes and do not dynamically modify them to take into account the traveler's emotions and satisfaction, making it impossible to reduce the stress and dissatisfaction felt by travelers. Similarly, shopping experiences in brick-and-mortar stores are also unable to dynamically modify plans to take into account the user's emotions, which can lead to a decrease in satisfaction. There is a need for a system that solves these problems and improves the satisfaction of travelers and users in brick-and-mortar stores.

[1803] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: an interface means for inputting the traveler's preferences; a means for acquiring information on transportation, accommodations, and tourist attractions based on the input preferences; a means for generating a travel plan based on the acquired information; a means for displaying the generated travel plan to the traveler; a means for the traveler to modify the displayed travel plan; a means for regenerating the modified travel plan; a means for making a reservation for the regenerated travel plan; a means for notifying the traveler of details of the reserved travel plan; a sentiment analysis means for recognizing and analyzing the user's emotions; and a means for dynamically modifying the travel plan based on the emotion data analyzed by the sentiment analysis means. This makes it possible to dynamically modify travel plans and shopping plans taking the user's emotions into consideration, thereby improving the satisfaction of travelers and users at physical stores.

[1804] 1. "Interface means" means the interface part of a device or software through which a traveler inputs his / her desired conditions or requests.

[1805] 2. "Means for acquiring information" refers to system components for collecting and processing data on transportation, accommodation, tourist attractions, etc.

[1806] 3. "Means for generating a travel plan" means an algorithm or process that uses the acquired information to create a travel plan based on the preferences entered by the user.

[1807] 4. "Display means" refers to a display or output device that visually shows the generated travel plan to the user.

[1808] 5. "Means for Modification" means an interface or software feature that allows a user to make changes to a generated itinerary.

[1809] 6. "Regenerating means" is an algorithm or process for updating the original travel plan based on user modifications.

[1810] 7. "Means for making reservations" refers to the part of the system that executes reservations for transportation and accommodation based on the finalized travel plan.

[1811] 8. "Means of Notification" means a messaging system or notification mechanism used to inform travelers of the details of their confirmed travel plans.

[1812] 9. "Emotion analysis means" refers to software modules or algorithms used to collect and analyze emotional data from users' facial expressions, voice, etc.

[1813] 10. "Dynamic Modification Means" means an algorithm or process that dynamically adjusts current travel or shopping plans based on emotional data obtained by the Emotion Analysis Means.

[1814] This invention is a system that generates travel plans and shopping plans based on the wishes of travelers and users in physical stores, and provides the optimal plans for users by combining it with an emotion engine that recognizes the user's emotions. This system includes the following main components:

[1815] System configuration

[1816] The system mainly consists of the following components:

[1817] 1. User terminal: A device (e.g., smartphone, tablet, PC) through which travelers and shoppers enter their preferences and receive generated plan proposals.

[1818] 2. Server: A central system for handling travel and shopping plan generation, modification, booking, and sentiment analysis.

[1819] 3. Database: Data storage for storing information on transportation, accommodation, tourist attractions, and physical store products, as well as user sentiment data.

[1820] 4. External API: An interface for obtaining real-time information on transportation, accommodation, products in physical stores, etc.

[1821] 5. Sentiment analysis means: A module for recognizing and analyzing user emotions.

[1822] Program processing

[1823] 1. User preference input

[1824] Enter your travel and shopping preferences (e.g., destination, budget, dates, preferred activities and brands) on your device.

[1825] The user terminal transmits the input data to the server.

[1826] 2. Data Receipt and Storage

[1827] The server analyzes the received data and stores it in a database.

[1828] 3. Generate a plan

[1829] The server executes a query from the database to obtain product information on transportation, accommodation, tourist spots, and brick-and-mortar stores that match the user's preferences.

[1830] Based on the initial data acquired by the server, external APIs (e.g., transport booking APIs, hotel booking APIs, physical store product information APIs) are called to obtain real-time availability and price information.

[1831] Based on the information obtained, optimal travel and shopping plans are generated.

[1832] 4. User Emotion Recognition

[1833] The emotion analysis means acquires emotion data (e.g., facial expression recognition data, voice tone data) from the user's terminal.

[1834] The server analyzes the received emotional data and reflects it in travel and shopping plans.

[1835] The server modifies or regenerates the plan based on the analysis results.

[1836] 5. View your plan

[1837] The server transmits the generated or modified plan to the user terminal.

[1838] The user terminal displays the received plan to the user, including a specific itinerary, transportation schedules, accommodation information, tourist attractions, and shopping plans.

[1839] 6. Amendments to the Plan

[1840] The user checks the proposed plan and makes any necessary modifications (e.g., changing the order of destinations, number of nights, shopping items, etc.) on the interface.

[1841] The user terminal transmits the correction data to the server.

[1842] The server regenerates a new plan and sends it to the user terminal again.

[1843] Specific examples

[1844] Travel Planner

[1845] When a user plans a "three-night, four-day trip from Tokyo to Kyoto," the system operates as follows:

[1846] The user uses the terminal and inputs "Tokyo to Kyoto, 3 nights and 4 days trip, budget 150,000 yen, temple visit."

[1847] The user terminal transmits this data to the server.

[1848] The server stores the input data in a database and calls an external API to retrieve information on transportation, accommodation, and temple tours.

[1849] The server generates a travel plan based on the obtained information.

[1850] The emotion analysis means analyzes the user's emotions from facial expression data and voice tone, and evaluates the user's satisfaction with the travel plan.

[1851] The server modifies the travel plan as needed based on the emotion data.

[1852] Shopping Plan

[1853] A similar process can be applied if a user plans to "find a bag of a specific brand with a budget of 20,000 yen."

[1854] The user enters into the app, "I'm looking for a bag from a specific brand with a budget of 20,000 yen."

[1855] The app retrieves store inventory information in real time and generates a plan such as, "This bag is on the second floor, on the right side."

[1856] If a user becomes dissatisfied while browsing bags, emotional data is obtained through facial expressions and a new bag is recommended.

[1857] An example of a prompt is:

[1858] User: "I'm looking for a new bag from a specific brand with a budget of ¥20,000."

[1859] System: "The following item was found. It's on the second floor, on the right."

[1860] (User is dissatisfied with the bag)

[1861] System: "Analyzing sentiment...Recommend other similar products."

[1862] In this way, the system takes into account the user's emotions and provides travel and shopping plans optimized to individual needs. Users can easily create integrated plans and enjoy them with a sense of satisfaction. In addition, the emotion analysis means allows for flexible responses to increase user satisfaction.

[1863] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1864] Step 1:

[1865] The user uses the device to input their travel and shopping preferences. The input data includes the destination, budget, dates, preferred activities and brands. An example input might be, "I'm looking for a bag from a specific brand with a budget of 20,000 yen." This data is sent from the device to the server.

[1866] Step 2:

[1867] The server analyzes the received user preference data and stores it in a database. For example, data is stored as "Search criteria: budget 20,000 yen, brand: specific brand." Database management software is used for this analysis and storage process.

[1868] Step 3:

[1869] The server executes a query from the database to obtain information on transportation, accommodation, tourist attractions, and physical store products that match the user's preferences. Based on this query, the necessary information is extracted from the database.

[1870] Step 4:

[1871] Based on the initial data acquired by the server, external APIs (e.g., transport reservation APIs, hotel reservation APIs, and physical store product information APIs) are called to obtain real-time availability and price information. For example, an API is used to obtain "stock information for a specific brand of bag." This acquired data is also stored on the server.

[1872] Step 5:

[1873] Based on the information acquired by the server, optimal travel plans and shopping plans are generated. Travel plan generation algorithms and shopping plan generation algorithms are used to generate travel plans. An example of a generated plan is a specific plan such as "Bag A is located on the right side of the second floor."

[1874] Step 6:

[1875] Emotion analysis means acquires emotion data (e.g., facial expression recognition data, voice tone data) from the user terminal. This data is sent from the terminal to the server, and the server receives it. For example, if the user shows a "dissatisfied expression," the facial expression data is analyzed.

[1876] Step 7:

[1877] The server analyzes the received emotional data and reflects it in travel plans and shopping plans. An example of emotional data is the analysis result, which may be "dissatisfied state." The server modifies or regenerates the plan based on this data. A dynamic plan modification algorithm is used to modify the plan.

[1878] Step 8:

[1879] The server sends the generated or modified plan to the user terminal. The user terminal displays the received plan to the user. For example, a specific plan such as "We recommend other similar products" is presented.

[1880] Step 9:

[1881] The user checks the proposed plan and makes any necessary modifications (e.g., changing the order of destinations, number of nights, shopping items, etc.) on the interface. The modified data is sent from the user's device to the server. An example of input is a modification such as "I would also like to see bag B."

[1882] Step 10:

[1883] The server regenerates a new plan and sends it to the user's device again. The regenerated plan is displayed to the user, and this process is repeated until the user is satisfied. For example, a specific new plan such as "Bag B is on the third floor" is presented.

[1884] Through the above processing steps, the system can take into account the user's wishes and feelings and provide travel and shopping plans optimized to individual needs.

[1885] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1886] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1887] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1888] [Fourth embodiment]

[1889] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1890] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1891] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1892] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1893] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1894] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1895] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1896] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1897] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1898] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1899] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1900] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1901] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1902] This invention relates to a system that integrates travel plans according to travelers' wishes and distributes travel dates and destinations according to reservation status. Furthermore, this system also provides integrated navigation functions such as transportation transfer information.

[1903] System configuration

[1904] The system mainly consists of the following components:

[1905] 1. User terminal: A device (e.g., smartphone, tablet, PC) through which travelers input their preferences and receive travel plan suggestions.

[1906] 2. Server: The central system for handling travel plan generation, modification and booking.

[1907] 3. Database: Data storage for storing information on transportation, accommodation and tourist destinations.

[1908] 4. External API: Interface for obtaining real-time information such as transportation and accommodation.

[1909] Program processing

[1910] 1. User preference input

[1911] The user uses the device to input their travel preferences (e.g., destination, budget, dates, preferred activities).

[1912] The terminal transmits the input data to the server.

[1913] 2. Data Receipt and Storage

[1914] The server stores the received data in a database.

[1915] 3. Generate a travel plan

[1916] The server retrieves information on transportation, accommodation, and tourist spots that match the traveler's preferences from the database.

[1917] The server calls an external API to retrieve real-time availability and pricing information.

[1918] Based on the acquired information, the optimal travel plan is generated.

[1919] 4. View your plan

[1920] The server transmits the generated travel plan to the user terminal.

[1921] The device will then display the received plan, including a detailed itinerary, transportation schedules, accommodation information, and details of tourist attractions.

[1922] 5. Amendments to the Plan

[1923] The user checks the proposed plan and makes any necessary modifications (e.g., changing the order of the tourist attractions to be visited, changing the number of nights to stay, etc.).

[1924] The terminal transmits the correction data to the server.

[1925] The server regenerates a new travel plan and transmits it again to the user terminal.

[1926] 6. Confirmation of reservation

[1927] The user instructs the reservation of the confirmed plan.

[1928] The terminal sends a reservation request to the server.

[1929] The server sends a request to various services (transportation, accommodation, tourist attractions) via an external API to confirm the reservation.

[1930] 7. Notification of Details

[1931] The server transmits the confirmed reservation information to the user terminal.

[1932] The terminal displays detailed travel itinerary and transport transfer information to the user.

[1933] Specific examples

[1934] When a user plans a "three-night, four-day trip from Tokyo to Kyoto," the system operates as follows:

[1935] 1. The user uses the terminal to input "Tokyo to Kyoto, 3 nights and 4 days trip, budget 150,000 yen, temple visit."

[1936] 2. The device sends this data to the server.

[1937] 3. The server saves the input data in a database and calls an external API to obtain information on transportation, accommodation, and temple tours.

[1938] 4. Based on the information obtained by the server, it generates a travel plan such as "Take the Shinkansen from Tokyo Station, stay at Hotel ABC in Kyoto City, and visit Kiyomizu-dera Temple, Kinkaku-ji Temple, and Ginkaku-ji Temple."

[1939] 5. The server sends this plan to the user's terminal, which displays it to the user.

[1940] 6. Since the day the user visits Kinkakuji Temple is crowded, the itinerary for the second and third days is swapped.

[1941] 7. The device sends the corrected data to the server, and the server generates and resends a new plan.

[1942] 8. The user is satisfied with the final plan and confirms the reservation.

[1943] 9. The device sends a reservation request to the server, and the server confirms the reservation with transportation, accommodation, and tourist attractions through the reservation API.

[1944] 10. The server sends the confirmed reservation information to the user's terminal, and the terminal notifies the user of the travel itinerary and transfer information.

[1945] In this way, this system will provide travelers with highly convenient travel plans, while also helping to resolve social issues such as reducing congestion.

[1946] The processing flow will be explained below.

[1947] Step 1:

[1948] A user launches a travel plan generation application on a terminal and inputs travel preferences (e.g., origin, destination, budget, dates, preferred activities) into the interface.

[1949] Step 2:

[1950] The terminal converts the input data into JSON format and sends it to the server as an HTTP POST request.

[1951] Step 3:

[1952] The server analyzes the received data and stores it in a database.

[1953] Step 4:

[1954] The server executes a query from the database to obtain transportation, accommodation, and tourist attraction information relevant to the traveler's preferences.

[1955] Step 5:

[1956] Based on the initial data acquired by the server, external APIs (e.g., transport booking API, hotel booking API, tourist destination information API) are called to obtain real-time availability and price information. The response to each API request is received and analyzed.

[1957] Step 6:

[1958] Based on the real-time information acquired by the server, the system generates an optimal travel plan that meets the traveler's needs, including determining the travel schedule, accommodation, and order of visits.

[1959] Step 7:

[1960] The travel plan generated by the server is converted into JSON format and sent to the terminal.

[1961] Step 8:

[1962] The device then converts the itinerary into a human-readable format and displays it in the application's interface, including an itinerary, transport schedules, accommodation information and details of tourist attractions.

[1963] Step 9:

[1964] The user checks the displayed travel plan and makes any necessary corrections (e.g., changing the order of visits, number of nights, etc.) on the interface.

[1965] Step 10:

[1966] The terminal converts the modified data from the user into JSON format and sends it back to the server.

[1967] Step 11:

[1968] The server receives the modified data and regenerates a new itinerary reflecting the necessary modifications.

[1969] Step 12:

[1970] The server sends the regenerated travel plan to the terminal, which displays it to the user.

[1971] Step 13:

[1972] The user finally decides on a plan that satisfies them and issues a reservation instruction via the interface.

[1973] Step 14:

[1974] The device sends a reservation request in JSON format to the server.

[1975] Step 15:

[1976] The server sends reservation requests through the reservation APIs of various service providers (e.g., transportation, accommodation, tourist attractions). If the reservation is confirmed, the information is stored in the database.

[1977] Step 16:

[1978] After the reservation request is completed, the server sends the confirmed reservation information in JSON format to the terminal.

[1979] Step 17:

[1980] The terminal presents detailed schedules for each travel date and transportation transfer information, and notifies the user of this.

[1981] Through the above processing steps, travelers can easily create an integrated travel plan and enjoy it in the most optimal way.

[1982] Example 1

[1983] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1984] Today's travelers want to create, modify, and book optimal travel plans that fit their individual preferences easily and quickly. However, these tasks typically require the use of multiple platforms and services, making them time-consuming and laborious. Furthermore, automating travel planning has been difficult due to the complex elements involved, such as obtaining real-time availability and pricing information, and providing transportation transfer information. Furthermore, travel plan suggestions using generative AI models have not performed satisfactorily, so there is a need to provide services that provide high user satisfaction.

[1985] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1986] In this invention, the server includes an interface for inputting traveler preferences, a means for acquiring information on transportation, accommodations, and tourist attractions based on the input preferences, a means for generating a travel plan based on the acquired information, a means for displaying the generated travel plan to the traveler, a means for the traveler to modify the displayed travel plan, a means for regenerating the modified travel plan, a means for making reservations for the regenerated travel plan, a means for notifying the traveler of details of the booked travel plan, an external API call means for acquiring real-time availability and price information, and a means for generating and displaying transfer information for the transportation modes included in the travel plan. This allows users to easily input their travel preferences, suggest and modify optimal travel plans, and automatically generate travel plans that reflect real-time reservation status and price information. Furthermore, by automatically generating and using prompt sentences from the generative AI model, efficient and high-quality travel plans can be provided.

[1987] An "interface means for inputting traveler preferences" is a digital interface (e.g., smartphone app, website, etc.) through which travelers input their preferences, such as travel destination, budget, dates, and preferred activities.

[1988] "Means for obtaining information on transportation, accommodation, and tourist attractions" refers to a mechanism for collecting information on relevant transportation, accommodation, and tourist attractions based on the input preferences.

[1989] The "means for generating a travel plan" is an algorithm that automatically creates a travel schedule and itinerary that best suits the traveler's wishes based on the acquired information.

[1990] "Means for displaying to travelers" refers to a mechanism for visually providing the generated travel plan to travelers (e.g., displaying on a screen, generating a PDF, etc.).

[1991] "Means for modification" refers to the functionality that allows a traveler to make changes to the displayed itinerary.

[1992] The "means for regenerating a revised itinerary" is an algorithm for regenerating a new itinerary that reflects the changes made by the traveler.

[1993] A "means for making reservations for travel plans" is a system for automatically making reservations based on the finalized travel plan.

[1994] "Means of notifying travelers of details of booked travel plans" refers to a function for notifying travelers of confirmed reservation information (e.g., email notification, app notification, etc.).

[1995] "Means for calling external APIs to obtain availability and price information in real time" refers to a mechanism for obtaining real-time availability and price information using external data provision services (e.g., APIs).

[1996] The "means for generating and displaying transfer guide information for the means of transportation included in the travel plan" is a mechanism for generating detailed transfer guide information for the means of transportation included in the travel plan and displaying it.

[1997] A "generative AI model" is an artificial intelligence algorithm used to generate travel plans, proposing optimal plans based on a given prompt.

[1998] A "prompt" is an instruction or question that is input to a generative AI model, and serves as the basis for the model to generate an optimal response.

[1999] The present invention relates to a system that generates optimal travel plans based on travelers' preferences, and then modifies and reserves the plans. This system is configured using a user terminal, a server, a database, and an external API. Specific embodiments of this system are described in detail below.

[2000] System Configuration

[2001] User device: A device used by a user to input travel preferences, generate travel plans, and make corrections. Specific devices include smartphones, tablets, and PCs.

[2002] Server: The central system for handling travel plan generation, modifications, and reservations.

[2003] Database: Data storage for storing information about transport, accommodation and tourist destinations.

[2004] External API: API interface used to obtain real-time availability and pricing information.

[2005] Program processing

[2006] In this system, the user inputs their travel preferences using a terminal, and the system generates and displays the optimal travel plan based on that information. If the user modifies the plan, the system generates a new plan reflecting the modifications, and finally confirms the reservation. The process is as follows:

[2007] 1. The user enters their preference

[2008] The user uses the terminal to input their preferences, such as "Destination: Kyoto, budget: 150,000 yen, 3 nights, 4 days, temple tour desired." The terminal then sends this data to the server.

[2009] 2. The server receives and stores the data

[2010] The server stores the received data in a database, for example in a "user preferences" table using an SQL query.

[2011] 3. The server generates the itinerary

[2012] The server retrieves information on transportation, accommodation, and tourist destinations from the database, and uses external APIs to obtain real-time availability and price information. This information is then integrated to generate the optimal travel plan.

[2013] 4. Display the travel plan on the user's device

[2014] The server sends the generated itinerary in JSON format to the device, which then visually displays it, including a detailed itinerary, transport schedules, accommodation information, and details of tourist attractions.

[2015] 5. The user modifies the plan

[2016] The user can make corrections to the displayed plan, such as "Kinkakuji Temple is crowded, so I'd like to switch the itinerary for the second and third days." The device then sends the correction data to the server.

[2017] 6. The server generates a new plan that reflects the changes.

[2018] The server again generates a plan based on the corrected data and transmits it to the terminal again.

[2019] 7. The user confirms the booking

[2020] The user instructs the device to reserve the confirmed plan, and the device sends the request to the server. The server confirms the reservation via an external API and sends the details to the device. The device then notifies the user of the detailed travel itinerary and transportation transfer information.

[2021] Specific examples

[2022] When a user plans a "three-night, four-day trip from Tokyo to Kyoto," the system operates as follows: The user enters "destination: Kyoto, budget: 150,000 yen, three-night, four-day trip, temple visit desired," and the device sends this information to the server. The server retrieves information from the database and collects real-time data using an external API. For example, it generates a plan such as "Shinkansen from Tokyo Station, accommodation: hotel in Kyoto City, sightseeing spots: Kiyomizu-dera Temple, Kinkaku-ji Temple, Ginkaku-ji Temple."

[2023] The user amends the itinerary by saying, "The day we visit Kinkaku-ji Temple is crowded, so I'd like to switch the itinerary between the second and third days," and the device sends this information to the server. The server generates a new plan and sends it back to the user's device. When the user is satisfied with the final plan, they instruct the server to confirm the reservation. The device then sends a reservation request to the server, which confirms the reservation via an external API. The confirmed reservation information is then sent to the user's device, and the user is notified of the detailed travel itinerary and transfer information. In this way, travelers can efficiently plan their trips.

[2024] Example prompt sentence:

[2025] "I'd like to create a 3-night, 4-day itinerary for a trip from Tokyo to Kyoto. My budget is 150,000 yen, and I'd like to visit temples. I'd like you to suggest the best plan for me based on information about transportation, accommodations, and tourist spots."

[2026] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2027] Step 1:

[2028] The user inputs their travel preferences.

[2029] Input: The user uses a terminal to input their preferences, such as "Destination Kyoto, budget 150,000 yen, 3 nights, 4 days, hope to visit temples."

[2030] How it works: The device receives user input data. It collects data through a form or interface. This data is organized in a structured format (e.g., JSON).

[2031] Output: The organized input data is ready to be sent to the server.

[2032] Step 2:

[2033] The terminal sends the input data to the server.

[2034] Input: User preference data collected in step 1.

[2035] How it works: The device sends data to the server over the internet by making a POST request using the REST API and sending the input data to the server in JSON format.

[2036] Output: The server receives the POST request and retrieves the input data.

[2037] Step 3:

[2038] The server stores the received data in a database.

[2039] Input: User preference data sent from the device.

[2040] What it does: The server extracts the necessary information from the request body, executes a SQL query, and saves the data into a "user preferences" table in the database.

[2041] Output: User preference data stored in a database.

[2042] Step 4:

[2043] The server retrieves information that matches the traveler's preferences from the database.

[2044] Input: User preference data stored in the database.

[2045] How it works: The server executes SQL queries to retrieve information about transportation, accommodation, and tourist attractions from a database.

[2046] Output: Retrieved transport, accommodation and tourist destination data.

[2047] Step 5:

[2048] The server calls an external API to retrieve real-time availability and pricing information.

[2049] Input: Transport, accommodation and tourist destination data taken from databases.

[2050] How it works: The server calls an external API (e.g., Google Maps API, hotel booking site API) to get real-time reservation status and pricing information. The data is returned in JSON format.

[2051] Output: Real-time availability and pricing information.

[2052] Step 6:

[2053] The server generates an optimal travel plan based on the acquired information.

[2054] Input: Information from databases and real-time information from external APIs.

[2055] How it works: The server analyzes this data with an algorithm to generate an optimal travel plan, calculating the fastest route and optimizing the time spent at each tourist spot.

[2056] Output: Optimal travel plan.

[2057] Step 7:

[2058] The server transmits the generated travel plan to the user terminal.

[2059] Input: The generated itinerary.

[2060] Operation: The server generates a plan and sends it to the device as a response. The data is structured in JSON format and sent via the REST API.

[2061] Output: The trip plan data received by the device.

[2062] Step 8:

[2063] Displays the plan received by the device.

[2064] Input: Travel plan data sent from the server.

[2065] How it works: The device analyzes the data it receives and displays it on its screen, including specific itineraries, transport schedules, accommodation information and details about tourist attractions.

[2066] Output: A visually displayed itinerary.

[2067] Step 9:

[2068] The user reviews the proposed plan and makes any necessary corrections.

[2069] Input: The displayed itinerary.

[2070] Operation: The user checks the plan and makes some changes, such as "Kinkakuji Temple is crowded, so I'd like to switch the itinerary between the second and third days." The device collects the changes.

[2071] Output: The modified data is saved to the device.

[2072] Step 10:

[2073] The terminal transmits the correction data to the server.

[2074] Input: User-modified data.

[2075] How it works: The device structures the correction data in JSON format and resends it to the server, using the REST API to send the data in a POST request.

[2076] Output: The correction data received by the server.

[2077] Step 11:

[2078] The server regenerates a new travel plan and transmits it again to the user terminal.

[2079] Input: Correction data.

[2080] Operation: The server recalculates based on the changes and generates a new itinerary, which is then sent to the device again.

[2081] Output: The new travel plan data is sent to the device.

[2082] Step 12:

[2083] The user instructs the reservation of the confirmed plan.

[2084] Input: The final displayed itinerary.

[2085] Operation: The user confirms the final plan and indicates that they want to confirm the reservation. The device prepares a reservation confirmation request.

[2086] Output: A booking confirmation request is prepared on the terminal.

[2087] Step 13:

[2088] The terminal sends a reservation request to the server.

[2089] Input: Confirmed booking request.

[2090] How it works: The device structures the reservation information in JSON format and sends it to the server via a POST request.

[2091] Output: The reservation request received by the server.

[2092] Step 14:

[2093] The server sends a request to various services via an external API to confirm the reservation.

[2094] Input: Booking request data.

[2095] How it works: The server calls an external transport booking API or accommodation booking API to confirm the reservation. The external API returns a reservation ID, confirmation number, etc.

[2096] Output: Confirmed booking information.

[2097] Step 15:

[2098] The server transmits the confirmed reservation information to the user terminal.

[2099] Input: Confirmed booking information.

[2100] How it works: The server structures the reservation information into JSON format and sends it to the device via the REST API.

[2101] Output: Confirmed reservation information received by the terminal.

[2102] Step 16:

[2103] The terminal displays detailed travel itinerary and transport transfer information to the user.

[2104] Input: Confirmed reservation information sent from the server.

[2105] How it works: The device analyzes the data it receives and displays detailed travel itineraries, transport route information, reservation IDs and confirmation numbers to the user.

[2106] Output: Detailed trip plan and confirmation information displayed to the user.

[2107] (Application example 1)

[2108] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2109] Modern travelers face a lot of hassle, from planning their trips to booking reservations and navigating the local area. They also lack a means to easily check local tourist and transportation information in real time. This forces travelers to frequently use their smartphones while traveling, reducing the enjoyment and convenience of their trip. Furthermore, there is a demand for an efficient travel experience that utilizes visual and audio interfaces.

[2110] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2111] In this invention, the server includes an interface means for inputting traveler preferences, a means for acquiring information on transportation, accommodations, and tourist attractions based on the input preferences, a means for generating a travel plan based on the acquired information, a means for displaying the generated travel plan to the traveler, a means for the traveler to modify the displayed travel plan, a means for regenerating the modified travel plan, a means for making reservations for the regenerated travel plan, a means for notifying the traveler of details of the booked travel plan, a display means for displaying visual information in real time based on the travel plan, and an input means for operating the visual information in response to voice commands. This allows travelers to receive consistent support from generating travel plans to making reservations and navigating on site, and also allows them to intuitively and efficiently refer to information on site.

[2112] "Traveller" refers to an individual who plans and undertakes a trip.

[2113] "Desired" refers to the specific conditions that a traveler desires in their travel plans, such as destination, duration, budget, and activities.

[2114] "Interface means" refers to devices and software that allow travelers to input preferences and exchange information.

[2115] "Transportation" refers to all means of transportation used by travelers to get around (e.g., trains, buses, airplanes, etc.).

[2116] "Accommodation" refers to a place where travelers stay (e.g., hotel, inn, guesthouse, etc.).

[2117] "Tourist destinations" refer to tourist spots and famous places that tourists want to visit.

[2118] "Travel Plan" means a travel schedule and list of destinations organized based on a traveler's preferences.

[2119] "Regeneration" refers to a traveler recreating a new travel plan based on their revised preferences.

[2120] "Reservation" refers to the act of reserving in advance the visit and use of transportation, accommodation, and tourist attractions included in a travel plan.

[2121] "Details" refers to specific information about the booked travel plan (e.g., transportation departure times, accommodation check-in times, etc.).

[2122] "Notification" refers to the act of informing travelers of details or changes to their travel plans.

[2123] "Display means" refers to display devices and display technologies used to provide visual information to travelers.

[2124] "Input means" refers to devices and software that allow travelers to input and operate information.

[2125] "Voice command" refers to an instruction that a traveler gives to the system using voice.

[2126] The present invention relates to a system for generating a travel plan according to a traveler's wishes and providing on-site navigation and information. Hereinafter, an embodiment of the present invention will be described in detail.

[2127] System configuration

[2128] The system mainly consists of the following components:

[2129] User terminal: A device (e.g., smartphone, tablet, smart glasses) through which a traveler inputs their preferences and receives travel plan suggestions.

[2130] Server: The central system that handles travel plan generation, modification, and booking.

[2131] Database: Data storage for transport, accommodation and tourist destination information.

[2132] External API: Interface for obtaining real-time information on transport, accommodation etc.

[2133] Display means: A device for displaying local information using a HUD (head-up display) such as smart glasses.

[2134] Input means: Devices and software that recognize voice commands and perform operations (e.g., voice recognition engine).

[2135] Program processing

[2136] The server performs the following process: The user uses the device to input their travel preferences (e.g., destination, budget, dates, activities). This data is sent to the server, which then generates a travel plan through the database and external API. The plan is displayed on the user's device and is regenerated if the user makes any changes. The finalized plan is then processed for booking, and the details are sent to the user's device.

[2137] Operating Procedure

[2138] The steps in generating a travel plan by the server are as follows: When the user inputs their travel preferences, the server receives them and retrieves the necessary information from the database and external APIs. Next, it generates a travel plan based on that information and sends it to the user's device for display. If the user wants to modify the displayed plan, it receives that information, generates a new plan, and sends it again.

[2139] Hardware and software used

[2140] Hardware:

[2141] Smart glasses (e.g., general-purpose head-mounted displays)

[2142] Built-in GPS

[2143] Speaker and microphone

[2144] software:

[2145] GPS API: A program to get your current location

[2146] External API (e.g., general-purpose data acquisition API): Acquire information on tourist attractions and accommodations

[2147] HUD: Providing visual information to travelers

[2148] Speech recognition engine (e.g., general-purpose voice recognition software): Recognizes voice commands

[2149] Specific examples

[2150] This shows the process when a user plans a "three-night, four-day trip from Tokyo to Kyoto." The user puts on smart glasses and can input by voice, "Tokyo to Kyoto, three-night, four-day trip, budget 150,000 yen, temple visits." The server generates an optimal travel plan based on that information and displays it on the user's smart glasses. The displayed plan includes transportation, accommodation, and tourist attractions, and when the user issues a voice command for "next tourist attraction," navigation information for the next tourist attraction is displayed on the HUD. In this way, the user can enjoy their trip intuitively.

[2151] Specific examples of prompts are as follows:

[2152] "Please tell me the best route from my current location to the next tourist spot I want to visit."

[2153] This system allows travelers to receive consistent support at every stage of their trip and makes it possible to refer to information on-site in an intuitive and efficient manner.

[2154] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2155] Step 1: User preference input

[2156] The user uses the terminal to input travel preferences (destination, budget, schedule, activities, etc.) through voice commands or an input interface. This data is sent from the terminal to the server.

[2157] Input: Destination, Budget, Dates, Activities

[2158] Data processing: Format conversion of input data (audio to text)

[2159] Output: Sending the formatted input data

[2160] Step 2: Receiving and storing data

[2161] The server receives the desired data sent from the device and stores it in a database. At the same time, it calls an external API to obtain the necessary information (information on transportation, accommodation, and tourist spots).

[2162] Input: Desired data sent from the terminal

[2163] Data processing: saving desired data, calling external API

[2164] Output: Save to database, retrieve information from external API

[2165] Step 3: Generate a travel plan

[2166] The server generates a travel plan optimized for the traveler's wishes based on information obtained from the database and external APIs. The generated plan includes information such as transportation timetables, accommodation reservations, and the order in which to visit tourist attractions.

[2167] Input: Information obtained from databases and external APIs

[2168] Data processing: Optimization calculation of travel plans

[2169] Output: Generated itinerary

[2170] Step 4: View your plan

[2171] The server sends the generated itinerary to the terminal and displays it on the HUD of the smart glasses or other terminal, allowing the user to visually check the itinerary.

[2172] Input: Generated itinerary

[2173] Data processing: Data transmission

[2174] Output: Trip plan displayed on HUD

[2175] Step 5: Modify the plan

[2176] If the user views the displayed itinerary and finds it necessary to make any corrections, he or she inputs the correction information into the terminal using a voice command or an input interface, and the terminal transmits the correction data to the server.

[2177] Input: User request for travel plan to be modified

[2178] Data processing: Format conversion of corrected data (audio to text)

[2179] Output: Send corrected data

[2180] Step 6: Regenerate the revised plan

[2181] The server receives the modified data from the user, optimizes the travel plan again, and regenerates the new travel plan, which is then sent to the terminal again.

[2182] Input: Correction data

[2183] Data processing: Reoptimization calculation

[2184] Output: Regenerated itinerary

[2185] Step 7: Confirm your booking

[2186] When the user is satisfied with the final travel plan, he / she issues a voice command or an input interface to confirm the reservation of the plan. The server processes the reservation request and confirms the reservation for various services.

[2187] Input: Final travel plan booking confirmation instructions

[2188] Data processing: Reservation procedure execution

[2189] Output: Send reservation confirmation data

[2190] Step 8: Notification of details

[2191] The server sends the confirmed reservation information to the terminal, which then notifies the user of the details. The user can then check the detailed itinerary and transportation transfer information on the smart glasses HUD or other terminal.

[2192] Input: Confirmed reservation information

[2193] Data processing: Data transmission

[2194] Output: Detailed travel itinerary and transit directions displayed on a HUD

[2195] This allows travelers to receive intuitive and efficient support throughout the entire travel process.

[2196] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2197] The present invention relates to a system that generates a travel plan based on a traveler's wishes and combines it with an emotion engine that recognizes the user's emotions to provide the traveler with the optimal travel plan. This system includes the following main components:

[2198] System configuration

[2199] The system mainly consists of the following components:

[2200] 1. User terminal: A device (e.g., smartphone, tablet, PC) through which travelers input their preferences and receive travel plan suggestions.

[2201] 2. Server: A central system for handling travel plan generation, modification, booking, and sentiment analysis.

[2202] 3. Database: Data storage for storing information on transportation, accommodation, tourist attractions, and user sentiment data.

[2203] 4. External API: Interface for obtaining real-time information such as transportation and accommodation.

[2204] 5. Emotion Engine: A module for recognizing and analyzing user emotions.

[2205] Program processing

[2206] 1. User preference input

[2207] The user uses the device to input travel preferences (e.g., origin, destination, budget, dates, preferred activities) into the interface.

[2208] The terminal transmits the input data to the server.

[2209] 2. Data Receipt and Storage

[2210] The server analyzes the received data and stores it in a database.

[2211] 3. Generate a travel plan

[2212] The server executes a query from the database to obtain information on transportation, accommodation, and tourist attractions that meet the traveler's preferences.

[2213] Based on the initial data acquired by the server, external APIs (e.g., transport booking API, hotel booking API, tourist destination information API) are called to obtain real-time availability and price information.

[2214] Based on the acquired information, the optimal travel plan is generated.

[2215] 4. User Emotion Recognition

[2216] The emotion engine acquires emotion data (e.g., facial expression recognition data, voice tone data) from the user's device.

[2217] The server analyzes the received emotional data and reflects it in the travel plan.

[2218] The server modifies or regenerates the itinerary based on the analysis results.

[2219] 5. View your plan

[2220] The server transmits the generated or modified travel plan to the user terminal.

[2221] The device displays the received plan to the user, including a specific itinerary, transportation schedules, accommodation information, and details of tourist attractions.

[2222] 6. Amendments to the Plan

[2223] The user reviews the proposed plan and makes any necessary modifications (e.g., changing the order of the destinations, changing the number of nights spent, etc.) on the interface.

[2224] The terminal transmits the correction data to the server.

[2225] The server regenerates a new travel plan and transmits it again to the user terminal.

[2226] 7. Confirmation of reservation

[2227] The user instructs the reservation of the confirmed plan.

[2228] The terminal sends a reservation request to the server.

[2229] The server sends reservation requests through the reservation APIs of various service providers (e.g., transportation, accommodation, tourist attractions). If the reservation is confirmed, the information is stored in the database.

[2230] 8. Notification of Details

[2231] The server transmits the confirmed reservation information to the user terminal.

[2232] The terminal will present the user with detailed schedules for each travel date and transportation transfer information.

[2233] Specific examples

[2234] When a user plans a "three-night, four-day trip from Tokyo to Kyoto," the system operates as follows:

[2235] 1. The user uses the terminal to input "Tokyo to Kyoto, 3 nights and 4 days trip, budget 150,000 yen, temple visit."

[2236] 2. The device sends this data to the server.

[2237] 3. The server saves the input data in a database and calls an external API to obtain information on transportation, accommodation, and temple tours.

[2238] 4. Based on the information obtained by the server, it generates a travel plan such as "Take the Shinkansen from Tokyo Station, stay at Hotel ABC in Kyoto City, and visit Kiyomizu-dera Temple, Kinkaku-ji Temple, and Ginkaku-ji Temple."

[2239] 5. The emotion engine analyzes the user's emotions from facial expression da...

Claims

1. an interface means for inputting traveler preferences; A means of obtaining information on transportation, accommodation and tourist attractions based on input preferences; A means for generating a travel plan based on the acquired information; means for displaying the generated itinerary to the traveler; a means for the traveler to modify the displayed itinerary; means for regenerating the modified travel plan; a means for making a reservation for the regenerated itinerary; a means of informing travelers of details of their booked travel plans; A system including:

2. The system according to claim 1, wherein availability and price information of transportation, accommodations and tourist spots is obtained in real time based on the preferences input by the traveler.

3. The system according to claim 1, wherein transfer information for transportation means included in a travel plan is generated and displayed.

Images