system

Abstract

Provide a system. A means for a user to input travel-related information; means for transmitting the information to a server; means for analyzing the information and automatically generating a travel plan tailored to the user's wishes; means for transmitting the generated travel plan to a user's terminal; The system includes means for displaying the travel plan to a user.

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In conventional travel planning, users need to spend a lot of time and effort on selecting accommodations, arranging transportation, scheduling visits, etc. This makes travel planning time-consuming and reduces the user's time efficiency. Furthermore, it is difficult to optimize the plan, making it difficult to realize an efficient trip. [Means for solving the problem]

[0005] The present invention solves the above-mentioned problems by providing a system that includes a means for a user to input travel-related information (travel purpose, departure date, destination, hotel preferences, transportation method, etc.), a means for transmitting the information to a server, a means for analyzing the information and automatically generating a travel plan tailored to the user's preferences, a means for transmitting the generated travel plan to the user's terminal, and a means for displaying the travel plan to the user. This system realizes efficient travel by obtaining information from a database of transportation methods, accommodations, and tourist spots and generating an optimal plan based on the user's preferences. Flexibility is also ensured by including a means for receiving user revision requests and re-adjusting the travel plan.

[0006] A "user" is an individual or organization that intends to use the system to plan a trip.

[0007] A "terminal" is a device that allows a user to input information and communicate with the system. Examples include smartphones and personal computers.

[0008] "Travel-related information" is a general term for information that a user needs to make travel plans, including the purpose of the trip, departure date, destination, preferred hotel, and transportation method.

[0009] "Server" means a computer system that receives, analyzes, and processes travel-related information provided by users.

[0010] The "database" is an information source that stores detailed information on transportation, accommodation, tourist attractions, etc. It is used by the server to obtain the necessary information.

[0011] A "travel plan" is a schedule that is automatically generated based on the user's wishes and includes specific travel dates, transportation, accommodations, destinations to visit, etc.

[0012] "Means for generating" refers to the process in which the server analyzes the information input by the user, collects necessary information from the database, and creates an optimal travel plan.

[0013] "Means for transmitting" refers to a method for transmitting information from a terminal to a server or from a server to a terminal.

[0014] The "display means" is a function that displays the travel plan received by the terminal from the server on the screen in a format that is easy for the user to understand.

[0015] A "modification request" is an action in which a user requests a change or modification to a proposed travel plan.

[0016] The "means for adjusting the travel plan again" is a process in which the server regenerates an optimal travel plan based on a modification request from the user. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8]FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0018] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0021] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0022] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0023] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0025] [First embodiment]

[0026] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0027] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0030] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0033] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0037] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0038] The present invention provides a system that allows users to easily create travel plans. This system allows users to input travel-related information, automatically generates an optimal travel plan based on that information, and provides it to the user, thereby significantly reducing the effort required for planning.

[0039] System configuration

[0040] This system consists of a user's terminal, a server, and a database. The user uses the terminal to input travel-related information, which is then sent to the server. The server analyzes the information, retrieves the necessary information from the database, automatically generates a travel plan, and sends the generated plan to the terminal. The terminal then displays the plan to the user and accepts confirmation or correction requests from the user.

[0041] User Input

[0042] The user uses the terminal to enter the following travel-related information:

[0043] Purpose of trip (e.g. sightseeing, business, gourmet)

[0044] Departure date (e.g. December 1, 2023)

[0045] Destination (e.g. Tokyo)

[0046] Hotel preferences (e.g. mid-range, near the station)

[0047] Transportation (e.g. bullet train, airplane, bus)

[0048] Data transmission

[0049] The terminal checks the information entered by the user, and after confirming that there are no errors, sends it to the server.

[0050] Database searching and analysis

[0051] Based on the information received, the server retrieves the following information from the database:

[0052] Transportation database (airline, train, and bus schedules and fares)

[0053] Accommodation database (listings and details of hotels, resorts, and guesthouses)

[0054] Tourist spot database (information on tourist spots, restaurants, and activities)

[0055] The server then uses this information to generate a travel plan that best suits the user's needs. Specifically, it combines the following information:

[0056] Determine the best mode of transportation based on departure date and destination.

[0057] Select the appropriate accommodation based on your hotel preferences (price range, location).

[0058] Depending on the purpose of the trip, it selects tourist spots and activities to visit and calculates the order in which to visit them and travel time.

[0059] Generate a travel plan

[0060] The server creates a specific itinerary tailored to the user's needs, including information such as:

[0061] Transportation details (e.g., what time and which Shinkansen to take)

[0062] Accommodation booking suggestions (e.g. mid-range hotel near Shinjuku Station)

[0063] Daily schedule (e.g., Sensoji Temple in the morning on the first day, Skytree in the afternoon, Shibuya in the evening, etc.)

[0064] Dining suggestions (e.g., tempura lunch in Asakusa, yakiniku dinner in Shibuya)

[0065] Provision to users

[0066] The server sends the generated itinerary to the terminal, which displays it to the user, who can review the itinerary and request modifications if necessary.

[0067] Processing correction requests

[0068] If the user requests an amendment to the plan, the device sends the request to the server, which again analyzes and retrieves the information to adjust the travel plan.

[0069] Specific examples

[0070] For example:

[0071] Purpose of trip: Sightseeing

[0072] Departure date: December 1, 2023

[0073] Destination: Tokyo

[0074] Hotel preference: Mid-range, near the station

[0075] Transportation: Shinkansen

[0076] 1. The user enters this information into the terminal and sends it.

[0077] 2. The device forwards the transmitted information to the server.

[0078] 3. The server analyzes the information and retrieves information from the database about appropriate transportation options (e.g., the Shinkansen at 8:00 AM on December 1st), accommodation options (e.g., a mid-range hotel near Shinjuku Station), and tourist attractions (e.g., Sensoji Temple, Skytree, Shibuya, etc.).

[0079] 4. Based on the information obtained, the server generates a specific itinerary, such as:

[0080] Departure date: December 1st, 8:00 AM Shinkansen

[0081] Hotel: Mid-range hotel near Shinjuku Station

[0082] Sightseeing Schedule: Day 1: Sensoji Temple in the morning, Skytree in the afternoon, Shibuya in the evening

[0083] Gourmet: Tempura lunch in Asakusa, Yakiniku dinner in Shibuya

[0084] 5. The server sends the generated itinerary to the terminal, which displays it to the user.

[0085] 6. The user reviews the plan and submits a request for revisions if necessary.

[0086] This system allows users to create efficient travel plans in a short amount of time, greatly simplifying travel preparations, thereby reducing the time and effort required for travel planning and providing a fulfilling travel experience.

[0087] The processing flow will be explained below.

[0088] Step 1:

[0089] The user uses a device (smartphone or PC) to input travel-related information (purpose of trip, departure date, destination, hotel preferences, and means of transportation).

[0090] Step 2:

[0091] The device checks the accuracy of the user's input data and ensures that all required fields are filled in.

[0092] Step 3:

[0093] The terminal sends the verified user-entered data to the server.

[0094] Step 4:

[0095] The server receives the user's input data and parses the input.

[0096] Step 5:

[0097] Based on the information analyzed by the server, the necessary information is searched from the transportation database, accommodation database, and tourist spot database.

[0098] Step 6:

[0099] The server filters the information obtained from each database and extracts the options that best suit the user's preferences.

[0100] Step 7:

[0101] The server generates an optimal travel plan based on the extracted information, including, for example:

[0102] Transportation: Departure date and time, seat information

[0103] Accommodation: Hotel name, address, rates, and facility information

[0104] Tourist schedule: places to visit, visiting times, means of transport and times

[0105] Meal planning: restaurant reservations, menu recommendations

[0106] Step 8:

[0107] The server transmits the generated travel plan to the terminal.

[0108] Step 9:

[0109] The device displays the travel plan received from the server to the user, visually showing detailed schedules, maps, reservation information, and more.

[0110] Step 10:

[0111] The user reviews the displayed itinerary and requests modifications if necessary.

[0112] Step 11:

[0113] The terminal sends the user's modification request to the server.

[0114] Step 12:

[0115] The server receives the modification request, searches and analyzes the database again based on the new parameters, and generates a new itinerary.

[0116] Step 13:

[0117] The server transmits the regenerated itinerary to the terminal.

[0118] Step 14:

[0119] The terminal displays the regenerated itinerary to the user, who then makes a final confirmation.

[0120] Step 15:

[0121] The user finalizes the travel plan and the terminal transmits the information to the server.

[0122] Step 16:

[0123] The server stores the confirmed itinerary and sends a confirmation message to the terminal.

[0124] All these steps allow users to easily plan and execute efficient and complete travel plans.

[0125] Example 1

[0126] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0127] Conventional travel planning systems require users to manually collect and organize large amounts of information, resulting in the time-consuming and labor-intensive process of planning. Furthermore, it is difficult to automatically generate a travel plan that perfectly matches the user's preferences, and it is also difficult to efficiently reflect revision requests. For these reasons, many users are dissatisfied with the process of creating a travel plan.

[0128] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0129] In this invention, the server includes means for a user to input travel-related information, means for transmitting the information to the server, means for analyzing the information and automatically generating a specific itinerary based on the user's preferences using a generative AI model, means for transmitting the generated itinerary to the user's terminal, means for displaying the itinerary to the user, means for receiving user revision requests and re-adjusting the itinerary, and means for acquiring information from databases of transportation, accommodations, and tourist spots and generating an optimal plan based on the user's preferences. This allows users to efficiently create an itinerary that suits their preferences in a short amount of time, and can also quickly respond to revision requests, greatly simplifying the process of planning an itinerary.

[0130] "User" means an individual or organization that uses the system to plan a trip.

[0131] "Travel-related information" refers to information necessary for planning a trip, such as the purpose of the trip, departure date, destination, preferred accommodation, and transportation.

[0132] A "terminal" is an electronic device, such as a computer, smartphone, or tablet, that a user uses to enter travel-related information and communicate with the system.

[0133] A "server" is a computer system that receives travel-related information sent by a user, analyzes it, and sends an automatically generated travel plan to the user's terminal.

[0134] "Analysis" is the process by which the server references information in the database and generates a travel plan based on the travel-related information received from the user.

[0135] A "generative AI model" is an artificial intelligence model used to automatically generate optimal travel plans based on a user's preferences.

[0136] A "travel plan" is a specific schedule that includes suggestions for transportation, accommodation, sightseeing spots, meals, etc., created based on the user's preferences.

[0137] A "modification request" is a request that a user submits to the system for changes or adjustments to a provided travel plan.

[0138] A "transportation database" is a database that stores information on schedules and fares for transportation such as airplanes, bullet trains, and buses.

[0139] The "accommodation database" is a database that stores detailed information about accommodation facilities such as hotels, resorts, and guesthouses.

[0140] The "tourist spot database" is a database that stores information about sightseeing spots, restaurants, activities, and other tourist-related information.

[0141] The present invention provides a system that allows users to easily plan their travel plans. In this system, the user inputs travel-related information using a terminal, and the information is sent to a server. The server then analyzes the information and uses a generative AI model to automatically generate an optimal travel plan based on the user's preferences, and sends the generated plan to the terminal. Finally, the user can review the plan and submit revision requests as necessary. Details of the system configuration and operation are as follows.

[0142] Hardware and software used

[0143] Server: A central processing unit used for information analysis and database searches. In this case, a specific cloud server service (e.g., AWS®, Google® Cloud Platform) is used.

[0144] Device: An electronic device used by a user to provide input information and display the generated itinerary, such as a personal computer, smartphone, or tablet.

[0145] Database: Stores various data (transportation, accommodation, tourist spots) and uses a database management system such as MySQL (registered trademark) or PostgreSQL.

[0146] Generative AI model: An artificial intelligence model used to automatically generate travel plans based on user preferences, such as GPT-3 (registered trademark).

[0147] User Input

[0148] The user uses the terminal to enter the following travel-related information:

[0149] Purpose of trip (e.g. sightseeing, business, gourmet)

[0150] Departure date (e.g. December 1, 2023)

[0151] Destination (e.g. Tokyo)

[0152] Hotel preferences (e.g. mid-range, near the station)

[0153] Transportation (e.g. bullet train, airplane, bus)

[0154] As a specific example, the user launches a web browser or a dedicated application, enters the above information into the input fields, and clicks the "Submit" button.

[0155] Data transmission

[0156] The device checks the information entered by the user, checks that there are no errors, and then sends the information to the server. Specifically, the input information is sent to the server as a POST request using the API (e.g., https: / / api.travelplanner.com / submit).

[0157] Database searching and analysis

[0158] The server retrieves the necessary information from the database based on the received information, queries the transportation database, accommodation database, and tourist spot database, and inputs the returned results into the generative AI model for analysis.

[0159] Generate a travel plan

[0160] The server generates a specific itinerary based on the data returned by the generative AI model. The itinerary is organized in JSON format and includes necessary information such as transportation details, accommodation suggestions, daily schedules, and meal suggestions.

[0161] Provision to users

[0162] The server sends the generated travel plan to the terminal, which then displays it to the user. Specifically, the server returns the generated plan to the terminal via API, and the plan is displayed in HTML format on the terminal (e.g., schedule display using table tags).

[0163] Processing correction requests

[0164] The user checks the provided travel plan and submits a request for revisions if necessary. The user enters the parts they want to revise and clicks the "Request revisions" button. The device then sends the information back to the server, which then generates a new plan and sends it back.

[0165] Prompt Sentence Examples

[0166] "Purpose of trip: Sightseeing. Departure date: December 1, 2023. Destination: Tokyo. Hotel preference: Mid-range, near the station. Transportation method: Shinkansen. Please suggest the best travel plan based on this."

[0167] This system allows users to create travel plans that are tailored to their needs in a short amount of time and efficiently. It also responds quickly to requests for revisions, greatly simplifying the process of creating travel plans.

[0168] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0169] Step 1:

[0170] The user enters travel-related information into the device. Specifically, the user opens a web browser or dedicated application and enters the necessary information into the input fields, such as the purpose of the trip, departure date, destination, hotel preferences, and transportation method. After the user has finished entering the information, they click the "Submit" button.

[0171] Input: purpose of trip, departure date, destination, hotel preference, mode of transportation.

[0172] Output: User's travel-related information entered into the terminal.

[0173] Step 2:

[0174] The device checks the information entered by the user to see if there are any errors. If there are any errors, the device displays an error message to the user. If the input is correct, the device sends the information to the server. Specifically, the device uses the API (e.g., https: / / api.travelplanner.com / submit) to send the information to the server as a POST request.

[0175] Input: Travel-related information entered by the user.

[0176] Output: User's travel related information sent to the server.

[0177] Step 3:

[0178] Based on the information received, the server retrieves the necessary information from the database. The server queries the transportation database, accommodation database, and tourist attraction database to collect relevant information. Specifically, the server uses SQL queries to retrieve the necessary data from each database.

[0179] Input: The user's travel-related information sent to the server.

[0180] Output: Transport, accommodation and tourist attraction information retrieved from the database.

[0181] Step 4:

[0182] The server analyzes the acquired data and inputs it into a generative AI model (e.g., GPT-3). The generative AI model automatically generates an optimal travel plan that matches the user's preferences based on this data. Specifically, the AI ​​model generates suggested transportation, accommodation, tourist spots, and schedule information.

[0183] Input: Transportation, accommodation and tourist attraction information retrieved from database.

[0184] Output: A concrete trip plan generated by the generative AI model.

[0185] Step 5:

[0186] The server sends the generated itinerary to the device. Specifically, it organizes the generated itinerary in JSON format and sends it to the device via API. The device receives this information and displays it in a format that is easy for the user to view. For example, it displays the itinerary using HTML and CSS.

[0187] Input: A concrete travel itinerary generated by a generative AI model.

[0188] Output: Trip plan displayed on the terminal.

[0189] Step 6:

[0190] The user checks the provided travel plan and submits an amendment request if necessary. Specifically, the user enters the amendment details into the amendment form in the browser or app and clicks the "Request amendment" button.

[0191] Input: A user's request to modify a travel plan.

[0192] Output: The modification request sent from the device to the server.

[0193] Step 7:

[0194] The server receives the request, analyzes the information again, and adjusts the travel plan. The server then requests the AI ​​model to generate a new plan that reflects the changes, and sends the regenerated plan to the device.

[0195] Input: The modification request sent from the terminal.

[0196] Output: The regenerated itinerary.

[0197] In this way, a specific and optimal travel plan based on the user's wishes can be quickly generated, and revision requests from the user can be flexibly accommodated.

[0198] (Application example 1)

[0199] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0200] Conventional travel planning systems allow users to plan their trip beforehand, but lack real-time guidance and information during the trip. Furthermore, it is difficult to change plans mid-trip or update local information in a timely manner, which can cause inconvenience during the trip. This has led to the problem of trip plans not being utilized efficiently and effectively.

[0201] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0202] In this invention, the server includes means for a user to input travel-related information, means for transmitting the information to the server, means for analyzing the information and automatically generating a travel plan tailored to the user's preferences, means for transmitting the generated travel plan to the user's terminal, means for displaying the travel plan to the user, means for providing the user with real-time guidance during the trip, means for displaying the generated travel plan on the user's smart glasses, and means for presenting information on tourist spots and restaurants in real time. This allows the user to receive real-time guidance during the trip, enabling them to smoothly navigate their travel destinations.

[0203] "User" refers to an individual who uses the system to plan a trip and receive real-time guidance during the trip.

[0204] "Travel-related information" refers to information necessary for planning a trip, such as travel destination, departure date, preferred accommodation, transportation, and tourist attractions.

[0205] "Server" refers to a computer system that receives and analyzes travel-related information sent by users, retrieves information from a database, and automatically generates an optimal travel plan.

[0206] A "terminal" is a device that allows a user to input travel-related information, confirm and transmit that information, and display the generated travel plan, and includes a smartphone, tablet, etc.

[0207] "Travel Plan" means a plan that includes specific travel itineraries, transportation, accommodations, sightseeing spots, and dining suggestions that is automatically generated based on information entered by a User.

[0208] "Means for automatic generation" refers to the algorithms and programs that allow the server to analyze the information entered by the user, retrieve the most appropriate information from the database, and automatically create a travel plan.

[0209] "Smart glasses" refer to a wearable device that can be worn by a user and display information in real time in their field of vision.

[0210] "Real-time guidance" refers to the latest information on tourist attractions, dining options, and transportation provided to users based on their current location and current conditions while traveling.

[0211] "Tourist attractions" refer to destinations and places of interest visited by tourists, including museums, parks, historical buildings, and entertainment venues.

[0212] "Dining facilities" are places where users can visit and eat meals during their trip, and include restaurants, cafes, dining halls, etc.

[0213] This invention provides a system that allows users to easily plan their travel plans. The system, which allows users to input travel-related information, automatically generates an optimal travel plan based on the information, and provides it to the user, is composed of a user terminal, a server, and a database. The system also provides real-time guidance during the trip and allows users to access the travel plan through smart glasses.

[0214] System configuration

[0215] The system consists of the following components:

[0216] 1. User's device: A device such as a smartphone or tablet that allows the user to enter, confirm and submit travel-related information and view the generated travel plan.

[0217] 2. Server: A computer system that receives and analyzes travel-related information sent by users, retrieves information from a database, and generates optimal travel plans. In particular, it runs a program using Python and the Requests library.

[0218] 3. Database: A database that stores information on transportation, accommodation, tourist attractions, and dining facilities.

[0219] 4. Smart glasses: These are wearable devices that users can wear and view, and are used to display travel plans and real-time directions.

[0220] Explanation of program processing

[0221] User inputs travel information: The user inputs information such as travel destination, departure date, preferred accommodation, transportation method, and tourist spots they want to visit into the terminal.

[0222] Sending information: The terminal checks the entered information and, after confirming that there are no errors, sends it to the server.

[0223] Analysis and plan generation on the server: The server analyzes the received information and retrieves the relevant information from the database. Using Python and the Requests library, it retrieves the information from the API and automatically generates the optimal travel plan.

[0224] Displaying the itinerary: The generated itinerary is sent from the server to the terminal and displayed to the user. The itinerary is also sent to the smart glasses.

[0225] Real-time guidance: Through smart glasses, users can receive real-time tourist information and dining facility information.

[0226] Specific examples

[0227] For example, a user enters the following travel information:

[0228] Purpose of trip: Sightseeing

[0229] Departure date: December 1, 2023

[0230] Destination: Tokyo

[0231] Hotel preference: Mid-range, near the station

[0232] Transportation: Shinkansen

[0233] The itinerary generated by the server will look something like this:

[0234] Day 1: Take the Shinkansen to Tokyo at 8am. Stay at a mid-range hotel near Shinjuku Station. Visit Sensoji Temple in the morning, Skytree in the afternoon, and Shibuya in the evening. Have tempura for lunch in Asakusa and yakiniku for dinner in Shibuya.

[0235] Example of input prompt for generative AI model

[0236] Purpose of trip: Sightseeing

[0237] Departure date: December 1, 2023

[0238] Destination: Tokyo

[0239] Hotel preference: Mid-range, near the station

[0240] Transportation: Shinkansen

[0241] Use this information to generate the best possible travel plan.

[0242] In this way, the system automatically generates a travel plan based on user input information and provides real-time guidance during the trip, greatly improving the user's travel experience.

[0243] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0244] Step 1:

[0245] A user uses a terminal to input travel-related information.

[0246] Input: Travel destination, departure date, accommodation preferences, transportation options, tourist attractions, and other information.

[0247] Data processing and calculation: The user enters this information through the device's UI, and the input is verified to ensure there are no errors.

[0248] Output: A set of verified travel-related information.

[0249] Step 2:

[0250] The terminal transmits the information input by the user to the server.

[0251] Input: A set of travel-related information for the user.

[0252] Data processing and calculation: The device packages the information and sends it to the server using a secure communication protocol (e.g., HTTPS).

[0253] Output: The user's travel-related information passed to the server.

[0254] Step 3:

[0255] The server analyzes the received travel-related information and retrieves relevant information from a database.

[0256] Input: User's travel-related information.

[0257] Data processing and calculation: The server uses Python and the Requests library to obtain information on transportation, accommodation, tourist attractions, and restaurants from multiple APIs. The information is then analyzed and filtered to select the information that meets the user's requirements.

[0258] Output: Parsed and filtered travel information.

[0259] Step 4:

[0260] The server automatically generates the optimal travel plan tailored to the user's wishes.

[0261] Input: Parsed and filtered information required for the trip.

[0262] Data processing and calculation: The server runs the algorithm to generate the optimal travel plan based on the user's requirements. It uses the generative AI model to create suggestions based on the prompt.

[0263] Output: Generated itinerary (e.g., dates, times, modes of transport, accommodation, tourist attractions, and dining details).

[0264] Step 5:

[0265] The generated travel plan is transmitted to the user's terminal and smart glasses.

[0266] Input: The generated itinerary.

[0267] Data processing and calculation: The server formats and transmits the travel plan to the device and smart glasses. Data communication uses a secure protocol.

[0268] Output: The trip plan displayed on the user's device and smart glasses.

[0269] Step 6:

[0270] The terminal and smart glasses display the travel plan to the user.

[0271] Input: Travel itinerary sent from the server.

[0272] Data processing and calculation: The device and smart glasses will visualize the travel plan in a user-friendly format and display specific schedules and suggestions.

[0273] Output: Trip plan details available to the user.

[0274] Step 7:

[0275] Smart glasses provide real-time tourist information and dining information.

[0276] Input: User's current location and real-time data retrieved from the server.

[0277] Data processing and calculation: The smart glasses use GPS functionality and updates from the server to display real-time information based on the user's current location.

[0278] Output: Tourist information and dining information that users can view in real time.

[0279] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0280] The present invention provides a system that allows users to efficiently plan their travel plans, and further aims to provide a more satisfying travel experience by recognizing the user's emotions and adjusting the travel plan based on those emotions. This system inputs and analyzes the user's travel-related information, generates an optimal travel plan, and presents it to the user. It also recognizes the user's emotions in real time and flexibly adjusts the travel plan based on that information.

[0281] System configuration

[0282] This system consists of a user's terminal, a server, a database, and an emotion engine. The user uses the terminal to input travel-related information, which is then sent to the server. The server analyzes the input information, retrieves the necessary information from the database, automatically generates a travel plan, and sends the generated plan to the terminal. The terminal displays the plan to the user and accepts the user's confirmation or correction requests. The emotion engine analyzes the user's emotions from the user's input and reactions, and this emotional information is used to optimize the travel plan.

[0283] User Input

[0284] The user uses the terminal to enter the following travel-related information:

[0285] Purpose of trip (e.g. sightseeing, business, gourmet)

[0286] Departure date (e.g. December 1, 2023)

[0287] Destination (e.g. Tokyo)

[0288] Hotel preferences (e.g. mid-range, near the station)

[0289] Transportation (e.g. bullet train, airplane, bus)

[0290] Data transmission and analysis

[0291] The device sends the user's input data to the server, which analyzes the information. Based on the analyzed information, the server searches and retrieves the necessary information from the transportation database, accommodation database, and tourist spot database.

[0292] Generate a travel plan

[0293] The server generates an optimal travel plan based on the information it has acquired. The plan includes the following information:

[0294] Transportation details (departure date and time, seat information)

[0295] Accommodation booking suggestions (hotel name, address, price, facilities information)

[0296] Daily schedule (visit locations, visit times, transportation methods and times)

[0297] Meal planning (restaurant reservations, menu recommendations)

[0298] Use of emotion engine

[0299] The emotion engine analyzes emotions in real time from the user's input and reactions. This emotional information is sent to the server and used to generate and adjust travel plans. For example, if the user expresses positive emotions such as "fun" or "excited," the plan will be adjusted to increase activity. On the other hand, if the user expresses emotions such as "tired" or "stressed," the plan will be adjusted to include more rest time.

[0300] Providing and coordinating travel plans

[0301] The server sends the generated travel plan to the terminal, which displays it to the user. If the user checks the plan and requests any modifications, the terminal sends the request to the server. The server receives the modification request, readjusts the travel plan taking into account the emotion data from the emotion engine, and sends the new plan to the terminal.

[0302] Specific examples

[0303] For example, here is a concrete example:

[0304] Purpose of trip: Sightseeing

[0305] Departure date: December 1, 2023

[0306] Destination: Tokyo

[0307] Hotel preference: Mid-range, near the station

[0308] Transportation: Shinkansen

[0309] 1. The user enters this information into the terminal and sends it.

[0310] 2. The device forwards the transmitted information to the server.

[0311] 3. The server analyzes the information and retrieves information from the database about appropriate transportation options (e.g., the Shinkansen at 8:00 AM on December 1st), accommodation options (e.g., a mid-range hotel near Shinjuku Station), and tourist attractions (e.g., Sensoji Temple, Skytree, Shibuya, etc.).

[0312] 4. Based on the information obtained, the server generates a specific itinerary, such as:

[0313] Departure date: December 1st, 8:00 AM Shinkansen

[0314] Hotel: Mid-range hotel near Shinjuku Station

[0315] Sightseeing Schedule: Day 1: Sensoji Temple in the morning, Skytree in the afternoon, Shibuya in the evening

[0316] Gourmet: Tempura lunch in Asakusa, Yakiniku dinner in Shibuya

[0317] 5. The server sends the generated itinerary to the terminal, which displays it to the user.

[0318] 6. The user expresses negative emotions such as "tired" or "stressed" about the displayed travel plan.

[0319] 7. The emotion engine analyzes the user's emotions and sends the information to the server.

[0320] 8. The server takes the emotional data into account and readjusts the itinerary, for example adding more breaks and relaxation spots.

[0321] 9. The server sends the re-arranged itinerary to the terminal, which displays it to the user.

[0322] This system allows users to plan their trips efficiently and flexibly in a short time, and enjoy an emotionally sensitive travel experience.

[0323] The processing flow will be explained below.

[0324] Step 1:

[0325] The user uses the terminal to input travel-related information (purpose of travel, departure date, destination, hotel preference, and means of transportation).

[0326] Step 2:

[0327] The device checks the accuracy of the user's input data and ensures that all required fields are filled in.

[0328] Step 3:

[0329] The terminal sends the verified user-entered data to the server.

[0330] Step 4:

[0331] The server receives the user's input data and begins parsing it.

[0332] Step 5:

[0333] Based on the information analyzed by the server, the necessary information is searched from the transportation database, accommodation database, and tourist spot database.

[0334] Step 6:

[0335] The server filters the information obtained from each database and extracts the options that best suit the user's preferences.

[0336] Step 7:

[0337] The server generates an optimal travel plan based on the extracted information, including, for example:

[0338] Transportation: Departure date and time, seat information

[0339] Accommodation: Hotel name, address, rates, and facility information

[0340] Daily schedule: places to visit, visiting times, transportation and time

[0341] Meal planning: restaurant reservations, menu recommendations

[0342] Step 8:

[0343] The server transmits the generated travel plan to the terminal.

[0344] Step 9:

[0345] The device displays the travel plan received from the server to the user, visually showing detailed schedules, maps, reservation information, and more.

[0346] Step 10:

[0347] The user checks the displayed travel plan and, if necessary, inputs emotions or makes a request for correction through the emotion engine.

[0348] Step 11:

[0349] The emotion engine analyzes the user's input and reactions (touch, voice, facial expressions, etc.) to recognize the user's emotions.

[0350] Step 12:

[0351] The terminal sends a modification request including emotion data to the server.

[0352] Step 13:

[0353] The server receives the modification request and emotion data, and performs a database search and analysis again based on the new parameters.

[0354] Step 14:

[0355] The server will adjust the travel plan based on the user's emotions. For example, if the user feels tired, it will set more rest time.

[0356] Step 15:

[0357] The server transmits the regenerated itinerary to the terminal.

[0358] Step 16:

[0359] The terminal displays the regenerated itinerary to the user, who then makes a final confirmation.

[0360] Step 17:

[0361] The user finalizes the travel plan and the terminal transmits the information to the server.

[0362] Step 18:

[0363] The server stores the confirmed itinerary and sends a confirmation message to the terminal.

[0364] All these steps allow users to easily plan and execute travel plans that are emotionally sensitive, efficient, and flexible.

[0365] Example 2

[0366] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0367] Conventional travel planning systems can generate travel plans based on user input, but they have the problem of not being able to flexibly adjust the plan to take the user's emotions into account. This means that the travel plans provided do not adapt to the user's real-time emotions and state, which can lead to a decrease in satisfaction.

[0368] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for a user to input travel-related information, means for transmitting the information to the server, means for analyzing the information and automatically generating a travel itinerary tailored to the user's wishes, means for transmitting the generated travel itinerary to the user's terminal, means for displaying the travel itinerary to the user, means for analyzing the user's emotions from the user's input content and reactions and optimizing the travel itinerary based on the emotion information, and means for re-adjusting the travel itinerary based on the user's emotions. This makes it possible to provide a flexible and optimal travel itinerary that responds to changes in the user's emotions.

[0369] "User" refers to an individual or organization that uses the system to plan a trip.

[0370] A "terminal" is a device through which a user inputs travel-related information and displays the generated travel plan, and includes a smartphone, a personal computer, etc.

[0371] "Server" refers to the central processing unit that receives and analyzes user input information and generates and transmits travel plans.

[0372] A "database" refers to an information aggregation system that stores information on transportation, accommodation, tourist attractions, etc., and is used by the server to obtain the necessary information.

[0373] An "emotion engine" refers to a program or module that analyzes emotions from user input and reactions and provides that emotional information to a server.

[0374] "Program" refers to a set of instructions that executes an algorithm that generates a travel plan based on user input and adjusts the plan based on emotional information.

[0375] "Travel Plan" refers to a travel schedule including details such as transportation, accommodations, dates, places to visit, and meal plans, generated based on travel-related information entered by a user.

[0376] "Emotion Data" refers to information about a user's emotions analyzed by the emotion engine, indicating a negative or positive emotional state.

[0377] "Analysis" refers to the process by which the server understands the travel-related information and sentiment data submitted by the user and converts it into a meaningful format.

[0378] The present invention is a system that allows users to efficiently plan travel plans and flexibly adjust those plans based on emotions. The system consists of the following main components: a user terminal, a server, a database, and an emotion engine.

[0379] Hardware and software used

[0380] User's device: A device such as a smartphone or PC on which the user inputs travel-related information and displays the generated travel plan.

[0381] Server: A cloud server (e.g., AWS, Google Cloud) that receives and analyzes user input information and generates a travel plan.

[0382] Database: A database (e.g. MySQL, PostgreSQL) for storing information on transportation, accommodation, tourist attractions, etc.

[0383] Emotion engine: Software that analyzes user emotions and provides that information to a server (e.g., Emotion API, Microsoft® Azure® Cognitive Services).

[0384] Program processing overview

[0385] The user enters travel-related information and sends it to the server via their device. The server analyzes the input data and retrieves the necessary information from a database. It then generates an optimal travel plan and sends it to the user's device. Next, the emotion engine analyzes the user's reactions and sends emotional information to the server. Based on this emotional information, the travel plan is readjusted and provided to the user again.

[0386] Specific processing of the program

[0387] 1. User input:

[0388] The user uses the device to input travel-related information, such as "Purpose of trip: sightseeing," "Departure date: December 1, 2023," "Destination: Tokyo," "Hotel preference: mid-range, near the station," and "Transportation method: Shinkansen."

[0389] 2. Data transmission and analysis:

[0390] The device sends the user's input data to the server, which then analyzes the received data and searches for and retrieves the necessary information from a database of transportation, accommodation, and tourist attractions.

[0391] 3. Generate itinerary:

[0392] The server generates an optimal travel plan based on the information obtained. For example, it creates a detailed travel plan like this:

[0393] Departure date: December 1st, 8:00 AM Shinkansen

[0394] Hotel: Mid-range hotel near Shinjuku Station

[0395] Sightseeing Schedule: Day 1: Sensoji Temple in the morning, Skytree in the afternoon, Shibuya in the evening

[0396] Gourmet: Tempura lunch in Asakusa, Yakiniku dinner in Shibuya

[0397] 4. Use of Emotion Engine:

[0398] The emotion engine then analyzes the user's emotion and sends the emotion data to the server. For example, if the user inputs "I'm tired," the emotion engine analyzes this as a negative emotion.

[0399] 5. Reconditioning and re-offering:

[0400] Based on the emotion data, the server adjusts the itinerary again. For example, it considers the emotion of "tired" and adjusts it to increase rest time and add relaxation spots. Then, it sends this adjusted itinerary to the terminal and displays it again to the user.

[0401] Examples of concrete examples and prompts

[0402] Examples of specific travel plans:

[0403] Purpose of trip: Sightseeing

[0404] Departure date: December 1, 2023

[0405] Destination: Tokyo

[0406] Hotel preference: Mid-range, near the station

[0407] Transportation: Shinkansen

[0408] Example prompt sentence:

[0409] "Please plan a trip to Tokyo starting on December 1st. I would like to do some sightseeing and stay somewhere mid-range and close to the station. I will be traveling by Shinkansen."

[0410] In this way, the system enables users to plan their trip efficiently and flexibly and enjoy an emotionally optimized travel experience.

[0411] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0412] Step 1:

[0413] User enters travel-related information

[0414] The user uses the terminal to input the purpose of the trip, departure date, destination, preferred hotel, mode of transportation, etc. The input data is saved in the terminal application.

[0415] Input: purpose of trip, departure date, destination, hotel preference, transportation method

[0416] Specific operation: The user enters information such as "tourism," "December 1, 2023," "Tokyo," "mid-range price range, near the station," and "Shinkansen" into the form on the application and presses the submit button.

[0417] Step 2:

[0418] The device sends the user's input data to the server

[0419] The entered data is sent from the device to the server via the Internet, allowing the server to begin analysis.

[0420] Input: User's travel-related information

[0421] Output: Data sent to the server

[0422] Specific operation: The terminal packages the data in JSON format and sends it to the server's API using the HTTPS protocol.

[0423] Step 3:

[0424] The server analyzes the received data

[0425] The server analyzes the information entered by the user and extracts information by category, dividing data such as the purpose of the trip, departure date, destination, hotel preference, and transportation method into separate fields.

[0426] Input: Travel-related information sent from your device

[0427] Output: Data for each analyzed category

[0428] Specific operation: The server parses the JSON data and breaks it down into data fields such as "Purpose of trip: sightseeing," "Departure date: December 1, 2023," "Destination: Tokyo," "Hotel preference: mid-range, near the station," and "Transportation method: Shinkansen."

[0429] Step 4:

[0430] The server retrieves the necessary information from the database

[0431] Based on the analyzed data, the server retrieves information on transportation, accommodations, tourist spots, etc. from a database, providing the base information needed to generate an optimal travel plan.

[0432] Input: Data for each category analyzed

[0433] Output: Transportation, accommodation, and tourist attraction information

[0434] Specific operation: The server issues an SQL query to the database to obtain accommodations that meet the criteria of "Tokyo," "mid-range price range," and "near the station," as well as information on Shinkansen trains departing at 8:00 AM on December 1st, and tourist spots such as Sensoji Temple, Skytree, and Shibuya.

[0435] Step 5:

[0436] The server generates the optimal travel plan

[0437] The system automatically generates an optimal travel plan by integrating all the information obtained from the database, including transportation, schedule, places to visit, and meal plans.

[0438] Input: Transportation, accommodation, and tourist attraction information

[0439] Output: Generated itinerary

[0440] Specific operation: Based on the program logic, the server creates a detailed travel plan such as "Depart on the Shinkansen at 8:00 AM on December 1st," "Stay at a mid-range hotel near Shinjuku Station," "On the first day, visit Sensoji Temple in the morning, Skytree in the afternoon, and Shibuya in the evening," "Tempura lunch in Asakusa, and yakiniku dinner in Shibuya."

[0441] Step 6:

[0442] The server sends the generated travel plan to the terminal.

[0443] The generated travel plan is sent from the server to the terminal, where the user can check the plan.

[0444] Input: Generated itinerary

[0445] Output: Trip plan sent to the device

[0446] Specific operation: The server packages the travel plan in JSON format and sends it to the device's API using the HTTPS protocol.

[0447] Step 7:

[0448] The device displays the travel plan to the user.

[0449] The transmitted travel plan is displayed on the terminal, and the user can check the plan details, thereby learning the contents of the travel plan.

[0450] Input: Submitted travel plan

[0451] Output: Trip plan displayed on the device

[0452] Specific operation: The device parses the JSON data received and displays it on the screen in the form of "Depart on the Shinkansen at 8:00 AM on December 1st," "Stay at a mid-range hotel near Shinjuku Station," "Day 1: Sensoji Temple in the morning, Skytree in the afternoon, Shibuya in the evening," "Tempura lunch in Asakusa, yakiniku dinner in Shibuya," etc.

[0453] Step 8:

[0454] Emotion engine analyzes user reactions

[0455] When a user inputs their thoughts or opinions about the displayed travel plan, the emotion engine analyzes them to generate emotion data, such as emotions like "tired" or "fun."

[0456] Input: User reactions and thoughts

[0457] Output: Parsed emotion data

[0458] Specific behavior: The user types "tired," and the emotion engine analyzes the text to generate negative emotion data.

[0459] Step 9:

[0460] The emotion engine sends the emotion data to the server.

[0461] The generated emotion data is sent from the emotion engine to a server, which uses the information to adjust the travel plan.

[0462] Input: Parsed emotion data

[0463] Output: Emotion data sent to the server

[0464] Specific operation: The emotion engine packages emotion data in JSON format and sends it to the server's API using the HTTPS protocol.

[0465] Step 10:

[0466] The server readjusts the travel plan based on the emotion data.

[0467] The server then adjusts the travel plan based on the emotion data received, for example by increasing rest periods and adding relaxation spots.

[0468] Input: emotion data, original travel plan

[0469] Output: Reworked itinerary

[0470] Specific operation: Based on the emotional data that the server is "tired," it makes adjustments such as increasing break time and adding a "break at a cafe."

[0471] Step 11:

[0472] The server sends the re-arranged travel plan to the device.

[0473] The server sends the re-arranged travel plan to the terminal, allowing the user to review the plan again.

[0474] Input: Re-arranged travel plans

[0475] Output: The adjusted itinerary sent to the device.

[0476] Specific operation: The server packages the re-arranged itinerary in JSON format and sends it to the device's API using the HTTPS protocol.

[0477] Step 12:

[0478] The device displays the re-arranged itinerary to the user.

[0479] The re-adjusted travel plan is displayed on the terminal, and the user confirms the plan again. This provides the user with a travel plan that takes emotions into consideration.

[0480] Input: Submitted rearranged travel plan

[0481] Output: The adjusted itinerary displayed on the device

[0482] Specific behavior: The device parses the received JSON data and displays the re-adjusted plan on the screen.

[0483] In this way, users can efficiently plan their trips and enjoy trip plans that are flexibly adjusted based on real-time emotions.

[0484] (Application example 2)

[0485] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0486] Conventional travel planning systems automatically generate travel plans without considering the user's emotions, which means they are unable to adapt to the user's real-time emotional changes. Furthermore, they are unable to adjust the plan to reflect negative emotions such as stress and fatigue that users experience during the trip, which makes it difficult to fully increase travel satisfaction. This often leaves users dissatisfied with their travel plans.

[0487] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0488] In this invention, the server includes means for inputting user travel-related information, means for transmitting the information to the server, means for analyzing the information and automatically generating a travel plan tailored to the user's preferences, means for transmitting the generated travel plan to the user's terminal, means for displaying the travel plan to the user, means for recognizing the user's emotions in real time, and means for adjusting the travel plan based on the recognized emotions. This makes it possible to flexibly adjust the travel plan according to the user's emotions, thereby increasing the user's travel satisfaction.

[0489] "User's travel-related information" refers to data that the user inputs to plan a trip, such as the purpose of the trip, departure date, destination, preferred accommodation, and means of transportation.

[0490] A "server" is a computer system that analyzes travel-related information submitted by users and generates and adjusts optimal travel plans.

[0491] "Means for automatic generation" refers to the function by which the server autonomously creates an optimal travel plan based on the data input by the user.

[0492] "User's terminal" refers to a device (e.g., smartphone, tablet, or PC) on which a user inputs travel-related information and displays and confirms the generated travel plan.

[0493] "Means for recognizing emotions in real time" refers to technologies (e.g., cameras, sensors, emotion analysis software) that monitor a user's facial expressions and behavior and analyze their current emotional state.

[0494] The "means for adjusting travel plans" is a function that flexibly changes and optimizes existing travel plans based on user sentiment information obtained in real time.

[0495] The present invention relates to a system that enables users to efficiently plan trips and adjust the plans while taking real-time emotions into account. The system for realizing the present invention is composed of a user terminal, a server, a database, and an emotion engine.

[0496] System configuration

[0497] Users input travel-related information using devices such as smartphones or tablets. The input information is sent from the device to a server. The server analyzes the information entered by the user, obtains necessary information (transportation, accommodations, tourist spots, etc.) from a database, and automatically generates an optimal travel plan. The generated travel plan is sent from the server to the device and displayed to the user.

[0498] Furthermore, the system of the present invention includes an emotion engine that recognizes emotions in real time from user inputs and reactions. This emotion information is sent to the server and used to generate and adjust travel plans.

[0499] System Operation

[0500] The emotion engine uses cameras and sensors installed in smart glasses or head-mounted displays (HMDs) to monitor the user's facial expressions and behavior and analyze their current emotional state. The server then adjusts the travel plan accordingly based on the analyzed emotional data. This adjustment can include adding breaks or relaxing areas.

[0501] Usage example

[0502] For example, a user enters the following travel-related information:

[0503] Purpose of trip: Sightseeing

[0504] Departure date: December 1, 2023

[0505] Destination: Tokyo

[0506] Hotel preference: Mid-range, near the station

[0507] Transportation: Shinkansen

[0508] When the user inputs this information into the device and sends it, the device transfers it to the server, which analyzes the information, retrieves information on appropriate transportation, accommodations, and tourist spots from a database, and generates an optimal travel plan.

[0509] The generated itinerary includes the following specific details:

[0510] Departure date: December 1st, 8:00 AM Shinkansen

[0511] Hotel: Mid-range hotel near Shinjuku Station

[0512] Sightseeing Schedule: Day 1: Sensoji Temple in the morning, Skytree in the afternoon, Shibuya in the evening

[0513] Gourmet: Tempura lunch in Asakusa, Yakiniku dinner in Shibuya

[0514] The generated itinerary is sent to the device, where the user can view it. If the user expresses a negative emotion such as "tired" about the displayed itinerary, the emotion engine analyzes the emotion and sends it to the server. The server takes the emotion data into account and readjusts the itinerary, for example, by increasing rest time or adding relaxation spots.

[0515] As an example of a specific prompt, if the user wants to change the location they are visiting, they would enter:

[0516] "Change request: Please suggest other tourist spots in Tokyo instead of Sensoji Temple."

[0517] If you want to add a place where users can relax, type:

[0518] "Sentiment analysis results: 'I'm tired'. Please add a place where you can relax to your visit."

[0519] In this way, users can flexibly plan their travel plans according to their real-time emotions, thereby increasing the satisfaction of their travel experience.

[0520] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0521] Step 1:

[0522] The user inputs travel-related information using a device such as a smartphone or tablet. This information includes the purpose of the trip, departure date, destination, preferred hotel, mode of transportation, etc. This information is then sent from the device to the server.

[0523] Step 2:

[0524] The server receives the travel-related information sent from the device and analyzes the data. During the analysis, the server searches and retrieves the necessary information from a database (transportation, accommodation, tourist spots) based on the user's preferences.

[0525] Step 3:

[0526] The server automatically generates an optimal travel plan based on the acquired information, including specific details of transportation, accommodation, daily schedule, meal plan, etc. The travel plan is then sent from the server to the device.

[0527] Step 4:

[0528] The terminal receives the itinerary sent from the server and displays it to the user, who then checks the displayed itinerary and inputs any necessary revision requests, which are also sent from the terminal to the server.

[0529] Step 5:

[0530] Cameras and sensors installed in the user's smart glasses or head-mounted display (HMD) monitor the user's facial expressions and behavior to obtain real-time emotional data, which is then transmitted to a server via the device.

[0531] Step 6:

[0532] The emotion engine analyzes the user's emotional data. Specifically, it reads the user's emotions from their facial expressions and voice and determines whether they are positive (e.g., happy, excited) or negative (e.g., tired, stressed). The analysis results are sent to the server.

[0533] Step 7:

[0534] The server adjusts the itinerary based on the emotional data analyzed by the emotion engine and the user's requests for modifications. For example, if there is a lot of negative emotional data, the server may increase rest time or add relaxation spots.

[0535] Step 8:

[0536] The server sends the new adjusted travel plan to the terminal, which displays it to the user, who confirms the re-adjusted plan and continues traveling.

[0537] Through these steps, users can achieve a more satisfying travel experience. The system can adjust travel plans in real time according to users' emotions.

[0538] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0539] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0540] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0541] [Second embodiment]

[0542] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0543] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0544] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0545] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0546] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0547] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0548] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0549] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0550] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0551] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0552] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0553] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0554] The present invention provides a system that allows users to easily create travel plans. This system allows users to input travel-related information, automatically generates an optimal travel plan based on that information, and provides it to the user, thereby significantly reducing the effort required for planning.

[0555] System configuration

[0556] This system consists of a user's terminal, a server, and a database. The user uses the terminal to input travel-related information, which is then sent to the server. The server analyzes the information, retrieves the necessary information from the database, automatically generates a travel plan, and sends the generated plan to the terminal. The terminal then displays the plan to the user and accepts confirmation or correction requests from the user.

[0557] User Input

[0558] The user uses the terminal to enter the following travel-related information:

[0559] Purpose of trip (e.g. sightseeing, business, gourmet)

[0560] Departure date (e.g. December 1, 2023)

[0561] Destination (e.g. Tokyo)

[0562] Hotel preferences (e.g. mid-range, near the station)

[0563] Transportation (e.g. bullet train, airplane, bus)

[0564] Data transmission

[0565] The terminal checks the information entered by the user, and after confirming that there are no errors, sends it to the server.

[0566] Database searching and analysis

[0567] Based on the information received, the server retrieves the following information from the database:

[0568] Transportation database (airline, train, and bus schedules and fares)

[0569] Accommodation database (listings and details of hotels, resorts, and guesthouses)

[0570] Tourist spot database (information on tourist spots, restaurants, and activities)

[0571] The server then uses this information to generate a travel plan that best suits the user's needs. Specifically, it combines the following information:

[0572] Determine the best mode of transportation based on departure date and destination.

[0573] Select the appropriate accommodation based on your hotel preferences (price range, location).

[0574] Depending on the purpose of the trip, it selects tourist spots and activities to visit and calculates the order in which to visit them and travel time.

[0575] Generate a travel plan

[0576] The server creates a specific itinerary tailored to the user's needs, including information such as:

[0577] Transportation details (e.g., what time and which Shinkansen to take)

[0578] Accommodation booking suggestions (e.g. mid-range hotel near Shinjuku Station)

[0579] Daily schedule (e.g., Sensoji Temple in the morning on the first day, Skytree in the afternoon, Shibuya in the evening, etc.)

[0580] Dining suggestions (e.g., tempura lunch in Asakusa, yakiniku dinner in Shibuya)

[0581] Provision to users

[0582] The server sends the generated itinerary to the terminal, which displays it to the user, who can review the itinerary and request modifications if necessary.

[0583] Processing correction requests

[0584] If the user requests an amendment to the plan, the device sends the request to the server, which again analyzes and retrieves the information to adjust the travel plan.

[0585] Specific examples

[0586] For example:

[0587] Purpose of trip: Sightseeing

[0588] Departure date: December 1, 2023

[0589] Destination: Tokyo

[0590] Hotel preference: Mid-range, near the station

[0591] Transportation: Shinkansen

[0592] 1. The user enters this information into the terminal and sends it.

[0593] 2. The device forwards the transmitted information to the server.

[0594] 3. The server analyzes the information and retrieves information from the database about appropriate transportation options (e.g., the Shinkansen at 8:00 AM on December 1st), accommodation options (e.g., a mid-range hotel near Shinjuku Station), and tourist attractions (e.g., Sensoji Temple, Skytree, Shibuya, etc.).

[0595] 4. Based on the information obtained, the server generates a specific itinerary, such as:

[0596] Departure date: December 1st, 8:00 AM Shinkansen

[0597] Hotel: Mid-range hotel near Shinjuku Station

[0598] Sightseeing Schedule: Day 1: Sensoji Temple in the morning, Skytree in the afternoon, Shibuya in the evening

[0599] Gourmet: Tempura lunch in Asakusa, Yakiniku dinner in Shibuya

[0600] 5. The server sends the generated itinerary to the terminal, which displays it to the user.

[0601] 6. The user reviews the plan and submits a request for revisions if necessary.

[0602] This system allows users to create efficient travel plans in a short amount of time, greatly simplifying travel preparations, thereby reducing the time and effort required for travel planning and providing a fulfilling travel experience.

[0603] The processing flow will be explained below.

[0604] Step 1:

[0605] The user uses a device (smartphone or PC) to input travel-related information (purpose of trip, departure date, destination, hotel preferences, and means of transportation).

[0606] Step 2:

[0607] The device checks the accuracy of the user's input data and ensures that all required fields are filled in.

[0608] Step 3:

[0609] The terminal sends the verified user-entered data to the server.

[0610] Step 4:

[0611] The server receives the user's input data and parses the input.

[0612] Step 5:

[0613] Based on the information analyzed by the server, the necessary information is searched from the transportation database, accommodation database, and tourist spot database.

[0614] Step 6:

[0615] The server filters the information obtained from each database and extracts the options that best suit the user's preferences.

[0616] Step 7:

[0617] The server generates an optimal travel plan based on the extracted information, including, for example:

[0618] Transportation: Departure date and time, seat information

[0619] Accommodation: Hotel name, address, rates, and facility information

[0620] Tourist schedule: places to visit, visiting times, means of transport and times

[0621] Meal planning: restaurant reservations, menu recommendations

[0622] Step 8:

[0623] The server transmits the generated travel plan to the terminal.

[0624] Step 9:

[0625] The device displays the travel plan received from the server to the user, visually showing detailed schedules, maps, reservation information, and more.

[0626] Step 10:

[0627] The user reviews the displayed itinerary and requests modifications if necessary.

[0628] Step 11:

[0629] The terminal sends the user's modification request to the server.

[0630] Step 12:

[0631] The server receives the modification request, searches and analyzes the database again based on the new parameters, and generates a new itinerary.

[0632] Step 13:

[0633] The server transmits the regenerated itinerary to the terminal.

[0634] Step 14:

[0635] The terminal displays the regenerated itinerary to the user, who then makes a final confirmation.

[0636] Step 15:

[0637] The user finalizes the travel plan and the terminal transmits the information to the server.

[0638] Step 16:

[0639] The server stores the confirmed itinerary and sends a confirmation message to the terminal.

[0640] All these steps allow users to easily plan and execute efficient and complete travel plans.

[0641] Example 1

[0642] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0643] Conventional travel planning systems require users to manually collect and organize large amounts of information, resulting in the time-consuming and labor-intensive process of planning. Furthermore, it is difficult to automatically generate a travel plan that perfectly matches the user's preferences, and it is also difficult to efficiently reflect revision requests. For these reasons, many users are dissatisfied with the process of creating a travel plan.

[0644] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0645] In this invention, the server includes means for a user to input travel-related information, means for transmitting the information to the server, means for analyzing the information and automatically generating a specific itinerary based on the user's preferences using a generative AI model, means for transmitting the generated itinerary to the user's terminal, means for displaying the itinerary to the user, means for receiving user revision requests and re-adjusting the itinerary, and means for acquiring information from databases of transportation, accommodations, and tourist spots and generating an optimal plan based on the user's preferences. This allows users to efficiently create an itinerary that suits their preferences in a short amount of time, and can also quickly respond to revision requests, greatly simplifying the process of planning an itinerary.

[0646] "User" means an individual or organization that uses the system to plan a trip.

[0647] "Travel-related information" refers to information necessary for planning a trip, such as the purpose of the trip, departure date, destination, preferred accommodation, and transportation.

[0648] A "terminal" is an electronic device, such as a computer, smartphone, or tablet, that a user uses to enter travel-related information and communicate with the system.

[0649] A "server" is a computer system that receives travel-related information sent by a user, analyzes it, and sends an automatically generated travel plan to the user's terminal.

[0650] "Analysis" is the process by which the server references information in the database and generates a travel plan based on the travel-related information received from the user.

[0651] A "generative AI model" is an artificial intelligence model used to automatically generate optimal travel plans based on a user's preferences.

[0652] A "travel plan" is a specific schedule that includes suggestions for transportation, accommodation, sightseeing spots, meals, etc., created based on the user's preferences.

[0653] A "modification request" is a request that a user submits to the system for changes or adjustments to a provided travel plan.

[0654] A "transportation database" is a database that stores information on schedules and fares for transportation such as airplanes, bullet trains, and buses.

[0655] The "accommodation database" is a database that stores detailed information about accommodation facilities such as hotels, resorts, and guesthouses.

[0656] The "tourist spot database" is a database that stores information about sightseeing spots, restaurants, activities, and other tourist-related information.

[0657] The present invention provides a system that allows users to easily plan their travel plans. In this system, the user inputs travel-related information using a terminal, and the information is sent to a server. The server then analyzes the information and uses a generative AI model to automatically generate an optimal travel plan based on the user's preferences, and sends the generated plan to the terminal. Finally, the user can review the plan and submit revision requests as necessary. Details of the system configuration and operation are as follows.

[0658] Hardware and software used

[0659] Server: A central processing unit used for information analysis and database searches, in this case using a specific cloud server service (e.g., AWS, Google Cloud Platform).

[0660] Device: An electronic device used by a user to provide input information and display the generated itinerary, such as a personal computer, smartphone, or tablet.

[0661] Database: Various data (transportation, accommodation, tourist spots) is stored in this database. This database uses a database management system such as MySQL or PostgreSQL.

[0662] Generative AI model: An artificial intelligence model used to automatically generate travel plans based on user preferences, such as GPT-3.

[0663] User Input

[0664] The user uses the terminal to enter the following travel-related information:

[0665] Purpose of trip (e.g. sightseeing, business, gourmet)

[0666] Departure date (e.g. December 1, 2023)

[0667] Destination (e.g. Tokyo)

[0668] Hotel preferences (e.g. mid-range, near the station)

[0669] Transportation (e.g. bullet train, airplane, bus)

[0670] As a specific example, the user launches a web browser or a dedicated application, enters the above information into the input fields, and clicks the "Submit" button.

[0671] Data transmission

[0672] The device checks the information entered by the user, checks that there are no errors, and then sends the information to the server. Specifically, the input information is sent to the server as a POST request using the API (e.g., https: / / api.travelplanner.com / submit).

[0673] Database searching and analysis

[0674] The server retrieves the necessary information from the database based on the received information, queries the transportation database, accommodation database, and tourist spot database, and inputs the returned results into the generative AI model for analysis.

[0675] Generate a travel plan

[0676] The server generates a specific itinerary based on the data returned by the generative AI model. The itinerary is organized in JSON format and includes necessary information such as transportation details, accommodation suggestions, daily schedules, and meal suggestions.

[0677] Provision to users

[0678] The server sends the generated travel plan to the terminal, which then displays it to the user. Specifically, the server returns the generated plan to the terminal via API, and the plan is displayed in HTML format on the terminal (e.g., schedule display using table tags).

[0679] Processing correction requests

[0680] The user checks the provided travel plan and submits a request for revisions if necessary. The user enters the parts they want to revise and clicks the "Request revisions" button. The device then sends the information back to the server, which then generates a new plan and sends it back.

[0681] Prompt Sentence Examples

[0682] "Purpose of trip: Sightseeing. Departure date: December 1, 2023. Destination: Tokyo. Hotel preference: Mid-range, near the station. Transportation method: Shinkansen. Please suggest the best travel plan based on this."

[0683] This system allows users to create travel plans that are tailored to their needs in a short amount of time and efficiently. It also responds quickly to requests for revisions, greatly simplifying the process of creating travel plans.

[0684] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0685] Step 1:

[0686] The user enters travel-related information into the device. Specifically, the user opens a web browser or dedicated application and enters the necessary information into the input fields, such as the purpose of the trip, departure date, destination, hotel preferences, and transportation method. After the user has finished entering the information, they click the "Submit" button.

[0687] Input: purpose of trip, departure date, destination, hotel preference, mode of transportation.

[0688] Output: User's travel-related information entered into the terminal.

[0689] Step 2:

[0690] The device checks the information entered by the user to see if there are any errors. If there are any errors, the device displays an error message to the user. If the input is correct, the device sends the information to the server. Specifically, the device uses the API (e.g., https: / / api.travelplanner.com / submit) to send the information to the server as a POST request.

[0691] Input: Travel-related information entered by the user.

[0692] Output: User's travel related information sent to the server.

[0693] Step 3:

[0694] Based on the information received, the server retrieves the necessary information from the database. The server queries the transportation database, accommodation database, and tourist attraction database to collect relevant information. Specifically, the server uses SQL queries to retrieve the necessary data from each database.

[0695] Input: The user's travel-related information sent to the server.

[0696] Output: Transport, accommodation and tourist attraction information retrieved from the database.

[0697] Step 4:

[0698] The server analyzes the acquired data and inputs it into a generative AI model (e.g., GPT-3). The generative AI model automatically generates an optimal travel plan that matches the user's preferences based on this data. Specifically, the AI ​​model generates suggested transportation, accommodation, tourist spots, and schedule information.

[0699] Input: Transportation, accommodation and tourist attraction information retrieved from database.

[0700] Output: A concrete trip plan generated by the generative AI model.

[0701] Step 5:

[0702] The server sends the generated itinerary to the device. Specifically, it organizes the generated itinerary in JSON format and sends it to the device via API. The device receives this information and displays it in a format that is easy for the user to view. For example, it displays the itinerary using HTML and CSS.

[0703] Input: A concrete travel itinerary generated by a generative AI model.

[0704] Output: Trip plan displayed on the terminal.

[0705] Step 6:

[0706] The user checks the provided travel plan and submits an amendment request if necessary. Specifically, the user enters the amendment details into the amendment form in the browser or app and clicks the "Request amendment" button.

[0707] Input: A user's request to modify a travel plan.

[0708] Output: The modification request sent from the device to the server.

[0709] Step 7:

[0710] The server receives the request, analyzes the information again, and adjusts the travel plan. The server then requests the AI ​​model to generate a new plan that reflects the changes, and sends the regenerated plan to the device.

[0711] Input: The modification request sent from the terminal.

[0712] Output: The regenerated itinerary.

[0713] In this way, a specific and optimal travel plan based on the user's wishes can be quickly generated, and revision requests from the user can be flexibly accommodated.

[0714] (Application example 1)

[0715] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0716] Conventional travel planning systems allow users to plan their trip beforehand, but lack real-time guidance and information during the trip. Furthermore, it is difficult to change plans mid-trip or update local information in a timely manner, which can cause inconvenience during the trip. This has led to the problem of trip plans not being utilized efficiently and effectively.

[0717] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0718] In this invention, the server includes means for a user to input travel-related information, means for transmitting the information to the server, means for analyzing the information and automatically generating a travel plan tailored to the user's preferences, means for transmitting the generated travel plan to the user's terminal, means for displaying the travel plan to the user, means for providing the user with real-time guidance during the trip, means for displaying the generated travel plan on the user's smart glasses, and means for presenting information on tourist spots and restaurants in real time. This allows the user to receive real-time guidance during the trip, enabling them to smoothly navigate their travel destinations.

[0719] "User" refers to an individual who uses the system to plan a trip and receive real-time guidance during the trip.

[0720] "Travel-related information" refers to information necessary for planning a trip, such as travel destination, departure date, preferred accommodation, transportation, and tourist attractions.

[0721] "Server" refers to a computer system that receives and analyzes travel-related information sent by users, retrieves information from a database, and automatically generates an optimal travel plan.

[0722] A "terminal" is a device that allows a user to input travel-related information, confirm and transmit that information, and display the generated travel plan, and includes a smartphone, tablet, etc.

[0723] "Travel Plan" means a plan that includes specific travel itineraries, transportation, accommodations, sightseeing spots, and dining suggestions that is automatically generated based on information entered by a User.

[0724] "Means for automatic generation" refers to the algorithms and programs that allow the server to analyze the information entered by the user, retrieve the most appropriate information from the database, and automatically create a travel plan.

[0725] "Smart glasses" refer to a wearable device that can be worn by a user and display information in real time in their field of vision.

[0726] "Real-time guidance" refers to the latest information on tourist attractions, dining options, and transportation provided to users based on their current location and current conditions while traveling.

[0727] "Tourist attractions" refer to destinations and places of interest visited by tourists, including museums, parks, historical buildings, and entertainment venues.

[0728] "Dining facilities" are places where users can visit and eat meals during their trip, and include restaurants, cafes, dining halls, etc.

[0729] This invention provides a system that allows users to easily plan their travel plans. The system, which allows users to input travel-related information, automatically generates an optimal travel plan based on the information, and provides it to the user, is composed of a user terminal, a server, and a database. The system also provides real-time guidance during the trip and allows users to access the travel plan through smart glasses.

[0730] System configuration

[0731] The system consists of the following components:

[0732] 1. User's device: A device such as a smartphone or tablet that allows the user to enter, confirm and submit travel-related information and view the generated travel plan.

[0733] 2. Server: A computer system that receives and analyzes travel-related information sent by users, retrieves information from a database, and generates optimal travel plans. In particular, it runs a program using Python and the Requests library.

[0734] 3. Database: A database that stores information on transportation, accommodation, tourist attractions, and dining facilities.

[0735] 4. Smart glasses: These are wearable devices that users can wear and view, and are used to display travel plans and real-time directions.

[0736] Explanation of program processing

[0737] User inputs travel information: The user inputs information such as travel destination, departure date, preferred accommodation, transportation method, and tourist spots they want to visit into the terminal.

[0738] Sending information: The terminal checks the entered information and, after confirming that there are no errors, sends it to the server.

[0739] Analysis and plan generation on the server: The server analyzes the received information and retrieves the relevant information from the database. Using Python and the Requests library, it retrieves the information from the API and automatically generates the optimal travel plan.

[0740] Displaying the itinerary: The generated itinerary is sent from the server to the terminal and displayed to the user. The itinerary is also sent to the smart glasses.

[0741] Real-time guidance: Through smart glasses, users can receive real-time tourist information and dining facility information.

[0742] Specific examples

[0743] For example, a user enters the following travel information:

[0744] Purpose of trip: Sightseeing

[0745] Departure date: December 1, 2023

[0746] Destination: Tokyo

[0747] Hotel preference: Mid-range, near the station

[0748] Transportation: Shinkansen

[0749] The itinerary generated by the server will look something like this:

[0750] Day 1: Take the Shinkansen to Tokyo at 8am. Stay at a mid-range hotel near Shinjuku Station. Visit Sensoji Temple in the morning, Skytree in the afternoon, and Shibuya in the evening. Have tempura for lunch in Asakusa and yakiniku for dinner in Shibuya.

[0751] Example of input prompt for generative AI model

[0752] Purpose of trip: Sightseeing

[0753] Departure date: December 1, 2023

[0754] Destination: Tokyo

[0755] Hotel preference: Mid-range, near the station

[0756] Transportation: Shinkansen

[0757] Use this information to generate the best possible travel plan.

[0758] In this way, the system automatically generates a travel plan based on user input information and provides real-time guidance during the trip, greatly improving the user's travel experience.

[0759] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0760] Step 1:

[0761] A user uses a terminal to input travel-related information.

[0762] Input: Travel destination, departure date, accommodation preferences, transportation options, tourist attractions, and other information.

[0763] Data processing and calculation: The user enters this information through the device's UI, and the input is verified to ensure there are no errors.

[0764] Output: A set of verified travel-related information.

[0765] Step 2:

[0766] The terminal transmits the information input by the user to the server.

[0767] Input: A set of travel-related information for the user.

[0768] Data processing and calculation: The device packages the information and sends it to the server using a secure communication protocol (e.g., HTTPS).

[0769] Output: The user's travel-related information passed to the server.

[0770] Step 3:

[0771] The server analyzes the received travel-related information and retrieves relevant information from a database.

[0772] Input: User's travel-related information.

[0773] Data processing and calculation: The server uses Python and the Requests library to obtain information on transportation, accommodation, tourist attractions, and restaurants from multiple APIs. The information is then analyzed and filtered to select the information that meets the user's requirements.

[0774] Output: Parsed and filtered travel information.

[0775] Step 4:

[0776] The server automatically generates the optimal travel plan tailored to the user's wishes.

[0777] Input: Parsed and filtered information required for the trip.

[0778] Data processing and calculation: The server runs the algorithm to generate the optimal travel plan based on the user's requirements. It uses the generative AI model to create suggestions based on the prompt.

[0779] Output: Generated itinerary (e.g., dates, times, modes of transport, accommodation, tourist attractions, and dining details).

[0780] Step 5:

[0781] The generated travel plan is transmitted to the user's terminal and smart glasses.

[0782] Input: The generated itinerary.

[0783] Data processing and calculation: The server formats and transmits the travel plan to the device and smart glasses. Data communication uses a secure protocol.

[0784] Output: The trip plan displayed on the user's device and smart glasses.

[0785] Step 6:

[0786] The terminal and smart glasses display the travel plan to the user.

[0787] Input: Travel itinerary sent from the server.

[0788] Data processing and calculation: The device and smart glasses will visualize the travel plan in a user-friendly format and display specific schedules and suggestions.

[0789] Output: Trip plan details available to the user.

[0790] Step 7:

[0791] Smart glasses provide real-time tourist information and dining information.

[0792] Input: User's current location and real-time data retrieved from the server.

[0793] Data processing and calculation: The smart glasses use GPS functionality and updates from the server to display real-time information based on the user's current location.

[0794] Output: Tourist information and dining information that users can view in real time.

[0795] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0796] The present invention provides a system that allows users to efficiently plan their travel plans, and further aims to provide a more satisfying travel experience by recognizing the user's emotions and adjusting the travel plan based on those emotions. This system inputs and analyzes the user's travel-related information, generates an optimal travel plan, and presents it to the user. It also recognizes the user's emotions in real time and flexibly adjusts the travel plan based on that information.

[0797] System configuration

[0798] This system consists of a user's terminal, a server, a database, and an emotion engine. The user uses the terminal to input travel-related information, which is then sent to the server. The server analyzes the input information, retrieves the necessary information from the database, automatically generates a travel plan, and sends the generated plan to the terminal. The terminal displays the plan to the user and accepts the user's confirmation or correction requests. The emotion engine analyzes the user's emotions from the user's input and reactions, and this emotional information is used to optimize the travel plan.

[0799] User Input

[0800] The user uses the terminal to enter the following travel-related information:

[0801] Purpose of trip (e.g. sightseeing, business, gourmet)

[0802] Departure date (e.g. December 1, 2023)

[0803] Destination (e.g. Tokyo)

[0804] Hotel preferences (e.g. mid-range, near the station)

[0805] Transportation (e.g. bullet train, airplane, bus)

[0806] Data transmission and analysis

[0807] The device sends the user's input data to the server, which analyzes the information. Based on the analyzed information, the server searches and retrieves the necessary information from the transportation database, accommodation database, and tourist spot database.

[0808] Generate a travel plan

[0809] The server generates an optimal travel plan based on the information it has acquired. The plan includes the following information:

[0810] Transportation details (departure date and time, seat information)

[0811] Accommodation booking suggestions (hotel name, address, price, facilities information)

[0812] Daily schedule (visit locations, visit times, transportation methods and times)

[0813] Meal planning (restaurant reservations, menu recommendations)

[0814] Use of emotion engine

[0815] The emotion engine analyzes emotions in real time from the user's input and reactions. This emotional information is sent to the server and used to generate and adjust travel plans. For example, if the user expresses positive emotions such as "fun" or "excited," the plan will be adjusted to increase activity. On the other hand, if the user expresses emotions such as "tired" or "stressed," the plan will be adjusted to include more rest time.

[0816] Providing and coordinating travel plans

[0817] The server sends the generated travel plan to the terminal, which displays it to the user. If the user checks the plan and requests any modifications, the terminal sends the request to the server. The server receives the modification request, readjusts the travel plan taking into account the emotion data from the emotion engine, and sends the new plan to the terminal.

[0818] Specific examples

[0819] For example, here is a concrete example:

[0820] Purpose of trip: Sightseeing

[0821] Departure date: December 1, 2023

[0822] Destination: Tokyo

[0823] Hotel preference: Mid-range, near the station

[0824] Transportation: Shinkansen

[0825] 1. The user enters this information into the terminal and sends it.

[0826] 2. The device forwards the transmitted information to the server.

[0827] 3. The server analyzes the information and retrieves information from the database about appropriate transportation options (e.g., the Shinkansen at 8:00 AM on December 1st), accommodation options (e.g., a mid-range hotel near Shinjuku Station), and tourist attractions (e.g., Sensoji Temple, Skytree, Shibuya, etc.).

[0828] 4. Based on the information obtained, the server generates a specific itinerary, such as:

[0829] Departure date: December 1st, 8:00 AM Shinkansen

[0830] Hotel: Mid-range hotel near Shinjuku Station

[0831] Sightseeing Schedule: Day 1: Sensoji Temple in the morning, Skytree in the afternoon, Shibuya in the evening

[0832] Gourmet: Tempura lunch in Asakusa, Yakiniku dinner in Shibuya

[0833] 5. The server sends the generated itinerary to the terminal, which displays it to the user.

[0834] 6. The user expresses negative emotions such as "tired" or "stressed" about the displayed travel plan.

[0835] 7. The emotion engine analyzes the user's emotions and sends the information to the server.

[0836] 8. The server takes the emotional data into account and readjusts the itinerary, for example adding more breaks and relaxation spots.

[0837] 9. The server sends the re-arranged itinerary to the terminal, which displays it to the user.

[0838] This system allows users to plan their trips efficiently and flexibly in a short time, and enjoy an emotionally sensitive travel experience.

[0839] The processing flow will be explained below.

[0840] Step 1:

[0841] The user uses the terminal to input travel-related information (purpose of travel, departure date, destination, hotel preference, and means of transportation).

[0842] Step 2:

[0843] The device checks the accuracy of the user's input data and ensures that all required fields are filled in.

[0844] Step 3:

[0845] The terminal sends the verified user-entered data to the server.

[0846] Step 4:

[0847] The server receives the user's input data and begins parsing it.

[0848] Step 5:

[0849] Based on the information analyzed by the server, the necessary information is searched from the transportation database, accommodation database, and tourist spot database.

[0850] Step 6:

[0851] The server filters the information obtained from each database and extracts the options that best suit the user's preferences.

[0852] Step 7:

[0853] The server generates an optimal travel plan based on the extracted information, including, for example:

[0854] Transportation: Departure date and time, seat information

[0855] Accommodation: Hotel name, address, rates, and facility information

[0856] Daily schedule: places to visit, visiting times, transportation and time

[0857] Meal planning: restaurant reservations, menu recommendations

[0858] Step 8:

[0859] The server transmits the generated travel plan to the terminal.

[0860] Step 9:

[0861] The device displays the travel plan received from the server to the user, visually showing detailed schedules, maps, reservation information, and more.

[0862] Step 10:

[0863] The user checks the displayed travel plan and, if necessary, inputs emotions or makes a request for correction through the emotion engine.

[0864] Step 11:

[0865] The emotion engine analyzes the user's input and reactions (touch, voice, facial expressions, etc.) to recognize the user's emotions.

[0866] Step 12:

[0867] The terminal sends a modification request including emotion data to the server.

[0868] Step 13:

[0869] The server receives the modification request and emotion data, and performs a database search and analysis again based on the new parameters.

[0870] Step 14:

[0871] The server will adjust the travel plan based on the user's emotions. For example, if the user feels tired, it will set more rest time.

[0872] Step 15:

[0873] The server transmits the regenerated itinerary to the terminal.

[0874] Step 16:

[0875] The terminal displays the regenerated itinerary to the user, who then makes a final confirmation.

[0876] Step 17:

[0877] The user finalizes the travel plan and the terminal transmits the information to the server.

[0878] Step 18:

[0879] The server stores the confirmed itinerary and sends a confirmation message to the terminal.

[0880] All these steps allow users to easily plan and execute travel plans that are emotionally sensitive, efficient, and flexible.

[0881] Example 2

[0882] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0883] Conventional travel planning systems can generate travel plans based on user input, but they have the problem of not being able to flexibly adjust the plan to take the user's emotions into account. This means that the travel plans provided do not adapt to the user's real-time emotions and state, which can lead to a decrease in satisfaction.

[0884] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for a user to input travel-related information, means for transmitting the information to the server, means for analyzing the information and automatically generating a travel itinerary tailored to the user's wishes, means for transmitting the generated travel itinerary to the user's terminal, means for displaying the travel itinerary to the user, means for analyzing the user's emotions from the user's input content and reactions and optimizing the travel itinerary based on the emotion information, and means for re-adjusting the travel itinerary based on the user's emotions. This makes it possible to provide a flexible and optimal travel itinerary that responds to changes in the user's emotions.

[0885] "User" refers to an individual or organization that uses the system to plan a trip.

[0886] A "terminal" is a device through which a user inputs travel-related information and displays the generated travel plan, and includes a smartphone, a personal computer, etc.

[0887] "Server" refers to the central processing unit that receives and analyzes user input information and generates and transmits travel plans.

[0888] A "database" refers to an information aggregation system that stores information on transportation, accommodation, tourist attractions, etc., and is used by the server to obtain the necessary information.

[0889] An "emotion engine" refers to a program or module that analyzes emotions from user input and reactions and provides that emotional information to a server.

[0890] "Program" refers to a set of instructions that executes an algorithm that generates a travel plan based on user input and adjusts the plan based on emotional information.

[0891] "Travel Plan" refers to a travel schedule including details such as transportation, accommodations, dates, places to visit, and meal plans, generated based on travel-related information entered by a user.

[0892] "Emotion Data" refers to information about a user's emotions analyzed by the emotion engine, indicating a negative or positive emotional state.

[0893] "Analysis" refers to the process by which the server understands the travel-related information and sentiment data submitted by the user and converts it into a meaningful format.

[0894] The present invention is a system that allows users to efficiently plan travel plans and flexibly adjust those plans based on emotions. The system consists of the following main components: a user terminal, a server, a database, and an emotion engine.

[0895] Hardware and software used

[0896] User's device: A device such as a smartphone or PC on which the user inputs travel-related information and displays the generated travel plan.

[0897] Server: A cloud server (e.g., AWS, Google Cloud) that receives and analyzes user input information and generates a travel plan.

[0898] Database: A database (e.g. MySQL, PostgreSQL) for storing information on transportation, accommodation, tourist attractions, etc.

[0899] Emotion engine: Software that analyzes user emotions and provides that information to a server (e.g., Emotion API, Microsoft Azure Cognitive Services).

[0900] Program processing overview

[0901] The user enters travel-related information and sends it to the server via their device. The server analyzes the input data and retrieves the necessary information from a database. It then generates an optimal travel plan and sends it to the user's device. Next, the emotion engine analyzes the user's reactions and sends emotional information to the server. Based on this emotional information, the travel plan is readjusted and provided to the user again.

[0902] Specific processing of the program

[0903] 1. User input:

[0904] The user uses the device to input travel-related information, such as "Purpose of trip: sightseeing," "Departure date: December 1, 2023," "Destination: Tokyo," "Hotel preference: mid-range, near the station," and "Transportation method: Shinkansen."

[0905] 2. Data transmission and analysis:

[0906] The device sends the user's input data to the server, which then analyzes the received data and searches for and retrieves the necessary information from a database of transportation, accommodation, and tourist attractions.

[0907] 3. Generate itinerary:

[0908] The server generates an optimal travel plan based on the information obtained. For example, it creates a detailed travel plan like this:

[0909] Departure date: December 1st, 8:00 AM Shinkansen

[0910] Hotel: Mid-range hotel near Shinjuku Station

[0911] Sightseeing Schedule: Day 1: Sensoji Temple in the morning, Skytree in the afternoon, Shibuya in the evening

[0912] Gourmet: Tempura lunch in Asakusa, Yakiniku dinner in Shibuya

[0913] 4. Use of Emotion Engine:

[0914] The emotion engine then analyzes the user's emotion and sends the emotion data to the server. For example, if the user inputs "I'm tired," the emotion engine analyzes this as a negative emotion.

[0915] 5. Reconditioning and re-offering:

[0916] Based on the emotion data, the server adjusts the itinerary again. For example, it considers the emotion of "tired" and adjusts it to increase rest time and add relaxation spots. Then, it sends this adjusted itinerary to the terminal and displays it again to the user.

[0917] Examples of concrete examples and prompts

[0918] Examples of specific travel plans:

[0919] Purpose of trip: Sightseeing

[0920] Departure date: December 1, 2023

[0921] Destination: Tokyo

[0922] Hotel preference: Mid-range, near the station

[0923] Transportation: Shinkansen

[0924] Example prompt sentence:

[0925] "Please plan a trip to Tokyo starting on December 1st. I would like to do some sightseeing and stay somewhere mid-range and close to the station. I will be traveling by Shinkansen."

[0926] In this way, the system enables users to plan their trip efficiently and flexibly and enjoy an emotionally optimized travel experience.

[0927] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0928] Step 1:

[0929] User enters travel-related information

[0930] The user uses the terminal to input the purpose of the trip, departure date, destination, preferred hotel, mode of transportation, etc. The input data is saved in the terminal application.

[0931] Input: purpose of trip, departure date, destination, hotel preference, transportation method

[0932] Specific operation: The user enters information such as "tourism," "December 1, 2023," "Tokyo," "mid-range price range, near the station," and "Shinkansen" into the form on the application and presses the submit button.

[0933] Step 2:

[0934] The device sends the user's input data to the server

[0935] The entered data is sent from the device to the server via the Internet, allowing the server to begin analysis.

[0936] Input: User's travel-related information

[0937] Output: Data sent to the server

[0938] Specific operation: The terminal packages the data in JSON format and sends it to the server's API using the HTTPS protocol.

[0939] Step 3:

[0940] The server analyzes the received data

[0941] The server analyzes the information entered by the user and extracts information by category, dividing data such as the purpose of the trip, departure date, destination, hotel preference, and transportation method into separate fields.

[0942] Input: Travel-related information sent from your device

[0943] Output: Data for each analyzed category

[0944] Specific operation: The server parses the JSON data and breaks it down into data fields such as "Purpose of trip: sightseeing," "Departure date: December 1, 2023," "Destination: Tokyo," "Hotel preference: mid-range, near the station," and "Transportation method: Shinkansen."

[0945] Step 4:

[0946] The server retrieves the necessary information from the database

[0947] Based on the analyzed data, the server retrieves information on transportation, accommodations, tourist spots, etc. from a database, providing the base information needed to generate an optimal travel plan.

[0948] Input: Data for each category analyzed

[0949] Output: Transportation, accommodation, and tourist attraction information

[0950] Specific operation: The server issues an SQL query to the database to obtain accommodations that meet the criteria of "Tokyo," "mid-range price range," and "near the station," as well as information on Shinkansen trains departing at 8:00 AM on December 1st, and tourist spots such as Sensoji Temple, Skytree, and Shibuya.

[0951] Step 5:

[0952] The server generates the optimal travel plan

[0953] The system automatically generates an optimal travel plan by integrating all the information obtained from the database, including transportation, schedule, places to visit, and meal plans.

[0954] Input: Transportation, accommodation, and tourist attraction information

[0955] Output: Generated itinerary

[0956] Specific operation: Based on the program logic, the server creates a detailed travel plan such as "Depart on the Shinkansen at 8:00 AM on December 1st," "Stay at a mid-range hotel near Shinjuku Station," "On the first day, visit Sensoji Temple in the morning, Skytree in the afternoon, and Shibuya in the evening," "Tempura lunch in Asakusa, and yakiniku dinner in Shibuya."

[0957] Step 6:

[0958] The server sends the generated travel plan to the terminal.

[0959] The generated travel plan is sent from the server to the terminal, where the user can check the plan.

[0960] Input: Generated itinerary

[0961] Output: Trip plan sent to the device

[0962] Specific operation: The server packages the travel plan in JSON format and sends it to the device's API using the HTTPS protocol.

[0963] Step 7:

[0964] The device displays the travel plan to the user.

[0965] The transmitted travel plan is displayed on the terminal, and the user can check the plan details, thereby learning the contents of the travel plan.

[0966] Input: Submitted travel plan

[0967] Output: Trip plan displayed on the device

[0968] Specific operation: The device parses the JSON data received and displays it on the screen in the form of "Depart on the Shinkansen at 8:00 AM on December 1st," "Stay at a mid-range hotel near Shinjuku Station," "Day 1: Sensoji Temple in the morning, Skytree in the afternoon, Shibuya in the evening," "Tempura lunch in Asakusa, yakiniku dinner in Shibuya," etc.

[0969] Step 8:

[0970] Emotion engine analyzes user reactions

[0971] When a user inputs their thoughts or opinions about the displayed travel plan, the emotion engine analyzes them to generate emotion data, such as emotions like "tired" or "fun."

[0972] Input: User reactions and thoughts

[0973] Output: Parsed emotion data

[0974] Specific behavior: The user types "tired," and the emotion engine analyzes the text to generate negative emotion data.

[0975] Step 9:

[0976] The emotion engine sends the emotion data to the server.

[0977] The generated emotion data is sent from the emotion engine to a server, which uses the information to adjust the travel plan.

[0978] Input: Parsed emotion data

[0979] Output: Emotion data sent to the server

[0980] Specific operation: The emotion engine packages emotion data in JSON format and sends it to the server's API using the HTTPS protocol.

[0981] Step 10:

[0982] The server readjusts the travel plan based on the emotion data.

[0983] The server then adjusts the travel plan based on the emotion data received, for example by increasing rest periods and adding relaxation spots.

[0984] Input: emotion data, original travel plan

[0985] Output: Reworked itinerary

[0986] Specific operation: Based on the emotional data that the server is "tired," it makes adjustments such as increasing break time and adding a "break at a cafe."

[0987] Step 11:

[0988] The server sends the re-arranged travel plan to the device.

[0989] The server sends the re-arranged travel plan to the terminal, allowing the user to review the plan again.

[0990] Input: Re-arranged travel plans

[0991] Output: The adjusted itinerary sent to the device.

[0992] Specific operation: The server packages the re-arranged itinerary in JSON format and sends it to the device's API using the HTTPS protocol.

[0993] Step 12:

[0994] The device displays the re-arranged itinerary to the user.

[0995] The re-adjusted travel plan is displayed on the terminal, and the user confirms the plan again. This provides the user with a travel plan that takes emotions into consideration.

[0996] Input: Submitted rearranged travel plan

[0997] Output: The adjusted itinerary displayed on the device

[0998] Specific behavior: The device parses the received JSON data and displays the re-adjusted plan on the screen.

[0999] In this way, users can efficiently plan their trips and enjoy trip plans that are flexibly adjusted based on real-time emotions.

[1000] (Application example 2)

[1001] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1002] Conventional travel planning systems automatically generate travel plans without considering the user's emotions, which means they are unable to adapt to the user's real-time emotional changes. Furthermore, they are unable to adjust the plan to reflect negative emotions such as stress and fatigue that users experience during the trip, which makes it difficult to fully increase travel satisfaction. This often leaves users dissatisfied with their travel plans.

[1003] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1004] In this invention, the server includes means for inputting user travel-related information, means for transmitting the information to the server, means for analyzing the information and automatically generating a travel plan tailored to the user's preferences, means for transmitting the generated travel plan to the user's terminal, means for displaying the travel plan to the user, means for recognizing the user's emotions in real time, and means for adjusting the travel plan based on the recognized emotions. This makes it possible to flexibly adjust the travel plan according to the user's emotions, thereby increasing the user's travel satisfaction.

[1005] "User's travel-related information" refers to data that the user inputs to plan a trip, such as the purpose of the trip, departure date, destination, preferred accommodation, and means of transportation.

[1006] A "server" is a computer system that analyzes travel-related information submitted by users and generates and adjusts optimal travel plans.

[1007] "Means for automatic generation" refers to the function by which the server autonomously creates an optimal travel plan based on the data input by the user.

[1008] "User's terminal" refers to a device (e.g., smartphone, tablet, or PC) on which a user inputs travel-related information and displays and confirms the generated travel plan.

[1009] "Means for recognizing emotions in real time" refers to technologies (e.g., cameras, sensors, emotion analysis software) that monitor a user's facial expressions and behavior and analyze their current emotional state.

[1010] The "means for adjusting travel plans" is a function that flexibly changes and optimizes existing travel plans based on user sentiment information obtained in real time.

[1011] The present invention relates to a system that enables users to efficiently plan trips and adjust the plans while taking real-time emotions into account. The system for realizing the present invention is composed of a user terminal, a server, a database, and an emotion engine.

[1012] System configuration

[1013] Users input travel-related information using devices such as smartphones or tablets. The input information is sent from the device to a server. The server analyzes the information entered by the user, obtains necessary information (transportation, accommodations, tourist spots, etc.) from a database, and automatically generates an optimal travel plan. The generated travel plan is sent from the server to the device and displayed to the user.

[1014] Furthermore, the system of the present invention includes an emotion engine that recognizes emotions in real time from user inputs and reactions. This emotion information is sent to the server and used to generate and adjust travel plans.

[1015] System Operation

[1016] The emotion engine uses cameras and sensors installed in smart glasses or head-mounted displays (HMDs) to monitor the user's facial expressions and behavior and analyze their current emotional state. The server then adjusts the travel plan accordingly based on the analyzed emotional data. This adjustment can include adding breaks or relaxing areas.

[1017] Usage example

[1018] For example, a user enters the following travel-related information:

[1019] Purpose of trip: Sightseeing

[1020] Departure date: December 1, 2023

[1021] Destination: Tokyo

[1022] Hotel preference: Mid-range, near the station

[1023] Transportation: Shinkansen

[1024] When the user inputs this information into the device and sends it, the device transfers it to the server, which analyzes the information, retrieves information on appropriate transportation, accommodations, and tourist spots from a database, and generates an optimal travel plan.

[1025] The generated itinerary includes the following specific details:

[1026] Departure date: December 1st, 8:00 AM Shinkansen

[1027] Hotel: Mid-range hotel near Shinjuku Station

[1028] Sightseeing Schedule: Day 1: Sensoji Temple in the morning, Skytree in the afternoon, Shibuya in the evening

[1029] Gourmet: Tempura lunch in Asakusa, Yakiniku dinner in Shibuya

[1030] The generated itinerary is sent to the device, where the user can view it. If the user expresses a negative emotion such as "tired" about the displayed itinerary, the emotion engine analyzes the emotion and sends it to the server. The server takes the emotion data into account and readjusts the itinerary, for example, by increasing rest time or adding relaxation spots.

[1031] As an example of a specific prompt, if the user wants to change the location they are visiting, they would enter:

[1032] "Change request: Please suggest other tourist spots in Tokyo instead of Sensoji Temple."

[1033] If you want to add a place where users can relax, type:

[1034] "Sentiment analysis results: 'I'm tired'. Please add a place where you can relax to your visit."

[1035] In this way, users can flexibly plan their travel plans according to their real-time emotions, thereby increasing the satisfaction of their travel experience.

[1036] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1037] Step 1:

[1038] The user inputs travel-related information using a device such as a smartphone or tablet. This information includes the purpose of the trip, departure date, destination, preferred hotel, mode of transportation, etc. This information is then sent from the device to the server.

[1039] Step 2:

[1040] The server receives the travel-related information sent from the device and analyzes the data. During the analysis, the server searches and retrieves the necessary information from a database (transportation, accommodation, tourist spots) based on the user's preferences.

[1041] Step 3:

[1042] The server automatically generates an optimal travel plan based on the acquired information, including specific details of transportation, accommodation, daily schedule, meal plan, etc. The travel plan is then sent from the server to the device.

[1043] Step 4:

[1044] The terminal receives the itinerary sent from the server and displays it to the user, who then checks the displayed itinerary and inputs any necessary revision requests, which are also sent from the terminal to the server.

[1045] Step 5:

[1046] Cameras and sensors installed in the user's smart glasses or head-mounted display (HMD) monitor the user's facial expressions and behavior to obtain real-time emotional data, which is then transmitted to a server via the device.

[1047] Step 6:

[1048] The emotion engine analyzes the user's emotional data. Specifically, it reads the user's emotions from their facial expressions and voice and determines whether they are positive (e.g., happy, excited) or negative (e.g., tired, stressed). The analysis results are sent to the server.

[1049] Step 7:

[1050] The server adjusts the itinerary based on the emotional data analyzed by the emotion engine and the user's requests for modifications. For example, if there is a lot of negative emotional data, the server may increase rest time or add relaxation spots.

[1051] Step 8:

[1052] The server sends the new adjusted travel plan to the terminal, which displays it to the user, who confirms the re-adjusted plan and continues traveling.

[1053] Through these steps, users can achieve a more satisfying travel experience. The system can adjust travel plans in real time according to users' emotions.

[1054] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1055] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1056] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1057] [Third embodiment]

[1058] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1059] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1060] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1061] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1062] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1063] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1064] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1065] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1066] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1067] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1068] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1069] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1070] The present invention provides a system that allows users to easily create travel plans. This system allows users to input travel-related information, automatically generates an optimal travel plan based on that information, and provides it to the user, thereby significantly reducing the effort required for planning.

[1071] System configuration

[1072] This system consists of a user's terminal, a server, and a database. The user uses the terminal to input travel-related information, which is then sent to the server. The server analyzes the information, retrieves the necessary information from the database, automatically generates a travel plan, and sends the generated plan to the terminal. The terminal then displays the plan to the user and accepts confirmation or correction requests from the user.

[1073] User Input

[1074] The user uses the terminal to enter the following travel-related information:

[1075] Purpose of trip (e.g. sightseeing, business, gourmet)

[1076] Departure date (e.g. December 1, 2023)

[1077] Destination (e.g. Tokyo)

[1078] Hotel preferences (e.g. mid-range, near the station)

[1079] Transportation (e.g. bullet train, airplane, bus)

[1080] Data transmission

[1081] The terminal checks the information entered by the user, and after confirming that there are no errors, sends it to the server.

[1082] Database searching and analysis

[1083] Based on the information received, the server retrieves the following information from the database:

[1084] Transportation database (airline, train, and bus schedules and fares)

[1085] Accommodation database (listings and details of hotels, resorts, and guesthouses)

[1086] Tourist spot database (information on tourist spots, restaurants, and activities)

[1087] The server then uses this information to generate a travel plan that best suits the user's needs. Specifically, it combines the following information:

[1088] Determine the best mode of transportation based on departure date and destination.

[1089] Select the appropriate accommodation based on your hotel preferences (price range, location).

[1090] Depending on the purpose of the trip, it selects tourist spots and activities to visit and calculates the order in which to visit them and travel time.

[1091] Generate a travel plan

[1092] The server creates a specific itinerary tailored to the user's needs, including information such as:

[1093] Transportation details (e.g., what time and which Shinkansen to take)

[1094] Accommodation booking suggestions (e.g. mid-range hotel near Shinjuku Station)

[1095] Daily schedule (e.g., Sensoji Temple in the morning on the first day, Skytree in the afternoon, Shibuya in the evening, etc.)

[1096] Dining suggestions (e.g., tempura lunch in Asakusa, yakiniku dinner in Shibuya)

[1097] Provision to users

[1098] The server sends the generated itinerary to the terminal, which displays it to the user, who can review the itinerary and request modifications if necessary.

[1099] Processing correction requests

[1100] If the user requests an amendment to the plan, the device sends the request to the server, which again analyzes and retrieves the information to adjust the travel plan.

[1101] Specific examples

[1102] For example:

[1103] Purpose of trip: Sightseeing

[1104] Departure date: December 1, 2023

[1105] Destination: Tokyo

[1106] Hotel preference: Mid-range, near the station

[1107] Transportation: Shinkansen

[1108] 1. The user enters this information into the terminal and sends it.

[1109] 2. The device forwards the transmitted information to the server.

[1110] 3. The server analyzes the information and retrieves information from the database about appropriate transportation options (e.g., the Shinkansen at 8:00 AM on December 1st), accommodation options (e.g., a mid-range hotel near Shinjuku Station), and tourist attractions (e.g., Sensoji Temple, Skytree, Shibuya, etc.).

[1111] 4. Based on the information obtained, the server generates a specific itinerary, such as:

[1112] Departure date: December 1st, 8:00 AM Shinkansen

[1113] Hotel: Mid-range hotel near Shinjuku Station

[1114] Sightseeing Schedule: Day 1: Sensoji Temple in the morning, Skytree in the afternoon, Shibuya in the evening

[1115] Gourmet: Tempura lunch in Asakusa, Yakiniku dinner in Shibuya

[1116] 5. The server sends the generated itinerary to the terminal, which displays it to the user.

[1117] 6. The user reviews the plan and submits a request for revisions if necessary.

[1118] This system allows users to create efficient travel plans in a short amount of time, greatly simplifying travel preparations, thereby reducing the time and effort required for travel planning and providing a fulfilling travel experience.

[1119] The processing flow will be explained below.

[1120] Step 1:

[1121] The user uses a device (smartphone or PC) to input travel-related information (purpose of trip, departure date, destination, hotel preferences, and means of transportation).

[1122] Step 2:

[1123] The device checks the accuracy of the user's input data and ensures that all required fields are filled in.

[1124] Step 3:

[1125] The terminal sends the verified user-entered data to the server.

[1126] Step 4:

[1127] The server receives the user's input data and parses the input.

[1128] Step 5:

[1129] Based on the information analyzed by the server, the necessary information is searched from the transportation database, accommodation database, and tourist spot database.

[1130] Step 6:

[1131] The server filters the information obtained from each database and extracts the options that best suit the user's preferences.

[1132] Step 7:

[1133] The server generates an optimal travel plan based on the extracted information, including, for example:

[1134] Transportation: Departure date and time, seat information

[1135] Accommodation: Hotel name, address, rates, and facility information

[1136] Tourist schedule: places to visit, visiting times, means of transport and times

[1137] Meal planning: restaurant reservations, menu recommendations

[1138] Step 8:

[1139] The server transmits the generated travel plan to the terminal.

[1140] Step 9:

[1141] The device displays the travel plan received from the server to the user, visually showing detailed schedules, maps, reservation information, and more.

[1142] Step 10:

[1143] The user reviews the displayed itinerary and requests modifications if necessary.

[1144] Step 11:

[1145] The terminal sends the user's modification request to the server.

[1146] Step 12:

[1147] The server receives the modification request, searches and analyzes the database again based on the new parameters, and generates a new itinerary.

[1148] Step 13:

[1149] The server transmits the regenerated itinerary to the terminal.

[1150] Step 14:

[1151] The terminal displays the regenerated itinerary to the user, who then makes a final confirmation.

[1152] Step 15:

[1153] The user finalizes the travel plan and the terminal transmits the information to the server.

[1154] Step 16:

[1155] The server stores the confirmed itinerary and sends a confirmation message to the terminal.

[1156] All these steps allow users to easily plan and execute efficient and complete travel plans.

[1157] Example 1

[1158] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1159] Conventional travel planning systems require users to manually collect and organize large amounts of information, resulting in the time-consuming and labor-intensive process of planning. Furthermore, it is difficult to automatically generate a travel plan that perfectly matches the user's preferences, and it is also difficult to efficiently reflect revision requests. For these reasons, many users are dissatisfied with the process of creating a travel plan.

[1160] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1161] In this invention, the server includes means for a user to input travel-related information, means for transmitting the information to the server, means for analyzing the information and automatically generating a specific itinerary based on the user's preferences using a generative AI model, means for transmitting the generated itinerary to the user's terminal, means for displaying the itinerary to the user, means for receiving user revision requests and re-adjusting the itinerary, and means for acquiring information from databases of transportation, accommodations, and tourist spots and generating an optimal plan based on the user's preferences. This allows users to efficiently create an itinerary that suits their preferences in a short amount of time, and can also quickly respond to revision requests, greatly simplifying the process of planning an itinerary.

[1162] "User" means an individual or organization that uses the system to plan a trip.

[1163] "Travel-related information" refers to information necessary for planning a trip, such as the purpose of the trip, departure date, destination, preferred accommodation, and transportation.

[1164] A "terminal" is an electronic device, such as a computer, smartphone, or tablet, that a user uses to enter travel-related information and communicate with the system.

[1165] A "server" is a computer system that receives travel-related information sent by a user, analyzes it, and sends an automatically generated travel plan to the user's terminal.

[1166] "Analysis" is the process by which the server references information in the database and generates a travel plan based on the travel-related information received from the user.

[1167] A "generative AI model" is an artificial intelligence model used to automatically generate optimal travel plans based on a user's preferences.

[1168] A "travel plan" is a specific schedule that includes suggestions for transportation, accommodation, sightseeing spots, meals, etc., created based on the user's preferences.

[1169] A "modification request" is a request that a user submits to the system for changes or adjustments to a provided travel plan.

[1170] A "transportation database" is a database that stores information on schedules and fares for transportation such as airplanes, bullet trains, and buses.

[1171] The "accommodation database" is a database that stores detailed information about accommodation facilities such as hotels, resorts, and guesthouses.

[1172] The "tourist spot database" is a database that stores information about sightseeing spots, restaurants, activities, and other tourist-related information.

[1173] The present invention provides a system that allows users to easily plan their travel plans. In this system, the user inputs travel-related information using a terminal, and the information is sent to a server. The server then analyzes the information and uses a generative AI model to automatically generate an optimal travel plan based on the user's preferences, and sends the generated plan to the terminal. Finally, the user can review the plan and submit revision requests as necessary. Details of the system configuration and operation are as follows.

[1174] Hardware and software used

[1175] Server: A central processing unit used for information analysis and database searches, in this case using a specific cloud server service (e.g., AWS, Google Cloud Platform).

[1176] Device: An electronic device used by a user to provide input information and display the generated itinerary, such as a personal computer, smartphone, or tablet.

[1177] Database: Various data (transportation, accommodation, tourist spots) is stored in this database. This database uses a database management system such as MySQL or PostgreSQL.

[1178] Generative AI model: An artificial intelligence model used to automatically generate travel plans based on user preferences, such as GPT-3.

[1179] User Input

[1180] The user uses the terminal to enter the following travel-related information:

[1181] Purpose of trip (e.g. sightseeing, business, gourmet)

[1182] Departure date (e.g. December 1, 2023)

[1183] Destination (e.g. Tokyo)

[1184] Hotel preferences (e.g. mid-range, near the station)

[1185] Transportation (e.g. bullet train, airplane, bus)

[1186] As a specific example, the user launches a web browser or a dedicated application, enters the above information into the input fields, and clicks the "Submit" button.

[1187] Data transmission

[1188] The device checks the information entered by the user, checks that there are no errors, and then sends the information to the server. Specifically, the input information is sent to the server as a POST request using the API (e.g., https: / / api.travelplanner.com / submit).

[1189] Database searching and analysis

[1190] The server retrieves the necessary information from the database based on the received information, queries the transportation database, accommodation database, and tourist spot database, and inputs the returned results into the generative AI model for analysis.

[1191] Generate a travel plan

[1192] The server generates a specific itinerary based on the data returned by the generative AI model. The itinerary is organized in JSON format and includes necessary information such as transportation details, accommodation suggestions, daily schedules, and meal suggestions.

[1193] Provision to users

[1194] The server sends the generated travel plan to the terminal, which then displays it to the user. Specifically, the server returns the generated plan to the terminal via API, and the plan is displayed in HTML format on the terminal (e.g., schedule display using table tags).

[1195] Processing correction requests

[1196] The user checks the provided travel plan and submits a request for revisions if necessary. The user enters the parts they want to revise and clicks the "Request revisions" button. The device then sends the information back to the server, which then generates a new plan and sends it back.

[1197] Prompt Sentence Examples

[1198] "Purpose of trip: Sightseeing. Departure date: December 1, 2023. Destination: Tokyo. Hotel preference: Mid-range, near the station. Transportation method: Shinkansen. Please suggest the best travel plan based on this."

[1199] This system allows users to create travel plans that are tailored to their needs in a short amount of time and efficiently. It also responds quickly to requests for revisions, greatly simplifying the process of creating travel plans.

[1200] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1201] Step 1:

[1202] The user enters travel-related information into the device. Specifically, the user opens a web browser or dedicated application and enters the necessary information into the input fields, such as the purpose of the trip, departure date, destination, hotel preferences, and transportation method. After the user has finished entering the information, they click the "Submit" button.

[1203] Input: purpose of trip, departure date, destination, hotel preference, mode of transportation.

[1204] Output: User's travel-related information entered into the terminal.

[1205] Step 2:

[1206] The device checks the information entered by the user to see if there are any errors. If there are any errors, the device displays an error message to the user. If the input is correct, the device sends the information to the server. Specifically, the device uses the API (e.g., https: / / api.travelplanner.com / submit) to send the information to the server as a POST request.

[1207] Input: Travel-related information entered by the user.

[1208] Output: User's travel related information sent to the server.

[1209] Step 3:

[1210] Based on the information received, the server retrieves the necessary information from the database. The server queries the transportation database, accommodation database, and tourist attraction database to collect relevant information. Specifically, the server uses SQL queries to retrieve the necessary data from each database.

[1211] Input: The user's travel-related information sent to the server.

[1212] Output: Transport, accommodation and tourist attraction information retrieved from the database.

[1213] Step 4:

[1214] The server analyzes the acquired data and inputs it into a generative AI model (e.g., GPT-3). The generative AI model automatically generates an optimal travel plan that matches the user's preferences based on this data. Specifically, the AI ​​model generates suggested transportation, accommodation, tourist spots, and schedule information.

[1215] Input: Transportation, accommodation and tourist attraction information retrieved from database.

[1216] Output: A concrete trip plan generated by the generative AI model.

[1217] Step 5:

[1218] The server sends the generated itinerary to the device. Specifically, it organizes the generated itinerary in JSON format and sends it to the device via API. The device receives this information and displays it in a format that is easy for the user to view. For example, it displays the itinerary using HTML and CSS.

[1219] Input: A concrete travel itinerary generated by a generative AI model.

[1220] Output: Trip plan displayed on the terminal.

[1221] Step 6:

[1222] The user checks the provided travel plan and submits an amendment request if necessary. Specifically, the user enters the amendment details into the amendment form in the browser or app and clicks the "Request amendment" button.

[1223] Input: A user's request to modify a travel plan.

[1224] Output: The modification request sent from the device to the server.

[1225] Step 7:

[1226] The server receives the request, analyzes the information again, and adjusts the travel plan. The server then requests the AI ​​model to generate a new plan that reflects the changes, and sends the regenerated plan to the device.

[1227] Input: The modification request sent from the terminal.

[1228] Output: The regenerated itinerary.

[1229] In this way, a specific and optimal travel plan based on the user's wishes can be quickly generated, and revision requests from the user can be flexibly accommodated.

[1230] (Application example 1)

[1231] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1232] Conventional travel planning systems allow users to plan their trip beforehand, but lack real-time guidance and information during the trip. Furthermore, it is difficult to change plans mid-trip or update local information in a timely manner, which can cause inconvenience during the trip. This has led to the problem of trip plans not being utilized efficiently and effectively.

[1233] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1234] In this invention, the server includes means for a user to input travel-related information, means for transmitting the information to the server, means for analyzing the information and automatically generating a travel plan tailored to the user's preferences, means for transmitting the generated travel plan to the user's terminal, means for displaying the travel plan to the user, means for providing the user with real-time guidance during the trip, means for displaying the generated travel plan on the user's smart glasses, and means for presenting information on tourist spots and restaurants in real time. This allows the user to receive real-time guidance during the trip, enabling them to smoothly navigate their travel destinations.

[1235] "User" refers to an individual who uses the system to plan a trip and receive real-time guidance during the trip.

[1236] "Travel-related information" refers to information necessary for planning a trip, such as travel destination, departure date, preferred accommodation, transportation, and tourist attractions.

[1237] "Server" refers to a computer system that receives and analyzes travel-related information sent by users, retrieves information from a database, and automatically generates an optimal travel plan.

[1238] A "terminal" is a device that allows a user to input travel-related information, confirm and transmit that information, and display the generated travel plan, and includes a smartphone, tablet, etc.

[1239] "Travel Plan" means a plan that includes specific travel itineraries, transportation, accommodations, sightseeing spots, and dining suggestions that is automatically generated based on information entered by a User.

[1240] "Means for automatic generation" refers to the algorithms and programs that allow the server to analyze the information entered by the user, retrieve the most appropriate information from the database, and automatically create a travel plan.

[1241] "Smart glasses" refer to a wearable device that can be worn by a user and display information in real time in their field of vision.

[1242] "Real-time guidance" refers to the latest information on tourist attractions, dining options, and transportation provided to users based on their current location and current conditions while traveling.

[1243] "Tourist attractions" refer to destinations and places of interest visited by tourists, including museums, parks, historical buildings, and entertainment venues.

[1244] "Dining facilities" are places where users can visit and eat meals during their trip, and include restaurants, cafes, dining halls, etc.

[1245] This invention provides a system that allows users to easily plan their travel plans. The system, which allows users to input travel-related information, automatically generates an optimal travel plan based on the information, and provides it to the user, is composed of a user terminal, a server, and a database. The system also provides real-time guidance during the trip and allows users to access the travel plan through smart glasses.

[1246] System configuration

[1247] The system consists of the following components:

[1248] 1. User's device: A device such as a smartphone or tablet that allows the user to enter, confirm and submit travel-related information and view the generated travel plan.

[1249] 2. Server: A computer system that receives and analyzes travel-related information sent by users, retrieves information from a database, and generates optimal travel plans. In particular, it runs a program using Python and the Requests library.

[1250] 3. Database: A database that stores information on transportation, accommodation, tourist attractions, and dining facilities.

[1251] 4. Smart glasses: These are wearable devices that users can wear and view, and are used to display travel plans and real-time directions.

[1252] Explanation of program processing

[1253] User inputs travel information: The user inputs information such as travel destination, departure date, preferred accommodation, transportation method, and tourist spots they want to visit into the terminal.

[1254] Sending information: The terminal checks the entered information and, after confirming that there are no errors, sends it to the server.

[1255] Analysis and plan generation on the server: The server analyzes the received information and retrieves the relevant information from the database. Using Python and the Requests library, it retrieves the information from the API and automatically generates the optimal travel plan.

[1256] Displaying the itinerary: The generated itinerary is sent from the server to the terminal and displayed to the user. The itinerary is also sent to the smart glasses.

[1257] Real-time guidance: Through smart glasses, users can receive real-time tourist information and dining facility information.

[1258] Specific examples

[1259] For example, a user enters the following travel information:

[1260] Purpose of trip: Sightseeing

[1261] Departure date: December 1, 2023

[1262] Destination: Tokyo

[1263] Hotel preference: Mid-range, near the station

[1264] Transportation: Shinkansen

[1265] The itinerary generated by the server will look something like this:

[1266] Day 1: Take the Shinkansen to Tokyo at 8am. Stay at a mid-range hotel near Shinjuku Station. Visit Sensoji Temple in the morning, Skytree in the afternoon, and Shibuya in the evening. Have tempura for lunch in Asakusa and yakiniku for dinner in Shibuya.

[1267] Example of input prompt for generative AI model

[1268] Purpose of trip: Sightseeing

[1269] Departure date: December 1, 2023

[1270] Destination: Tokyo

[1271] Hotel preference: Mid-range, near the station

[1272] Transportation: Shinkansen

[1273] Use this information to generate the best possible travel plan.

[1274] In this way, the system automatically generates a travel plan based on user input information and provides real-time guidance during the trip, greatly improving the user's travel experience.

[1275] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1276] Step 1:

[1277] A user uses a terminal to input travel-related information.

[1278] Input: Travel destination, departure date, accommodation preferences, transportation options, tourist attractions, and other information.

[1279] Data processing and calculation: The user enters this information through the device's UI, and the input is verified to ensure there are no errors.

[1280] Output: A set of verified travel-related information.

[1281] Step 2:

[1282] The terminal transmits the information input by the user to the server.

[1283] Input: A set of travel-related information for the user.

[1284] Data processing and calculation: The device packages the information and sends it to the server using a secure communication protocol (e.g., HTTPS).

[1285] Output: The user's travel-related information passed to the server.

[1286] Step 3:

[1287] The server analyzes the received travel-related information and retrieves relevant information from a database.

[1288] Input: User's travel-related information.

[1289] Data processing and calculation: The server uses Python and the Requests library to obtain information on transportation, accommodation, tourist attractions, and restaurants from multiple APIs. The information is then analyzed and filtered to select the information that meets the user's requirements.

[1290] Output: Parsed and filtered travel information.

[1291] Step 4:

[1292] The server automatically generates the optimal travel plan tailored to the user's wishes.

[1293] Input: Parsed and filtered information required for the trip.

[1294] Data processing and calculation: The server runs the algorithm to generate the optimal travel plan based on the user's requirements. It uses the generative AI model to create suggestions based on the prompt.

[1295] Output: Generated itinerary (e.g., dates, times, modes of transport, accommodation, tourist attractions, and dining details).

[1296] Step 5:

[1297] The generated travel plan is transmitted to the user's terminal and smart glasses.

[1298] Input: The generated itinerary.

[1299] Data processing and calculation: The server formats and transmits the travel plan to the device and smart glasses. Data communication uses a secure protocol.

[1300] Output: The trip plan displayed on the user's device and smart glasses.

[1301] Step 6:

[1302] The terminal and smart glasses display the travel plan to the user.

[1303] Input: Travel itinerary sent from the server.

[1304] Data processing and calculation: The device and smart glasses will visualize the travel plan in a user-friendly format and display specific schedules and suggestions.

[1305] Output: Trip plan details available to the user.

[1306] Step 7:

[1307] Smart glasses provide real-time tourist information and dining information.

[1308] Input: User's current location and real-time data retrieved from the server.

[1309] Data processing and calculation: The smart glasses use GPS functionality and updates from the server to display real-time information based on the user's current location.

[1310] Output: Tourist information and dining information that users can view in real time.

[1311] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1312] The present invention provides a system that allows users to efficiently plan their travel plans, and further aims to provide a more satisfying travel experience by recognizing the user's emotions and adjusting the travel plan based on those emotions. This system inputs and analyzes the user's travel-related information, generates an optimal travel plan, and presents it to the user. It also recognizes the user's emotions in real time and flexibly adjusts the travel plan based on that information.

[1313] System configuration

[1314] This system consists of a user's terminal, a server, a database, and an emotion engine. The user uses the terminal to input travel-related information, which is then sent to the server. The server analyzes the input information, retrieves the necessary information from the database, automatically generates a travel plan, and sends the generated plan to the terminal. The terminal displays the plan to the user and accepts the user's confirmation or correction requests. The emotion engine analyzes the user's emotions from the user's input and reactions, and this emotional information is used to optimize the travel plan.

[1315] User Input

[1316] The user uses the terminal to enter the following travel-related information:

[1317] Purpose of trip (e.g. sightseeing, business, gourmet)

[1318] Departure date (e.g. December 1, 2023)

[1319] Destination (e.g. Tokyo)

[1320] Hotel preferences (e.g. mid-range, near the station)

[1321] Transportation (e.g. bullet train, airplane, bus)

[1322] Data transmission and analysis

[1323] The device sends the user's input data to the server, which analyzes the information. Based on the analyzed information, the server searches and retrieves the necessary information from the transportation database, accommodation database, and tourist spot database.

[1324] Generate a travel plan

[1325] The server generates an optimal travel plan based on the information it has acquired. The plan includes the following information:

[1326] Transportation details (departure date and time, seat information)

[1327] Accommodation booking suggestions (hotel name, address, price, facilities information)

[1328] Daily schedule (visit locations, visit times, transportation methods and times)

[1329] Meal planning (restaurant reservations, menu recommendations)

[1330] Use of emotion engine

[1331] The emotion engine analyzes emotions in real time from the user's input and reactions. This emotional information is sent to the server and used to generate and adjust travel plans. For example, if the user expresses positive emotions such as "fun" or "excited," the plan will be adjusted to increase activity. On the other hand, if the user expresses emotions such as "tired" or "stressed," the plan will be adjusted to include more rest time.

[1332] Providing and coordinating travel plans

[1333] The server sends the generated travel plan to the terminal, which displays it to the user. If the user checks the plan and requests any modifications, the terminal sends the request to the server. The server receives the modification request, readjusts the travel plan taking into account the emotion data from the emotion engine, and sends the new plan to the terminal.

[1334] Specific examples

[1335] For example, here is a concrete example:

[1336] Purpose of trip: Sightseeing

[1337] Departure date: December 1, 2023

[1338] Destination: Tokyo

[1339] Hotel preference: Mid-range, near the station

[1340] Transportation: Shinkansen

[1341] 1. The user enters this information into the terminal and sends it.

[1342] 2. The device forwards the transmitted information to the server.

[1343] 3. The server analyzes the information and retrieves information from the database about appropriate transportation options (e.g., the Shinkansen at 8:00 AM on December 1st), accommodation options (e.g., a mid-range hotel near Shinjuku Station), and tourist attractions (e.g., Sensoji Temple, Skytree, Shibuya, etc.).

[1344] 4. Based on the information obtained, the server generates a specific itinerary, such as:

[1345] Departure date: December 1st, 8:00 AM Shinkansen

[1346] Hotel: Mid-range hotel near Shinjuku Station

[1347] Sightseeing Schedule: Day 1: Sensoji Temple in the morning, Skytree in the afternoon, Shibuya in the evening

[1348] Gourmet: Tempura lunch in Asakusa, Yakiniku dinner in Shibuya

[1349] 5. The server sends the generated itinerary to the terminal, which displays it to the user.

[1350] 6. The user expresses negative emotions such as "tired" or "stressed" about the displayed travel plan.

[1351] 7. The emotion engine analyzes the user's emotions and sends the information to the server.

[1352] 8. The server takes the emotional data into account and readjusts the itinerary, for example adding more breaks and relaxation spots.

[1353] 9. The server sends the re-arranged itinerary to the terminal, which displays it to the user.

[1354] This system allows users to plan their trips efficiently and flexibly in a short time, and enjoy an emotionally sensitive travel experience.

[1355] The processing flow will be explained below.

[1356] Step 1:

[1357] The user uses the terminal to input travel-related information (purpose of travel, departure date, destination, hotel preference, and means of transportation).

[1358] Step 2:

[1359] The device checks the accuracy of the user's input data and ensures that all required fields are filled in.

[1360] Step 3:

[1361] The terminal sends the verified user-entered data to the server.

[1362] Step 4:

[1363] The server receives the user's input data and begins parsing it.

[1364] Step 5:

[1365] Based on the information analyzed by the server, the necessary information is searched from the transportation database, accommodation database, and tourist spot database.

[1366] Step 6:

[1367] The server filters the information obtained from each database and extracts the options that best suit the user's preferences.

[1368] Step 7:

[1369] The server generates an optimal travel plan based on the extracted information, including, for example:

[1370] Transportation: Departure date and time, seat information

[1371] Accommodation: Hotel name, address, rates, and facility information

[1372] Daily schedule: places to visit, visiting times, transportation and time

[1373] Meal planning: restaurant reservations, menu recommendations

[1374] Step 8:

[1375] The server transmits the generated travel plan to the terminal.

[1376] Step 9:

[1377] The device displays the travel plan received from the server to the user, visually showing detailed schedules, maps, reservation information, and more.

[1378] Step 10:

[1379] The user checks the displayed travel plan and, if necessary, inputs emotions or makes a request for correction through the emotion engine.

[1380] Step 11:

[1381] The emotion engine analyzes the user's input and reactions (touch, voice, facial expressions, etc.) to recognize the user's emotions.

[1382] Step 12:

[1383] The terminal sends a modification request including emotion data to the server.

[1384] Step 13:

[1385] The server receives the modification request and emotion data, and performs a database search and analysis again based on the new parameters.

[1386] Step 14:

[1387] The server will adjust the travel plan based on the user's emotions. For example, if the user feels tired, it will set more rest time.

[1388] Step 15:

[1389] The server transmits the regenerated itinerary to the terminal.

[1390] Step 16:

[1391] The terminal displays the regenerated itinerary to the user, who then makes a final confirmation.

[1392] Step 17:

[1393] The user finalizes the travel plan and the terminal transmits the information to the server.

[1394] Step 18:

[1395] The server stores the confirmed itinerary and sends a confirmation message to the terminal.

[1396] All these steps allow users to easily plan and execute travel plans that are emotionally sensitive, efficient, and flexible.

[1397] Example 2

[1398] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1399] Conventional travel planning systems can generate travel plans based on user input, but they have the problem of not being able to flexibly adjust the plan to take the user's emotions into account. This means that the travel plans provided do not adapt to the user's real-time emotions and state, which can lead to a decrease in satisfaction.

[1400] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for a user to input travel-related information, means for transmitting the information to the server, means for analyzing the information and automatically generating a travel itinerary tailored to the user's wishes, means for transmitting the generated travel itinerary to the user's terminal, means for displaying the travel itinerary to the user, means for analyzing the user's emotions from the user's input content and reactions and optimizing the travel itinerary based on the emotion information, and means for re-adjusting the travel itinerary based on the user's emotions. This makes it possible to provide a flexible and optimal travel itinerary that responds to changes in the user's emotions.

[1401] "User" refers to an individual or organization that uses the system to plan a trip.

[1402] A "terminal" is a device through which a user inputs travel-related information and displays the generated travel plan, and includes a smartphone, a personal computer, etc.

[1403] "Server" refers to the central processing unit that receives and analyzes user input information and generates and transmits travel plans.

[1404] A "database" refers to an information aggregation system that stores information on transportation, accommodation, tourist attractions, etc., and is used by the server to obtain the necessary information.

[1405] An "emotion engine" refers to a program or module that analyzes emotions from user input and reactions and provides that emotional information to a server.

[1406] "Program" refers to a set of instructions that executes an algorithm that generates a travel plan based on user input and adjusts the plan based on emotional information.

[1407] "Travel Plan" refers to a travel schedule including details such as transportation, accommodations, dates, places to visit, and meal plans, generated based on travel-related information entered by a user.

[1408] "Emotion Data" refers to information about a user's emotions analyzed by the emotion engine, indicating a negative or positive emotional state.

[1409] "Analysis" refers to the process by which the server understands the travel-related information and sentiment data submitted by the user and converts it into a meaningful format.

[1410] The present invention is a system that allows users to efficiently plan travel plans and flexibly adjust those plans based on emotions. The system consists of the following main components: a user terminal, a server, a database, and an emotion engine.

[1411] Hardware and software used

[1412] User's device: A device such as a smartphone or PC on which the user inputs travel-related information and displays the generated travel plan.

[1413] Server: A cloud server (e.g., AWS, Google Cloud) that receives and analyzes user input information and generates a travel plan.

[1414] Database: A database (e.g. MySQL, PostgreSQL) for storing information on transportation, accommodation, tourist attractions, etc.

[1415] Emotion engine: Software that analyzes user emotions and provides that information to a server (e.g., Emotion API, Microsoft Azure Cognitive Services).

[1416] Program processing overview

[1417] The user enters travel-related information and sends it to the server via their device. The server analyzes the input data and retrieves the necessary information from a database. It then generates an optimal travel plan and sends it to the user's device. Next, the emotion engine analyzes the user's reactions and sends emotional information to the server. Based on this emotional information, the travel plan is readjusted and provided to the user again.

[1418] Specific processing of the program

[1419] 1. User input:

[1420] The user uses the device to input travel-related information, such as "Purpose of trip: sightseeing," "Departure date: December 1, 2023," "Destination: Tokyo," "Hotel preference: mid-range, near the station," and "Transportation method: Shinkansen."

[1421] 2. Data transmission and analysis:

[1422] The device sends the user's input data to the server, which then analyzes the received data and searches for and retrieves the necessary information from a database of transportation, accommodation, and tourist attractions.

[1423] 3. Generate itinerary:

[1424] The server generates an optimal travel plan based on the information obtained. For example, it creates a detailed travel plan like this:

[1425] Departure date: December 1st, 8:00 AM Shinkansen

[1426] Hotel: Mid-range hotel near Shinjuku Station

[1427] Sightseeing Schedule: Day 1: Sensoji Temple in the morning, Skytree in the afternoon, Shibuya in the evening

[1428] Gourmet: Tempura lunch in Asakusa, Yakiniku dinner in Shibuya

[1429] 4. Use of Emotion Engine:

[1430] The emotion engine then analyzes the user's emotion and sends the emotion data to the server. For example, if the user inputs "I'm tired," the emotion engine analyzes this as a negative emotion.

[1431] 5. Reconditioning and re-offering:

[1432] Based on the emotion data, the server adjusts the itinerary again. For example, it considers the emotion of "tired" and adjusts it to increase rest time and add relaxation spots. Then, it sends this adjusted itinerary to the terminal and displays it again to the user.

[1433] Examples of concrete examples and prompts

[1434] Examples of specific travel plans:

[1435] Purpose of trip: Sightseeing

[1436] Departure date: December 1, 2023

[1437] Destination: Tokyo

[1438] Hotel preference: Mid-range, near the station

[1439] Transportation: Shinkansen

[1440] Example prompt sentence:

[1441] "Please plan a trip to Tokyo starting on December 1st. I would like to do some sightseeing and stay somewhere mid-range and close to the station. I will be traveling by Shinkansen."

[1442] In this way, the system enables users to plan their trip efficiently and flexibly and enjoy an emotionally optimized travel experience.

[1443] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1444] Step 1:

[1445] User enters travel-related information

[1446] The user uses the terminal to input the purpose of the trip, departure date, destination, preferred hotel, mode of transportation, etc. The input data is saved in the terminal application.

[1447] Input: purpose of trip, departure date, destination, hotel preference, transportation method

[1448] Specific operation: The user enters information such as "tourism," "December 1, 2023," "Tokyo," "mid-range price range, near the station," and "Shinkansen" into the form on the application and presses the submit button.

[1449] Step 2:

[1450] The device sends the user's input data to the server

[1451] The entered data is sent from the device to the server via the Internet, allowing the server to begin analysis.

[1452] Input: User's travel-related information

[1453] Output: Data sent to the server

[1454] Specific operation: The terminal packages the data in JSON format and sends it to the server's API using the HTTPS protocol.

[1455] Step 3:

[1456] The server analyzes the received data

[1457] The server analyzes the information entered by the user and extracts information by category, dividing data such as the purpose of the trip, departure date, destination, hotel preference, and transportation method into separate fields.

[1458] Input: Travel-related information sent from your device

[1459] Output: Data for each analyzed category

[1460] Specific operation: The server parses the JSON data and breaks it down into data fields such as "Purpose of trip: sightseeing," "Departure date: December 1, 2023," "Destination: Tokyo," "Hotel preference: mid-range, near the station," and "Transportation method: Shinkansen."

[1461] Step 4:

[1462] The server retrieves the necessary information from the database

[1463] Based on the analyzed data, the server retrieves information on transportation, accommodations, tourist spots, etc. from a database, providing the base information needed to generate an optimal travel plan.

[1464] Input: Data for each category analyzed

[1465] Output: Transportation, accommodation, and tourist attraction information

[1466] Specific operation: The server issues an SQL query to the database to obtain accommodations that meet the criteria of "Tokyo," "mid-range price range," and "near the station," as well as information on Shinkansen trains departing at 8:00 AM on December 1st, and tourist spots such as Sensoji Temple, Skytree, and Shibuya.

[1467] Step 5:

[1468] The server generates the optimal travel plan

[1469] The system automatically generates an optimal travel plan by integrating all the information obtained from the database, including transportation, schedule, places to visit, and meal plans.

[1470] Input: Transportation, accommodation, and tourist attraction information

[1471] Output: Generated itinerary

[1472] Specific operation: Based on the program logic, the server creates a detailed travel plan such as "Depart on the Shinkansen at 8:00 AM on December 1st," "Stay at a mid-range hotel near Shinjuku Station," "On the first day, visit Sensoji Temple in the morning, Skytree in the afternoon, and Shibuya in the evening," "Tempura lunch in Asakusa, and yakiniku dinner in Shibuya."

[1473] Step 6:

[1474] The server sends the generated travel plan to the terminal.

[1475] The generated travel plan is sent from the server to the terminal, where the user can check the plan.

[1476] Input: Generated itinerary

[1477] Output: Trip plan sent to the device

[1478] Specific operation: The server packages the travel plan in JSON format and sends it to the device's API using the HTTPS protocol.

[1479] Step 7:

[1480] The device displays the travel plan to the user.

[1481] The transmitted travel plan is displayed on the terminal, and the user can check the plan details, thereby learning the contents of the travel plan.

[1482] Input: Submitted travel plan

[1483] Output: Trip plan displayed on the device

[1484] Specific operation: The device parses the JSON data received and displays it on the screen in the form of "Depart on the Shinkansen at 8:00 AM on December 1st," "Stay at a mid-range hotel near Shinjuku Station," "Day 1: Sensoji Temple in the morning, Skytree in the afternoon, Shibuya in the evening," "Tempura lunch in Asakusa, yakiniku dinner in Shibuya," etc.

[1485] Step 8:

[1486] Emotion engine analyzes user reactions

[1487] When a user inputs their thoughts or opinions about the displayed travel plan, the emotion engine analyzes them to generate emotion data, such as emotions like "tired" or "fun."

[1488] Input: User reactions and thoughts

[1489] Output: Parsed emotion data

[1490] Specific behavior: The user types "tired," and the emotion engine analyzes the text to generate negative emotion data.

[1491] Step 9:

[1492] The emotion engine sends the emotion data to the server.

[1493] The generated emotion data is sent from the emotion engine to a server, which uses the information to adjust the travel plan.

[1494] Input: Parsed emotion data

[1495] Output: Emotion data sent to the server

[1496] Specific operation: The emotion engine packages emotion data in JSON format and sends it to the server's API using the HTTPS protocol.

[1497] Step 10:

[1498] The server readjusts the travel plan based on the emotion data.

[1499] The server then adjusts the travel plan based on the emotion data received, for example by increasing rest periods and adding relaxation spots.

[1500] Input: emotion data, original travel plan

[1501] Output: Reworked itinerary

[1502] Specific operation: Based on the emotional data that the server is "tired," it makes adjustments such as increasing break time and adding a "break at a cafe."

[1503] Step 11:

[1504] The server sends the re-arranged travel plan to the device.

[1505] The server sends the re-arranged travel plan to the terminal, allowing the user to review the plan again.

[1506] Input: Re-arranged travel plans

[1507] Output: The adjusted itinerary sent to the device.

[1508] Specific operation: The server packages the re-arranged itinerary in JSON format and sends it to the device's API using the HTTPS protocol.

[1509] Step 12:

[1510] The device displays the re-arranged itinerary to the user.

[1511] The re-adjusted travel plan is displayed on the terminal, and the user confirms the plan again. This provides the user with a travel plan that takes emotions into consideration.

[1512] Input: Submitted rearranged travel plan

[1513] Output: The adjusted itinerary displayed on the device

[1514] Specific behavior: The device parses the received JSON data and displays the re-adjusted plan on the screen.

[1515] In this way, users can efficiently plan their trips and enjoy trip plans that are flexibly adjusted based on real-time emotions.

[1516] (Application example 2)

[1517] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1518] Conventional travel planning systems automatically generate travel plans without considering the user's emotions, which means they are unable to adapt to the user's real-time emotional changes. Furthermore, they are unable to adjust the plan to reflect negative emotions such as stress and fatigue that users experience during the trip, which makes it difficult to fully increase travel satisfaction. This often leaves users dissatisfied with their travel plans.

[1519] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1520] In this invention, the server includes means for inputting user travel-related information, means for transmitting the information to the server, means for analyzing the information and automatically generating a travel plan tailored to the user's preferences, means for transmitting the generated travel plan to the user's terminal, means for displaying the travel plan to the user, means for recognizing the user's emotions in real time, and means for adjusting the travel plan based on the recognized emotions. This makes it possible to flexibly adjust the travel plan according to the user's emotions, thereby increasing the user's travel satisfaction.

[1521] "User's travel-related information" refers to data that the user inputs to plan a trip, such as the purpose of the trip, departure date, destination, preferred accommodation, and means of transportation.

[1522] A "server" is a computer system that analyzes travel-related information submitted by users and generates and adjusts optimal travel plans.

[1523] "Means for automatic generation" refers to the function by which the server autonomously creates an optimal travel plan based on the data input by the user.

[1524] "User's terminal" refers to a device (e.g., smartphone, tablet, or PC) on which a user inputs travel-related information and displays and confirms the generated travel plan.

[1525] "Means for recognizing emotions in real time" refers to technologies (e.g., cameras, sensors, emotion analysis software) that monitor a user's facial expressions and behavior and analyze their current emotional state.

[1526] The "means for adjusting travel plans" is a function that flexibly changes and optimizes existing travel plans based on user sentiment information obtained in real time.

[1527] The present invention relates to a system that enables users to efficiently plan trips and adjust the plans while taking real-time emotions into account. The system for realizing the present invention is composed of a user terminal, a server, a database, and an emotion engine.

[1528] System configuration

[1529] Users input travel-related information using devices such as smartphones or tablets. The input information is sent from the device to a server. The server analyzes the information entered by the user, obtains necessary information (transportation, accommodations, tourist spots, etc.) from a database, and automatically generates an optimal travel plan. The generated travel plan is sent from the server to the device and displayed to the user.

[1530] Furthermore, the system of the present invention includes an emotion engine that recognizes emotions in real time from user inputs and reactions. This emotion information is sent to the server and used to generate and adjust travel plans.

[1531] System Operation

[1532] The emotion engine uses cameras and sensors installed in smart glasses or head-mounted displays (HMDs) to monitor the user's facial expressions and behavior and analyze their current emotional state. The server then adjusts the travel plan accordingly based on the analyzed emotional data. This adjustment can include adding breaks or relaxing areas.

[1533] Usage example

[1534] For example, a user enters the following travel-related information:

[1535] Purpose of trip: Sightseeing

[1536] Departure date: December 1, 2023

[1537] Destination: Tokyo

[1538] Hotel preference: Mid-range, near the station

[1539] Transportation: Shinkansen

[1540] When the user inputs this information into the device and sends it, the device transfers it to the server, which analyzes the information, retrieves information on appropriate transportation, accommodations, and tourist spots from a database, and generates an optimal travel plan.

[1541] The generated itinerary includes the following specific details:

[1542] Departure date: December 1st, 8:00 AM Shinkansen

[1543] Hotel: Mid-range hotel near Shinjuku Station

[1544] Sightseeing Schedule: Day 1: Sensoji Temple in the morning, Skytree in the afternoon, Shibuya in the evening

[1545] Gourmet: Tempura lunch in Asakusa, Yakiniku dinner in Shibuya

[1546] The generated itinerary is sent to the device, where the user can view it. If the user expresses a negative emotion such as "tired" about the displayed itinerary, the emotion engine analyzes the emotion and sends it to the server. The server takes the emotion data into account and readjusts the itinerary, for example, by increasing rest time or adding relaxation spots.

[1547] As an example of a specific prompt, if the user wants to change the location they are visiting, they would enter:

[1548] "Change request: Please suggest other tourist spots in Tokyo instead of Sensoji Temple."

[1549] If you want to add a place where users can relax, type:

[1550] "Sentiment analysis results: 'I'm tired'. Please add a place where you can relax to your visit."

[1551] In this way, users can flexibly plan their travel plans according to their real-time emotions, thereby increasing the satisfaction of their travel experience.

[1552] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1553] Step 1:

[1554] The user inputs travel-related information using a device such as a smartphone or tablet. This information includes the purpose of the trip, departure date, destination, preferred hotel, mode of transportation, etc. This information is then sent from the device to the server.

[1555] Step 2:

[1556] The server receives the travel-related information sent from the device and analyzes the data. During the analysis, the server searches and retrieves the necessary information from a database (transportation, accommodation, tourist spots) based on the user's preferences.

[1557] Step 3:

[1558] The server automatically generates an optimal travel plan based on the acquired information, including specific details of transportation, accommodation, daily schedule, meal plan, etc. The travel plan is then sent from the server to the device.

[1559] Step 4:

[1560] The terminal receives the itinerary sent from the server and displays it to the user, who then checks the displayed itinerary and inputs any necessary revision requests, which are also sent from the terminal to the server.

[1561] Step 5:

[1562] Cameras and sensors installed in the user's smart glasses or head-mounted display (HMD) monitor the user's facial expressions and behavior to obtain real-time emotional data, which is then transmitted to a server via the device.

[1563] Step 6:

[1564] The emotion engine analyzes the user's emotional data. Specifically, it reads the user's emotions from their facial expressions and voice and determines whether they are positive (e.g., happy, excited) or negative (e.g., tired, stressed). The analysis results are sent to the server.

[1565] Step 7:

[1566] The server adjusts the itinerary based on the emotional data analyzed by the emotion engine and the user's requests for modifications. For example, if there is a lot of negative emotional data, the server may increase rest time or add relaxation spots.

[1567] Step 8:

[1568] The server sends the new adjusted travel plan to the terminal, which displays it to the user, who confirms the re-adjusted plan and continues traveling.

[1569] Through these steps, users can achieve a more satisfying travel experience. The system can adjust travel plans in real time according to users' emotions.

[1570] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1571] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1572] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1573] [Fourth embodiment]

[1574] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1575] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1576] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1577] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1578] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1579] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1580] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1581] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1582] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1583] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1584] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1585] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1586] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1587] The present invention provides a system that allows users to easily create travel plans. This system allows users to input travel-related information, automatically generates an optimal travel plan based on that information, and provides it to the user, thereby significantly reducing the effort required for planning.

[1588] System configuration

[1589] This system consists of a user's terminal, a server, and a database. The user uses the terminal to input travel-related information, which is then sent to the server. The server analyzes the information, retrieves the necessary information from the database, automatically generates a travel plan, and sends the generated plan to the terminal. The terminal then displays the plan to the user and accepts confirmation or correction requests from the user.

[1590] User Input

[1591] The user uses the terminal to enter the following travel-related information:

[1592] Purpose of trip (e.g. sightseeing, business, gourmet)

[1593] Departure date (e.g. December 1, 2023)

[1594] Destination (e.g. Tokyo)

[1595] Hotel preferences (e.g. mid-range, near the station)

[1596] Transportation (e.g. bullet train, airplane, bus)

[1597] Data transmission

[1598] The terminal checks the information entered by the user, and after confirming that there are no errors, sends it to the server.

[1599] Database searching and analysis

[1600] Based on the information received, the server retrieves the following information from the database:

[1601] Transportation database (airline, train, and bus schedules and fares)

[1602] Accommodation database (listings and details of hotels, resorts, and guesthouses)

[1603] Tourist spot database (information on tourist spots, restaurants, and activities)

[1604] The server then uses this information to generate a travel plan that best suits the user's needs. Specifically, it combines the following information:

[1605] Determine the best mode of transportation based on departure date and destination.

[1606] Select the appropriate accommodation based on your hotel preferences (price range, location).

[1607] Depending on the purpose of the trip, it selects tourist spots and activities to visit and calculates the order in which to visit them and travel time.

[1608] Generate a travel plan

[1609] The server creates a specific itinerary tailored to the user's needs, including information such as:

[1610] Transportation details (e.g., what time and which Shinkansen to take)

[1611] Accommodation booking suggestions (e.g. mid-range hotel near Shinjuku Station)

[1612] Daily schedule (e.g., Sensoji Temple in the morning on the first day, Skytree in the afternoon, Shibuya in the evening, etc.)

[1613] Dining suggestions (e.g., tempura lunch in Asakusa, yakiniku dinner in Shibuya)

[1614] Provision to users

[1615] The server sends the generated itinerary to the terminal, which displays it to the user, who can review the itinerary and request modifications if necessary.

[1616] Processing correction requests

[1617] If the user requests an amendment to the plan, the device sends the request to the server, which again analyzes and retrieves the information to adjust the travel plan.

[1618] Specific examples

[1619] For example:

[1620] Purpose of trip: Sightseeing

[1621] Departure date: December 1, 2023

[1622] Destination: Tokyo

[1623] Hotel preference: Mid-range, near the station

[1624] Transportation: Shinkansen

[1625] 1. The user enters this information into the terminal and sends it.

[1626] 2. The device forwards the transmitted information to the server.

[1627] 3. The server analyzes the information and retrieves information from the database about appropriate transportation options (e.g., the Shinkansen at 8:00 AM on December 1st), accommodation options (e.g., a mid-range hotel near Shinjuku Station), and tourist attractions (e.g., Sensoji Temple, Skytree, Shibuya, etc.).

[1628] 4. Based on the information obtained, the server generates a specific itinerary, such as:

[1629] Departure date: December 1st, 8:00 AM Shinkansen

[1630] Hotel: Mid-range hotel near Shinjuku Station

[1631] Sightseeing Schedule: Day 1: Sensoji Temple in the morning, Skytree in the afternoon, Shibuya in the evening

[1632] Gourmet: Tempura lunch in Asakusa, Yakiniku dinner in Shibuya

[1633] 5. The server sends the generated itinerary to the terminal, which displays it to the user.

[1634] 6. The user reviews the plan and submits a request for revisions if necessary.

[1635] This system allows users to create efficient travel plans in a short amount of time, greatly simplifying travel preparations, thereby reducing the time and effort required for travel planning and providing a fulfilling travel experience.

[1636] The processing flow will be explained below.

[1637] Step 1:

[1638] The user uses a device (smartphone or PC) to input travel-related information (purpose of trip, departure date, destination, hotel preferences, and means of transportation).

[1639] Step 2:

[1640] The device checks the accuracy of the user's input data and ensures that all required fields are filled in.

[1641] Step 3:

[1642] The terminal sends the verified user-entered data to the server.

[1643] Step 4:

[1644] The server receives the user's input data and parses the input.

[1645] Step 5:

[1646] Based on the information analyzed by the server, the necessary information is searched from the transportation database, accommodation database, and tourist spot database.

[1647] Step 6:

[1648] The server filters the information obtained from each database and extracts the options that best suit the user's preferences.

[1649] Step 7:

[1650] The server generates an optimal travel plan based on the extracted information, including, for example:

[1651] Transportation: Departure date and time, seat information

[1652] Accommodation: Hotel name, address, rates, and facility information

[1653] Tourist schedule: places to visit, visiting times, means of transport and times

[1654] Meal planning: restaurant reservations, menu recommendations

[1655] Step 8:

[1656] The server transmits the generated travel plan to the terminal.

[1657] Step 9:

[1658] The device displays the travel plan received from the server to the user, visually showing detailed schedules, maps, reservation information, and more.

[1659] Step 10:

[1660] The user reviews the displayed itinerary and requests modifications if necessary.

[1661] Step 11:

[1662] The terminal sends the user's modification request to the server.

[1663] Step 12:

[1664] The server receives the modification request, searches and analyzes the database again based on the new parameters, and generates a new itinerary.

[1665] Step 13:

[1666] The server transmits the regenerated itinerary to the terminal.

[1667] Step 14:

[1668] The terminal displays the regenerated itinerary to the user, who then makes a final confirmation.

[1669] Step 15:

[1670] The user finalizes the travel plan and the terminal transmits the information to the server.

[1671] Step 16:

[1672] The server stores the confirmed itinerary and sends a confirmation message to the terminal.

[1673] All these steps allow users to easily plan and execute efficient and complete travel plans.

[1674] Example 1

[1675] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1676] Conventional travel planning systems require users to manually collect and organize large amounts of information, resulting in the time-consuming and labor-intensive process of planning. Furthermore, it is difficult to automatically generate a travel plan that perfectly matches the user's preferences, and it is also difficult to efficiently reflect revision requests. For these reasons, many users are dissatisfied with the process of creating a travel plan.

[1677] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1678] In this invention, the server includes means for a user to input travel-related information, means for transmitting the information to the server, means for analyzing the information and automatically generating a specific itinerary based on the user's preferences using a generative AI model, means for transmitting the generated itinerary to the user's terminal, means for displaying the itinerary to the user, means for receiving user revision requests and re-adjusting the itinerary, and means for acquiring information from databases of transportation, accommodations, and tourist spots and generating an optimal plan based on the user's preferences. This allows users to efficiently create an itinerary that suits their preferences in a short amount of time, and can also quickly respond to revision requests, greatly simplifying the process of planning an itinerary.

[1679] "User" means an individual or organization that uses the system to plan a trip.

[1680] "Travel-related information" refers to information necessary for planning a trip, such as the purpose of the trip, departure date, destination, preferred accommodation, and transportation.

[1681] A "terminal" is an electronic device, such as a computer, smartphone, or tablet, that a user uses to enter travel-related information and communicate with the system.

[1682] A "server" is a computer system that receives travel-related information sent by a user, analyzes it, and sends an automatically generated travel plan to the user's terminal.

[1683] "Analysis" is the process by which the server references information in the database and generates a travel plan based on the travel-related information received from the user.

[1684] A "generative AI model" is an artificial intelligence model used to automatically generate optimal travel plans based on a user's preferences.

[1685] A "travel plan" is a specific schedule that includes suggestions for transportation, accommodation, sightseeing spots, meals, etc., created based on the user's preferences.

[1686] A "modification request" is a request that a user submits to the system for changes or adjustments to a provided travel plan.

[1687] A "transportation database" is a database that stores information on schedules and fares for transportation such as airplanes, bullet trains, and buses.

[1688] The "accommodation database" is a database that stores detailed information about accommodation facilities such as hotels, resorts, and guesthouses.

[1689] The "tourist spot database" is a database that stores information about sightseeing spots, restaurants, activities, and other tourist-related information.

[1690] The present invention provides a system that allows users to easily plan their travel plans. In this system, the user inputs travel-related information using a terminal, and the information is sent to a server. The server then analyzes the information and uses a generative AI model to automatically generate an optimal travel plan based on the user's preferences, and sends the generated plan to the terminal. Finally, the user can review the plan and submit revision requests as necessary. Details of the system configuration and operation are as follows.

[1691] Hardware and software used

[1692] Server: A central processing unit used for information analysis and database searches, in this case using a specific cloud server service (e.g., AWS, Google Cloud Platform).

[1693] Device: An electronic device used by a user to provide input information and display the generated itinerary, such as a personal computer, smartphone, or tablet.

[1694] Database: Various data (transportation, accommodation, tourist spots) is stored in this database. This database uses a database management system such as MySQL or PostgreSQL.

[1695] Generative AI model: An artificial intelligence model used to automatically generate travel plans based on user preferences, such as GPT-3.

[1696] User Input

[1697] The user uses the terminal to enter the following travel-related information:

[1698] Purpose of trip (e.g. sightseeing, business, gourmet)

[1699] Departure date (e.g. December 1, 2023)

[1700] Destination (e.g. Tokyo)

[1701] Hotel preferences (e.g. mid-range, near the station)

[1702] Transportation (e.g. bullet train, airplane, bus)

[1703] As a specific example, the user launches a web browser or a dedicated application, enters the above information into the input fields, and clicks the "Submit" button.

[1704] Data transmission

[1705] The device checks the information entered by the user, checks that there are no errors, and then sends the information to the server. Specifically, the input information is sent to the server as a POST request using the API (e.g., https: / / api.travelplanner.com / submit).

[1706] Database searching and analysis

[1707] The server retrieves the necessary information from the database based on the received information, queries the transportation database, accommodation database, and tourist spot database, and inputs the returned results into the generative AI model for analysis.

[1708] Generate a travel plan

[1709] The server generates a specific itinerary based on the data returned by the generative AI model. The itinerary is organized in JSON format and includes necessary information such as transportation details, accommodation suggestions, daily schedules, and meal suggestions.

[1710] Provision to users

[1711] The server sends the generated travel plan to the terminal, which then displays it to the user. Specifically, the server returns the generated plan to the terminal via API, and the plan is displayed in HTML format on the terminal (e.g., schedule display using table tags).

[1712] Processing correction requests

[1713] The user checks the provided travel plan and submits a request for revisions if necessary. The user enters the parts they want to revise and clicks the "Request revisions" button. The device then sends the information back to the server, which then generates a new plan and sends it back.

[1714] Prompt Sentence Examples

[1715] "Purpose of trip: Sightseeing. Departure date: December 1, 2023. Destination: Tokyo. Hotel preference: Mid-range, near the station. Transportation method: Shinkansen. Please suggest the best travel plan based on this."

[1716] This system allows users to create travel plans that are tailored to their needs in a short amount of time and efficiently. It also responds quickly to requests for revisions, greatly simplifying the process of creating travel plans.

[1717] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1718] Step 1:

[1719] The user enters travel-related information into the device. Specifically, the user opens a web browser or dedicated application and enters the necessary information into the input fields, such as the purpose of the trip, departure date, destination, hotel preferences, and transportation method. After the user has finished entering the information, they click the "Submit" button.

[1720] Input: purpose of trip, departure date, destination, hotel preference, mode of transportation.

[1721] Output: User's travel-related information entered into the terminal.

[1722] Step 2:

[1723] The device checks the information entered by the user to see if there are any errors. If there are any errors, the device displays an error message to the user. If the input is correct, the device sends the information to the server. Specifically, the device uses the API (e.g., https: / / api.travelplanner.com / submit) to send the information to the server as a POST request.

[1724] Input: Travel-related information entered by the user.

[1725] Output: User's travel related information sent to the server.

[1726] Step 3:

[1727] Based on the information received, the server retrieves the necessary information from the database. The server queries the transportation database, accommodation database, and tourist attraction database to collect relevant information. Specifically, the server uses SQL queries to retrieve the necessary data from each database.

[1728] Input: The user's travel-related information sent to the server.

[1729] Output: Transport, accommodation and tourist attraction information retrieved from the database.

[1730] Step 4:

[1731] The server analyzes the acquired data and inputs it into a generative AI model (e.g., GPT-3). The generative AI model automatically generates an optimal travel plan that matches the user's preferences based on this data. Specifically, the AI ​​model generates suggested transportation, accommodation, tourist spots, and schedule information.

[1732] Input: Transportation, accommodation and tourist attraction information retrieved from database.

[1733] Output: A concrete trip plan generated by the generative AI model.

[1734] Step 5:

[1735] The server sends the generated itinerary to the device. Specifically, it organizes the generated itinerary in JSON format and sends it to the device via API. The device receives this information and displays it in a format that is easy for the user to view. For example, it displays the itinerary using HTML and CSS.

[1736] Input: A concrete travel itinerary generated by a generative AI model.

[1737] Output: Trip plan displayed on the terminal.

[1738] Step 6:

[1739] The user checks the provided travel plan and submits an amendment request if necessary. Specifically, the user enters the amendment details into the amendment form in the browser or app and clicks the "Request amendment" button.

[1740] Input: A user's request to modify a travel plan.

[1741] Output: The modification request sent from the device to the server.

[1742] Step 7:

[1743] The server receives the request, analyzes the information again, and adjusts the travel plan. The server then requests the AI ​​model to generate a new plan that reflects the changes, and sends the regenerated plan to the device.

[1744] Input: The modification request sent from the terminal.

[1745] Output: The regenerated itinerary.

[1746] In this way, a specific and optimal travel plan based on the user's wishes can be quickly generated, and revision requests from the user can be flexibly accommodated.

[1747] (Application example 1)

[1748] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1749] Conventional travel planning systems allow users to plan their trip beforehand, but lack real-time guidance and information during the trip. Furthermore, it is difficult to change plans mid-trip or update local information in a timely manner, which can cause inconvenience during the trip. This has led to the problem of trip plans not being utilized efficiently and effectively.

[1750] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1751] In this invention, the server includes means for a user to input travel-related information, means for transmitting the information to the server, means for analyzing the information and automatically generating a travel plan tailored to the user's preferences, means for transmitting the generated travel plan to the user's terminal, means for displaying the travel plan to the user, means for providing the user with real-time guidance during the trip, means for displaying the generated travel plan on the user's smart glasses, and means for presenting information on tourist spots and restaurants in real time. This allows the user to receive real-time guidance during the trip, enabling them to smoothly navigate their travel destinations.

[1752] "User" refers to an individual who uses the system to plan a trip and receive real-time guidance during the trip.

[1753] "Travel-related information" refers to information necessary for planning a trip, such as travel destination, departure date, preferred accommodation, transportation, and tourist attractions.

[1754] "Server" refers to a computer system that receives and analyzes travel-related information sent by users, retrieves information from a database, and automatically generates an optimal travel plan.

[1755] A "terminal" is a device that allows a user to input travel-related information, confirm and transmit that information, and display the generated travel plan, and includes a smartphone, tablet, etc.

[1756] "Travel Plan" means a plan that includes specific travel itineraries, transportation, accommodations, sightseeing spots, and dining suggestions that is automatically generated based on information entered by a User.

[1757] "Means for automatic generation" refers to the algorithms and programs that allow the server to analyze the information entered by the user, retrieve the most appropriate information from the database, and automatically create a travel plan.

[1758] "Smart glasses" refer to a wearable device that can be worn by a user and display information in real time in their field of vision.

[1759] "Real-time guidance" refers to the latest information on tourist attractions, dining options, and transportation provided to users based on their current location and current conditions while traveling.

[1760] "Tourist attractions" refer to destinations and places of interest visited by tourists, including museums, parks, historical buildings, and entertainment venues.

[1761] "Dining facilities" are places where users can visit and eat meals during their trip, and include restaurants, cafes, dining halls, etc.

[1762] This invention provides a system that allows users to easily plan their travel plans. The system, which allows users to input travel-related information, automatically generates an optimal travel plan based on the information, and provides it to the user, is composed of a user terminal, a server, and a database. The system also provides real-time guidance during the trip and allows users to access the travel plan through smart glasses.

[1763] System configuration

[1764] The system consists of the following components:

[1765] 1. User's device: A device such as a smartphone or tablet that allows the user to enter, confirm and submit travel-related information and view the generated travel plan.

[1766] 2. Server: A computer system that receives and analyzes travel-related information sent by users, retrieves information from a database, and generates optimal travel plans. In particular, it runs a program using Python and the Requests library.

[1767] 3. Database: A database that stores information on transportation, accommodation, tourist attractions, and dining facilities.

[1768] 4. Smart glasses: These are wearable devices that users can wear and view, and are used to display travel plans and real-time directions.

[1769] Explanation of program processing

[1770] User inputs travel information: The user inputs information such as travel destination, departure date, preferred accommodation, transportation method, and tourist spots they want to visit into the terminal.

[1771] Sending information: The terminal checks the entered information and, after confirming that there are no errors, sends it to the server.

[1772] Analysis and plan generation on the server: The server analyzes the received information and retrieves the relevant information from the database. Using Python and the Requests library, it retrieves the information from the API and automatically generates the optimal travel plan.

[1773] Displaying the itinerary: The generated itinerary is sent from the server to the terminal and displayed to the user. The itinerary is also sent to the smart glasses.

[1774] Real-time guidance: Through smart glasses, users can receive real-time tourist information and dining facility information.

[1775] Specific examples

[1776] For example, a user enters the following travel information:

[1777] Purpose of trip: Sightseeing

[1778] Departure date: December 1, 2023

[1779] Destination: Tokyo

[1780] Hotel preference: Mid-range, near the station

[1781] Transportation: Shinkansen

[1782] The itinerary generated by the server will look something like this:

[1783] Day 1: Take the Shinkansen to Tokyo at 8am. Stay at a mid-range hotel near Shinjuku Station. Visit Sensoji Temple in the morning, Skytree in the afternoon, and Shibuya in the evening. Have tempura for lunch in Asakusa and yakiniku for dinner in Shibuya.

[1784] Example of input prompt for generative AI model

[1785] Purpose of trip: Sightseeing

[1786] Departure date: December 1, 2023

[1787] Destination: Tokyo

[1788] Hotel preference: Mid-range, near the station

[1789] Transportation: Shinkansen

[1790] Use this information to generate the best possible travel plan.

[1791] In this way, the system automatically generates a travel plan based on user input information and provides real-time guidance during the trip, greatly improving the user's travel experience.

[1792] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1793] Step 1:

[1794] A user uses a terminal to input travel-related information.

[1795] Input: Travel destination, departure date, accommodation preferences, transportation options, tourist attractions, and other information.

[1796] Data processing and calculation: The user enters this information through the device's UI, and the input is verified to ensure there are no errors.

[1797] Output: A set of verified travel-related information.

[1798] Step 2:

[1799] The terminal transmits the information input by the user to the server.

[1800] Input: A set of travel-related information for the user.

[1801] Data processing and calculation: The device packages the information and sends it to the server using a secure communication protocol (e.g., HTTPS).

[1802] Output: The user's travel-related information passed to the server.

[1803] Step 3:

[1804] The server analyzes the received travel-related information and retrieves relevant information from a database.

[1805] Input: User's travel-related information.

[1806] Data processing and calculation: The server uses Python and the Requests library to obtain information on transportation, accommodation, tourist attractions, and restaurants from multiple APIs. The information is then analyzed and filtered to select the information that meets the user's requirements.

[1807] Output: Parsed and filtered travel information.

[1808] Step 4:

[1809] The server automatically generates the optimal travel plan tailored to the user's wishes.

[1810] Input: Parsed and filtered information required for the trip.

[1811] Data processing and calculation: The server runs the algorithm to generate the optimal travel plan based on the user's requirements. It uses the generative AI model to create suggestions based on the prompt.

[1812] Output: Generated itinerary (e.g., dates, times, modes of transport, accommodation, tourist attractions, and dining details).

[1813] Step 5:

[1814] The generated travel plan is transmitted to the user's terminal and smart glasses.

[1815] Input: The generated itinerary.

[1816] Data processing and calculation: The server formats and transmits the travel plan to the device and smart glasses. Data communication uses a secure protocol.

[1817] Output: The trip plan displayed on the user's device and smart glasses.

[1818] Step 6:

[1819] The terminal and smart glasses display the travel plan to the user.

[1820] Input: Travel itinerary sent from the server.

[1821] Data processing and calculation: The device and smart glasses will visualize the travel plan in a user-friendly format and display specific schedules and suggestions.

[1822] Output: Trip plan details available to the user.

[1823] Step 7:

[1824] Smart glasses provide real-time tourist information and dining information.

[1825] Input: User's current location and real-time data retrieved from the server.

[1826] Data processing and calculation: The smart glasses use GPS functionality and updates from the server to display real-time information based on the user's current location.

[1827] Output: Tourist information and dining information that users can view in real time.

[1828] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1829] The present invention provides a system that allows users to efficiently plan their travel plans, and further aims to provide a more satisfying travel experience by recognizing the user's emotions and adjusting the travel plan based on those emotions. This system inputs and analyzes the user's travel-related information, generates an optimal travel plan, and presents it to the user. It also recognizes the user's emotions in real time and flexibly adjusts the travel plan based on that information.

[1830] System configuration

[1831] This system consists of a user's terminal, a server, a database, and an emotion engine. The user uses the terminal to input travel-related information, which is then sent to the server. The server analyzes the input information, retrieves the necessary information from the database, automatically generates a travel plan, and sends the generated plan to the terminal. The terminal displays the plan to the user and accepts the user's confirmation or correction requests. The emotion engine analyzes the user's emotions from the user's input and reactions, and this emotional information is used to optimize the travel plan.

[1832] User Input

[1833] The user uses the terminal to enter the following travel-related information:

[1834] Purpose of trip (e.g. sightseeing, business, gourmet)

[1835] Departure date (e.g. December 1, 2023)

[1836] Destination (e.g. Tokyo)

[1837] Hotel preferences (e.g. mid-range, near the station)

[1838] Transportation (e.g. bullet train, airplane, bus)

[1839] Data transmission and analysis

[1840] The device sends the user's input data to the server, which analyzes the information. Based on the analyzed information, the server searches and retrieves the necessary information from the transportation database, accommodation database, and tourist spot database.

[1841] Generate a travel plan

[1842] The server generates an optimal travel plan based on the information it has acquired. The plan includes the following information:

[1843] Transportation details (departure date and time, seat information)

[1844] Accommodation booking suggestions (hotel name, address, price, facilities information)

[1845] Daily schedule (visit locations, visit times, transportation methods and times)

[1846] Meal planning (restaurant reservations, menu recommendations)

[1847] Use of emotion engine

[1848] The emotion engine analyzes emotions in real time from the user's input and reactions. This emotional information is sent to the server and used to generate and adjust travel plans. For example, if the user expresses positive emotions such as "fun" or "excited," the plan will be adjusted to increase activity. On the other hand, if the user expresses emotions such as "tired" or "stressed," the plan will be adjusted to include more rest time.

[1849] Providing and coordinating travel plans

[1850] The server sends the generated travel plan to the terminal, which displays it to the user. If the user checks the plan and requests any modifications, the terminal sends the request to the server. The server receives the modification request, readjusts the travel plan taking into account the emotion data from the emotion engine, and sends the new plan to the terminal.

[1851] Specific examples

[1852] For example, here is a concrete example:

[1853] Purpose of trip: Sightseeing

[1854] Departure date: December 1, 2023

[1855] Destination: Tokyo

[1856] Hotel preference: Mid-range, near the station

[1857] Transportation: Shinkansen

[1858] 1. The user enters this information into the terminal and sends it.

[1859] 2. The device forwards the transmitted information to the server.

[1860] 3. The server analyzes the information and retrieves information from the database about appropriate transportation options (e.g., the Shinkansen at 8:00 AM on December 1st), accommodation options (e.g., a mid-range hotel near Shinjuku Station), and tourist attractions (e.g., Sensoji Temple, Skytree, Shibuya, etc.).

[1861] 4. Based on the information obtained, the server generates a specific itinerary, such as:

[1862] Departure date: December 1st, 8:00 AM Shinkansen

[1863] Hotel: Mid-range hotel near Shinjuku Station

[1864] Sightseeing Schedule: Day 1: Sensoji Temple in the morning, Skytree in the afternoon, Shibuya in the evening

[1865] Gourmet: Tempura lunch in Asakusa, Yakiniku dinner in Shibuya

[1866] 5. The server sends the generated itinerary to the terminal, which displays it to the user.

[1867] 6. The user expresses negative emotions such as "tired" or "stressed" about the displayed travel plan.

[1868] 7. The emotion engine analyzes the user's emotions and sends the information to the server.

[1869] 8. The server takes the emotional data into account and readjusts the itinerary, for example adding more breaks and relaxation spots.

[1870] 9. The server sends the re-arranged itinerary to the terminal, which displays it to the user.

[1871] This system allows users to plan their trips efficiently and flexibly in a short time, and enjoy an emotionally sensitive travel experience.

[1872] The processing flow will be explained below.

[1873] Step 1:

[1874] The user uses the terminal to input travel-related information (purpose of travel, departure date, destination, hotel preference, and means of transportation).

[1875] Step 2:

[1876] The device checks the accuracy of the user's input data and ensures that all required fields are filled in.

[1877] Step 3:

[1878] The terminal sends the verified user-entered data to the server.

[1879] Step 4:

[1880] The server receives the user's input data and begins parsing it.

[1881] Step 5:

[1882] Based on the information analyzed by the server, the necessary information is searched from the transportation database, accommodation database, and tourist spot database.

[1883] Step 6:

[1884] The server filters the information obtained from each database and extracts the options that best suit the user's preferences.

[1885] Step 7:

[1886] The server generates an optimal travel plan based on the extracted information, including, for example:

[1887] Transportation: Departure date and time, seat information

[1888] Accommodation: Hotel name, address, rates, and facility information

[1889] Daily schedule: places to visit, visiting times, transportation and time

[1890] Meal planning: restaurant reservations, menu recommendations

[1891] Step 8:

[1892] The server transmits the generated travel plan to the terminal.

[1893] Step 9:

[1894] The device displays the travel plan received from the server to the user, visually showing detailed schedules, maps, reservation information, and more.

[1895] Step 10:

[1896] The user checks the displayed travel plan and, if necessary, inputs emotions or makes a request for correction through the emotion engine.

[1897] Step 11:

[1898] The emotion engine analyzes the user's input and reactions (touch, voice, facial expressions, etc.) to recognize the user's emotions.

[1899] Step 12:

[1900] The terminal sends a modification request including emotion data to the server.

[1901] Step 13:

[1902] The server receives the modification request and emotion data, and performs a database search and analysis again based on the new parameters.

[1903] Step 14:

[1904] The server will adjust the travel plan based on the user's emotions. For example, if the user feels tired, it will set more rest time.

[1905] Step 15:

[1906] The server transmits the regenerated itinerary to the terminal.

[1907] Step 16:

[1908] The terminal displays the regenerated itinerary to the user, who then makes a final confirmation.

[1909] Step 17:

[1910] The user finalizes the travel plan and the terminal transmits the information to the server.

[1911] Step 18:

[1912] The server stores the confirmed itinerary and sends a confirmation message to the terminal.

[1913] All these steps allow users to easily plan and execute travel plans that are emotionally sensitive, efficient, and flexible.

[1914] Example 2

[1915] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1916] Conventional travel planning systems can generate travel plans based on user input, but they have the problem of not being able to flexibly adjust the plan to take the user's emotions into account. This means that the travel plans provided do not adapt to the user's real-time emotions and state, which can lead to a decrease in satisfaction.

[1917] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for a user to input travel-related information, means for transmitting the information to the server, means for analyzing the information and automatically generating a travel itinerary tailored to the user's wishes, means for transmitting the generated travel itinerary to the user's terminal, means for displaying the travel itinerary to the user, means for analyzing the user's emotions from the user's input content and reactions and optimizing the travel itinerary based on the emotion information, and means for re-adjusting the travel itinerary based on the user's emotions. This makes it possible to provide a flexible and optimal travel itinerary that responds to changes in the user's emotions.

[1918] "User" refers to an individual or organization that uses the system to plan a trip.

[1919] A "terminal" is a device through which a user inputs travel-related information and displays the generated travel plan, and includes a smartphone, a personal computer, etc.

[1920] "Server" refers to the central processing unit that receives and analyzes user input information and generates and transmits travel plans.

[1921] A "database" refers to an information aggregation system that stores information on transportation, accommodation, tourist attractions, etc., and is used by the server to obtain the necessary information.

[1922] An "emotion engine" refers to a program or module that analyzes emotions from user input and reactions and provides that emotional information to a server.

[1923] "Program" refers to a set of instructions that executes an algorithm that generates a travel plan based on user input and adjusts the plan based on emotional information.

[1924] "Travel Plan" refers to a travel schedule including details such as transportation, accommodations, dates, places to visit, and meal plans, generated based on travel-related information entered by a user.

[1925] "Emotion Data" refers to information about a user's emotions analyzed by the emotion engine, indicating a negative or positive emotional state.

[1926] "Analysis" refers to the process by which the server understands the travel-related information and sentiment data submitted by the user and converts it into a meaningful format.

[1927] The present invention is a system that allows users to efficiently plan travel plans and flexibly adjust those plans based on emotions. The system consists of the following main components: a user terminal, a server, a database, and an emotion engine.

[1928] Hardware and software used

[1929] User's device: A device such as a smartphone or PC on which the user inputs travel-related information and displays the generated travel plan.

[1930] Server: A cloud server (e.g., AWS, Google Cloud) that receives and analyzes user input information and generates a travel plan.

[1931] Database: A database (e.g. MySQL, PostgreSQL) for storing information on transportation, accommodation, tourist attractions, etc.

[1932] Emotion engine: Software that analyzes user emotions and provides that information to a server (e.g., Emotion API, Microsoft Azure Cognitive Services).

[1933] Program processing overview

[1934] The user enters travel-related information and sends it to the server via their device. The server analyzes the input data and retrieves the necessary information from a database. It then generates an optimal travel plan and sends it to the user's device. Next, the emotion engine analyzes the user's reactions and sends emotional information to the server. Based on this emotional information, the travel plan is readjusted and provided to the user again.

[1935] Specific processing of the program

[1936] 1. User input:

[1937] The user uses the device to input travel-related information, such as "Purpose of trip: sightseeing," "Departure date: December 1, 2023," "Destination: Tokyo," "Hotel preference: mid-range, near the station," and "Transportation method: Shinkansen."

[1938] 2. Data transmission and analysis:

[1939] The device sends the user's input data to the server, which then analyzes the received data and searches for and retrieves the necessary information from a database of transportation, accommodation, and tourist attractions.

[1940] 3. Generate itinerary:

[1941] The server generates an optimal travel plan based on the information obtained. For example, it creates a detailed travel plan like this:

[1942] Departure date: December 1st, 8:00 AM Shinkansen

[1943] Hotel: Mid-range hotel near Shinjuku Station

[1944] Sightseeing Schedule: Day 1: Sensoji Temple in the morning, Skytree in the afternoon, Shibuya in the evening

[1945] Gourmet: Tempura lunch in Asakusa, Yakiniku dinner in Shibuya

[1946] 4. Use of Emotion Engine:

[1947] The emotion engine then analyzes the user's emotion and sends the emotion data to the server. For example, if the user inputs "I'm tired," the emotion engine analyzes this as a negative emotion.

[1948] 5. Reconditioning and re-offering:

[1949] Based on the emotion data, the server adjusts the itinerary again. For example, it considers the emotion of "tired" and adjusts it to increase rest time and add relaxation spots. Then, it sends this adjusted itinerary to the terminal and displays it again to the user.

[1950] Examples of concrete examples and prompts

[1951] Examples of specific travel plans:

[1952] Purpose of trip: Sightseeing

[1953] Departure date: December 1, 2023

[1954] Destination: Tokyo

[1955] Hotel preference: Mid-range, near the station

[1956] Transportation: Shinkansen

[1957] Example prompt sentence:

[1958] "Please plan a trip to Tokyo starting on December 1st. I would like to do some sightseeing and stay somewhere mid-range and close to the station. I will be traveling by Shinkansen."

[1959] In this way, the system enables users to plan their trip efficiently and flexibly and enjoy an emotionally optimized travel experience.

[1960] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1961] Step 1:

[1962] User enters travel-related information

[1963] The user uses the terminal to input the purpose of the trip, departure date, destination, preferred hotel, mode of transportation, etc. The input data is saved in the terminal application.

[1964] Input: purpose of trip, departure date, destination, hotel preference, transportation method

[1965] Specific operation: The user enters information such as "tourism," "December 1, 2023," "Tokyo," "mid-range price range, near the station," and "Shinkansen" into the form on the application and presses the submit button.

[1966] Step 2:

[1967] The device sends the user's input data to the server

[1968] The entered data is sent from the device to the server via the Internet, allowing the server to begin analysis.

[1969] Input: User's travel-related information

[1970] Output: Data sent to the server

[1971] Specific operation: The terminal packages the data in JSON format and sends it to the server's API using the HTTPS protocol.

[1972] Step 3:

[1973] The server analyzes the received data

[1974] The server analyzes the information entered by the user and extracts information by category, dividing data such as the purpose of the trip, departure date, destination, hotel preference, and transportation method into separate fields.

[1975] Input: Travel-related information sent from your device

[1976] Output: Data for each analyzed category

[1977] Specific operation: The server parses the JSON data and breaks it down into data fields such as "Purpose of trip: sightseeing," "Departure date: December 1, 2023," "Destination: Tokyo," "Hotel preference: mid-range, near the station," and "Transportation method: Shinkansen."

[1978] Step 4:

[1979] The server retrieves the necessary information from the database

[1980] Based on the analyzed data, the server retrieves information on transportation, accommodations, tourist spots, etc. from a database, providing the base information needed to generate an optimal travel plan.

[1981] Input: Data for each category analyzed

[1982] Output: Transportation, accommodation, and tourist attraction information

[1983] Specific operation: The server issues an SQL query to the database to obtain accommodations that meet the criteria of "Tokyo," "mid-range price range," and "near the station," as well as information on Shinkansen trains departing at 8:00 AM on December 1st, and tourist spots such as Sensoji Temple, Skytree, and Shibuya.

[1984] Step 5:

[1985] The server generates the optimal travel plan

[1986] The system automatically generates an optimal travel plan by integrating all the information obtained from the database, including transportation, schedule, places to visit, and meal plans.

[1987] Input: Transportation, accommodation, and tourist attraction information

[1988] Output: Generated itinerary

[1989] Specific operation: Based on the program logic, the server creates a detailed travel plan such as "Depart on the Shinkansen at 8:00 AM on December 1st," "Stay at a mid-range hotel near Shinjuku Station," "On the first day, visit Sensoji Temple in the morning, Skytree in the afternoon, and Shibuya in the evening," "Tempura lunch in Asakusa, and yakiniku dinner in Shibuya."

[1990] Step 6:

[1991] The server sends the generated travel plan to the terminal.

[1992] The generated travel plan is sent from the server to the terminal, where the user can check the plan.

[1993] Input: Generated itinerary

[1994] Output: Trip plan sent to the device

[1995] Specific operation: The server packages the travel plan in JSON format and sends it to the device's API using the HTTPS protocol.

[1996] Step 7:

[1997] The device displays the travel plan to the user.

[1998] The transmitted travel plan is displayed on the terminal, and the user can check the plan details, thereby learning the contents of the travel plan.

[1999] Input: Submitted travel plan

[2000] Output: Trip plan displayed on the device

[2001] Specific operation: The device parses the JSON data received and displays it on the screen in the form of "Depart on the Shinkansen at 8:00 AM on December 1st," "Stay at a mid-range hotel near Shinjuku Station," "Day 1: Sensoji Temple in the morning, Skytree in the afternoon, Shibuya in the evening," "Tempura lunch in Asakusa, yakiniku dinner in Shibuya," etc.

[2002] Step 8:

[2003] Emotion engine analyzes user reactions

[2004] When a user inputs their thoughts or opinions about the displayed travel plan, the emotion engine analyzes them to generate emotion data, such as emotions like "tired" or "fun."

[2005] Input: User reactions and thoughts

[2006] Output: Parsed emotion data

[2007] Specific behavior: The user types "tired," and the emotion engine analyzes the text to generate negative emotion data.

[2008] Step 9:

[2009] The emotion engine sends the emotion data to the server.

[2010] The generated emotion data is sent from the emotion engine to a server, which uses the information to adjust the travel plan.

[2011] Input: Parsed emotion data

[2012] Output: Emotion data sent to the server

[2013] Specific operation: The emotion engine packages emotion data in JSON format and sends it to the server's API using the HTTPS protocol.

[2014] Step 10:

[2015] The server readjusts the travel plan based on the emotion data.

[2016] The server then adjusts the travel plan based on the emotion data received, for example by increasing rest periods and adding relaxation spots.

[2017] Input: emotion data, original travel plan

[2018] Output: Reworked itinerary

[2019] Specific operation: Based on the emotional data that the server is "tired," it makes adjustments such as increasing break time and adding a "break at a cafe."

[2020] Step 11:

[2021] The server sends the re-arranged travel plan to the device.

[2022] The server sends the re-arranged travel plan to the terminal, allowing the user to review the plan again.

[2023] Input: Re-arranged travel plans

[2024] Output: The adjusted itinerary sent to the device.

[2025] Specific operation: The server packages the re-arranged itinerary in JSON format and sends it to the device's API using the HTTPS protocol.

[2026] Step 12:

[2027] The device displays the re-arranged itinerary to the user.

[2028] The re-adjusted travel plan is displayed on the terminal, and the user confirms the plan again. This provides the user with a travel plan that takes emotions into consideration.

[2029] Input: Submitted rearranged travel plan

[2030] Output: The adjusted itinerary displayed on the device

[2031] Specific behavior: The device parses the received JSON data and displays the re-adjusted plan on the screen.

[2032] In this way, users can efficiently plan their trips and enjoy trip plans that are flexibly adjusted based on real-time emotions.

[2033] (Application example 2)

[2034] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2035] Conventional travel planning systems automatically generate travel plans without considering the user's emotions, which means they are unable to adapt to the user's real-time emotional changes. Furthermore, they are unable to adjust the plan to reflect negative emotions such as stress and fatigue that users experience during the trip, which makes it difficult to fully increase travel satisfaction. This often leaves users dissatisfied with their travel plans.

[2036] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2037] In this invention, the server includes means for inputting user travel-related information, means for transmitting the information to the server, means for analyzing the information and automatically generating a travel plan tailored to the user's preferences, means for transmitting the generated travel plan to the user's terminal, means for displaying the travel plan to the user, means for recognizing the user's emotions in real time, and means for adjusting the travel plan based on the recognized emotions. This makes it possible to flexibly adjust the travel plan according to the user's emotions, thereby increasing the user's travel satisfaction.

[2038] "User's travel-related information" refers to data that the user inputs to plan a trip, such as the purpose of the trip, departure date, destination, preferred accommodation, and means of transportation.

[2039] A "server" is a computer system that analyzes travel-related information submitted by users and generates and adjusts optimal travel plans.

[2040] "Means for automatic generation" refers to the function by which the server autonomously creates an optimal travel plan based on the data input by the user.

[2041] "User's terminal" refers to a device (e.g., smartphone, tablet, or PC) on which a user inputs travel-related information and displays and confirms the generated travel plan.

[2042] "Means for recognizing emotions in real time" refers to technologies (e.g., cameras, sensors, emotion analysis software) that monitor a user's facial expressions and behavior and analyze their current emotional state.

[2043] The "means for adjusting travel plans" is a function that flexibly changes and optimizes existing travel plans based on user sentiment information obtained in real time.

[2044] The present invention relates to a system that enables users to efficiently plan trips and adjust the plans while taking real-time emotions into account. The system for realizing the present invention is composed of a user terminal, a server, a database, and an emotion engine.

[2045] System configuration

[2046] Users input travel-related information using devices such as smartphones or tablets. The input information is sent from the device to a server. The server analyzes the information entered by the user, obtains necessary information (transportation, accommodations, tourist spots, etc.) from a database, and automatically generates an optimal travel plan. The generated travel plan is sent from the server to the device and displayed to the user.

[2047] Furthermore, the system of the present invention includes an emotion engine that recognizes emotions in real time from user inputs and reactions. This emotion information is sent to the server and used to generate and adjust travel plans.

[2048] System Operation

[2049] The emotion engine uses cameras and sensors installed in smart glasses or head-mounted displays (HMDs) to monitor the user's facial expressions and behavior and analyze their current emotional state. The server then adjusts the travel plan accordingly based on the analyzed emotional data. This adjustment can include adding breaks or relaxing areas.

[2050] Usage example

[2051] For example, a user enters the following travel-related information:

[2052] Purpose of trip: Sightseeing

[2053] Departure date: December 1, 2023

[2054] Destination: Tokyo

[2055] Hotel preference: Mid-range, near the station

[2056] Transportation: Shinkansen

[2057] When the user inputs this information into the device and sends it, the device transfers it to the server, which analyzes the information, retrieves information on appropriate transportation, accommodations, and tourist spots from a database, and generates an optimal travel plan.

[2058] The generated itinerary includes the following specific details:

[2059] Departure date: December 1st, 8:00 AM Shinkansen

[2060] Hotel: Mid-range hotel near Shinjuku Station

[2061] Sightseeing Schedule: Day 1: Sensoji Temple in the morning, Skytree in the afternoon, Shibuya in the evening

[2062] Gourmet: Tempura lunch in Asakusa, Yakiniku dinner in Shibuya

[2063] The generated itinerary is sent to the device, where the user can view it. If the user expresses a negative emotion such as "tired" about the displayed itinerary, the emotion engine analyzes the emotion and sends it to the server. The server takes the emotion data into account and readjusts the itinerary, for example, by increasing rest time or adding relaxation spots.

[2064] As an example of a specific prompt, if the user wants to change the location they are visiting, they would enter:

[2065] "Change request: Please suggest other tourist spots in Tokyo instead of Sensoji Temple."

[2066] If you want to add a place where users can relax, type:

[2067] "Sentiment analysis results: 'I'm tired'. Please add a place where you can relax to your visit."

[2068] In this way, users can flexibly plan their travel plans according to their real-time emotions, thereby increasing the satisfaction of their travel experience.

[2069] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2070] Step 1:

[2071] The user inputs travel-related information using a device such as a smartphone or tablet. This information includes the purpose of the trip, departure date, destination, preferred hotel, mode of transportation, etc. This information is then sent from the device to the server.

[2072] Step 2:

[2073] The server receives the travel-related information sent from the device and analyzes the data. During the analysis, the server searches and retrieves the necessary information from a database (transportation, accommodation, tourist spots) based on the user's preferences.

[2074] Step 3:

[2075] The server automatically generates an optimal travel plan based on the acquired information, including specific details of transportation, accommodation, daily schedule, meal plan, etc. The travel plan is then sent from the server to the device.

[2076] Step 4:

[2077] The terminal receives the itinerary sent from the server and displays it to the user, who then checks the displayed itinerary and inputs any necessary revision requests, which are also sent from the terminal to the server.

[2078] Step 5:

[2079] Cameras and sensors installed in the user's smart glasses or head-mounted display (HMD) monitor the user's facial expressions and behavior to obtain real-time emotional data, which is then transmitted to a server via the device.

[2080] Step 6:

[2081] The emotion engine analyzes the user's emotional data. Specifically, it reads the user's emotions from their facial expressions and voice and determines whether they are positive (e.g., happy, excited) or negative (e.g., tired, stressed). The analysis results are sent to the server.

[2082] Step 7:

[2083] The server adjusts the itinerary based on the emotional data analyzed by the emotion engine and the user's requests for modifications. For example, if there is a lot of negative emotional data, the server may increase rest time or add relaxation spots.

[2084] Step 8:

[2085] The server sends the new adjusted travel plan to the terminal, which displays it to the user, who confirms the re-adjusted plan and continues traveling.

[2086] Through these steps, users can achieve a more satisfying travel experience. The system can adjust travel plans in real time according to users' emotions.

[2087] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2088] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2089] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2090] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2091] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[2092] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[2093] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[2094] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[2095] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[2096] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[2097] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[2098] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[2099] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[2100] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[2101] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[2102] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[2103] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[2104] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[2105] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[2106] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[2107] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[2108] The following is further disclosed regarding the above embodiment.

[2109] (Claim 1)

[2110] a means for a user to input travel-related information;

[2111] means for transmitting the information to a server;

[2112] means for analyzing the information and automatically generating a travel plan tailored to the user's wishes;

[2113] means for transmitting the generated travel plan to a user's terminal;

[2114] The system includes means for displaying the travel plan to a user.

[2115] (Claim 2)

[2116] 2. The system according to claim 1, further comprising means for acquiring information from a database of transportation means, accommodations, and tourist attractions, and generating an optimal plan based on the user's wishes.

[2117] (Claim 3)

[2118] 10. The system of claim 1, further comprising means for receiving a user's request for modification and re-adjusting the travel plan.

[2119] "Example 1"

[2120] (Claim 1)

[2121] a means for a user to input travel-related information;

[2122] means for transmitting the information to a server;

[2123] means for analyzing the information and automatically generating a travel plan tailored to the user's wishes;

[2124] means for transmitting the generated travel plan to a user's terminal;

[2125] means for displaying the travel plan to a user;

[2126] The system includes means for receiving a user's request for modification and re-adjusting the travel plan.

[2127] (Claim 2)

[2128] 2. The system according to claim 1, further comprising means for acquiring information from a database of transportation means, accommodations, and tourist attractions, and generating an optimal plan based on the user's wishes.

[2129] (Claim 3)

[2130] 10. The system of claim 1, further comprising means for analyzing the information and using a generative AI model to automatically generate a specific travel plan based on the user's preferences.

[2131] "Application Example 1"

[2132] (Claim 1)

[2133] a means for a user to input travel-related information;

[2134] means for transmitting the information to a server;

[2135] means for analyzing the information and automatically generating a travel plan tailored to the user's wishes;

[2136] means for transmitting the generated travel plan to a user's terminal;

[2137] means for displaying the travel plan to a user;

[2138] means for providing real-time guidance to the user during the journey;

[2139] means for displaying the generated itinerary on the user's smart glasses;

[2140] A system that includes a means for presenting information on tourist attractions and dining establishments in real time.

[2141] (Claim 2)

[2142] 2. The system according to claim 1, further comprising means for acquiring information from a database of transportation means, accommodations, and tourist attractions, and generating an optimal plan based on the user's wishes.

[2143] (Claim 3)

[2144] 10. The system of claim 1, further comprising means for receiving a user's request for modification and re-adjusting the travel plan.

[2145] "Example 2: Combining Emotion Engines"

[2146] (Claim 1)

[2147] a means for a user to input travel-related information;

[2148] means for transmitting the information to a server;

[2149] means for analyzing the information and automatically generating a travel plan tailored to the user's wishes;

[2150] means for transmitting the generated travel plan to a user's terminal;

[2151] means for displaying the travel plan to a user;

[2152] A means for analyzing emotions from user inputs and reactions and optimizing travel plans based on the emotional information;

[2153] The system includes a means for re-adjusting travel plans based on the user's emotions.

[2154] (Claim 2)

[2155] 2. The system according to claim 1, further comprising means for acquiring information from a database of transportation means, accommodations, and tourist attractions, and generating an optimal plan based on the user's wishes.

[2156] (Claim 3)

[2157] 10. The system of claim 1, further comprising means for receiving the user's revision request and sentiment analysis data and adjusting the travel plan again.

[2158] "Application example 2 when combining emotion engines"

[2159] (Claim 1)

[2160] a means for a user to input travel-related information;

[2161] means for transmitting the information to a server;

[2162] means for analyzing the information and automatically generating a travel plan tailored to the user's wishes;

[2163] means for transmitting the generated travel plan to a user's terminal;

[2164] means for displaying the travel plan to a user;

[2165] a means for recognizing a user's emotions in real time;

[2166] The system includes a means for adjusting travel plans based on the recognized emotions.

[2167] (Claim 2)

[2168] 2. The system according to claim 1, further comprising means for acquiring information from a database of transportation means, accommodations, and tourist attractions, and generating an optimal plan based on the user's wishes.

[2169] (Claim 3)

[2170] 10. The system of claim 1, further comprising means for receiving a user's request for modification and re-adjusting the travel plan. [Explanation of symbols]

[2171] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. a means for a user to input travel-related information; means for transmitting the information to a server; means for analyzing the information and automatically generating a travel plan tailored to the user's wishes; means for transmitting the generated travel plan to a user's terminal; The system includes means for displaying the travel plan to a user.

2. 2. The system according to claim 1, further comprising means for acquiring information from a database of transportation means, accommodations, and tourist attractions, and generating an optimal plan based on the user's wishes.

3. 10. The system of claim 1, further comprising means for receiving a user's request for modification and re-adjusting the travel plan.

Images