System

Abstract

A system is provided.SOLUTION: A system comprising: means for receiving traveler input information; means for obtaining relevant city data based on the traveler input information; means for integrating the relevant city data and the traveler input information to generate an optimal travel plan; and means for providing the optimal travel plan to a traveler.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Today's travelers spend a lot of time and effort selecting travel destinations and creating detailed travel plans. In addition, the proliferation of various comparison sites makes it difficult to properly organize the necessary information, which often leaves travelers feeling stressed and makes travel preparations complicated. Therefore, there is a need for a system that allows travelers to efficiently create ideal travel plans. [Means for solving the problem]

[0005] To solve this problem, the present invention provides the following means: a means for receiving input information from a traveler and acquiring related city data based on the received information; a means for integrating the acquired city data with the traveler's input information to generate an optimal itinerary, and a means for providing the generated itinerary to the traveler; a means for monitoring the traveler's location information and the latest local information during the trip, and updating the itinerary in real time based on the information; and a means for analyzing the input information on the travel destination, budget, traveling companions, and values, and selecting optimal tourist attractions, events, restaurants, and hotels based on the analysis results, and sequencing these to optimize transportation methods and timetables. This allows travelers to easily plan and execute efficient and ideal itineraries.

[0006] "Traveler input information" refers to information that a traveler inputs into the application to plan a trip, including destination, budget, travel companions, values, etc.

[0007] "Related city data" refers to various data related to a particular city, such as information about tourist attractions, events, restaurants, hotels, etc.

[0008] The "optimal travel plan" is an ideal travel plan for a traveler generated by AI based on the traveler's input information and related city data, and includes places to visit, events, accommodation, transportation, etc.

[0009] The term "means for providing a travel plan" refers to a method for displaying or transmitting the generated optimal travel plan to a traveler.

[0010] "Location information" is data indicating the current location of a traveler, and is obtained using GPS or the like.

[0011] "Local latest information" refers to information that indicates the current situation at the travel destination, including weather, traffic conditions, changes in events, and the like.

[0012] "Real-time update methods" refers to methods for changing and amending travel plans on the spot in a timely manner based on the latest local information and traveler location information.

[0013] "Means for optimizing travel modes and timetables" refers to methods for selecting travel modes and adjusting time schedules so that travelers visit their destinations in the optimal order. [Brief explanation of the drawings]

[0014] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0015] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0016] First, the terms used in the following description will be explained.

[0017] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0018] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0019] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0020] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0022] [First embodiment]

[0023] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0024] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0025] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0027] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0029] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0030] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0032] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0034] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0035] MODE FOR CARRYING OUT THE INVENTION

[0036] System Overview

[0037] The present invention provides a system that enables travelers to efficiently plan their ideal itinerary. Specifically, it provides a method and apparatus for generating an optimal itinerary based on information input by the traveler. The system includes a terminal that receives the traveler's input information, a server that acquires city data and generates an optimal itinerary, and a function for providing and updating the itinerary.

[0038] Program processing

[0039] User Input Phase

[0040] 1. A user launches the travel application and enters their login information on the login screen, or if they are a new user, enters the required information on the registration screen.

[0041] 2. After authenticating the user, the terminal displays a form for entering travel information.

[0042] 3. The user enters information such as destination, budget, travel companions, and values, and presses the send button.

[0043] 4. The terminal sends the user's input information to the server.

[0044] Data Processing Phase

[0045] 1. The server analyzes the input information received from the user.

[0046] 2. The server accesses the city database and retrieves data related to the entered destination (tourist attractions, events, restaurants, hotels, etc.).

[0047] 3. The server integrates the acquired city data with the user's input information and uses an AI algorithm to generate an optimal travel plan.

[0048] 4. The server sends the generated travel plan to the terminal.

[0049] Show Plan Phase

[0050] 1. The terminal displays the travel plan received from the server on the user interface.

[0051] 2. The user is presented with an interface that allows them to review the displayed itinerary and fine-tune the plan if necessary.

[0052] 3. The device sends the user's fine-tuning information to the server, which then re-plans.

[0053] 4. The server sends the updated itinerary to the terminal, which displays it again to the user.

[0054] Real-time Support Phase

[0055] 1. The server monitors the location and latest information (weather, event changes, etc.) of travelers during their trip.

[0056] 2. The travel plan is updated in real time based on the latest information obtained by the server.

[0057] 3. The server sends updated plans and important alert information to the device.

[0058] 4. The device notifies the user of updates and alerts received from the server.

[0059] Specific examples

[0060] For example, suppose a user inputs "Tokyo," "budget 100,000 yen," "traveling companion: friend," and "value: cultural experience." In this case, the server retrieves data on tourist attractions, events, restaurants, and hotels related to Tokyo. Next, it generates a plan that emphasizes the user's cultural experiences and proposes it to the user. This plan might include Sensoji Temple in Asakusa, a kabuki performance, and a traditional craft experience. Furthermore, if it suddenly rains in the area, the server will reflect the local weather information and suggest changing the user's plans to indoor activities.

[0061] In this way, the present invention provides a system that allows travelers to efficiently plan optimal travel plans and receive real-time support during their trip.

[0062] The processing flow will be explained below.

[0063] User Input Phase

[0064] Step 1:

[0065] The user launches the travel application and enters their login information into the login screen.

[0066] Step 2:

[0067] The terminal performs user authentication, and if the authentication is successful, sends the user information to the server.

[0068] Step 3:

[0069] The server checks the user information against an authentication database, and if authentication is successful, returns an authentication success message to the terminal.

[0070] Step 4:

[0071] The terminal receives the authentication success message and displays a form for the user to enter travel information.

[0072] Step 5:

[0073] The user enters information such as destination, budget, travel companions, and values ​​into the form and presses the submit button.

[0074] Step 6:

[0075] The terminal transmits the user's input information to the server.

[0076] Data Processing Phase

[0077] Step 1:

[0078] The server analyzes the input information received from the user.

[0079] Step 2:

[0080] The server accesses a city database to retrieve data related to the entered destination (tourist attractions, events, restaurants, hotels, etc.).

[0081] Step 3:

[0082] The server combines the city data it has acquired with the user's input information and uses an AI algorithm to generate an optimal travel plan.

[0083] Step 4:

[0084] The server transmits the generated itinerary to the terminal.

[0085] Show Plan Phase

[0086] Step 1:

[0087] The terminal displays the travel plan received from the server on a user interface.

[0088] Step 2:

[0089] The user confirms the displayed itinerary.

[0090] Step 3:

[0091] The user can then fine-tune the plan as needed and hit send again.

[0092] Step 4:

[0093] The device sends the user's fine-tuning details to the server.

[0094] Step 5:

[0095] The server receives the user's tweaks and re-plans.

[0096] Step 6:

[0097] The server sends the updated itinerary to the terminal.

[0098] Step 7:

[0099] The terminal displays the replanned itinerary again to the user.

[0100] Real-time Support Phase

[0101] Step 1:

[0102] The server monitors the location information of travelers in real time during their trip.

[0103] Step 2:

[0104] The server retrieves local updates (weather, traffic, event changes, etc.).

[0105] Step 3:

[0106] Travel plans are updated in real time based on the latest information obtained by the server.

[0107] Step 4:

[0108] The server sends updated travel plans and important alert information to the device.

[0109] Step 5:

[0110] The device notifies the user of updates and alerts received from the server.

[0111] Through these steps, users can efficiently create optimal travel plans and receive real-time support during their trip.

[0112] Example 1

[0113] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0114] Conventional travel planning systems can generate travel plans based on information entered by the user, but they have difficulty obtaining appropriate city data and generating optimal travel plans that match the user's values. Furthermore, they have problems in that they are unable to provide real-time support during the trip or flexibly respond to external conditions (such as weather changes or event cancellations). The purpose of this invention is to solve these problems, efficiently plan the ideal travel plan for travelers, and provide real-time support.

[0115] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0116] In this invention, the server includes a means for receiving traveler input information, a means for acquiring related city data, and a means for generating an optimal travel plan using an artificial intelligence algorithm. This allows for effective acquisition of city data based on the information entered by the traveler, enabling the generation of an optimal travel plan suited to the user's values ​​and requirements. The server also monitors the traveler's location information and latest information during the trip, and updates the travel plan in real time based on this information, thereby enabling flexible responses during the trip. Furthermore, by accepting traveler adjustments and re-planning, it is possible to provide a flexible travel plan that meets the user's requests.

[0117] "Traveler input information" refers to information about personal preferences and requirements provided by a traveler to plan a trip, such as travel destination, budget, travel companions, and values.

[0118] "City data" is information related to a specific city, such as tourist attractions, events, restaurants, and accommodations, and is data used to create travel plans.

[0119] "Artificial intelligence algorithms" are algorithms that include techniques such as machine learning and deep learning, which are used to analyze massive amounts of data and generate optimal travel plans.

[0120] "User Interface" means the software and hardware interfaces that provide the screens and controls used by travelers to view, edit, and update their travel plans.

[0121] "Location information" is data used to identify the geographic location of a particular individual or object using technologies such as GPS.

[0122] "Latest information" refers to real-time information that is important to travelers, such as weather forecasts, event changes, and traffic conditions.

[0123] "Real-time updates" means quickly changing travel plans in response to changes in external conditions that occur during the trip (such as weather changes or event cancellations).

[0124] "Notify" means informing travelers of travel plan updates and important information via their device.

[0125] "Tweaks" are small modifications made by travelers to change some of their plans or to reflect additional requests.

[0126] MODE FOR CARRYING OUT THE INVENTION

[0127] System Overview

[0128] The present invention is a system for enabling travelers to create efficient and ideal travel plans. This system generates, displays, and updates an optimal travel plan based on information input by the traveler. It includes a means for receiving the traveler's input information, a means for acquiring city data, a means for integrating the acquired data with the traveler's input information and generating an optimal travel plan using an artificial intelligence algorithm, and a means for providing the traveler with the travel plan and fine-tuning it.

[0129] Hardware and software used

[0130] 1. Server: Responsible for data processing, accessing the city database, and generating and updating travel plans. Software used includes a natural language processing engine and generative AI models (such as Tensorflow (registered trademark) and PyTorch). The hardware is expected to be a cloud service (such as an AWS (registered trademark) EC2 instance).

[0131] 2. Terminal: The terminal is used to input information, display travel plans, and make fine adjustments through the user interface. Front-end software such as React or Vue.js is used.

[0132] 3. Database: A database such as MongoDB is used to store city data (tourist attractions, events, hotels, restaurants, etc.).

[0133] 4. GPS devices: Used to obtain and monitor the location of travelers.

[0134] Program processing

[0135] 1. The user launches the travel application on their device and enters their login information. If they are a new user, they enter the required information on the registration screen.

[0136] 2. After authenticating the user, the device displays a travel information input form, where the user enters information such as destination, budget, travel companions, and values, and submits it.

[0137] 3. The device sends the input information to the server, which analyzes the input information and accesses the city database to retrieve relevant city information.

[0138] 4. The server integrates the acquired city data with the user's input information and generates an optimal travel plan using a generative AI model.

[0139] 5. The server sends the generated itinerary to the terminal, which displays it on the user interface.

[0140] 6. The user checks the itinerary and makes any necessary adjustments. The device sends the changes to the server, which then re-plans and sends the updated itinerary back to the device.

[0141] Real-time Support

[0142] 1. The server monitors the location information of the traveler through the GPS device during the trip, and obtains the traveler's location information and the latest weather and event change information in real time.

[0143] 2. The server updates the travel plan in real time based on the latest information and sends the updated information to the device.

[0144] 3. The terminal notifies the user interface of the updated information received from the server, allowing the user to review the plan based on the new information.

[0145] Examples and prompts

[0146] For example, if a user inputs "Tokyo," "budget 100,000 yen," "traveling companion: friend," and "value: cultural experience," the server retrieves city data related to Tokyo (information on tourist attractions, events, restaurants, and hotels) and generates an optimal travel plan that emphasizes cultural experiences. This travel plan includes a visit to Sensoji Temple, a kabuki performance, and a traditional craft experience.

[0147] If the weather worsens in Tokyo during a trip, the server retrieves the weather forecast in real time, generates an updated itinerary that changes outdoor activities to indoor activities, such as visiting a museum or an indoor art gallery, and notifies the user.

[0148] Prompt Sentence Examples

[0149] "Travel planning assistant. The user is planning a trip to Tokyo with a budget of ¥100,000, friends as companions, and cultural experiences as their value. Create a travel plan that suggests appropriate tourist spots and activities and adapts to changing weather conditions."

[0150] In this way, the present invention provides a system that allows travelers to efficiently plan optimal travel plans and receive real-time support during their trip.

[0151] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0152] Step 1:

[0153] A user launches a travel application and enters their login information. If they are a new user, they enter the required information, such as their name, email address, and password, on the registration screen. The information they enter is processed as input data on their device and sent to the server.

[0154] Input: User login or registration information

[0155] Output: Authentication request data from the device to the server

[0156] Specific behavior:

[0157] A user launches an application on their smartphone or PC and goes to the login screen. They enter their email address and password. If they are a new user, they enter the required registration information into the form.

[0158] Step 2:

[0159] The server authenticates the login information it receives, searching the database for authentication if the user is already there, or adding the information to the database if the user is new.

[0160] Input: Login or registration information sent from your device

[0161] Output: Authentication result (success / failure) and user data when authentication is successful

[0162] Specific behavior:

[0163] The server checks the login information using a database (for example, MySQL (registered trademark) or MongoDB) and performs authentication. If authentication is successful, it generates and returns a token to proceed to the next step.

[0164] Step 3:

[0165] After authenticating the user, the terminal displays a travel information input form, in which the user enters detailed information such as destination, budget, travel dates, travel companions, and values, and submits the form.

[0166] Input: User data after successful authentication

[0167] Output: Trip information entered by the user

[0168] Specific behavior:

[0169] The user enters travel preferences such as destination, budget, companions, and values ​​into the displayed travel information input form, and presses the send button to send the information to the server.

[0170] Step 4:

[0171] The terminal sends the user's input information to the server, which receives the input information and begins analyzing it.

[0172] Input: User's travel information

[0173] Output: Trip information sent to the server

[0174] Specific behavior:

[0175] The terminal sends the user's input information as an HTTP request to the server, which receives it and starts processing the data.

[0176] Step 5:

[0177] The server analyzes the received user travel information and converts it into structured data using a natural language processing engine.

[0178] Input: User's travel information

[0179] Output: Structured travel information

[0180] Specific behavior:

[0181] The server receives the user's input information and uses a natural language processing engine to analyze and convert it into the necessary data. For example, information such as "cultural experience" or "budget of 100,000 yen" is analyzed and converted into an internal data structure.

[0182] Step 6:

[0183] The server accesses a city database and retrieves city data such as tourist attractions, events, restaurants, and accommodations related to the destination entered by the user.

[0184] Input: Structured travel information (e.g., destination)

[0185] Output: City data (tourist attractions, events, restaurants, accommodations, etc.)

[0186] Specific behavior:

[0187] The server connects to a city database (e.g. MongoDB) and queries and retrieves information about attractions, events, restaurants, and accommodations based on the destination.

[0188] Step 7:

[0189] The server integrates the acquired city data with the user's structured data and generates an optimal travel plan using a generative AI model.

[0190] Input: City data and structured travel information

[0191] Output: Optimal travel plan

[0192] Specific behavior:

[0193] The server integrates the city data it acquires with user information, and uses a generative AI model built with TensorFlow and PyTorch to generate an optimal travel plan based on the user's requests and conditions.

[0194] Step 8:

[0195] The server transmits the generated itinerary to the terminal, which displays it on a user interface.

[0196] Input: Best Travel Planner

[0197] Output: Travel plan display data

[0198] Specific behavior:

[0199] The server generates the itinerary and sends it to the device in a structured format. The device receives this data and displays it in a user interface using React and Vue.js.

[0200] Step 9:

[0201] The user checks the displayed itinerary and makes any necessary adjustments. The adjustments are entered and sent to the server by the device.

[0202] Input: User tweaks

[0203] Output: Fine-tuned trip information

[0204] Specific behavior:

[0205] The user checks the travel plan, changes some of the plans, or enters new requests. The terminal sends this information to the server.

[0206] Step 10:

[0207] The server re-plans based on the fine-tuning information received from the user, generates an updated itinerary, and sends it to the terminal, which displays it again on the user interface.

[0208] Input: Fine-tuned travel information

[0209] Output: Updated itinerary

[0210] Specific behavior:

[0211] The server again uses its AI algorithm to generate a new itinerary based on the user's tweaks, which the device receives and displays the updated itinerary.

[0212] Step 11:

[0213] The server monitors the location of travelers during their trip via their GPS devices and obtains the latest information on weather, event changes, etc.

[0214] Input: Traveler location, weather updates, event changes

[0215] Output: Latest travel plan updates

[0216] Specific behavior:

[0217] The server obtains the traveler's GPS data and collects the latest information from weather APIs, event APIs, etc.

[0218] Step 12:

[0219] The server updates the travel plan in real time based on the latest information, and the device displays the updated information on the user interface and sends push notifications as needed.

[0220] Input: Latest travel plan update

[0221] Output: User notification

[0222] Specific behavior:

[0223] The server automatically updates the travel plan based on the latest information and sends it to the device, which receives it, displays it on the user interface, and notifies the user via push notifications, etc.

[0224] (Application example 1)

[0225] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0226] Traditional travel planning systems are unable to provide an appropriate combination of travelers' dining preferences and local food delivery data. As a result, travelers have to spend time finding the best dining options at their destinations, which can lead to a lower quality trip. They also lack real-time food delivery recommendations based on the latest local information, resulting in a lack of planning flexibility, making it difficult for travelers to enjoy truly satisfying dining experiences during their trips.

[0227] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0228] In this invention, the server includes means for receiving input information from a traveler, means for acquiring related city data based on the traveler's input information, means for integrating the related city data with the traveler's input information to generate an optimal travel plan, means for acquiring local food service facility data based on the optimal travel plan and integrating the data with the traveler's preferences to generate food delivery recommendations, means for providing the recommended food delivery information to the traveler, and means for updating the food delivery recommendations in real time based on the traveler's current location information. This allows travelers to easily find the optimal food delivery options for their destinations. Furthermore, real-time plan updates allow travelers to enjoy an optimal dining experience tailored to the latest conditions.

[0229] "Traveller" means an individual or group that plans and undertakes a trip.

[0230] "Input Information" refers to data such as destination, budget, travel companions, values, and preferences that a traveler provides to generate a travel plan.

[0231] "City Data" means information about attractions, events, restaurants, hotels, transportation, and other information about a particular city.

[0232] "Optimal travel plan" refers to a travel schedule generated based on the traveler's input information and city data to best meet the traveler's requirements.

[0233] "Dining Facility Data" refers to information about restaurants, cafes, food delivery services, etc. within a particular area.

[0234] "Food Delivery Recommendations" refers to information recommending specific dining options or delivery services based on a traveler's preferences and current circumstances.

[0235] "Traveler's current location information" refers to geographic information indicating the location where the traveler is actually moving.

[0236] "Real-time updates" refers to the process of instantly modifying or changing travel plans or recommendations based on current, up-to-date information.

[0237] System Overview

[0238] This invention is a system that enables travelers to enjoy optimal food delivery at their destinations. Specifically, it generates an optimal travel plan based on the traveler's input information, acquires data on local food establishments based on the plan, and recommends food delivery options that match the traveler's preferences. It also monitors location information in real time and provides the traveler with the latest travel plans and food delivery recommendations.

[0239] Program processing

[0240] User Input Phase

[0241] Users log in using a device such as a smartphone or tablet and enter their travel information, including their destination, budget, travel companions, values, preferences, etc. This information is then sent from the device to the server.

[0242] Data Processing Phase

[0243] The server uses software such as Python and the Requests library to perform the following tasks:

[0244] 1. Parse the input information received from the user.

[0245] 2. Obtain data on tourist attractions, events, restaurants, hotels, etc. from a city database.

[0246] 3. The acquired city data and user input information are input into a generative AI model to generate an optimal travel plan.

[0247] 4. Based on the travel plan, local dining establishment data is retrieved and integrated with the user's preferences to generate food delivery recommendations.

[0248] Show Plan Phase

[0249] The device displays the travel plan and food delivery recommendations received from the server on the user interface. The user checks the displayed plan and makes adjustments as necessary. The device sends the user's adjustments to the server, which then re-plans. The updated plan and recommendations are sent back to the device and displayed to the user.

[0250] Real-time Support Phase

[0251] The server monitors the traveler's real-time location and local updates (weather, event changes, etc.). Based on these updates, it updates travel plans and food delivery recommendations in real time and notifies the device. Users can receive these updates via their smartphone or tablet and take appropriate action.

[0252] Specific examples of programs

[0253] For example, if a traveler enters "Tokyo," "budget of 100,000 yen," "traveling companion: friends," "values: cultural experiences," and "preferences: vegetarian food," the server will retrieve data on vegetarian-friendly restaurants along with data on tourist attractions and events in Tokyo, and generate optimal travel plans and food delivery recommendations. During the travel period, for example, if the traveler is in Asakusa, it will recommend delivery of "Japanese vegetarian food." Also, if it suddenly rains in the area, the server will reflect the weather information and change the traveler's plans to indoor activities, and re-suggest meals that can be enjoyed indoors.

[0254] Prompt Sentence Examples

[0255] "Destination: Tokyo, Duration: 5 days, Budget: 20,000 yen, Number of people: 2. Please recommend a local vegetarian restaurant and its menu."

[0256] As described above, the present invention provides a system that allows travelers to easily plan optimal dining experiences and travel plans and receive real-time support during their trip.

[0257] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0258] Step 1:

[0259] The user launches the travel application and enters their login information on the login screen. If they are a new user, they enter the required information on the registration screen. The entered information is sent from the device to the server. Based on the input, the server authenticates the user. If authentication is successful, the travel information input form is displayed on the device.

[0260] Step 2:

[0261] The user enters travel information such as destination, budget, travel companions, values, and preferences, and then presses the send button. The entered data is sent from the device to the server. The server analyzes the received information and extracts the traveler's preferences and requests. This analysis includes data processing such as natural language processing.

[0262] Step 3:

[0263] The server accesses the city database and retrieves data related to the entered destination (tourist attractions, events, restaurants, hotels, etc.). This database can be, for example, MongoDB or PostgreSQL. The retrieved data is temporarily stored.

[0264] Step 4:

[0265] The server integrates the city data acquired with the user's input information and uses a generative AI model to generate an optimal travel plan. Specifically, it selects tourist attractions, events, and restaurants based on the user's values ​​and preferences, and optimizes the timetable and transportation methods. For example, GPT-3 (registered trademark) is used as the generative AI model.

[0266] Step 5:

[0267] Based on the optimal itinerary, the server retrieves local dining establishment data, integrates it with the user's preferences, and generates food delivery recommendations. For example, it uses automated queries to retrieve data from a local restaurant API and filters it against the user's preferences.

[0268] Step 6:

[0269] The server sends the generated travel plans and food delivery recommendations to the device, which displays the received information on a user interface. The user can review the proposed travel plans and food delivery recommendations and make adjustments as needed.

[0270] Step 7:

[0271] The user's refinements are sent to the server, which then re-generates the itinerary. The updated itinerary is then sent back to the device and displayed again, allowing the user to receive optimal itinerary and food delivery recommendations in real time.

[0272] Step 8:

[0273] During the trip, the server monitors the user's location information and the latest local information (weather, event changes, etc.). The current location information is periodically sent to the server as GPS data, and the server takes the appropriate action based on that information.

[0274] Step 9:

[0275] The server updates travel plans and food delivery recommendations in real time based on the latest information it receives, again using the AI ​​model to adjust plans to accommodate changes in weather or event cancellations, for example.

[0276] Step 10:

[0277] The server sends updated plans and important alert information to the device, which then notifies the user, allowing the user to receive real-time updates on travel plans and food delivery information and make appropriate changes.

[0278] As described above, this system provides advanced support for users to enjoy an optimal experience during their trip. Through specific actions and data processing, it is possible to provide appropriate and timely travel plans and food delivery recommendations.

[0279] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0280] MODE FOR CARRYING OUT THE INVENTION

[0281] System Overview

[0282] The present invention provides a system that enables travelers to efficiently plan their ideal itinerary, and in particular has the function of recognizing the travelers' emotions and reflecting them in the itinerary. Specifically, it provides a method and apparatus for generating an optimal itinerary based on the travelers' input information and further personalizing the itinerary by analyzing the travelers' real-time and past emotional data. The system includes a terminal that receives the travelers' input information, a server that acquires city data and generates an optimal itinerary, an emotion engine, and a function for providing and updating the itinerary.

[0283] Program processing

[0284] User Input Phase

[0285] 1. A user launches the travel application and enters their login information on the login screen, or if they are a new user, enters the required information on the registration screen.

[0286] 2. After authenticating the user, the terminal displays a form for entering travel information.

[0287] 3. The user enters information such as destination, budget, travel companions, and values ​​into the form and presses the submit button.

[0288] 4. The terminal sends the user's input information to the server.

[0289] Data Processing Phase

[0290] 1. The server analyzes the input information received from the user.

[0291] 2. The server accesses the city database and retrieves data related to the entered destination (tourist attractions, events, restaurants, hotels, etc.).

[0292] 3. The server integrates the acquired city data with the user's input information and uses an AI algorithm to generate an optimal travel plan.

[0293] 4. The server sends the generated travel plan to the terminal.

[0294] Emotion engine processing

[0295] Acquiring and analyzing emotion data

[0296] 1. The device acquires real-time emotional data of travelers using facial recognition and voice analysis technologies.

[0297] 2. The device sends the acquired emotion data to the server.

[0298] 3. The server analyzes the real-time emotional data and determines the traveler's current emotional state.

[0299] 4. The server analyzes the data, including past emotional data, and determines how to adjust the travel plan.

[0300] Emotion-based travel planning adjustments

[0301] 1. The server recommends activities and hotels that can help travelers relax if they are feeling stressed.

[0302] 2. The server adjusts the travel plan to add more exciting activities if the traveler is excited.

[0303] 3. The server sends the adjusted itinerary to the terminal.

[0304] 4. The device displays the adjusted itinerary and activities on the user interface.

[0305] Real-time Support Phase

[0306] 1. The server continuously monitors the location information and real-time emotion data of travelers during their trip.

[0307] 2. The server retrieves local updates (weather, traffic, event changes, etc.) and emotion data.

[0308] 3. The server updates the travel plan in real time based on the latest local information and sentiment data.

[0309] 4. The server sends updated travel plans and important alert information to the device.

[0310] 5. The device notifies the user of updates and alerts received from the server.

[0311] Specific examples

[0312] For example, suppose a user inputs "Tokyo," "budget 100,000 yen," "traveling companion: friend," and "value: cultural experience." In this case, the server retrieves data on tourist attractions, events, restaurants, and hotels related to Tokyo. Next, it generates a plan that emphasizes the user's cultural experience and proposes it to the user. This plan includes visits to Sensoji Temple in Asakusa, a kabuki performance, and a traditional craft experience.

[0313] Furthermore, if the user begins to feel stressed during the trip, the server will detect this state using the emotion engine and adjust the travel plan by suggesting additional activities such as relaxing cafes or hot springs, allowing the user to enjoy the entire trip more comfortably.

[0314] In this way, the present invention provides a system that enables travelers to efficiently plan optimal travel plans and receive emotion-based real-time support during their trip.

[0315] The processing flow will be explained below.

[0316] User Input Phase

[0317] Step 1:

[0318] The user launches the travel application and enters their login information into the login screen.

[0319] Step 2:

[0320] The terminal performs user authentication, and if the authentication is successful, sends the user information to the server.

[0321] Step 3:

[0322] The server checks the user information against an authentication database, and if authentication is successful, returns an authentication success message to the terminal.

[0323] Step 4:

[0324] The terminal receives the authentication success message and displays a form for the user to enter travel information.

[0325] Step 5:

[0326] The user enters information such as destination, budget, travel companions, and values ​​into the form and presses the submit button.

[0327] Step 6:

[0328] The terminal transmits the user's input information to the server.

[0329] Data Processing Phase

[0330] Step 1:

[0331] The server analyzes the input information received from the user.

[0332] Step 2:

[0333] The server accesses a city database to retrieve data related to the entered destination (tourist attractions, events, restaurants, hotels, etc.).

[0334] Step 3:

[0335] The server combines the city data it has acquired with the user's input information and uses an AI algorithm to generate an optimal travel plan.

[0336] Step 4:

[0337] The server transmits the generated itinerary to the terminal.

[0338] Show Plan Phase

[0339] Step 1:

[0340] The terminal displays the travel plan received from the server on a user interface.

[0341] Step 2:

[0342] The user confirms the displayed itinerary.

[0343] Step 3:

[0344] The user can then fine-tune the plan as needed and hit send again.

[0345] Step 4:

[0346] The device sends the user's fine-tuning details to the server.

[0347] Step 5:

[0348] The server receives the user's tweaks and re-plans.

[0349] Step 6:

[0350] The server sends the updated itinerary to the terminal.

[0351] Step 7:

[0352] The terminal displays the replanned itinerary again to the user.

[0353] Emotion engine processing

[0354] Acquiring and analyzing emotion data

[0355] Step 1:

[0356] The device will acquire real-time emotional data from travelers using facial recognition and voice analysis technologies.

[0357] Step 2:

[0358] The emotion data acquired by the terminal is transmitted to the server.

[0359] Step 3:

[0360] The server analyzes real-time emotional data to determine the traveler's current emotional state.

[0361] Step 4:

[0362] The server analyzes the data, including past emotional data, and determines how to adjust the travel plan.

[0363] Emotion-based travel planning adjustments

[0364] Step 1:

[0365] The server will recommend relaxing activities and hotels if the traveler is feeling stressed.

[0366] Step 2:

[0367] The server adjusts the itinerary to add more exciting activities if the traveler is excited.

[0368] Step 3:

[0369] The server sends the adjusted itinerary to the terminal.

[0370] Step 4:

[0371] The device displays the adjusted itinerary and activities on a user interface.

[0372] Real-time Support Phase

[0373] Step 1:

[0374] The server monitors the location information of travelers in real time during their trip.

[0375] Step 2:

[0376] The server retrieves local updates (weather, traffic, event changes, etc.) and emotion data.

[0377] Step 3:

[0378] The travel plan is updated in real time based on the latest information and emotion data obtained by the server.

[0379] Step 4:

[0380] The server sends updated travel plans and important alert information to the device.

[0381] Step 5:

[0382] The device notifies the user of updates and alerts received from the server.

[0383] Through the above steps, a system is provided that enables users to efficiently plan optimal travel plans and receive real-time emotional support during their trip.

[0384] Example 2

[0385] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0386] Conventional travel planning systems provide travel plans based on user input, but they are unable to consider the real-time emotional state of travelers or the latest local information, which means they are unable to fully support travelers' comfortable travel experiences. Furthermore, plans are not adjusted to reflect changes in travelers' emotions during the trip, and real-time support to reduce travelers' stress is lacking.

[0387] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for receiving input information from a traveler, means for acquiring related area data based on the input information from the traveler, means for integrating the related area data and the input information from the traveler to generate an optimal itinerary, means for providing the optimal itinerary to the traveler, means for acquiring emotional data from the traveler in real time, and means for analyzing the emotional data and adjusting the itinerary. This makes it possible to dynamically adjust the itinerary based on the real-time emotional state of the traveler and the latest local information, allowing the traveler to enjoy a comfortable and fulfilling travel experience.

[0388] "Traveler input information" refers to information such as destination, budget, travel companions, and values ​​that a traveler inputs when planning a trip.

[0389] "Regional data" refers to data that includes information about tourist attractions, events, dining facilities, accommodations, and the like related to a particular region.

[0390] A "travel plan" is a schedule or itinerary that is planned by combining tourist attractions to visit, events to participate in, dining facilities and accommodations to use, etc.

[0391] "Emotional data" is data obtained by using facial recognition and voice analysis technology to capture a traveler's real-time emotional state.

[0392] "Real-time updates" means modifying and changing information and plans instantly based on current situations and conditions.

[0393] "Analysis" is the process of analyzing acquired data in detail and extracting meaning and relationships.

[0394] "Selection" means choosing the most suitable one from multiple candidates.

[0395] "Ordering" means rearranging selected elements in an appropriate order.

[0396] "Transportation" means the means of transportation used by a traveler to travel from one point to another.

[0397] A "timetable" is a schedule that divides dates and itineraries into time periods.

[0398] The present invention relates to a system for generating an optimal travel plan based on traveler input information and personalizing the travel plan by analyzing real-time traveler emotion data. The system includes a terminal for receiving traveler input information, a server for acquiring relevant area data, an emotion engine for acquiring and analyzing emotion data, and a function for providing and updating the travel plan.

[0399] System Hardware and Software

[0400] Device: A mobile device such as a smartphone or tablet is used. The device provides a user interface (UI) and a means for travelers to input information. It also has a camera and microphone to capture real-time emotion data.

[0401] Server: Uses a high-performance cloud server or on-premise server. The server analyzes the received traveller input information, retrieves relevant local data from a database, and generates an optimal travel plan using AI algorithms (e.g., Recurrent Neural Network, RNN).

[0402] Emotion engine: The technologies used to acquire and analyze emotion data include facial recognition technology (OpenCV) and voice analysis technology (Google (registered trademark) Cloud Speech-to-Text).

[0403] Process Details

[0404] 1. A user launches a travel application and enters login information and travel destination information (destination, budget, travel companions, values).

[0405] 2. The terminal sends the entered information to the server.

[0406] 3. The server analyzes the received input information and retrieves relevant local data (tourist attractions, events, dining facilities, accommodation, etc.) from the database.

[0407] 4. The server integrates the acquired local data with the user's input information and uses an AI algorithm to generate an optimal travel plan.

[0408] 5. The server sends the generated itinerary to the terminal, which displays it to the user.

[0409] 6. During the trip, the device will acquire the user's emotional data in real time using facial recognition and voice analysis technology and send it to the server.

[0410] 7. The server analyzes the sentiment data and adjusts the travel plan as needed.

[0411] 8. The server sends the adjusted travel plan to the terminal, which notifies the user.

[0412] Specific examples

[0413] For example, suppose a user enters "Tokyo," "budget 100,000 yen," "traveling companion: friend," and "value: cultural experience" into a travel application. In this case, the server retrieves data on tourist attractions, events, restaurants, and hotels related to Tokyo and generates a plan that emphasizes "cultural experience." If the user feels stressed during the trip, the device retrieves emotional data in real time, and the server analyzes this data and suggests cafes and hot springs where they can relax.

[0414] Here are some examples of prompts for generative AI models:

[0415] The user has entered "Tokyo", "budget 100,000 yen", "travelling companion: friends", and "values: cultural experience". Based on this information, generate an ideal travel plan. Also, if the user feels stressed during the trip based on sentiment analysis, suggest how to adjust the travel plan.

[0416] In this way, the present invention provides a system that enables travelers to efficiently plan optimal travel plans and receive emotion-based real-time support during their trip.

[0417] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0418] Step 1:

[0419] A user launches the travel application, enters their login information, and logs in. If they are a new user, they enter the required information, such as their name, email address, and password, on the registration screen.

[0420] Input: User login information (or new registration information)

[0421] Output: Login authentication result

[0422] Specific operation: When the login button is pressed, the terminal sends the input information to the server, and the server checks the database and returns the authentication result.

[0423] Step 2:

[0424] After authenticating the user, the device displays a form for entering travel information, including destination, budget, travel companions, and values.

[0425] Input: None (automatically operates based on user authentication results)

[0426] Output: Display of travel information input form

[0427] Specific operation: Upon receiving the authentication success message, the terminal displays the travel information input form on the screen.

[0428] Step 3:

[0429] The user enters information such as destination, budget, travel companions, and values, and presses the send button.

[0430] Input: Travel information such as destination, budget, travel companions, values, etc.

[0431] Output: Travel information submission request

[0432] Specific operation: After entering travel information, press the send button and the device will send this information to the server in JSON format.

[0433] Step 4:

[0434] The server analyzes the input information received from the user, for example, using a natural language processing algorithm.

[0435] Input: Travel information (JSON format)

[0436] Output: Traveler requirements as analysis results

[0437] Specific operation: The server analyzes the JSON format travel information received and breaks it down into the traveler's required specifications.

[0438] Step 5:

[0439] The server retrieves relevant local data from a database, using database queries to retrieve information about attractions, events, dining options, accommodations, etc. for the destination.

[0440] Input: Traveler's requirements (destination)

[0441] Output: Local data (tourist attractions, events, restaurants, accommodations, etc.)

[0442] Specific operation: The server generates the necessary query and accesses the database to retrieve information related to the destination.

[0443] Step 6:

[0444] The server integrates the acquired regional data with the user's input information and generates an optimal travel plan using an AI algorithm (e.g., Recurrent Neural Network, RNN).

[0445] Input: Acquired regional data, traveler requirements

[0446] Output: Optimal travel plan

[0447] Specific operation: The server inputs regional data and traveler requirements into an AI algorithm to generate an optimal travel plan.

[0448] Step 7:

[0449] The server transmits the generated itinerary to the terminal.

[0450] Input: Optimal Travel Plan

[0451] Output: Trip plan submission request

[0452] Specific operation: The generated travel plan is structured in JSON format and sent to the terminal as an HTTP response.

[0453] Step 8:

[0454] The terminal displays the travel plan on a user interface.

[0455] Input: Travel plan (JSON format)

[0456] Output: A visual display to the user

[0457] Specific operation: The device analyzes the received travel plan and displays it in an easy-to-read format for the user.

[0458] Step 9:

[0459] During the trip, the device uses facial recognition technology (OpenCV) and voice analysis technology (Google Cloud Speech-to-Text) to obtain the user's emotional data in real time.

[0460] Input: None (Real-time traveller data)

[0461] Output: Emotion data

[0462] Specific operation: Data is collected using the device's camera and microphone, and analyzed by an analysis engine to generate emotion data.

[0463] Step 10:

[0464] The emotion data acquired by the device is transmitted to the server.

[0465] Input: Emotion data

[0466] Output: Emotion data transmission request

[0467] Specific operation: Emotion data is composed in JSON format and sent to the server as an HTTP request.

[0468] Step 11:

[0469] The server analyzes the emotion data and adjusts the travel plan as needed.

[0470] Input: Emotion data

[0471] Output: Adjusted itinerary

[0472] How it works: The server analyzes the emotional data, recalculates the travel plan according to the level of stress or excitement, and makes necessary adjustments.

[0473] Step 12:

[0474] The server sends the adjusted travel plan to the terminal, which notifies the user.

[0475] Input: Adjusted travel plans

[0476] Output: Coordinated travel plan submission request, user notification

[0477] Specific operation: The adjusted plan is constructed in JSON format and sent to the device as an HTTP response, and the device notifies the user via push notification or in-app notification.

[0478] In this way, the system dynamically provides optimal travel plans based on travelers' input information and real-time emotional data, significantly improving travel comfort and satisfaction.

[0479] (Application example 2)

[0480] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0481] Conventional travel planning systems provide static itineraries without considering travelers' emotions, which means they cannot quickly respond to changes in travelers' emotions or the latest information during the trip. Furthermore, they lack the functionality to recommend appropriate activities and spots when travelers feel stressed or excited, making it difficult for travelers to have a satisfying experience.

[0482] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving input information from a traveler, means for acquiring related city data based on the input information of the traveler, means for integrating the related city data and the input information of the traveler to generate an optimal itinerary, means for acquiring emotion data from the traveler, means for adjusting the itinerary by analyzing the emotion data, and means for providing the optimal itinerary and the adjusted itinerary to the traveler. This allows the itinerary to be adjusted flexibly and appropriately based on the traveler's emotions and the latest information, enabling the traveler to have a comfortable and satisfying travel experience.

[0483] "Traveler input information" refers to information provided by a traveler when planning a trip, such as travel destination, budget, travel companions, and values.

[0484] "Related city data" refers to data related to tourist attractions, events, restaurants, accommodations, etc. in the city that is the travel destination.

[0485] The "optimal travel plan" is a plan that includes the most ideal travel itinerary and activity content for the traveler, generated by integrating the traveler's input information and related city data.

[0486] "Emotional data" is data that indicates a traveler's real-time emotional state, obtained using facial recognition and voice analysis technologies.

[0487] "Travel plan adjustment" refers to analyzing travelers' sentiment data and making appropriate changes to existing travel plans.

[0488] "Providing to travelers" refers to the act of displaying the optimal travel plan or an adjusted travel plan to travelers via their terminals.

[0489] "Location information" is geographical information that indicates where a traveler is located during a trip.

[0490] "Latest information" refers to real-time data such as changes in weather, traffic conditions, and events at your travel destination.

[0491] "Notifying" refers to the act of displaying information received from the server on the traveler's terminal.

[0492] "Tourist attractions" refer to places in a travel destination that are particularly popular with tourists or have historical or cultural significance.

[0493] "Events" refers to activities such as festivals, concerts, and exhibitions held at your travel destination.

[0494] "Restaurants" refers to establishments that serve meals at travel destinations.

[0495] "Accommodation" refers to facilities for travelers to stay, such as hotels, inns, and guesthouses.

[0496] "Transportation" refers to the means of transportation used by travelers to travel to each tourist attraction or facility.

[0497] A "timetable" refers to the time allocation for each activity in a travel plan.

[0498] System Overview

[0499] This invention is a system that enables travelers to plan travel plans that are both efficient and satisfying. In particular, it improves travel satisfaction by acquiring travelers' emotional data in real time and reflecting this in travel plans. Specific implementation methods of the system are described below.

[0500] Program processing

[0501] User Input Phase

[0502] A traveler (user) launches a travel planning application using a device such as a smartphone or tablet. The user enters login information and necessary information (travel destination, budget, travel companions, values). This information is sent from the device to the server.

[0503] Data Processing Phase

[0504] The server analyzes the input information received from the user and accesses a city database to retrieve relevant city data, including information on tourist attractions, events, restaurants, accommodations, etc. The server then integrates this data with the user's input information and uses AI algorithms to generate an optimal travel plan.

[0505] The server sends the generated itinerary to the traveler's device, which displays it on the user interface so that the user can check and modify it.

[0506] Acquiring and analyzing emotion data

[0507] During the trip, the device uses facial recognition and voice analysis technologies to capture real-time emotional data of the traveler. For example, it uses a camera to analyze the traveler's facial expressions and a microphone to analyze the tone and volume of the voice. This emotional data is sent to a server, which analyzes it in real time and also refers to past emotional data to determine the traveler's emotional state.

[0508] Adjusting travel plans

[0509] The server adjusts the travel plan based on the results of the emotion data analysis. For example, if the traveler feels stressed, it adds relaxing activities (such as cafes and hot springs), and if the traveler feels excited, it adds more exciting activities (such as amusement parks). The adjusted travel plan is sent to the terminal and displayed on the user interface.

[0510] Real-time Support Phase

[0511] During the trip, the server continuously monitors the traveler's location and local updates (such as changes in weather, traffic, and events). Based on this information and real-time emotion data, the server updates the travel plan in real time and sends important alert information to the device. The device then notifies the user of these updates and alerts.

[0512] Specific examples

[0513] If a user inputs "Tokyo," "budget 100,000 yen," "traveling companion: friend," and "values: cultural experience," the server retrieves data on Tokyo's tourist attractions, events, restaurants, and accommodations, and uses a generative AI model to generate an optimal travel plan that includes visits to Sensoji Temple, a kabuki performance, and a traditional craft experience.

[0514] If the user feels stressed during the trip, the server will analyze the emotional data to detect this and suggest additional cafes or hot springs where the user can relax, allowing the user to enjoy the entire trip more comfortably.

[0515] Prompt Sentence Examples

[0516] Generate a travel itinerary for Tokyo that emphasizes cultural experiences.

[0517] If the user feels stressed, suggest a place for them to relax.

[0518] In this way, the present invention provides a system that enables travelers to efficiently plan optimal travel plans and receive emotion-based real-time support during their trip.

[0519] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0520] Step 1:

[0521] A user launches a travel planning application and enters their login information. New users register with the necessary information. This information is saved on the user's device and sent to the server.

[0522] Input: User login information, new registration information

[0523] Output: Authenticated user information

[0524] Step 2:

[0525] The user inputs travel information such as destination, budget, travel companions, and values, and presses the send button. The terminal then sends this travel information to the server.

[0526] Input: Travel information such as destination, budget, travel companions, and values

[0527] Output: Trip information sent to the server

[0528] Step 3:

[0529] The server analyzes the received travel information and accesses a city database to retrieve relevant city data, including information on tourist attractions, events, restaurants, accommodations, etc. Data is dynamically extracted according to the travel destination.

[0530] Input: Travel information sent to the server, city database

[0531] Output: Retrieved city data

[0532] Step 4:

[0533] The server integrates the acquired city data and travel information and generates an optimal travel plan using a generative AI model. An example of a prompt sentence that can be input is, "Please generate a travel plan that emphasizes cultural experiences related to Tokyo."

[0534] Input: Captured city data, travel information, generative AI model

[0535] Output: Optimal travel plan

[0536] Step 5:

[0537] The server sends the generated optimal travel plan to the user's device, which displays it in a user interface, allowing the user to review it and make changes as needed.

[0538] Input: Best Travel Planner

[0539] Output: The itinerary displayed in the user interface

[0540] Step 6:

[0541] During the journey, the device will capture real-time emotional data using facial recognition and voice analysis technology, specifically using the device's camera and microphone.

[0542] Input: Real-time audio and video of the user while traveling

[0543] Output: Obtained emotion data

[0544] Step 7:

[0545] The acquired emotional data is transmitted to a server, which analyzes the emotional data in real time and determines the user's current emotional state.

[0546] Input: Captured emotion data

[0547] Output: Parsed emotional state

[0548] Step 8:

[0549] The server adjusts the itinerary based on the user's emotional state. For example, if the user is stressed, it adds relaxing activities, and if the user is excited, it adds exciting activities. An example prompt could be "If the user is stressed, please suggest places where he can relax."

[0550] Input: Parsed emotional state, original travel plan

[0551] Output: Adjusted itinerary

[0552] Step 9:

[0553] The adjusted itinerary is sent to the user's terminal and displayed on the user interface, allowing the user to confirm the adjusted itinerary.

[0554] Input: Adjusted travel plan

[0555] Output: The adjusted itinerary displayed in the user interface.

[0556] Step 10:

[0557] During the trip, the server continuously monitors the traveler's location and local updates (such as weather, traffic, and event changes), which are obtained and used in real time.

[0558] Input: Traveler location, local updates

[0559] Output: Retrieved location information and latest updates

[0560] Step 11:

[0561] The server updates the travel plan in real time based on the latest information and emotion data obtained, thereby constantly optimizing the user's travel experience.

[0562] Input: Obtained location information, updates, and emotion data

[0563] Output: Updated itinerary

[0564] Step 12:

[0565] The server sends update information and important alert information to the user's terminal, which then notifies the user.

[0566] Input: Updated travel plans, alert information

[0567] Output: Updates and alerts notified to the user

[0568] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0569] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0570] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0571] [Second embodiment]

[0572] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0573] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0574] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0575] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0576] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0577] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0578] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0579] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0580] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0581] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0582] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0583] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0584] MODE FOR CARRYING OUT THE INVENTION

[0585] System Overview

[0586] The present invention provides a system that enables travelers to efficiently plan their ideal itinerary. Specifically, it provides a method and apparatus for generating an optimal itinerary based on information input by the traveler. The system includes a terminal that receives the traveler's input information, a server that acquires city data and generates an optimal itinerary, and a function for providing and updating the itinerary.

[0587] Program processing

[0588] User Input Phase

[0589] 1. A user launches the travel application and enters their login information on the login screen, or if they are a new user, enters the required information on the registration screen.

[0590] 2. After authenticating the user, the terminal displays a form for entering travel information.

[0591] 3. The user enters information such as destination, budget, travel companions, and values, and presses the send button.

[0592] 4. The terminal sends the user's input information to the server.

[0593] Data Processing Phase

[0594] 1. The server analyzes the input information received from the user.

[0595] 2. The server accesses the city database and retrieves data related to the entered destination (tourist attractions, events, restaurants, hotels, etc.).

[0596] 3. The server integrates the acquired city data with the user's input information and uses an AI algorithm to generate an optimal travel plan.

[0597] 4. The server sends the generated travel plan to the terminal.

[0598] Show Plan Phase

[0599] 1. The terminal displays the travel plan received from the server on the user interface.

[0600] 2. The user is presented with an interface that allows them to review the displayed itinerary and fine-tune the plan if necessary.

[0601] 3. The device sends the user's fine-tuning information to the server, which then re-plans.

[0602] 4. The server sends the updated itinerary to the terminal, which displays it again to the user.

[0603] Real-time Support Phase

[0604] 1. The server monitors the location and latest information (weather, event changes, etc.) of travelers during their trip.

[0605] 2. The travel plan is updated in real time based on the latest information obtained by the server.

[0606] 3. The server sends updated plans and important alert information to the device.

[0607] 4. The device notifies the user of updates and alerts received from the server.

[0608] Specific examples

[0609] For example, suppose a user inputs "Tokyo," "budget 100,000 yen," "traveling companion: friend," and "value: cultural experience." In this case, the server retrieves data on tourist attractions, events, restaurants, and hotels related to Tokyo. Next, it generates a plan that emphasizes the user's cultural experiences and proposes it to the user. This plan might include Sensoji Temple in Asakusa, a kabuki performance, and a traditional craft experience. Furthermore, if it suddenly rains in the area, the server will reflect the local weather information and suggest changing the user's plans to indoor activities.

[0610] In this way, the present invention provides a system that allows travelers to efficiently plan optimal travel plans and receive real-time support during their trip.

[0611] The processing flow will be explained below.

[0612] User Input Phase

[0613] Step 1:

[0614] The user launches the travel application and enters their login information into the login screen.

[0615] Step 2:

[0616] The terminal performs user authentication, and if the authentication is successful, sends the user information to the server.

[0617] Step 3:

[0618] The server checks the user information against an authentication database, and if authentication is successful, returns an authentication success message to the terminal.

[0619] Step 4:

[0620] The terminal receives the authentication success message and displays a form for the user to enter travel information.

[0621] Step 5:

[0622] The user enters information such as destination, budget, travel companions, and values ​​into the form and presses the submit button.

[0623] Step 6:

[0624] The terminal transmits the user's input information to the server.

[0625] Data Processing Phase

[0626] Step 1:

[0627] The server analyzes the input information received from the user.

[0628] Step 2:

[0629] The server accesses a city database to retrieve data related to the entered destination (tourist attractions, events, restaurants, hotels, etc.).

[0630] Step 3:

[0631] The server combines the city data it has acquired with the user's input information and uses an AI algorithm to generate an optimal travel plan.

[0632] Step 4:

[0633] The server transmits the generated itinerary to the terminal.

[0634] Show Plan Phase

[0635] Step 1:

[0636] The terminal displays the travel plan received from the server on a user interface.

[0637] Step 2:

[0638] The user confirms the displayed itinerary.

[0639] Step 3:

[0640] The user can then fine-tune the plan as needed and hit send again.

[0641] Step 4:

[0642] The device sends the user's fine-tuning details to the server.

[0643] Step 5:

[0644] The server receives the user's tweaks and re-plans.

[0645] Step 6:

[0646] The server sends the updated itinerary to the terminal.

[0647] Step 7:

[0648] The terminal displays the replanned itinerary again to the user.

[0649] Real-time Support Phase

[0650] Step 1:

[0651] The server monitors the location information of travelers in real time during their trip.

[0652] Step 2:

[0653] The server retrieves local updates (weather, traffic, event changes, etc.).

[0654] Step 3:

[0655] Travel plans are updated in real time based on the latest information obtained by the server.

[0656] Step 4:

[0657] The server sends updated travel plans and important alert information to the device.

[0658] Step 5:

[0659] The device notifies the user of updates and alerts received from the server.

[0660] Through these steps, users can efficiently create optimal travel plans and receive real-time support during their trip.

[0661] Example 1

[0662] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0663] Conventional travel planning systems can generate travel plans based on information entered by the user, but they have difficulty obtaining appropriate city data and generating optimal travel plans that match the user's values. Furthermore, they have problems in that they are unable to provide real-time support during the trip or flexibly respond to external conditions (such as weather changes or event cancellations). The purpose of this invention is to solve these problems, efficiently plan the ideal travel plan for travelers, and provide real-time support.

[0664] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0665] In this invention, the server includes a means for receiving traveler input information, a means for acquiring related city data, and a means for generating an optimal travel plan using an artificial intelligence algorithm. This allows for effective acquisition of city data based on the information entered by the traveler, enabling the generation of an optimal travel plan suited to the user's values ​​and requirements. The server also monitors the traveler's location information and latest information during the trip, and updates the travel plan in real time based on this information, thereby enabling flexible responses during the trip. Furthermore, by accepting traveler adjustments and re-planning, it is possible to provide a flexible travel plan that meets the user's requests.

[0666] "Traveler input information" refers to information about personal preferences and requirements provided by a traveler to plan a trip, such as travel destination, budget, travel companions, and values.

[0667] "City data" is information related to a specific city, such as tourist attractions, events, restaurants, and accommodations, and is data used to create travel plans.

[0668] "Artificial intelligence algorithms" are algorithms that include techniques such as machine learning and deep learning, which are used to analyze massive amounts of data and generate optimal travel plans.

[0669] "User Interface" means the software and hardware interfaces that provide the screens and controls used by travelers to view, edit, and update their travel plans.

[0670] "Location information" is data used to identify the geographic location of a particular individual or object using technologies such as GPS.

[0671] "Latest information" refers to real-time information that is important to travelers, such as weather forecasts, event changes, and traffic conditions.

[0672] "Real-time updates" means quickly changing travel plans in response to changes in external conditions that occur during the trip (such as weather changes or event cancellations).

[0673] "Notify" means informing travelers of travel plan updates and important information via their device.

[0674] "Tweaks" are small modifications made by travelers to change some of their plans or to reflect additional requests.

[0675] MODE FOR CARRYING OUT THE INVENTION

[0676] System Overview

[0677] The present invention is a system for enabling travelers to create efficient and ideal travel plans. This system generates, displays, and updates an optimal travel plan based on information input by the traveler. It includes a means for receiving the traveler's input information, a means for acquiring city data, a means for integrating the acquired data with the traveler's input information and generating an optimal travel plan using an artificial intelligence algorithm, and a means for providing the traveler with the travel plan and fine-tuning it.

[0678] Hardware and software used

[0679] 1. Server: Responsible for data processing, accessing the city database, and generating and updating itineraries. Software used includes a natural language processing engine and generative AI models (such as TensorFlow or PyTorch). The hardware is expected to be a cloud service (e.g., AWS EC2 instances).

[0680] 2. Terminal: The terminal is used to input information, display travel plans, and make fine adjustments through the user interface. Front-end software such as React or Vue.js is used.

[0681] 3. Database: A database such as MongoDB is used to store city data (tourist attractions, events, hotels, restaurants, etc.).

[0682] 4. GPS devices: Used to obtain and monitor the location of travelers.

[0683] Program processing

[0684] 1. The user launches the travel application on their device and enters their login information. If they are a new user, they enter the required information on the registration screen.

[0685] 2. After authenticating the user, the device displays a travel information input form, where the user enters information such as destination, budget, travel companions, and values, and submits it.

[0686] 3. The device sends the input information to the server, which analyzes the input information and accesses the city database to retrieve relevant city information.

[0687] 4. The server integrates the acquired city data with the user's input information and generates an optimal travel plan using a generative AI model.

[0688] 5. The server sends the generated itinerary to the terminal, which displays it on the user interface.

[0689] 6. The user checks the itinerary and makes any necessary adjustments. The device sends the changes to the server, which then re-plans and sends the updated itinerary back to the device.

[0690] Real-time Support

[0691] 1. The server monitors the location information of the traveler through the GPS device during the trip, and obtains the traveler's location information and the latest weather and event change information in real time.

[0692] 2. The server updates the travel plan in real time based on the latest information and sends the updated information to the device.

[0693] 3. The terminal notifies the user interface of the updated information received from the server, allowing the user to review the plan based on the new information.

[0694] Examples and prompts

[0695] For example, if a user inputs "Tokyo," "budget 100,000 yen," "traveling companion: friend," and "value: cultural experience," the server retrieves city data related to Tokyo (information on tourist attractions, events, restaurants, and hotels) and generates an optimal travel plan that emphasizes cultural experiences. This travel plan includes a visit to Sensoji Temple, a kabuki performance, and a traditional craft experience.

[0696] If the weather worsens in Tokyo during a trip, the server retrieves the weather forecast in real time, generates an updated itinerary that changes outdoor activities to indoor activities, such as visiting a museum or an indoor art gallery, and notifies the user.

[0697] Prompt Sentence Examples

[0698] "Travel planning assistant. The user is planning a trip to Tokyo with a budget of ¥100,000, friends as companions, and cultural experiences as their value. Create a travel plan that suggests appropriate tourist spots and activities and adapts to changing weather conditions."

[0699] In this way, the present invention provides a system that allows travelers to efficiently plan optimal travel plans and receive real-time support during their trip.

[0700] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0701] Step 1:

[0702] A user launches a travel application and enters their login information. If they are a new user, they enter the required information, such as their name, email address, and password, on the registration screen. The information they enter is processed as input data on their device and sent to the server.

[0703] Input: User login or registration information

[0704] Output: Authentication request data from the device to the server

[0705] Specific behavior:

[0706] A user launches an application on their smartphone or PC and goes to the login screen. They enter their email address and password. If they are a new user, they enter the required registration information into the form.

[0707] Step 2:

[0708] The server authenticates the login information it receives, searching the database for authentication if the user is already there, or adding the information to the database if the user is new.

[0709] Input: Login or registration information sent from your device

[0710] Output: Authentication result (success / failure) and user data when authentication is successful

[0711] Specific behavior:

[0712] The server verifies the login information using a database (e.g., MySQL or MongoDB) and performs authentication. If authentication is successful, it generates and returns a token to proceed to the next step.

[0713] Step 3:

[0714] After authenticating the user, the terminal displays a travel information input form, in which the user enters detailed information such as destination, budget, travel dates, travel companions, and values, and submits the form.

[0715] Input: User data after successful authentication

[0716] Output: Trip information entered by the user

[0717] Specific behavior:

[0718] The user enters travel preferences such as destination, budget, companions, and values ​​into the displayed travel information input form, and presses the send button to send the information to the server.

[0719] Step 4:

[0720] The terminal sends the user's input information to the server, which receives the input information and begins analyzing it.

[0721] Input: User's travel information

[0722] Output: Trip information sent to the server

[0723] Specific behavior:

[0724] The terminal sends the user's input information as an HTTP request to the server, which receives it and starts processing the data.

[0725] Step 5:

[0726] The server analyzes the received user travel information and converts it into structured data using a natural language processing engine.

[0727] Input: User's travel information

[0728] Output: Structured travel information

[0729] Specific behavior:

[0730] The server receives the user's input information and uses a natural language processing engine to analyze and convert it into the necessary data. For example, information such as "cultural experience" or "budget of 100,000 yen" is analyzed and converted into an internal data structure.

[0731] Step 6:

[0732] The server accesses a city database and retrieves city data such as tourist attractions, events, restaurants, and accommodations related to the destination entered by the user.

[0733] Input: Structured travel information (e.g., destination)

[0734] Output: City data (tourist attractions, events, restaurants, accommodations, etc.)

[0735] Specific behavior:

[0736] The server connects to a city database (e.g. MongoDB) and queries and retrieves information about attractions, events, restaurants, and accommodations based on the destination.

[0737] Step 7:

[0738] The server integrates the acquired city data with the user's structured data and generates an optimal travel plan using a generative AI model.

[0739] Input: City data and structured travel information

[0740] Output: Optimal travel plan

[0741] Specific behavior:

[0742] The server integrates the city data it acquires with user information, and uses a generative AI model built with TensorFlow and PyTorch to generate an optimal travel plan based on the user's requests and conditions.

[0743] Step 8:

[0744] The server transmits the generated itinerary to the terminal, which displays it on a user interface.

[0745] Input: Best Travel Planner

[0746] Output: Travel plan display data

[0747] Specific behavior:

[0748] The server generates the itinerary and sends it to the device in a structured format. The device receives this data and displays it in a user interface using React and Vue.js.

[0749] Step 9:

[0750] The user checks the displayed itinerary and makes any necessary adjustments. The adjustments are entered and sent to the server by the device.

[0751] Input: User tweaks

[0752] Output: Fine-tuned trip information

[0753] Specific behavior:

[0754] The user checks the travel plan, changes some of the plans, or enters new requests. The terminal sends this information to the server.

[0755] Step 10:

[0756] The server re-plans based on the fine-tuning information received from the user, generates an updated itinerary, and sends it to the terminal, which displays it again on the user interface.

[0757] Input: Fine-tuned travel information

[0758] Output: Updated itinerary

[0759] Specific behavior:

[0760] The server again uses its AI algorithm to generate a new itinerary based on the user's tweaks, which the device receives and displays the updated itinerary.

[0761] Step 11:

[0762] The server monitors the location of travelers during their trip via their GPS devices and obtains the latest information on weather, event changes, etc.

[0763] Input: Traveler location, weather updates, event changes

[0764] Output: Latest travel plan updates

[0765] Specific behavior:

[0766] The server obtains the traveler's GPS data and collects the latest information from weather APIs, event APIs, etc.

[0767] Step 12:

[0768] The server updates the travel plan in real time based on the latest information, and the device displays the updated information on the user interface and sends push notifications as needed.

[0769] Input: Latest travel plan update

[0770] Output: User notification

[0771] Specific behavior:

[0772] The server automatically updates the travel plan based on the latest information and sends it to the device, which receives it, displays it on the user interface, and notifies the user via push notifications, etc.

[0773] (Application example 1)

[0774] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0775] Traditional travel planning systems are unable to provide an appropriate combination of travelers' dining preferences and local food delivery data. As a result, travelers have to spend time finding the best dining options at their destinations, which can lead to a lower quality trip. They also lack real-time food delivery recommendations based on the latest local information, resulting in a lack of planning flexibility, making it difficult for travelers to enjoy truly satisfying dining experiences during their trips.

[0776] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0777] In this invention, the server includes means for receiving input information from a traveler, means for acquiring related city data based on the traveler's input information, means for integrating the related city data with the traveler's input information to generate an optimal travel plan, means for acquiring local food service facility data based on the optimal travel plan and integrating the data with the traveler's preferences to generate food delivery recommendations, means for providing the recommended food delivery information to the traveler, and means for updating the food delivery recommendations in real time based on the traveler's current location information. This allows travelers to easily find the optimal food delivery options for their destinations. Furthermore, real-time plan updates allow travelers to enjoy an optimal dining experience tailored to the latest conditions.

[0778] "Traveller" means an individual or group that plans and undertakes a trip.

[0779] "Input Information" refers to data such as destination, budget, travel companions, values, and preferences that a traveler provides to generate a travel plan.

[0780] "City Data" means information about attractions, events, restaurants, hotels, transportation, and other information about a particular city.

[0781] "Optimal travel plan" refers to a travel schedule generated based on the traveler's input information and city data to best meet the traveler's requirements.

[0782] "Dining Facility Data" refers to information about restaurants, cafes, food delivery services, etc. within a particular area.

[0783] "Food Delivery Recommendations" refers to information recommending specific dining options or delivery services based on a traveler's preferences and current circumstances.

[0784] "Traveler's current location information" refers to geographic information indicating the location where the traveler is actually moving.

[0785] "Real-time updates" refers to the process of instantly modifying or changing travel plans or recommendations based on current, up-to-date information.

[0786] System Overview

[0787] This invention is a system that enables travelers to enjoy optimal food delivery at their destinations. Specifically, it generates an optimal travel plan based on the traveler's input information, acquires data on local food establishments based on the plan, and recommends food delivery options that match the traveler's preferences. It also monitors location information in real time and provides the traveler with the latest travel plans and food delivery recommendations.

[0788] Program processing

[0789] User Input Phase

[0790] Users log in using a device such as a smartphone or tablet and enter their travel information, including their destination, budget, travel companions, values, preferences, etc. This information is then sent from the device to the server.

[0791] Data Processing Phase

[0792] The server uses software such as Python and the Requests library to perform the following tasks:

[0793] 1. Parse the input information received from the user.

[0794] 2. Obtain data on tourist attractions, events, restaurants, hotels, etc. from a city database.

[0795] 3. The acquired city data and user input information are input into a generative AI model to generate an optimal travel plan.

[0796] 4. Based on the travel plan, local dining establishment data is retrieved and integrated with the user's preferences to generate food delivery recommendations.

[0797] Show Plan Phase

[0798] The device displays the travel plan and food delivery recommendations received from the server on the user interface. The user checks the displayed plan and makes adjustments as necessary. The device sends the user's adjustments to the server, which then re-plans. The updated plan and recommendations are sent back to the device and displayed to the user.

[0799] Real-time Support Phase

[0800] The server monitors the traveler's real-time location and local updates (weather, event changes, etc.). Based on these updates, it updates travel plans and food delivery recommendations in real time and notifies the device. Users can receive these updates via their smartphone or tablet and take appropriate action.

[0801] Specific examples of programs

[0802] For example, if a traveler enters "Tokyo," "budget of 100,000 yen," "traveling companion: friends," "values: cultural experiences," and "preferences: vegetarian food," the server will retrieve data on vegetarian-friendly restaurants along with data on tourist attractions and events in Tokyo, and generate optimal travel plans and food delivery recommendations. During the travel period, for example, if the traveler is in Asakusa, it will recommend delivery of "Japanese vegetarian food." Also, if it suddenly rains in the area, the server will reflect the weather information and change the traveler's plans to indoor activities, and re-suggest meals that can be enjoyed indoors.

[0803] Prompt Sentence Examples

[0804] "Destination: Tokyo, Duration: 5 days, Budget: 20,000 yen, Number of people: 2. Please recommend a local vegetarian restaurant and its menu."

[0805] As described above, the present invention provides a system that allows travelers to easily plan optimal dining experiences and travel plans and receive real-time support during their trip.

[0806] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0807] Step 1:

[0808] The user launches the travel application and enters their login information on the login screen. If they are a new user, they enter the required information on the registration screen. The entered information is sent from the device to the server. Based on the input, the server authenticates the user. If authentication is successful, the travel information input form is displayed on the device.

[0809] Step 2:

[0810] The user enters travel information such as destination, budget, travel companions, values, and preferences, and then presses the send button. The entered data is sent from the device to the server. The server analyzes the received information and extracts the traveler's preferences and requests. This analysis includes data processing such as natural language processing.

[0811] Step 3:

[0812] The server accesses the city database and retrieves data related to the entered destination (tourist attractions, events, restaurants, hotels, etc.). This database can be, for example, MongoDB or PostgreSQL. The retrieved data is temporarily stored.

[0813] Step 4:

[0814] The server combines the city data it acquires with the user's input information and uses a generative AI model to generate an optimal travel plan. Specifically, it selects tourist attractions, events, and restaurants based on the user's values ​​and preferences, and optimizes the timetable and transportation methods. For example, GPT-3 is used as the generative AI model.

[0815] Step 5:

[0816] Based on the optimal itinerary, the server retrieves local dining establishment data, integrates it with the user's preferences, and generates food delivery recommendations. For example, it uses automated queries to retrieve data from a local restaurant API and filters it against the user's preferences.

[0817] Step 6:

[0818] The server sends the generated travel plans and food delivery recommendations to the device, which displays the received information on a user interface. The user can review the proposed travel plans and food delivery recommendations and make adjustments as needed.

[0819] Step 7:

[0820] The user's refinements are sent to the server, which then re-generates the itinerary. The updated itinerary is then sent back to the device and displayed again, allowing the user to receive optimal itinerary and food delivery recommendations in real time.

[0821] Step 8:

[0822] During the trip, the server monitors the user's location information and the latest local information (weather, event changes, etc.). The current location information is periodically sent to the server as GPS data, and the server takes the appropriate action based on that information.

[0823] Step 9:

[0824] The server updates travel plans and food delivery recommendations in real time based on the latest information it receives, again using the AI ​​model to adjust plans to accommodate changes in weather or event cancellations, for example.

[0825] Step 10:

[0826] The server sends updated plans and important alert information to the device, which then notifies the user, allowing the user to receive real-time updates on travel plans and food delivery information and make appropriate changes.

[0827] As described above, this system provides advanced support for users to enjoy an optimal experience during their trip. Through specific actions and data processing, it is possible to provide appropriate and timely travel plans and food delivery recommendations.

[0828] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0829] MODE FOR CARRYING OUT THE INVENTION

[0830] System Overview

[0831] The present invention provides a system that enables travelers to efficiently plan their ideal itinerary, and in particular has the function of recognizing the travelers' emotions and reflecting them in the itinerary. Specifically, it provides a method and apparatus for generating an optimal itinerary based on the travelers' input information and further personalizing the itinerary by analyzing the travelers' real-time and past emotional data. The system includes a terminal that receives the travelers' input information, a server that acquires city data and generates an optimal itinerary, an emotion engine, and a function for providing and updating the itinerary.

[0832] Program processing

[0833] User Input Phase

[0834] 1. A user launches the travel application and enters their login information on the login screen, or if they are a new user, enters the required information on the registration screen.

[0835] 2. After authenticating the user, the terminal displays a form for entering travel information.

[0836] 3. The user enters information such as destination, budget, travel companions, and values ​​into the form and presses the submit button.

[0837] 4. The terminal sends the user's input information to the server.

[0838] Data Processing Phase

[0839] 1. The server analyzes the input information received from the user.

[0840] 2. The server accesses the city database and retrieves data related to the entered destination (tourist attractions, events, restaurants, hotels, etc.).

[0841] 3. The server integrates the acquired city data with the user's input information and uses an AI algorithm to generate an optimal travel plan.

[0842] 4. The server sends the generated travel plan to the terminal.

[0843] Emotion engine processing

[0844] Acquiring and analyzing emotion data

[0845] 1. The device acquires real-time emotional data of travelers using facial recognition and voice analysis technologies.

[0846] 2. The device sends the acquired emotion data to the server.

[0847] 3. The server analyzes the real-time emotional data and determines the traveler's current emotional state.

[0848] 4. The server analyzes the data, including past emotional data, and determines how to adjust the travel plan.

[0849] Emotion-based travel planning adjustments

[0850] 1. The server recommends activities and hotels that can help travelers relax if they are feeling stressed.

[0851] 2. The server adjusts the travel plan to add more exciting activities if the traveler is excited.

[0852] 3. The server sends the adjusted itinerary to the terminal.

[0853] 4. The device displays the adjusted itinerary and activities on the user interface.

[0854] Real-time Support Phase

[0855] 1. The server continuously monitors the location information and real-time emotion data of travelers during their trip.

[0856] 2. The server retrieves local updates (weather, traffic, event changes, etc.) and emotion data.

[0857] 3. The server updates the travel plan in real time based on the latest local information and sentiment data.

[0858] 4. The server sends updated travel plans and important alert information to the device.

[0859] 5. The device notifies the user of updates and alerts received from the server.

[0860] Specific examples

[0861] For example, suppose a user inputs "Tokyo," "budget 100,000 yen," "traveling companion: friend," and "value: cultural experience." In this case, the server retrieves data on tourist attractions, events, restaurants, and hotels related to Tokyo. Next, it generates a plan that emphasizes the user's cultural experience and proposes it to the user. This plan includes visits to Sensoji Temple in Asakusa, a kabuki performance, and a traditional craft experience.

[0862] Furthermore, if the user begins to feel stressed during the trip, the server will detect this state using the emotion engine and adjust the travel plan by suggesting additional activities such as relaxing cafes or hot springs, allowing the user to enjoy the entire trip more comfortably.

[0863] In this way, the present invention provides a system that enables travelers to efficiently plan optimal travel plans and receive emotion-based real-time support during their trip.

[0864] The processing flow will be explained below.

[0865] User Input Phase

[0866] Step 1:

[0867] The user launches the travel application and enters their login information into the login screen.

[0868] Step 2:

[0869] The terminal performs user authentication, and if the authentication is successful, sends the user information to the server.

[0870] Step 3:

[0871] The server checks the user information against an authentication database, and if authentication is successful, returns an authentication success message to the terminal.

[0872] Step 4:

[0873] The terminal receives the authentication success message and displays a form for the user to enter travel information.

[0874] Step 5:

[0875] The user enters information such as destination, budget, travel companions, and values ​​into the form and presses the submit button.

[0876] Step 6:

[0877] The terminal transmits the user's input information to the server.

[0878] Data Processing Phase

[0879] Step 1:

[0880] The server analyzes the input information received from the user.

[0881] Step 2:

[0882] The server accesses a city database to retrieve data related to the entered destination (tourist attractions, events, restaurants, hotels, etc.).

[0883] Step 3:

[0884] The server combines the city data it has acquired with the user's input information and uses an AI algorithm to generate an optimal travel plan.

[0885] Step 4:

[0886] The server transmits the generated itinerary to the terminal.

[0887] Show Plan Phase

[0888] Step 1:

[0889] The terminal displays the travel plan received from the server on a user interface.

[0890] Step 2:

[0891] The user confirms the displayed itinerary.

[0892] Step 3:

[0893] The user can then fine-tune the plan as needed and hit send again.

[0894] Step 4:

[0895] The device sends the user's fine-tuning details to the server.

[0896] Step 5:

[0897] The server receives the user's tweaks and re-plans.

[0898] Step 6:

[0899] The server sends the updated itinerary to the terminal.

[0900] Step 7:

[0901] The terminal displays the replanned itinerary again to the user.

[0902] Emotion engine processing

[0903] Acquiring and analyzing emotion data

[0904] Step 1:

[0905] The device will acquire real-time emotional data from travelers using facial recognition and voice analysis technologies.

[0906] Step 2:

[0907] The emotion data acquired by the terminal is transmitted to the server.

[0908] Step 3:

[0909] The server analyzes real-time emotional data to determine the traveler's current emotional state.

[0910] Step 4:

[0911] The server analyzes the data, including past emotional data, and determines how to adjust the travel plan.

[0912] Emotion-based travel planning adjustments

[0913] Step 1:

[0914] The server will recommend relaxing activities and hotels if the traveler is feeling stressed.

[0915] Step 2:

[0916] The server adjusts the itinerary to add more exciting activities if the traveler is excited.

[0917] Step 3:

[0918] The server sends the adjusted itinerary to the terminal.

[0919] Step 4:

[0920] The device displays the adjusted itinerary and activities on a user interface.

[0921] Real-time Support Phase

[0922] Step 1:

[0923] The server monitors the location information of travelers in real time during their trip.

[0924] Step 2:

[0925] The server retrieves local updates (weather, traffic, event changes, etc.) and emotion data.

[0926] Step 3:

[0927] The travel plan is updated in real time based on the latest information and emotion data obtained by the server.

[0928] Step 4:

[0929] The server sends updated travel plans and important alert information to the device.

[0930] Step 5:

[0931] The device notifies the user of updates and alerts received from the server.

[0932] Through the above steps, a system is provided that enables users to efficiently plan optimal travel plans and receive real-time emotional support during their trip.

[0933] Example 2

[0934] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0935] Conventional travel planning systems provide travel plans based on user input, but they are unable to consider the real-time emotional state of travelers or the latest local information, which means they are unable to fully support travelers' comfortable travel experiences. Furthermore, plans are not adjusted to reflect changes in travelers' emotions during the trip, and real-time support to reduce travelers' stress is lacking.

[0936] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for receiving input information from a traveler, means for acquiring related area data based on the input information from the traveler, means for integrating the related area data and the input information from the traveler to generate an optimal itinerary, means for providing the optimal itinerary to the traveler, means for acquiring emotional data from the traveler in real time, and means for analyzing the emotional data and adjusting the itinerary. This makes it possible to dynamically adjust the itinerary based on the real-time emotional state of the traveler and the latest local information, allowing the traveler to enjoy a comfortable and fulfilling travel experience.

[0937] "Traveler input information" refers to information such as destination, budget, travel companions, and values ​​that a traveler inputs when planning a trip.

[0938] "Regional data" refers to data that includes information about tourist attractions, events, dining facilities, accommodations, and the like related to a particular region.

[0939] A "travel plan" is a schedule or itinerary that is planned by combining tourist attractions to visit, events to participate in, dining facilities and accommodations to use, etc.

[0940] "Emotional data" is data obtained by using facial recognition and voice analysis technology to capture a traveler's real-time emotional state.

[0941] "Real-time updates" means modifying and changing information and plans instantly based on current situations and conditions.

[0942] "Analysis" is the process of analyzing acquired data in detail and extracting meaning and relationships.

[0943] "Selection" means choosing the most suitable one from multiple candidates.

[0944] "Ordering" means rearranging selected elements in an appropriate order.

[0945] "Transportation" means the means of transportation used by a traveler to travel from one point to another.

[0946] A "timetable" is a schedule that divides dates and itineraries into time periods.

[0947] The present invention relates to a system for generating an optimal travel plan based on traveler input information and personalizing the travel plan by analyzing real-time traveler emotion data. The system includes a terminal for receiving traveler input information, a server for acquiring relevant area data, an emotion engine for acquiring and analyzing emotion data, and a function for providing and updating the travel plan.

[0948] System Hardware and Software

[0949] Device: A mobile device such as a smartphone or tablet is used. The device provides a user interface (UI) and a means for travelers to input information. It also has a camera and microphone to capture real-time emotion data.

[0950] Server: Uses a high-performance cloud server or on-premise server. The server analyzes the received traveller input information, retrieves relevant local data from a database, and generates an optimal travel plan using AI algorithms (e.g., Recurrent Neural Network, RNN).

[0951] Emotion Engine: The technologies used to acquire and analyze emotion data include facial recognition technology (OpenCV) and voice analysis technology (Google Cloud Speech-to-Text).

[0952] Process Details

[0953] 1. A user launches a travel application and enters login information and travel destination information (destination, budget, travel companions, values).

[0954] 2. The terminal sends the entered information to the server.

[0955] 3. The server analyzes the received input information and retrieves relevant local data (tourist attractions, events, dining facilities, accommodation, etc.) from the database.

[0956] 4. The server integrates the acquired local data with the user's input information and uses an AI algorithm to generate an optimal travel plan.

[0957] 5. The server sends the generated itinerary to the terminal, which displays it to the user.

[0958] 6. During the trip, the device will acquire the user's emotional data in real time using facial recognition and voice analysis technology and send it to the server.

[0959] 7. The server analyzes the sentiment data and adjusts the travel plan as needed.

[0960] 8. The server sends the adjusted travel plan to the terminal, which notifies the user.

[0961] Specific examples

[0962] For example, suppose a user enters "Tokyo," "budget 100,000 yen," "traveling companion: friend," and "value: cultural experience" into a travel application. In this case, the server retrieves data on tourist attractions, events, restaurants, and hotels related to Tokyo and generates a plan that emphasizes "cultural experience." If the user feels stressed during the trip, the device retrieves emotional data in real time, and the server analyzes this data and suggests cafes and hot springs where they can relax.

[0963] Here are some examples of prompts for generative AI models:

[0964] The user has entered "Tokyo", "budget 100,000 yen", "travelling companion: friends", and "values: cultural experience". Based on this information, generate an ideal travel plan. Also, if the user feels stressed during the trip based on sentiment analysis, suggest how to adjust the travel plan.

[0965] In this way, the present invention provides a system that enables travelers to efficiently plan optimal travel plans and receive emotion-based real-time support during their trip.

[0966] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0967] Step 1:

[0968] A user launches the travel application, enters their login information, and logs in. If they are a new user, they enter the required information, such as their name, email address, and password, on the registration screen.

[0969] Input: User login information (or new registration information)

[0970] Output: Login authentication result

[0971] Specific operation: When the login button is pressed, the terminal sends the input information to the server, and the server checks the database and returns the authentication result.

[0972] Step 2:

[0973] After authenticating the user, the device displays a form for entering travel information, including destination, budget, travel companions, and values.

[0974] Input: None (automatically operates based on user authentication results)

[0975] Output: Display of travel information input form

[0976] Specific operation: Upon receiving the authentication success message, the terminal displays the travel information input form on the screen.

[0977] Step 3:

[0978] The user enters information such as destination, budget, travel companions, and values, and presses the send button.

[0979] Input: Travel information such as destination, budget, travel companions, values, etc.

[0980] Output: Travel information submission request

[0981] Specific operation: After entering travel information, press the send button and the device will send this information to the server in JSON format.

[0982] Step 4:

[0983] The server analyzes the input information received from the user, for example, using a natural language processing algorithm.

[0984] Input: Travel information (JSON format)

[0985] Output: Traveler requirements as analysis results

[0986] Specific operation: The server analyzes the JSON format travel information received and breaks it down into the traveler's required specifications.

[0987] Step 5:

[0988] The server retrieves relevant local data from a database, using database queries to retrieve information about attractions, events, dining options, accommodations, etc. for the destination.

[0989] Input: Traveler's requirements (destination)

[0990] Output: Local data (tourist attractions, events, restaurants, accommodations, etc.)

[0991] Specific operation: The server generates the necessary query and accesses the database to retrieve information related to the destination.

[0992] Step 6:

[0993] The server integrates the acquired regional data with the user's input information and generates an optimal travel plan using an AI algorithm (e.g., Recurrent Neural Network, RNN).

[0994] Input: Acquired regional data, traveler requirements

[0995] Output: Optimal travel plan

[0996] Specific operation: The server inputs regional data and traveler requirements into an AI algorithm to generate an optimal travel plan.

[0997] Step 7:

[0998] The server transmits the generated itinerary to the terminal.

[0999] Input: Optimal Travel Plan

[1000] Output: Trip plan submission request

[1001] Specific operation: The generated travel plan is structured in JSON format and sent to the terminal as an HTTP response.

[1002] Step 8:

[1003] The terminal displays the travel plan on a user interface.

[1004] Input: Travel plan (JSON format)

[1005] Output: A visual display to the user

[1006] Specific operation: The device analyzes the received travel plan and displays it in an easy-to-read format for the user.

[1007] Step 9:

[1008] During the trip, the device uses facial recognition technology (OpenCV) and voice analysis technology (Google Cloud Speech-to-Text) to obtain the user's emotional data in real time.

[1009] Input: None (Real-time traveller data)

[1010] Output: Emotion data

[1011] Specific operation: Data is collected using the device's camera and microphone, and analyzed by an analysis engine to generate emotion data.

[1012] Step 10:

[1013] The emotion data acquired by the device is transmitted to the server.

[1014] Input: Emotion data

[1015] Output: Emotion data transmission request

[1016] Specific operation: Emotion data is composed in JSON format and sent to the server as an HTTP request.

[1017] Step 11:

[1018] The server analyzes the emotion data and adjusts the travel plan as needed.

[1019] Input: Emotion data

[1020] Output: Adjusted itinerary

[1021] How it works: The server analyzes the emotional data, recalculates the travel plan according to the level of stress or excitement, and makes necessary adjustments.

[1022] Step 12:

[1023] The server sends the adjusted travel plan to the terminal, which notifies the user.

[1024] Input: Adjusted travel plans

[1025] Output: Coordinated travel plan submission request, user notification

[1026] Specific operation: The adjusted plan is constructed in JSON format and sent to the device as an HTTP response, and the device notifies the user via push notification or in-app notification.

[1027] In this way, the system dynamically provides optimal travel plans based on travelers' input information and real-time emotional data, significantly improving travel comfort and satisfaction.

[1028] (Application example 2)

[1029] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1030] Conventional travel planning systems provide static itineraries without considering travelers' emotions, which means they cannot quickly respond to changes in travelers' emotions or the latest information during the trip. Furthermore, they lack the functionality to recommend appropriate activities and spots when travelers feel stressed or excited, making it difficult for travelers to have a satisfying experience.

[1031] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving input information from a traveler, means for acquiring related city data based on the input information of the traveler, means for integrating the related city data and the input information of the traveler to generate an optimal itinerary, means for acquiring emotion data from the traveler, means for adjusting the itinerary by analyzing the emotion data, and means for providing the optimal itinerary and the adjusted itinerary to the traveler. This allows the itinerary to be adjusted flexibly and appropriately based on the traveler's emotions and the latest information, enabling the traveler to have a comfortable and satisfying travel experience.

[1032] "Traveler input information" refers to information provided by a traveler when planning a trip, such as travel destination, budget, travel companions, and values.

[1033] "Related city data" refers to data related to tourist attractions, events, restaurants, accommodations, etc. in the city that is the travel destination.

[1034] The "optimal travel plan" is a plan that includes the most ideal travel itinerary and activity content for the traveler, generated by integrating the traveler's input information and related city data.

[1035] "Emotional data" is data that indicates a traveler's real-time emotional state, obtained using facial recognition and voice analysis technologies.

[1036] "Travel plan adjustment" refers to analyzing travelers' sentiment data and making appropriate changes to existing travel plans.

[1037] "Providing to travelers" refers to the act of displaying the optimal travel plan or an adjusted travel plan to travelers via their terminals.

[1038] "Location information" is geographical information that indicates where a traveler is located during a trip.

[1039] "Latest information" refers to real-time data such as changes in weather, traffic conditions, and events at your travel destination.

[1040] "Notifying" refers to the act of displaying information received from the server on the traveler's terminal.

[1041] "Tourist attractions" refer to places in a travel destination that are particularly popular with tourists or have historical or cultural significance.

[1042] "Events" refers to activities such as festivals, concerts, and exhibitions held at your travel destination.

[1043] "Restaurants" refers to establishments that serve meals at travel destinations.

[1044] "Accommodation" refers to facilities for travelers to stay, such as hotels, inns, and guesthouses.

[1045] "Transportation" refers to the means of transportation used by travelers to travel to each tourist attraction or facility.

[1046] A "timetable" refers to the time allocation for each activity in a travel plan.

[1047] System Overview

[1048] This invention is a system that enables travelers to plan travel plans that are both efficient and satisfying. In particular, it improves travel satisfaction by acquiring travelers' emotional data in real time and reflecting this in travel plans. Specific implementation methods of the system are described below.

[1049] Program processing

[1050] User Input Phase

[1051] A traveler (user) launches a travel planning application using a device such as a smartphone or tablet. The user enters login information and necessary information (travel destination, budget, travel companions, values). This information is sent from the device to the server.

[1052] Data Processing Phase

[1053] The server analyzes the input information received from the user and accesses a city database to retrieve relevant city data, including information on tourist attractions, events, restaurants, accommodations, etc. The server then integrates this data with the user's input information and uses AI algorithms to generate an optimal travel plan.

[1054] The server sends the generated itinerary to the traveler's device, which displays it on the user interface so that the user can check and modify it.

[1055] Acquiring and analyzing emotion data

[1056] During the trip, the device uses facial recognition and voice analysis technologies to capture real-time emotional data of the traveler. For example, it uses a camera to analyze the traveler's facial expressions and a microphone to analyze the tone and volume of the voice. This emotional data is sent to a server, which analyzes it in real time and also refers to past emotional data to determine the traveler's emotional state.

[1057] Adjusting travel plans

[1058] The server adjusts the travel plan based on the results of the emotion data analysis. For example, if the traveler feels stressed, it adds relaxing activities (such as cafes and hot springs), and if the traveler feels excited, it adds more exciting activities (such as amusement parks). The adjusted travel plan is sent to the terminal and displayed on the user interface.

[1059] Real-time Support Phase

[1060] During the trip, the server continuously monitors the traveler's location and local updates (such as changes in weather, traffic, and events). Based on this information and real-time emotion data, the server updates the travel plan in real time and sends important alert information to the device. The device then notifies the user of these updates and alerts.

[1061] Specific examples

[1062] If a user inputs "Tokyo," "budget 100,000 yen," "traveling companion: friend," and "values: cultural experience," the server retrieves data on Tokyo's tourist attractions, events, restaurants, and accommodations, and uses a generative AI model to generate an optimal travel plan that includes visits to Sensoji Temple, a kabuki performance, and a traditional craft experience.

[1063] If the user feels stressed during the trip, the server will analyze the emotional data to detect this and suggest additional cafes or hot springs where the user can relax, allowing the user to enjoy the entire trip more comfortably.

[1064] Prompt Sentence Examples

[1065] Generate a travel itinerary for Tokyo that emphasizes cultural experiences.

[1066] If the user feels stressed, suggest a place for them to relax.

[1067] In this way, the present invention provides a system that enables travelers to efficiently plan optimal travel plans and receive emotion-based real-time support during their trip.

[1068] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1069] Step 1:

[1070] A user launches a travel planning application and enters their login information. New users register with the necessary information. This information is saved on the user's device and sent to the server.

[1071] Input: User login information, new registration information

[1072] Output: Authenticated user information

[1073] Step 2:

[1074] The user inputs travel information such as destination, budget, travel companions, and values, and presses the send button. The terminal then sends this travel information to the server.

[1075] Input: Travel information such as destination, budget, travel companions, and values

[1076] Output: Trip information sent to the server

[1077] Step 3:

[1078] The server analyzes the received travel information and accesses a city database to retrieve relevant city data, including information on tourist attractions, events, restaurants, accommodations, etc. Data is dynamically extracted according to the travel destination.

[1079] Input: Travel information sent to the server, city database

[1080] Output: Retrieved city data

[1081] Step 4:

[1082] The server integrates the acquired city data and travel information and generates an optimal travel plan using a generative AI model. An example of a prompt sentence that can be input is, "Please generate a travel plan that emphasizes cultural experiences related to Tokyo."

[1083] Input: Captured city data, travel information, generative AI model

[1084] Output: Optimal travel plan

[1085] Step 5:

[1086] The server sends the generated optimal travel plan to the user's device, which displays it in a user interface, allowing the user to review it and make changes as needed.

[1087] Input: Best Travel Planner

[1088] Output: The itinerary displayed in the user interface

[1089] Step 6:

[1090] During the journey, the device will capture real-time emotional data using facial recognition and voice analysis technology, specifically using the device's camera and microphone.

[1091] Input: Real-time audio and video of the user while traveling

[1092] Output: Obtained emotion data

[1093] Step 7:

[1094] The acquired emotional data is transmitted to a server, which analyzes the emotional data in real time and determines the user's current emotional state.

[1095] Input: Captured emotion data

[1096] Output: Parsed emotional state

[1097] Step 8:

[1098] The server adjusts the itinerary based on the user's emotional state. For example, if the user is stressed, it adds relaxing activities, and if the user is excited, it adds exciting activities. An example prompt could be "If the user is stressed, please suggest places where he can relax."

[1099] Input: Parsed emotional state, original travel plan

[1100] Output: Adjusted itinerary

[1101] Step 9:

[1102] The adjusted itinerary is sent to the user's terminal and displayed on the user interface, allowing the user to confirm the adjusted itinerary.

[1103] Input: Adjusted travel plan

[1104] Output: The adjusted itinerary displayed in the user interface.

[1105] Step 10:

[1106] During the trip, the server continuously monitors the traveler's location and local updates (such as weather, traffic, and event changes), which are obtained and used in real time.

[1107] Input: Traveler location, local updates

[1108] Output: Retrieved location information and latest updates

[1109] Step 11:

[1110] The server updates the travel plan in real time based on the latest information and emotion data obtained, thereby constantly optimizing the user's travel experience.

[1111] Input: Obtained location information, updates, and emotion data

[1112] Output: Updated itinerary

[1113] Step 12:

[1114] The server sends update information and important alert information to the user's terminal, which then notifies the user.

[1115] Input: Updated travel plans, alert information

[1116] Output: Updates and alerts notified to the user

[1117] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1118] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1119] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1120] [Third embodiment]

[1121] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1122] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1123] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1124] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1125] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1126] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1127] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1128] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1129] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1130] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1131] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1132] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1133] MODE FOR CARRYING OUT THE INVENTION

[1134] System Overview

[1135] The present invention provides a system that enables travelers to efficiently plan their ideal itinerary. Specifically, it provides a method and apparatus for generating an optimal itinerary based on information input by the traveler. The system includes a terminal that receives the traveler's input information, a server that acquires city data and generates an optimal itinerary, and a function for providing and updating the itinerary.

[1136] Program processing

[1137] User Input Phase

[1138] 1. A user launches the travel application and enters their login information on the login screen, or if they are a new user, enters the required information on the registration screen.

[1139] 2. After authenticating the user, the terminal displays a form for entering travel information.

[1140] 3. The user enters information such as destination, budget, travel companions, and values, and presses the send button.

[1141] 4. The terminal sends the user's input information to the server.

[1142] Data Processing Phase

[1143] 1. The server analyzes the input information received from the user.

[1144] 2. The server accesses the city database and retrieves data related to the entered destination (tourist attractions, events, restaurants, hotels, etc.).

[1145] 3. The server integrates the acquired city data with the user's input information and uses an AI algorithm to generate an optimal travel plan.

[1146] 4. The server sends the generated travel plan to the terminal.

[1147] Show Plan Phase

[1148] 1. The terminal displays the travel plan received from the server on the user interface.

[1149] 2. The user is presented with an interface that allows them to review the displayed itinerary and fine-tune the plan if necessary.

[1150] 3. The device sends the user's fine-tuning information to the server, which then re-plans.

[1151] 4. The server sends the updated itinerary to the terminal, which displays it again to the user.

[1152] Real-time Support Phase

[1153] 1. The server monitors the location and latest information (weather, event changes, etc.) of travelers during their trip.

[1154] 2. The travel plan is updated in real time based on the latest information obtained by the server.

[1155] 3. The server sends updated plans and important alert information to the device.

[1156] 4. The device notifies the user of updates and alerts received from the server.

[1157] Specific examples

[1158] For example, suppose a user inputs "Tokyo," "budget 100,000 yen," "traveling companion: friend," and "value: cultural experience." In this case, the server retrieves data on tourist attractions, events, restaurants, and hotels related to Tokyo. Next, it generates a plan that emphasizes the user's cultural experiences and proposes it to the user. This plan might include Sensoji Temple in Asakusa, a kabuki performance, and a traditional craft experience. Furthermore, if it suddenly rains in the area, the server will reflect the local weather information and suggest changing the user's plans to indoor activities.

[1159] In this way, the present invention provides a system that allows travelers to efficiently plan optimal travel plans and receive real-time support during their trip.

[1160] The processing flow will be explained below.

[1161] User Input Phase

[1162] Step 1:

[1163] The user launches the travel application and enters their login information into the login screen.

[1164] Step 2:

[1165] The terminal performs user authentication, and if the authentication is successful, sends the user information to the server.

[1166] Step 3:

[1167] The server checks the user information against an authentication database, and if authentication is successful, returns an authentication success message to the terminal.

[1168] Step 4:

[1169] The terminal receives the authentication success message and displays a form for the user to enter travel information.

[1170] Step 5:

[1171] The user enters information such as destination, budget, travel companions, and values ​​into the form and presses the submit button.

[1172] Step 6:

[1173] The terminal transmits the user's input information to the server.

[1174] Data Processing Phase

[1175] Step 1:

[1176] The server analyzes the input information received from the user.

[1177] Step 2:

[1178] The server accesses a city database to retrieve data related to the entered destination (tourist attractions, events, restaurants, hotels, etc.).

[1179] Step 3:

[1180] The server combines the city data it has acquired with the user's input information and uses an AI algorithm to generate an optimal travel plan.

[1181] Step 4:

[1182] The server transmits the generated itinerary to the terminal.

[1183] Show Plan Phase

[1184] Step 1:

[1185] The terminal displays the travel plan received from the server on a user interface.

[1186] Step 2:

[1187] The user confirms the displayed itinerary.

[1188] Step 3:

[1189] The user can then fine-tune the plan as needed and hit send again.

[1190] Step 4:

[1191] The device sends the user's fine-tuning details to the server.

[1192] Step 5:

[1193] The server receives the user's tweaks and re-plans.

[1194] Step 6:

[1195] The server sends the updated itinerary to the terminal.

[1196] Step 7:

[1197] The terminal displays the replanned itinerary again to the user.

[1198] Real-time Support Phase

[1199] Step 1:

[1200] The server monitors the location information of travelers in real time during their trip.

[1201] Step 2:

[1202] The server retrieves local updates (weather, traffic, event changes, etc.).

[1203] Step 3:

[1204] Travel plans are updated in real time based on the latest information obtained by the server.

[1205] Step 4:

[1206] The server sends updated travel plans and important alert information to the device.

[1207] Step 5:

[1208] The device notifies the user of updates and alerts received from the server.

[1209] Through these steps, users can efficiently create optimal travel plans and receive real-time support during their trip.

[1210] Example 1

[1211] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1212] Conventional travel planning systems can generate travel plans based on information entered by the user, but they have difficulty obtaining appropriate city data and generating optimal travel plans that match the user's values. Furthermore, they have problems in that they are unable to provide real-time support during the trip or flexibly respond to external conditions (such as weather changes or event cancellations). The purpose of this invention is to solve these problems, efficiently plan the ideal travel plan for travelers, and provide real-time support.

[1213] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1214] In this invention, the server includes a means for receiving traveler input information, a means for acquiring related city data, and a means for generating an optimal travel plan using an artificial intelligence algorithm. This allows for effective acquisition of city data based on the information entered by the traveler, enabling the generation of an optimal travel plan suited to the user's values ​​and requirements. The server also monitors the traveler's location information and latest information during the trip, and updates the travel plan in real time based on this information, thereby enabling flexible responses during the trip. Furthermore, by accepting traveler adjustments and re-planning, it is possible to provide a flexible travel plan that meets the user's requests.

[1215] "Traveler input information" refers to information about personal preferences and requirements provided by a traveler to plan a trip, such as travel destination, budget, travel companions, and values.

[1216] "City data" is information related to a specific city, such as tourist attractions, events, restaurants, and accommodations, and is data used to create travel plans.

[1217] "Artificial intelligence algorithms" are algorithms that include techniques such as machine learning and deep learning, which are used to analyze massive amounts of data and generate optimal travel plans.

[1218] "User Interface" means the software and hardware interfaces that provide the screens and controls used by travelers to view, edit, and update their travel plans.

[1219] "Location information" is data used to identify the geographic location of a particular individual or object using technologies such as GPS.

[1220] "Latest information" refers to real-time information that is important to travelers, such as weather forecasts, event changes, and traffic conditions.

[1221] "Real-time updates" means quickly changing travel plans in response to changes in external conditions that occur during the trip (such as weather changes or event cancellations).

[1222] "Notify" means informing travelers of travel plan updates and important information via their device.

[1223] "Tweaks" are small modifications made by travelers to change some of their plans or to reflect additional requests.

[1224] MODE FOR CARRYING OUT THE INVENTION

[1225] System Overview

[1226] The present invention is a system for enabling travelers to create efficient and ideal travel plans. This system generates, displays, and updates an optimal travel plan based on information input by the traveler. It includes a means for receiving the traveler's input information, a means for acquiring city data, a means for integrating the acquired data with the traveler's input information and generating an optimal travel plan using an artificial intelligence algorithm, and a means for providing the traveler with the travel plan and fine-tuning it.

[1227] Hardware and software used

[1228] 1. Server: Responsible for data processing, accessing the city database, and generating and updating itineraries. Software used includes a natural language processing engine and generative AI models (such as TensorFlow or PyTorch). The hardware is expected to be a cloud service (e.g., AWS EC2 instances).

[1229] 2. Terminal: The terminal is used to input information, display travel plans, and make fine adjustments through the user interface. Front-end software such as React or Vue.js is used.

[1230] 3. Database: A database such as MongoDB is used to store city data (tourist attractions, events, hotels, restaurants, etc.).

[1231] 4. GPS devices: Used to obtain and monitor the location of travelers.

[1232] Program processing

[1233] 1. The user launches the travel application on their device and enters their login information. If they are a new user, they enter the required information on the registration screen.

[1234] 2. After authenticating the user, the device displays a travel information input form, where the user enters information such as destination, budget, travel companions, and values, and submits it.

[1235] 3. The device sends the input information to the server, which analyzes the input information and accesses the city database to retrieve relevant city information.

[1236] 4. The server integrates the acquired city data with the user's input information and generates an optimal travel plan using a generative AI model.

[1237] 5. The server sends the generated itinerary to the terminal, which displays it on the user interface.

[1238] 6. The user checks the itinerary and makes any necessary adjustments. The device sends the changes to the server, which then re-plans and sends the updated itinerary back to the device.

[1239] Real-time Support

[1240] 1. The server monitors the location information of the traveler through the GPS device during the trip, and obtains the traveler's location information and the latest weather and event change information in real time.

[1241] 2. The server updates the travel plan in real time based on the latest information and sends the updated information to the device.

[1242] 3. The terminal notifies the user interface of the updated information received from the server, allowing the user to review the plan based on the new information.

[1243] Examples and prompts

[1244] For example, if a user inputs "Tokyo," "budget 100,000 yen," "traveling companion: friend," and "value: cultural experience," the server retrieves city data related to Tokyo (information on tourist attractions, events, restaurants, and hotels) and generates an optimal travel plan that emphasizes cultural experiences. This travel plan includes a visit to Sensoji Temple, a kabuki performance, and a traditional craft experience.

[1245] If the weather worsens in Tokyo during a trip, the server retrieves the weather forecast in real time, generates an updated itinerary that changes outdoor activities to indoor activities, such as visiting a museum or an indoor art gallery, and notifies the user.

[1246] Prompt Sentence Examples

[1247] "Travel planning assistant. The user is planning a trip to Tokyo with a budget of ¥100,000, friends as companions, and cultural experiences as their value. Create a travel plan that suggests appropriate tourist spots and activities and adapts to changing weather conditions."

[1248] In this way, the present invention provides a system that allows travelers to efficiently plan optimal travel plans and receive real-time support during their trip.

[1249] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1250] Step 1:

[1251] A user launches a travel application and enters their login information. If they are a new user, they enter the required information, such as their name, email address, and password, on the registration screen. The information they enter is processed as input data on their device and sent to the server.

[1252] Input: User login or registration information

[1253] Output: Authentication request data from the device to the server

[1254] Specific behavior:

[1255] A user launches an application on their smartphone or PC and goes to the login screen. They enter their email address and password. If they are a new user, they enter the required registration information into the form.

[1256] Step 2:

[1257] The server authenticates the login information it receives, searching the database for authentication if the user is already there, or adding the information to the database if the user is new.

[1258] Input: Login or registration information sent from your device

[1259] Output: Authentication result (success / failure) and user data when authentication is successful

[1260] Specific behavior:

[1261] The server verifies the login information using a database (e.g., MySQL or MongoDB) and performs authentication. If authentication is successful, it generates and returns a token to proceed to the next step.

[1262] Step 3:

[1263] After authenticating the user, the terminal displays a travel information input form, in which the user enters detailed information such as destination, budget, travel dates, travel companions, and values, and submits the form.

[1264] Input: User data after successful authentication

[1265] Output: Trip information entered by the user

[1266] Specific behavior:

[1267] The user enters travel preferences such as destination, budget, companions, and values ​​into the displayed travel information input form, and presses the send button to send the information to the server.

[1268] Step 4:

[1269] The terminal sends the user's input information to the server, which receives the input information and begins analyzing it.

[1270] Input: User's travel information

[1271] Output: Trip information sent to the server

[1272] Specific behavior:

[1273] The terminal sends the user's input information as an HTTP request to the server, which receives it and starts processing the data.

[1274] Step 5:

[1275] The server analyzes the received user travel information and converts it into structured data using a natural language processing engine.

[1276] Input: User's travel information

[1277] Output: Structured travel information

[1278] Specific behavior:

[1279] The server receives the user's input information and uses a natural language processing engine to analyze and convert it into the necessary data. For example, information such as "cultural experience" or "budget of 100,000 yen" is analyzed and converted into an internal data structure.

[1280] Step 6:

[1281] The server accesses a city database and retrieves city data such as tourist attractions, events, restaurants, and accommodations related to the destination entered by the user.

[1282] Input: Structured travel information (e.g., destination)

[1283] Output: City data (tourist attractions, events, restaurants, accommodations, etc.)

[1284] Specific behavior:

[1285] The server connects to a city database (e.g. MongoDB) and queries and retrieves information about attractions, events, restaurants, and accommodations based on the destination.

[1286] Step 7:

[1287] The server integrates the acquired city data with the user's structured data and generates an optimal travel plan using a generative AI model.

[1288] Input: City data and structured travel information

[1289] Output: Optimal travel plan

[1290] Specific behavior:

[1291] The server integrates the city data it acquires with user information, and uses a generative AI model built with TensorFlow and PyTorch to generate an optimal travel plan based on the user's requests and conditions.

[1292] Step 8:

[1293] The server transmits the generated itinerary to the terminal, which displays it on a user interface.

[1294] Input: Best Travel Planner

[1295] Output: Travel plan display data

[1296] Specific behavior:

[1297] The server generates the itinerary and sends it to the device in a structured format. The device receives this data and displays it in a user interface using React and Vue.js.

[1298] Step 9:

[1299] The user checks the displayed itinerary and makes any necessary adjustments. The adjustments are entered and sent to the server by the device.

[1300] Input: User tweaks

[1301] Output: Fine-tuned trip information

[1302] Specific behavior:

[1303] The user checks the travel plan, changes some of the plans, or enters new requests. The terminal sends this information to the server.

[1304] Step 10:

[1305] The server re-plans based on the fine-tuning information received from the user, generates an updated itinerary, and sends it to the terminal, which displays it again on the user interface.

[1306] Input: Fine-tuned travel information

[1307] Output: Updated itinerary

[1308] Specific behavior:

[1309] The server again uses its AI algorithm to generate a new itinerary based on the user's tweaks, which the device receives and displays the updated itinerary.

[1310] Step 11:

[1311] The server monitors the location of travelers during their trip via their GPS devices and obtains the latest information on weather, event changes, etc.

[1312] Input: Traveler location, weather updates, event changes

[1313] Output: Latest travel plan updates

[1314] Specific behavior:

[1315] The server obtains the traveler's GPS data and collects the latest information from weather APIs, event APIs, etc.

[1316] Step 12:

[1317] The server updates the travel plan in real time based on the latest information, and the device displays the updated information on the user interface and sends push notifications as needed.

[1318] Input: Latest travel plan update

[1319] Output: User notification

[1320] Specific behavior:

[1321] The server automatically updates the travel plan based on the latest information and sends it to the device, which receives it, displays it on the user interface, and notifies the user via push notifications, etc.

[1322] (Application example 1)

[1323] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1324] Traditional travel planning systems are unable to provide an appropriate combination of travelers' dining preferences and local food delivery data. As a result, travelers have to spend time finding the best dining options at their destinations, which can lead to a lower quality trip. They also lack real-time food delivery recommendations based on the latest local information, resulting in a lack of planning flexibility, making it difficult for travelers to enjoy truly satisfying dining experiences during their trips.

[1325] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1326] In this invention, the server includes means for receiving input information from a traveler, means for acquiring related city data based on the traveler's input information, means for integrating the related city data with the traveler's input information to generate an optimal travel plan, means for acquiring local food service facility data based on the optimal travel plan and integrating the data with the traveler's preferences to generate food delivery recommendations, means for providing the recommended food delivery information to the traveler, and means for updating the food delivery recommendations in real time based on the traveler's current location information. This allows travelers to easily find the optimal food delivery options for their destinations. Furthermore, real-time plan updates allow travelers to enjoy an optimal dining experience tailored to the latest conditions.

[1327] "Traveller" means an individual or group that plans and undertakes a trip.

[1328] "Input Information" refers to data such as destination, budget, travel companions, values, and preferences that a traveler provides to generate a travel plan.

[1329] "City Data" means information about attractions, events, restaurants, hotels, transportation, and other information about a particular city.

[1330] "Optimal travel plan" refers to a travel schedule generated based on the traveler's input information and city data to best meet the traveler's requirements.

[1331] "Dining Facility Data" refers to information about restaurants, cafes, food delivery services, etc. within a particular area.

[1332] "Food Delivery Recommendations" refers to information recommending specific dining options or delivery services based on a traveler's preferences and current circumstances.

[1333] "Traveler's current location information" refers to geographic information indicating the location where the traveler is actually moving.

[1334] "Real-time updates" refers to the process of instantly modifying or changing travel plans or recommendations based on current, up-to-date information.

[1335] System Overview

[1336] This invention is a system that enables travelers to enjoy optimal food delivery at their destinations. Specifically, it generates an optimal travel plan based on the traveler's input information, acquires data on local food establishments based on the plan, and recommends food delivery options that match the traveler's preferences. It also monitors location information in real time and provides the traveler with the latest travel plans and food delivery recommendations.

[1337] Program processing

[1338] User Input Phase

[1339] Users log in using a device such as a smartphone or tablet and enter their travel information, including their destination, budget, travel companions, values, preferences, etc. This information is then sent from the device to the server.

[1340] Data Processing Phase

[1341] The server uses software such as Python and the Requests library to perform the following tasks:

[1342] 1. Parse the input information received from the user.

[1343] 2. Obtain data on tourist attractions, events, restaurants, hotels, etc. from a city database.

[1344] 3. The acquired city data and user input information are input into a generative AI model to generate an optimal travel plan.

[1345] 4. Based on the travel plan, local dining establishment data is retrieved and integrated with the user's preferences to generate food delivery recommendations.

[1346] Show Plan Phase

[1347] The device displays the travel plan and food delivery recommendations received from the server on the user interface. The user checks the displayed plan and makes adjustments as necessary. The device sends the user's adjustments to the server, which then re-plans. The updated plan and recommendations are sent back to the device and displayed to the user.

[1348] Real-time Support Phase

[1349] The server monitors the traveler's real-time location and local updates (weather, event changes, etc.). Based on these updates, it updates travel plans and food delivery recommendations in real time and notifies the device. Users can receive these updates via their smartphone or tablet and take appropriate action.

[1350] Specific examples of programs

[1351] For example, if a traveler enters "Tokyo," "budget of 100,000 yen," "traveling companion: friends," "values: cultural experiences," and "preferences: vegetarian food," the server will retrieve data on vegetarian-friendly restaurants along with data on tourist attractions and events in Tokyo, and generate optimal travel plans and food delivery recommendations. During the travel period, for example, if the traveler is in Asakusa, it will recommend delivery of "Japanese vegetarian food." Also, if it suddenly rains in the area, the server will reflect the weather information and change the traveler's plans to indoor activities, and re-suggest meals that can be enjoyed indoors.

[1352] Prompt Sentence Examples

[1353] "Destination: Tokyo, Duration: 5 days, Budget: 20,000 yen, Number of people: 2. Please recommend a local vegetarian restaurant and its menu."

[1354] As described above, the present invention provides a system that allows travelers to easily plan optimal dining experiences and travel plans and receive real-time support during their trip.

[1355] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1356] Step 1:

[1357] The user launches the travel application and enters their login information on the login screen. If they are a new user, they enter the required information on the registration screen. The entered information is sent from the device to the server. Based on the input, the server authenticates the user. If authentication is successful, the travel information input form is displayed on the device.

[1358] Step 2:

[1359] The user enters travel information such as destination, budget, travel companions, values, and preferences, and then presses the send button. The entered data is sent from the device to the server. The server analyzes the received information and extracts the traveler's preferences and requests. This analysis includes data processing such as natural language processing.

[1360] Step 3:

[1361] The server accesses the city database and retrieves data related to the entered destination (tourist attractions, events, restaurants, hotels, etc.). This database can be, for example, MongoDB or PostgreSQL. The retrieved data is temporarily stored.

[1362] Step 4:

[1363] The server combines the city data it acquires with the user's input information and uses a generative AI model to generate an optimal travel plan. Specifically, it selects tourist attractions, events, and restaurants based on the user's values ​​and preferences, and optimizes the timetable and transportation methods. For example, GPT-3 is used as the generative AI model.

[1364] Step 5:

[1365] Based on the optimal itinerary, the server retrieves local dining establishment data, integrates it with the user's preferences, and generates food delivery recommendations. For example, it uses automated queries to retrieve data from a local restaurant API and filters it against the user's preferences.

[1366] Step 6:

[1367] The server sends the generated travel plans and food delivery recommendations to the device, which displays the received information on a user interface. The user can review the proposed travel plans and food delivery recommendations and make adjustments as needed.

[1368] Step 7:

[1369] The user's refinements are sent to the server, which then re-generates the itinerary. The updated itinerary is then sent back to the device and displayed again, allowing the user to receive optimal itinerary and food delivery recommendations in real time.

[1370] Step 8:

[1371] During the trip, the server monitors the user's location information and the latest local information (weather, event changes, etc.). The current location information is periodically sent to the server as GPS data, and the server takes the appropriate action based on that information.

[1372] Step 9:

[1373] The server updates travel plans and food delivery recommendations in real time based on the latest information it receives, again using the AI ​​model to adjust plans to accommodate changes in weather or event cancellations, for example.

[1374] Step 10:

[1375] The server sends updated plans and important alert information to the device, which then notifies the user, allowing the user to receive real-time updates on travel plans and food delivery information and make appropriate changes.

[1376] As described above, this system provides advanced support for users to enjoy an optimal experience during their trip. Through specific actions and data processing, it is possible to provide appropriate and timely travel plans and food delivery recommendations.

[1377] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1378] MODE FOR CARRYING OUT THE INVENTION

[1379] System Overview

[1380] The present invention provides a system that enables travelers to efficiently plan their ideal itinerary, and in particular has the function of recognizing the travelers' emotions and reflecting them in the itinerary. Specifically, it provides a method and apparatus for generating an optimal itinerary based on the travelers' input information and further personalizing the itinerary by analyzing the travelers' real-time and past emotional data. The system includes a terminal that receives the travelers' input information, a server that acquires city data and generates an optimal itinerary, an emotion engine, and a function for providing and updating the itinerary.

[1381] Program processing

[1382] User Input Phase

[1383] 1. A user launches the travel application and enters their login information on the login screen, or if they are a new user, enters the required information on the registration screen.

[1384] 2. After authenticating the user, the terminal displays a form for entering travel information.

[1385] 3. The user enters information such as destination, budget, travel companions, and values ​​into the form and presses the submit button.

[1386] 4. The terminal sends the user's input information to the server.

[1387] Data Processing Phase

[1388] 1. The server analyzes the input information received from the user.

[1389] 2. The server accesses the city database and retrieves data related to the entered destination (tourist attractions, events, restaurants, hotels, etc.).

[1390] 3. The server integrates the acquired city data with the user's input information and uses an AI algorithm to generate an optimal travel plan.

[1391] 4. The server sends the generated travel plan to the terminal.

[1392] Emotion engine processing

[1393] Acquiring and analyzing emotion data

[1394] 1. The device acquires real-time emotional data of travelers using facial recognition and voice analysis technologies.

[1395] 2. The device sends the acquired emotion data to the server.

[1396] 3. The server analyzes the real-time emotional data and determines the traveler's current emotional state.

[1397] 4. The server analyzes the data, including past emotional data, and determines how to adjust the travel plan.

[1398] Emotion-based travel planning adjustments

[1399] 1. The server recommends activities and hotels that can help travelers relax if they are feeling stressed.

[1400] 2. The server adjusts the travel plan to add more exciting activities if the traveler is excited.

[1401] 3. The server sends the adjusted itinerary to the terminal.

[1402] 4. The device displays the adjusted itinerary and activities on the user interface.

[1403] Real-time Support Phase

[1404] 1. The server continuously monitors the location information and real-time emotion data of travelers during their trip.

[1405] 2. The server retrieves local updates (weather, traffic, event changes, etc.) and emotion data.

[1406] 3. The server updates the travel plan in real time based on the latest local information and sentiment data.

[1407] 4. The server sends updated travel plans and important alert information to the device.

[1408] 5. The device notifies the user of updates and alerts received from the server.

[1409] Specific examples

[1410] For example, suppose a user inputs "Tokyo," "budget 100,000 yen," "traveling companion: friend," and "value: cultural experience." In this case, the server retrieves data on tourist attractions, events, restaurants, and hotels related to Tokyo. Next, it generates a plan that emphasizes the user's cultural experience and proposes it to the user. This plan includes visits to Sensoji Temple in Asakusa, a kabuki performance, and a traditional craft experience.

[1411] Furthermore, if the user begins to feel stressed during the trip, the server will detect this state using the emotion engine and adjust the travel plan by suggesting additional activities such as relaxing cafes or hot springs, allowing the user to enjoy the entire trip more comfortably.

[1412] In this way, the present invention provides a system that enables travelers to efficiently plan optimal travel plans and receive emotion-based real-time support during their trip.

[1413] The processing flow will be explained below.

[1414] User Input Phase

[1415] Step 1:

[1416] The user launches the travel application and enters their login information into the login screen.

[1417] Step 2:

[1418] The terminal performs user authentication, and if the authentication is successful, sends the user information to the server.

[1419] Step 3:

[1420] The server checks the user information against an authentication database, and if authentication is successful, returns an authentication success message to the terminal.

[1421] Step 4:

[1422] The terminal receives the authentication success message and displays a form for the user to enter travel information.

[1423] Step 5:

[1424] The user enters information such as destination, budget, travel companions, and values ​​into the form and presses the submit button.

[1425] Step 6:

[1426] The terminal transmits the user's input information to the server.

[1427] Data Processing Phase

[1428] Step 1:

[1429] The server analyzes the input information received from the user.

[1430] Step 2:

[1431] The server accesses a city database to retrieve data related to the entered destination (tourist attractions, events, restaurants, hotels, etc.).

[1432] Step 3:

[1433] The server combines the city data it has acquired with the user's input information and uses an AI algorithm to generate an optimal travel plan.

[1434] Step 4:

[1435] The server transmits the generated itinerary to the terminal.

[1436] Show Plan Phase

[1437] Step 1:

[1438] The terminal displays the travel plan received from the server on a user interface.

[1439] Step 2:

[1440] The user confirms the displayed itinerary.

[1441] Step 3:

[1442] The user can then fine-tune the plan as needed and hit send again.

[1443] Step 4:

[1444] The device sends the user's fine-tuning details to the server.

[1445] Step 5:

[1446] The server receives the user's tweaks and re-plans.

[1447] Step 6:

[1448] The server sends the updated itinerary to the terminal.

[1449] Step 7:

[1450] The terminal displays the replanned itinerary again to the user.

[1451] Emotion engine processing

[1452] Acquiring and analyzing emotion data

[1453] Step 1:

[1454] The device will acquire real-time emotional data from travelers using facial recognition and voice analysis technologies.

[1455] Step 2:

[1456] The emotion data acquired by the terminal is transmitted to the server.

[1457] Step 3:

[1458] The server analyzes real-time emotional data to determine the traveler's current emotional state.

[1459] Step 4:

[1460] The server analyzes the data, including past emotional data, and determines how to adjust the travel plan.

[1461] Emotion-based travel planning adjustments

[1462] Step 1:

[1463] The server will recommend relaxing activities and hotels if the traveler is feeling stressed.

[1464] Step 2:

[1465] The server adjusts the itinerary to add more exciting activities if the traveler is excited.

[1466] Step 3:

[1467] The server sends the adjusted itinerary to the terminal.

[1468] Step 4:

[1469] The device displays the adjusted itinerary and activities on a user interface.

[1470] Real-time Support Phase

[1471] Step 1:

[1472] The server monitors the location information of travelers in real time during their trip.

[1473] Step 2:

[1474] The server retrieves local updates (weather, traffic, event changes, etc.) and emotion data.

[1475] Step 3:

[1476] The travel plan is updated in real time based on the latest information and emotion data obtained by the server.

[1477] Step 4:

[1478] The server sends updated travel plans and important alert information to the device.

[1479] Step 5:

[1480] The device notifies the user of updates and alerts received from the server.

[1481] Through the above steps, a system is provided that enables users to efficiently plan optimal travel plans and receive real-time emotional support during their trip.

[1482] Example 2

[1483] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1484] Conventional travel planning systems provide travel plans based on user input, but they are unable to consider the real-time emotional state of travelers or the latest local information, which means they are unable to fully support travelers' comfortable travel experiences. Furthermore, plans are not adjusted to reflect changes in travelers' emotions during the trip, and real-time support to reduce travelers' stress is lacking.

[1485] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for receiving input information from a traveler, means for acquiring related area data based on the input information from the traveler, means for integrating the related area data and the input information from the traveler to generate an optimal itinerary, means for providing the optimal itinerary to the traveler, means for acquiring emotional data from the traveler in real time, and means for analyzing the emotional data and adjusting the itinerary. This makes it possible to dynamically adjust the itinerary based on the real-time emotional state of the traveler and the latest local information, allowing the traveler to enjoy a comfortable and fulfilling travel experience.

[1486] "Traveler input information" refers to information such as destination, budget, travel companions, and values ​​that a traveler inputs when planning a trip.

[1487] "Regional data" refers to data that includes information about tourist attractions, events, dining facilities, accommodations, and the like related to a particular region.

[1488] A "travel plan" is a schedule or itinerary that is planned by combining tourist attractions to visit, events to participate in, dining facilities and accommodations to use, etc.

[1489] "Emotional data" is data obtained by using facial recognition and voice analysis technology to capture a traveler's real-time emotional state.

[1490] "Real-time updates" means modifying and changing information and plans instantly based on current situations and conditions.

[1491] "Analysis" is the process of analyzing acquired data in detail and extracting meaning and relationships.

[1492] "Selection" means choosing the most suitable one from multiple candidates.

[1493] "Ordering" means rearranging selected elements in an appropriate order.

[1494] "Transportation" means the means of transportation used by a traveler to travel from one point to another.

[1495] A "timetable" is a schedule that divides dates and itineraries into time periods.

[1496] The present invention relates to a system for generating an optimal travel plan based on traveler input information and personalizing the travel plan by analyzing real-time traveler emotion data. The system includes a terminal for receiving traveler input information, a server for acquiring relevant area data, an emotion engine for acquiring and analyzing emotion data, and a function for providing and updating the travel plan.

[1497] System Hardware and Software

[1498] Device: A mobile device such as a smartphone or tablet is used. The device provides a user interface (UI) and a means for travelers to input information. It also has a camera and microphone to capture real-time emotion data.

[1499] Server: Uses a high-performance cloud server or on-premise server. The server analyzes the received traveller input information, retrieves relevant local data from a database, and generates an optimal travel plan using AI algorithms (e.g., Recurrent Neural Network, RNN).

[1500] Emotion Engine: The technologies used to acquire and analyze emotion data include facial recognition technology (OpenCV) and voice analysis technology (Google Cloud Speech-to-Text).

[1501] Process Details

[1502] 1. A user launches a travel application and enters login information and travel destination information (destination, budget, travel companions, values).

[1503] 2. The terminal sends the entered information to the server.

[1504] 3. The server analyzes the received input information and retrieves relevant local data (tourist attractions, events, dining facilities, accommodation, etc.) from the database.

[1505] 4. The server integrates the acquired local data with the user's input information and uses an AI algorithm to generate an optimal travel plan.

[1506] 5. The server sends the generated itinerary to the terminal, which displays it to the user.

[1507] 6. During the trip, the device will acquire the user's emotional data in real time using facial recognition and voice analysis technology and send it to the server.

[1508] 7. The server analyzes the sentiment data and adjusts the travel plan as needed.

[1509] 8. The server sends the adjusted travel plan to the terminal, which notifies the user.

[1510] Specific examples

[1511] For example, suppose a user enters "Tokyo," "budget 100,000 yen," "traveling companion: friend," and "value: cultural experience" into a travel application. In this case, the server retrieves data on tourist attractions, events, restaurants, and hotels related to Tokyo and generates a plan that emphasizes "cultural experience." If the user feels stressed during the trip, the device retrieves emotional data in real time, and the server analyzes this data and suggests cafes and hot springs where they can relax.

[1512] Here are some examples of prompts for generative AI models:

[1513] The user has entered "Tokyo", "budget 100,000 yen", "travelling companion: friends", and "values: cultural experience". Based on this information, generate an ideal travel plan. Also, if the user feels stressed during the trip based on sentiment analysis, suggest how to adjust the travel plan.

[1514] In this way, the present invention provides a system that enables travelers to efficiently plan optimal travel plans and receive emotion-based real-time support during their trip.

[1515] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1516] Step 1:

[1517] A user launches the travel application, enters their login information, and logs in. If they are a new user, they enter the required information, such as their name, email address, and password, on the registration screen.

[1518] Input: User login information (or new registration information)

[1519] Output: Login authentication result

[1520] Specific operation: When the login button is pressed, the terminal sends the input information to the server, and the server checks the database and returns the authentication result.

[1521] Step 2:

[1522] After authenticating the user, the device displays a form for entering travel information, including destination, budget, travel companions, and values.

[1523] Input: None (automatically operates based on user authentication results)

[1524] Output: Display of travel information input form

[1525] Specific operation: Upon receiving the authentication success message, the terminal displays the travel information input form on the screen.

[1526] Step 3:

[1527] The user enters information such as destination, budget, travel companions, and values, and presses the send button.

[1528] Input: Travel information such as destination, budget, travel companions, values, etc.

[1529] Output: Travel information submission request

[1530] Specific operation: After entering travel information, press the send button and the device will send this information to the server in JSON format.

[1531] Step 4:

[1532] The server analyzes the input information received from the user, for example, using a natural language processing algorithm.

[1533] Input: Travel information (JSON format)

[1534] Output: Traveler requirements as analysis results

[1535] Specific operation: The server analyzes the JSON format travel information received and breaks it down into the traveler's required specifications.

[1536] Step 5:

[1537] The server retrieves relevant local data from a database, using database queries to retrieve information about attractions, events, dining options, accommodations, etc. for the destination.

[1538] Input: Traveler's requirements (destination)

[1539] Output: Local data (tourist attractions, events, restaurants, accommodations, etc.)

[1540] Specific operation: The server generates the necessary query and accesses the database to retrieve information related to the destination.

[1541] Step 6:

[1542] The server integrates the acquired regional data with the user's input information and generates an optimal travel plan using an AI algorithm (e.g., Recurrent Neural Network, RNN).

[1543] Input: Acquired regional data, traveler requirements

[1544] Output: Optimal travel plan

[1545] Specific operation: The server inputs regional data and traveler requirements into an AI algorithm to generate an optimal travel plan.

[1546] Step 7:

[1547] The server transmits the generated itinerary to the terminal.

[1548] Input: Optimal Travel Plan

[1549] Output: Trip plan submission request

[1550] Specific operation: The generated travel plan is structured in JSON format and sent to the terminal as an HTTP response.

[1551] Step 8:

[1552] The terminal displays the travel plan on a user interface.

[1553] Input: Travel plan (JSON format)

[1554] Output: A visual display to the user

[1555] Specific operation: The device analyzes the received travel plan and displays it in an easy-to-read format for the user.

[1556] Step 9:

[1557] During the trip, the device uses facial recognition technology (OpenCV) and voice analysis technology (Google Cloud Speech-to-Text) to obtain the user's emotional data in real time.

[1558] Input: None (Real-time traveller data)

[1559] Output: Emotion data

[1560] Specific operation: Data is collected using the device's camera and microphone, and analyzed by an analysis engine to generate emotion data.

[1561] Step 10:

[1562] The emotion data acquired by the device is transmitted to the server.

[1563] Input: Emotion data

[1564] Output: Emotion data transmission request

[1565] Specific operation: Emotion data is composed in JSON format and sent to the server as an HTTP request.

[1566] Step 11:

[1567] The server analyzes the emotion data and adjusts the travel plan as needed.

[1568] Input: Emotion data

[1569] Output: Adjusted itinerary

[1570] How it works: The server analyzes the emotional data, recalculates the travel plan according to the level of stress or excitement, and makes necessary adjustments.

[1571] Step 12:

[1572] The server sends the adjusted travel plan to the terminal, which notifies the user.

[1573] Input: Adjusted travel plans

[1574] Output: Coordinated travel plan submission request, user notification

[1575] Specific operation: The adjusted plan is constructed in JSON format and sent to the device as an HTTP response, and the device notifies the user via push notification or in-app notification.

[1576] In this way, the system dynamically provides optimal travel plans based on travelers' input information and real-time emotional data, significantly improving travel comfort and satisfaction.

[1577] (Application example 2)

[1578] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1579] Conventional travel planning systems provide static itineraries without considering travelers' emotions, which means they cannot quickly respond to changes in travelers' emotions or the latest information during the trip. Furthermore, they lack the functionality to recommend appropriate activities and spots when travelers feel stressed or excited, making it difficult for travelers to have a satisfying experience.

[1580] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving input information from a traveler, means for acquiring related city data based on the input information of the traveler, means for integrating the related city data and the input information of the traveler to generate an optimal itinerary, means for acquiring emotion data from the traveler, means for adjusting the itinerary by analyzing the emotion data, and means for providing the optimal itinerary and the adjusted itinerary to the traveler. This allows the itinerary to be adjusted flexibly and appropriately based on the traveler's emotions and the latest information, enabling the traveler to have a comfortable and satisfying travel experience.

[1581] "Traveler input information" refers to information provided by a traveler when planning a trip, such as travel destination, budget, travel companions, and values.

[1582] "Related city data" refers to data related to tourist attractions, events, restaurants, accommodations, etc. in the city that is the travel destination.

[1583] The "optimal travel plan" is a plan that includes the most ideal travel itinerary and activity content for the traveler, generated by integrating the traveler's input information and related city data.

[1584] "Emotional data" is data that indicates a traveler's real-time emotional state, obtained using facial recognition and voice analysis technologies.

[1585] "Travel plan adjustment" refers to analyzing travelers' sentiment data and making appropriate changes to existing travel plans.

[1586] "Providing to travelers" refers to the act of displaying the optimal travel plan or an adjusted travel plan to travelers via their terminals.

[1587] "Location information" is geographical information that indicates where a traveler is located during a trip.

[1588] "Latest information" refers to real-time data such as changes in weather, traffic conditions, and events at your travel destination.

[1589] "Notifying" refers to the act of displaying information received from the server on the traveler's terminal.

[1590] "Tourist attractions" refer to places in a travel destination that are particularly popular with tourists or have historical or cultural significance.

[1591] "Events" refers to activities such as festivals, concerts, and exhibitions held at your travel destination.

[1592] "Restaurants" refers to establishments that serve meals at travel destinations.

[1593] "Accommodation" refers to facilities for travelers to stay, such as hotels, inns, and guesthouses.

[1594] "Transportation" refers to the means of transportation used by travelers to travel to each tourist attraction or facility.

[1595] A "timetable" refers to the time allocation for each activity in a travel plan.

[1596] System Overview

[1597] This invention is a system that enables travelers to plan travel plans that are both efficient and satisfying. In particular, it improves travel satisfaction by acquiring travelers' emotional data in real time and reflecting this in travel plans. Specific implementation methods of the system are described below.

[1598] Program processing

[1599] User Input Phase

[1600] A traveler (user) launches a travel planning application using a device such as a smartphone or tablet. The user enters login information and necessary information (travel destination, budget, travel companions, values). This information is sent from the device to the server.

[1601] Data Processing Phase

[1602] The server analyzes the input information received from the user and accesses a city database to retrieve relevant city data, including information on tourist attractions, events, restaurants, accommodations, etc. The server then integrates this data with the user's input information and uses AI algorithms to generate an optimal travel plan.

[1603] The server sends the generated itinerary to the traveler's device, which displays it on the user interface so that the user can check and modify it.

[1604] Acquiring and analyzing emotion data

[1605] During the trip, the device uses facial recognition and voice analysis technologies to capture real-time emotional data of the traveler. For example, it uses a camera to analyze the traveler's facial expressions and a microphone to analyze the tone and volume of the voice. This emotional data is sent to a server, which analyzes it in real time and also refers to past emotional data to determine the traveler's emotional state.

[1606] Adjusting travel plans

[1607] The server adjusts the travel plan based on the results of the emotion data analysis. For example, if the traveler feels stressed, it adds relaxing activities (such as cafes and hot springs), and if the traveler feels excited, it adds more exciting activities (such as amusement parks). The adjusted travel plan is sent to the terminal and displayed on the user interface.

[1608] Real-time Support Phase

[1609] During the trip, the server continuously monitors the traveler's location and local updates (such as changes in weather, traffic, and events). Based on this information and real-time emotion data, the server updates the travel plan in real time and sends important alert information to the device. The device then notifies the user of these updates and alerts.

[1610] Specific examples

[1611] If a user inputs "Tokyo," "budget 100,000 yen," "traveling companion: friend," and "values: cultural experience," the server retrieves data on Tokyo's tourist attractions, events, restaurants, and accommodations, and uses a generative AI model to generate an optimal travel plan that includes visits to Sensoji Temple, a kabuki performance, and a traditional craft experience.

[1612] If the user feels stressed during the trip, the server will analyze the emotional data to detect this and suggest additional cafes or hot springs where the user can relax, allowing the user to enjoy the entire trip more comfortably.

[1613] Prompt Sentence Examples

[1614] Generate a travel itinerary for Tokyo that emphasizes cultural experiences.

[1615] If the user feels stressed, suggest a place for them to relax.

[1616] In this way, the present invention provides a system that enables travelers to efficiently plan optimal travel plans and receive emotion-based real-time support during their trip.

[1617] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1618] Step 1:

[1619] A user launches a travel planning application and enters their login information. New users register with the necessary information. This information is saved on the user's device and sent to the server.

[1620] Input: User login information, new registration information

[1621] Output: Authenticated user information

[1622] Step 2:

[1623] The user inputs travel information such as destination, budget, travel companions, and values, and presses the send button. The terminal then sends this travel information to the server.

[1624] Input: Travel information such as destination, budget, travel companions, and values

[1625] Output: Trip information sent to the server

[1626] Step 3:

[1627] The server analyzes the received travel information and accesses a city database to retrieve relevant city data, including information on tourist attractions, events, restaurants, accommodations, etc. Data is dynamically extracted according to the travel destination.

[1628] Input: Travel information sent to the server, city database

[1629] Output: Retrieved city data

[1630] Step 4:

[1631] The server integrates the acquired city data and travel information and generates an optimal travel plan using a generative AI model. An example of a prompt sentence that can be input is, "Please generate a travel plan that emphasizes cultural experiences related to Tokyo."

[1632] Input: Captured city data, travel information, generative AI model

[1633] Output: Optimal travel plan

[1634] Step 5:

[1635] The server sends the generated optimal travel plan to the user's device, which displays it in a user interface, allowing the user to review it and make changes as needed.

[1636] Input: Best Travel Planner

[1637] Output: The itinerary displayed in the user interface

[1638] Step 6:

[1639] During the journey, the device will capture real-time emotional data using facial recognition and voice analysis technology, specifically using the device's camera and microphone.

[1640] Input: Real-time audio and video of the user while traveling

[1641] Output: Obtained emotion data

[1642] Step 7:

[1643] The acquired emotional data is transmitted to a server, which analyzes the emotional data in real time and determines the user's current emotional state.

[1644] Input: Captured emotion data

[1645] Output: Parsed emotional state

[1646] Step 8:

[1647] The server adjusts the itinerary based on the user's emotional state. For example, if the user is stressed, it adds relaxing activities, and if the user is excited, it adds exciting activities. An example prompt could be "If the user is stressed, please suggest places where he can relax."

[1648] Input: Parsed emotional state, original travel plan

[1649] Output: Adjusted itinerary

[1650] Step 9:

[1651] The adjusted itinerary is sent to the user's terminal and displayed on the user interface, allowing the user to confirm the adjusted itinerary.

[1652] Input: Adjusted travel plan

[1653] Output: The adjusted itinerary displayed in the user interface.

[1654] Step 10:

[1655] During the trip, the server continuously monitors the traveler's location and local updates (such as weather, traffic, and event changes), which are obtained and used in real time.

[1656] Input: Traveler location, local updates

[1657] Output: Retrieved location information and latest updates

[1658] Step 11:

[1659] The server updates the travel plan in real time based on the latest information and emotion data obtained, thereby constantly optimizing the user's travel experience.

[1660] Input: Obtained location information, updates, and emotion data

[1661] Output: Updated itinerary

[1662] Step 12:

[1663] The server sends update information and important alert information to the user's terminal, which then notifies the user.

[1664] Input: Updated travel plans, alert information

[1665] Output: Updates and alerts notified to the user

[1666] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1667] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1668] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1669] [Fourth embodiment]

[1670] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1671] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1672] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1673] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1674] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1675] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1676] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1677] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1678] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1679] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1680] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1681] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1682] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1683] MODE FOR CARRYING OUT THE INVENTION

[1684] System Overview

[1685] The present invention provides a system that enables travelers to efficiently plan their ideal itinerary. Specifically, it provides a method and apparatus for generating an optimal itinerary based on information input by the traveler. The system includes a terminal that receives the traveler's input information, a server that acquires city data and generates an optimal itinerary, and a function for providing and updating the itinerary.

[1686] Program processing

[1687] User Input Phase

[1688] 1. A user launches the travel application and enters their login information on the login screen, or if they are a new user, enters the required information on the registration screen.

[1689] 2. After authenticating the user, the terminal displays a form for entering travel information.

[1690] 3. The user enters information such as destination, budget, travel companions, and values, and presses the send button.

[1691] 4. The terminal sends the user's input information to the server.

[1692] Data Processing Phase

[1693] 1. The server analyzes the input information received from the user.

[1694] 2. The server accesses the city database and retrieves data related to the entered destination (tourist attractions, events, restaurants, hotels, etc.).

[1695] 3. The server integrates the acquired city data with the user's input information and uses an AI algorithm to generate an optimal travel plan.

[1696] 4. The server sends the generated travel plan to the terminal.

[1697] Show Plan Phase

[1698] 1. The terminal displays the travel plan received from the server on the user interface.

[1699] 2. The user is presented with an interface that allows them to review the displayed itinerary and fine-tune the plan if necessary.

[1700] 3. The device sends the user's fine-tuning information to the server, which then re-plans.

[1701] 4. The server sends the updated itinerary to the terminal, which displays it again to the user.

[1702] Real-time Support Phase

[1703] 1. The server monitors the location and latest information (weather, event changes, etc.) of travelers during their trip.

[1704] 2. The travel plan is updated in real time based on the latest information obtained by the server.

[1705] 3. The server sends updated plans and important alert information to the device.

[1706] 4. The device notifies the user of updates and alerts received from the server.

[1707] Specific examples

[1708] For example, suppose a user inputs "Tokyo," "budget 100,000 yen," "traveling companion: friend," and "value: cultural experience." In this case, the server retrieves data on tourist attractions, events, restaurants, and hotels related to Tokyo. Next, it generates a plan that emphasizes the user's cultural experiences and proposes it to the user. This plan might include Sensoji Temple in Asakusa, a kabuki performance, and a traditional craft experience. Furthermore, if it suddenly rains in the area, the server will reflect the local weather information and suggest changing the user's plans to indoor activities.

[1709] In this way, the present invention provides a system that allows travelers to efficiently plan optimal travel plans and receive real-time support during their trip.

[1710] The processing flow will be explained below.

[1711] User Input Phase

[1712] Step 1:

[1713] The user launches the travel application and enters their login information into the login screen.

[1714] Step 2:

[1715] The terminal performs user authentication, and if the authentication is successful, sends the user information to the server.

[1716] Step 3:

[1717] The server checks the user information against an authentication database, and if authentication is successful, returns an authentication success message to the terminal.

[1718] Step 4:

[1719] The terminal receives the authentication success message and displays a form for the user to enter travel information.

[1720] Step 5:

[1721] The user enters information such as destination, budget, travel companions, and values ​​into the form and presses the submit button.

[1722] Step 6:

[1723] The terminal transmits the user's input information to the server.

[1724] Data Processing Phase

[1725] Step 1:

[1726] The server analyzes the input information received from the user.

[1727] Step 2:

[1728] The server accesses a city database to retrieve data related to the entered destination (tourist attractions, events, restaurants, hotels, etc.).

[1729] Step 3:

[1730] The server combines the city data it has acquired with the user's input information and uses an AI algorithm to generate an optimal travel plan.

[1731] Step 4:

[1732] The server transmits the generated itinerary to the terminal.

[1733] Show Plan Phase

[1734] Step 1:

[1735] The terminal displays the travel plan received from the server on a user interface.

[1736] Step 2:

[1737] The user confirms the displayed itinerary.

[1738] Step 3:

[1739] The user can then fine-tune the plan as needed and hit send again.

[1740] Step 4:

[1741] The device sends the user's fine-tuning details to the server.

[1742] Step 5:

[1743] The server receives the user's tweaks and re-plans.

[1744] Step 6:

[1745] The server sends the updated itinerary to the terminal.

[1746] Step 7:

[1747] The terminal displays the replanned itinerary again to the user.

[1748] Real-time Support Phase

[1749] Step 1:

[1750] The server monitors the location information of travelers in real time during their trip.

[1751] Step 2:

[1752] The server retrieves local updates (weather, traffic, event changes, etc.).

[1753] Step 3:

[1754] Travel plans are updated in real time based on the latest information obtained by the server.

[1755] Step 4:

[1756] The server sends updated travel plans and important alert information to the device.

[1757] Step 5:

[1758] The device notifies the user of updates and alerts received from the server.

[1759] Through these steps, users can efficiently create optimal travel plans and receive real-time support during their trip.

[1760] Example 1

[1761] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1762] Conventional travel planning systems can generate travel plans based on information entered by the user, but they have difficulty obtaining appropriate city data and generating optimal travel plans that match the user's values. Furthermore, they have problems in that they are unable to provide real-time support during the trip or flexibly respond to external conditions (such as weather changes or event cancellations). The purpose of this invention is to solve these problems, efficiently plan the ideal travel plan for travelers, and provide real-time support.

[1763] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1764] In this invention, the server includes a means for receiving traveler input information, a means for acquiring related city data, and a means for generating an optimal travel plan using an artificial intelligence algorithm. This allows for effective acquisition of city data based on the information entered by the traveler, enabling the generation of an optimal travel plan suited to the user's values ​​and requirements. The server also monitors the traveler's location information and latest information during the trip, and updates the travel plan in real time based on this information, thereby enabling flexible responses during the trip. Furthermore, by accepting traveler adjustments and re-planning, it is possible to provide a flexible travel plan that meets the user's requests.

[1765] "Traveler input information" refers to information about personal preferences and requirements provided by a traveler to plan a trip, such as travel destination, budget, travel companions, and values.

[1766] "City data" is information related to a specific city, such as tourist attractions, events, restaurants, and accommodations, and is data used to create travel plans.

[1767] "Artificial intelligence algorithms" are algorithms that include techniques such as machine learning and deep learning, which are used to analyze massive amounts of data and generate optimal travel plans.

[1768] "User Interface" means the software and hardware interfaces that provide the screens and controls used by travelers to view, edit, and update their travel plans.

[1769] "Location information" is data used to identify the geographic location of a particular individual or object using technologies such as GPS.

[1770] "Latest information" refers to real-time information that is important to travelers, such as weather forecasts, event changes, and traffic conditions.

[1771] "Real-time updates" means quickly changing travel plans in response to changes in external conditions that occur during the trip (such as weather changes or event cancellations).

[1772] "Notify" means informing travelers of travel plan updates and important information via their device.

[1773] "Tweaks" are small modifications made by travelers to change some of their plans or to reflect additional requests.

[1774] MODE FOR CARRYING OUT THE INVENTION

[1775] System Overview

[1776] The present invention is a system for enabling travelers to create efficient and ideal travel plans. This system generates, displays, and updates an optimal travel plan based on information input by the traveler. It includes a means for receiving the traveler's input information, a means for acquiring city data, a means for integrating the acquired data with the traveler's input information and generating an optimal travel plan using an artificial intelligence algorithm, and a means for providing the traveler with the travel plan and fine-tuning it.

[1777] Hardware and software used

[1778] 1. Server: Responsible for data processing, accessing the city database, and generating and updating itineraries. Software used includes a natural language processing engine and generative AI models (such as TensorFlow or PyTorch). The hardware is expected to be a cloud service (e.g., AWS EC2 instances).

[1779] 2. Terminal: The terminal is used to input information, display travel plans, and make fine adjustments through the user interface. Front-end software such as React or Vue.js is used.

[1780] 3. Database: A database such as MongoDB is used to store city data (tourist attractions, events, hotels, restaurants, etc.).

[1781] 4. GPS devices: Used to obtain and monitor the location of travelers.

[1782] Program processing

[1783] 1. The user launches the travel application on their device and enters their login information. If they are a new user, they enter the required information on the registration screen.

[1784] 2. After authenticating the user, the device displays a travel information input form, where the user enters information such as destination, budget, travel companions, and values, and submits it.

[1785] 3. The device sends the input information to the server, which analyzes the input information and accesses the city database to retrieve relevant city information.

[1786] 4. The server integrates the acquired city data with the user's input information and generates an optimal travel plan using a generative AI model.

[1787] 5. The server sends the generated itinerary to the terminal, which displays it on the user interface.

[1788] 6. The user checks the itinerary and makes any necessary adjustments. The device sends the changes to the server, which then re-plans and sends the updated itinerary back to the device.

[1789] Real-time Support

[1790] 1. The server monitors the location information of the traveler through the GPS device during the trip, and obtains the traveler's location information and the latest weather and event change information in real time.

[1791] 2. The server updates the travel plan in real time based on the latest information and sends the updated information to the device.

[1792] 3. The terminal notifies the user interface of the updated information received from the server, allowing the user to review the plan based on the new information.

[1793] Examples and prompts

[1794] For example, if a user inputs "Tokyo," "budget 100,000 yen," "traveling companion: friend," and "value: cultural experience," the server retrieves city data related to Tokyo (information on tourist attractions, events, restaurants, and hotels) and generates an optimal travel plan that emphasizes cultural experiences. This travel plan includes a visit to Sensoji Temple, a kabuki performance, and a traditional craft experience.

[1795] If the weather worsens in Tokyo during a trip, the server retrieves the weather forecast in real time, generates an updated itinerary that changes outdoor activities to indoor activities, such as visiting a museum or an indoor art gallery, and notifies the user.

[1796] Prompt Sentence Examples

[1797] "Travel planning assistant. The user is planning a trip to Tokyo with a budget of ¥100,000, friends as companions, and cultural experiences as their value. Create a travel plan that suggests appropriate tourist spots and activities and adapts to changing weather conditions."

[1798] In this way, the present invention provides a system that allows travelers to efficiently plan optimal travel plans and receive real-time support during their trip.

[1799] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1800] Step 1:

[1801] A user launches a travel application and enters their login information. If they are a new user, they enter the required information, such as their name, email address, and password, on the registration screen. The information they enter is processed as input data on their device and sent to the server.

[1802] Input: User login or registration information

[1803] Output: Authentication request data from the device to the server

[1804] Specific behavior:

[1805] A user launches an application on their smartphone or PC and goes to the login screen. They enter their email address and password. If they are a new user, they enter the required registration information into the form.

[1806] Step 2:

[1807] The server authenticates the login information it receives, searching the database for authentication if the user is already there, or adding the information to the database if the user is new.

[1808] Input: Login or registration information sent from your device

[1809] Output: Authentication result (success / failure) and user data when authentication is successful

[1810] Specific behavior:

[1811] The server verifies the login information using a database (e.g., MySQL or MongoDB) and performs authentication. If authentication is successful, it generates and returns a token to proceed to the next step.

[1812] Step 3:

[1813] After authenticating the user, the terminal displays a travel information input form, in which the user enters detailed information such as destination, budget, travel dates, travel companions, and values, and submits the form.

[1814] Input: User data after successful authentication

[1815] Output: Trip information entered by the user

[1816] Specific behavior:

[1817] The user enters travel preferences such as destination, budget, companions, and values ​​into the displayed travel information input form, and presses the send button to send the information to the server.

[1818] Step 4:

[1819] The terminal sends the user's input information to the server, which receives the input information and begins analyzing it.

[1820] Input: User's travel information

[1821] Output: Trip information sent to the server

[1822] Specific behavior:

[1823] The terminal sends the user's input information as an HTTP request to the server, which receives it and starts processing the data.

[1824] Step 5:

[1825] The server analyzes the received user travel information and converts it into structured data using a natural language processing engine.

[1826] Input: User's travel information

[1827] Output: Structured travel information

[1828] Specific behavior:

[1829] The server receives the user's input information and uses a natural language processing engine to analyze and convert it into the necessary data. For example, information such as "cultural experience" or "budget of 100,000 yen" is analyzed and converted into an internal data structure.

[1830] Step 6:

[1831] The server accesses a city database and retrieves city data such as tourist attractions, events, restaurants, and accommodations related to the destination entered by the user.

[1832] Input: Structured travel information (e.g., destination)

[1833] Output: City data (tourist attractions, events, restaurants, accommodations, etc.)

[1834] Specific behavior:

[1835] The server connects to a city database (e.g. MongoDB) and queries and retrieves information about attractions, events, restaurants, and accommodations based on the destination.

[1836] Step 7:

[1837] The server integrates the acquired city data with the user's structured data and generates an optimal travel plan using a generative AI model.

[1838] Input: City data and structured travel information

[1839] Output: Optimal travel plan

[1840] Specific behavior:

[1841] The server integrates the city data it acquires with user information, and uses a generative AI model built with TensorFlow and PyTorch to generate an optimal travel plan based on the user's requests and conditions.

[1842] Step 8:

[1843] The server transmits the generated itinerary to the terminal, which displays it on a user interface.

[1844] Input: Best Travel Planner

[1845] Output: Travel plan display data

[1846] Specific behavior:

[1847] The server generates the itinerary and sends it to the device in a structured format. The device receives this data and displays it in a user interface using React and Vue.js.

[1848] Step 9:

[1849] The user checks the displayed itinerary and makes any necessary adjustments. The adjustments are entered and sent to the server by the device.

[1850] Input: User tweaks

[1851] Output: Fine-tuned trip information

[1852] Specific behavior:

[1853] The user checks the travel plan, changes some of the plans, or enters new requests. The terminal sends this information to the server.

[1854] Step 10:

[1855] The server re-plans based on the fine-tuning information received from the user, generates an updated itinerary, and sends it to the terminal, which displays it again on the user interface.

[1856] Input: Fine-tuned travel information

[1857] Output: Updated itinerary

[1858] Specific behavior:

[1859] The server again uses its AI algorithm to generate a new itinerary based on the user's tweaks, which the device receives and displays the updated itinerary.

[1860] Step 11:

[1861] The server monitors the location of travelers during their trip via their GPS devices and obtains the latest information on weather, event changes, etc.

[1862] Input: Traveler location, weather updates, event changes

[1863] Output: Latest travel plan updates

[1864] Specific behavior:

[1865] The server obtains the traveler's GPS data and collects the latest information from weather APIs, event APIs, etc.

[1866] Step 12:

[1867] The server updates the travel plan in real time based on the latest information, and the device displays the updated information on the user interface and sends push notifications as needed.

[1868] Input: Latest travel plan update

[1869] Output: User notification

[1870] Specific behavior:

[1871] The server automatically updates the travel plan based on the latest information and sends it to the device, which receives it, displays it on the user interface, and notifies the user via push notifications, etc.

[1872] (Application example 1)

[1873] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1874] Traditional travel planning systems are unable to provide an appropriate combination of travelers' dining preferences and local food delivery data. As a result, travelers have to spend time finding the best dining options at their destinations, which can lead to a lower quality trip. They also lack real-time food delivery recommendations based on the latest local information, resulting in a lack of planning flexibility, making it difficult for travelers to enjoy truly satisfying dining experiences during their trips.

[1875] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1876] In this invention, the server includes means for receiving input information from a traveler, means for acquiring related city data based on the traveler's input information, means for integrating the related city data with the traveler's input information to generate an optimal travel plan, means for acquiring local food service facility data based on the optimal travel plan and integrating the data with the traveler's preferences to generate food delivery recommendations, means for providing the recommended food delivery information to the traveler, and means for updating the food delivery recommendations in real time based on the traveler's current location information. This allows travelers to easily find the optimal food delivery options for their destinations. Furthermore, real-time plan updates allow travelers to enjoy an optimal dining experience tailored to the latest conditions.

[1877] "Traveller" means an individual or group that plans and undertakes a trip.

[1878] "Input Information" refers to data such as destination, budget, travel companions, values, and preferences that a traveler provides to generate a travel plan.

[1879] "City Data" means information about attractions, events, restaurants, hotels, transportation, and other information about a particular city.

[1880] "Optimal travel plan" refers to a travel schedule generated based on the traveler's input information and city data to best meet the traveler's requirements.

[1881] "Dining Facility Data" refers to information about restaurants, cafes, food delivery services, etc. within a particular area.

[1882] "Food Delivery Recommendations" refers to information recommending specific dining options or delivery services based on a traveler's preferences and current circumstances.

[1883] "Traveler's current location information" refers to geographic information indicating the location where the traveler is actually moving.

[1884] "Real-time updates" refers to the process of instantly modifying or changing travel plans or recommendations based on current, up-to-date information.

[1885] System Overview

[1886] This invention is a system that enables travelers to enjoy optimal food delivery at their destinations. Specifically, it generates an optimal travel plan based on the traveler's input information, acquires data on local food establishments based on the plan, and recommends food delivery options that match the traveler's preferences. It also monitors location information in real time and provides the traveler with the latest travel plans and food delivery recommendations.

[1887] Program processing

[1888] User Input Phase

[1889] Users log in using a device such as a smartphone or tablet and enter their travel information, including their destination, budget, travel companions, values, preferences, etc. This information is then sent from the device to the server.

[1890] Data Processing Phase

[1891] The server uses software such as Python and the Requests library to perform the following tasks:

[1892] 1. Parse the input information received from the user.

[1893] 2. Obtain data on tourist attractions, events, restaurants, hotels, etc. from a city database.

[1894] 3. The acquired city data and user input information are input into a generative AI model to generate an optimal travel plan.

[1895] 4. Based on the travel plan, local dining establishment data is retrieved and integrated with the user's preferences to generate food delivery recommendations.

[1896] Show Plan Phase

[1897] The device displays the travel plan and food delivery recommendations received from the server on the user interface. The user checks the displayed plan and makes adjustments as necessary. The device sends the user's adjustments to the server, which then re-plans. The updated plan and recommendations are sent back to the device and displayed to the user.

[1898] Real-time Support Phase

[1899] The server monitors the traveler's real-time location and local updates (weather, event changes, etc.). Based on these updates, it updates travel plans and food delivery recommendations in real time and notifies the device. Users can receive these updates via their smartphone or tablet and take appropriate action.

[1900] Specific examples of programs

[1901] For example, if a traveler enters "Tokyo," "budget of 100,000 yen," "traveling companion: friends," "values: cultural experiences," and "preferences: vegetarian food," the server will retrieve data on vegetarian-friendly restaurants along with data on tourist attractions and events in Tokyo, and generate optimal travel plans and food delivery recommendations. During the travel period, for example, if the traveler is in Asakusa, it will recommend delivery of "Japanese vegetarian food." Also, if it suddenly rains in the area, the server will reflect the weather information and change the traveler's plans to indoor activities, and re-suggest meals that can be enjoyed indoors.

[1902] Prompt Sentence Examples

[1903] "Destination: Tokyo, Duration: 5 days, Budget: 20,000 yen, Number of people: 2. Please recommend a local vegetarian restaurant and its menu."

[1904] As described above, the present invention provides a system that allows travelers to easily plan optimal dining experiences and travel plans and receive real-time support during their trip.

[1905] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1906] Step 1:

[1907] The user launches the travel application and enters their login information on the login screen. If they are a new user, they enter the required information on the registration screen. The entered information is sent from the device to the server. Based on the input, the server authenticates the user. If authentication is successful, the travel information input form is displayed on the device.

[1908] Step 2:

[1909] The user enters travel information such as destination, budget, travel companions, values, and preferences, and then presses the send button. The entered data is sent from the device to the server. The server analyzes the received information and extracts the traveler's preferences and requests. This analysis includes data processing such as natural language processing.

[1910] Step 3:

[1911] The server accesses the city database and retrieves data related to the entered destination (tourist attractions, events, restaurants, hotels, etc.). This database can be, for example, MongoDB or PostgreSQL. The retrieved data is temporarily stored.

[1912] Step 4:

[1913] The server combines the city data it acquires with the user's input information and uses a generative AI model to generate an optimal travel plan. Specifically, it selects tourist attractions, events, and restaurants based on the user's values ​​and preferences, and optimizes the timetable and transportation methods. For example, GPT-3 is used as the generative AI model.

[1914] Step 5:

[1915] Based on the optimal itinerary, the server retrieves local dining establishment data, integrates it with the user's preferences, and generates food delivery recommendations. For example, it uses automated queries to retrieve data from a local restaurant API and filters it against the user's preferences.

[1916] Step 6:

[1917] The server sends the generated travel plans and food delivery recommendations to the device, which displays the received information on a user interface. The user can review the proposed travel plans and food delivery recommendations and make adjustments as needed.

[1918] Step 7:

[1919] The user's refinements are sent to the server, which then re-generates the itinerary. The updated itinerary is then sent back to the device and displayed again, allowing the user to receive optimal itinerary and food delivery recommendations in real time.

[1920] Step 8:

[1921] During the trip, the server monitors the user's location information and the latest local information (weather, event changes, etc.). The current location information is periodically sent to the server as GPS data, and the server takes the appropriate action based on that information.

[1922] Step 9:

[1923] The server updates travel plans and food delivery recommendations in real time based on the latest information it receives, again using the AI ​​model to adjust plans to accommodate changes in weather or event cancellations, for example.

[1924] Step 10:

[1925] The server sends updated plans and important alert information to the device, which then notifies the user, allowing the user to receive real-time updates on travel plans and food delivery information and make appropriate changes.

[1926] As described above, this system provides advanced support for users to enjoy an optimal experience during their trip. Through specific actions and data processing, it is possible to provide appropriate and timely travel plans and food delivery recommendations.

[1927] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1928] MODE FOR CARRYING OUT THE INVENTION

[1929] System Overview

[1930] The present invention provides a system that enables travelers to efficiently plan their ideal itinerary, and in particular has the function of recognizing the travelers' emotions and reflecting them in the itinerary. Specifically, it provides a method and apparatus for generating an optimal itinerary based on the travelers' input information and further personalizing the itinerary by analyzing the travelers' real-time and past emotional data. The system includes a terminal that receives the travelers' input information, a server that acquires city data and generates an optimal itinerary, an emotion engine, and a function for providing and updating the itinerary.

[1931] Program processing

[1932] User Input Phase

[1933] 1. A user launches the travel application and enters their login information on the login screen, or if they are a new user, enters the required information on the registration screen.

[1934] 2. After authenticating the user, the terminal displays a form for entering travel information.

[1935] 3. The user enters information such as destination, budget, travel companions, and values ​​into the form and presses the submit button.

[1936] 4. The terminal sends the user's input information to the server.

[1937] Data Processing Phase

[1938] 1. The server analyzes the input information received from the user.

[1939] 2. The server accesses the city database and retrieves data related to the entered destination (tourist attractions, events, restaurants, hotels, etc.).

[1940] 3. The server integrates the acquired city data with the user's input information and uses an AI algorithm to generate an optimal travel plan.

[1941] 4. The server sends the generated travel plan to the terminal.

[1942] Emotion engine processing

[1943] Acquiring and analyzing emotion data

[1944] 1. The device acquires real-time emotional data of travelers using facial recognition and voice analysis technologies.

[1945] 2. The device sends the acquired emotion data to the server.

[1946] 3. The server analyzes the real-time emotional data and determines the traveler's current emotional state.

[1947] 4. The server analyzes the data, including past emotional data, and determines how to adjust the travel plan.

[1948] Emotion-based travel planning adjustments

[1949] 1. The server recommends activities and hotels that can help travelers relax if they are feeling stressed.

[1950] 2. The server adjusts the travel plan to add more exciting activities if the traveler is excited.

[1951] 3. The server sends the adjusted itinerary to the terminal.

[1952] 4. The device displays the adjusted itinerary and activities on the user interface.

[1953] Real-time Support Phase

[1954] 1. The server continuously monitors the location information and real-time emotion data of travelers during their trip.

[1955] 2. The server retrieves local updates (weather, traffic, event changes, etc.) and emotion data.

[1956] 3. The server updates the travel plan in real time based on the latest local information and sentiment data.

[1957] 4. The server sends updated travel plans and important alert information to the device.

[1958] 5. The device notifies the user of updates and alerts received from the server.

[1959] Specific examples

[1960] For example, suppose a user inputs "Tokyo," "budget 100,000 yen," "traveling companion: friend," and "value: cultural experience." In this case, the server retrieves data on tourist attractions, events, restaurants, and hotels related to Tokyo. Next, it generates a plan that emphasizes the user's cultural experience and proposes it to the user. This plan includes visits to Sensoji Temple in Asakusa, a kabuki performance, and a traditional craft experience.

[1961] Furthermore, if the user begins to feel stressed during the trip, the server will detect this state using the emotion engine and adjust the travel plan by suggesting additional activities such as relaxing cafes or hot springs, allowing the user to enjoy the entire trip more comfortably.

[1962] In this way, the present invention provides a system that enables travelers to efficiently plan optimal travel plans and receive emotion-based real-time support during their trip.

[1963] The processing flow will be explained below.

[1964] User Input Phase

[1965] Step 1:

[1966] The user launches the travel application and enters their login information into the login screen.

[1967] Step 2:

[1968] The terminal performs user authentication, and if the authentication is successful, sends the user information to the server.

[1969] Step 3:

[1970] The server checks the user information against an authentication database, and if authentication is successful, returns an authentication success message to the terminal.

[1971] Step 4:

[1972] The terminal receives the authentication success message and displays a form for the user to enter travel information.

[1973] Step 5:

[1974] The user enters information such as destination, budget, travel companions, and values ​​into the form and presses the submit button.

[1975] Step 6:

[1976] The terminal transmits the user's input information to the server.

[1977] Data Processing Phase

[1978] Step 1:

[1979] The server analyzes the input information received from the user.

[1980] Step 2:

[1981] The server accesses a city database to retrieve data related to the entered destination (tourist attractions, events, restaurants, hotels, etc.).

[1982] Step 3:

[1983] The server combines the city data it has acquired with the user's input information and uses an AI algorithm to generate an optimal travel plan.

[1984] Step 4:

[1985] The server transmits the generated itinerary to the terminal.

[1986] Show Plan Phase

[1987] Step 1:

[1988] The terminal displays the travel plan received from the server on a user interface.

[1989] Step 2:

[1990] The user confirms the displayed itinerary.

[1991] Step 3:

[1992] The user can then fine-tune the plan as needed and hit send again.

[1993] Step 4:

[1994] The device sends the user's fine-tuning details to the server.

[1995] Step 5:

[1996] The server receives the user's tweaks and re-plans.

[1997] Step 6:

[1998] The server sends the updated itinerary to the terminal.

[1999] Step 7:

[2000] The terminal displays the replanned itinerary again to the user.

[2001] Emotion engine processing

[2002] Acquiring and analyzing emotion data

[2003] Step 1:

[2004] The device will acquire real-time emotional data from travelers using facial recognition and voice analysis technologies.

[2005] Step 2:

[2006] The emotion data acquired by the terminal is transmitted to the server.

[2007] Step 3:

[2008] The server analyzes real-time emotional data to determine the traveler's current emotional state.

[2009] Step 4:

[2010] The server analyzes the data, including past emotional data, and determines how to adjust the travel plan.

[2011] Emotion-based travel planning adjustments

[2012] Step 1:

[2013] The server will recommend relaxing activities and hotels if the traveler is feeling stressed.

[2014] Step 2:

[2015] The server adjusts the itinerary to add more exciting activities if the traveler is excited.

[2016] Step 3:

[2017] The server sends the adjusted itinerary to the terminal.

[2018] Step 4:

[2019] The device displays the adjusted itinerary and activities on a user interface.

[2020] Real-time Support Phase

[2021] Step 1:

[2022] The server monitors the location information of travelers in real time during their trip.

[2023] Step 2:

[2024] The server retrieves local updates (weather, traffic, event changes, etc.) and emotion data.

[2025] Step 3:

[2026] The travel plan is updated in real time based on the latest information and emotion data obtained by the server.

[2027] Step 4:

[2028] The server sends updated travel plans and important alert information to the device.

[2029] Step 5:

[2030] The device notifies the user of updates and alerts received from the server.

[2031] Through the above steps, a system is provided that enables users to efficiently plan optimal travel plans and receive real-time emotional support during their trip.

[2032] Example 2

[2033] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2034] Conventional travel planning systems provide travel plans based on user input, but they are unable to consider the real-time emotional state of travelers or the latest local information, which means they are unable to fully support travelers' comfortable travel experiences. Furthermore, plans are not adjusted to reflect changes in travelers' emotions during the trip, and real-time support to reduce travelers' stress is lacking.

[2035] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for receiving input information from a traveler, means for acquiring related area data based on the input information from the traveler, means for integrating the related area data and the input information from the traveler to generate an optimal itinerary, means for providing the optimal itinerary to the traveler, means for acquiring emotional data from the traveler in real time, and means for analyzing the emotional data and adjusting the itinerary. This makes it possible to dynamically adjust the itinerary based on the real-time emotional state of the traveler and the latest local information, allowing the traveler to enjoy a comfortable and fulfilling travel experience.

[2036] "Traveler input information" refers to information such as destination, budget, travel companions, and values ​​that a traveler inputs when planning a trip.

[2037] "Regional data" refers to data that includes information about tourist attractions, events, dining facilities, accommodations, and the like related to a particular region.

[2038] A "travel plan" is a schedule or itinerary that is planned by combining tourist attractions to visit, events to participate in, dining facilities and accommodations to use, etc.

[2039] "Emotional data" is data obtained by using facial recognition and voice analysis technology to capture a traveler's real-time emotional state.

[2040] "Real-time updates" means modifying and changing information and plans instantly based on current situations and conditions.

[2041] "Analysis" is the process of analyzing acquired data in detail and extracting meaning and relationships.

[2042] "Selection" means choosing the most suitable one from multiple candidates.

[2043] "Ordering" means rearranging selected elements in an appropriate order.

[2044] "Transportation" means the means of transportation used by a traveler to travel from one point to another.

[2045] A "timetable" is a schedule that divides dates and itineraries into time periods.

[2046] The present invention relates to a system for generating an optimal travel plan based on traveler input information and personalizing the travel plan by analyzing real-time traveler emotion data. The system includes a terminal for receiving traveler input information, a server for acquiring relevant area data, an emotion engine for acquiring and analyzing emotion data, and a function for providing and updating the travel plan.

[2047] System Hardware and Software

[2048] Device: A mobile device such as a smartphone or tablet is used. The device provides a user interface (UI) and a means for travelers to input information. It also has a camera and microphone to capture real-time emotion data.

[2049] Server: Uses a high-performance cloud server or on-premise server. The server analyzes the received traveller input information, retrieves relevant local data from a database, and generates an optimal travel plan using AI algorithms (e.g., Recurrent Neural Network, RNN).

[2050] Emotion Engine: The technologies used to acquire and analyze emotion data include facial recognition technology (OpenCV) and voice analysis technology (Google Cloud Speech-to-Text).

[2051] Process Details

[2052] 1. A user launches a travel application and enters login information and travel destination information (destination, budget, travel companions, values).

[2053] 2. The terminal sends the entered information to the server.

[2054] 3. The server analyzes the received input information and retrieves relevant local data (tourist attractions, events, dining facilities, accommodation, etc.) from the database.

[2055] 4. The server integrates the acquired local data with the user's input information and uses an AI algorithm to generate an optimal travel plan.

[2056] 5. The server sends the generated itinerary to the terminal, which displays it to the user.

[2057] 6. During the trip, the device will acquire the user's emotional data in real time using facial recognition and voice analysis technology and send it to the server.

[2058] 7. The server analyzes the sentiment data and adjusts the travel plan as needed.

[2059] 8. The server sends the adjusted travel plan to the terminal, which notifies the user.

[2060] Specific examples

[2061] For example, suppose a user enters "Tokyo," "budget 100,000 yen," "traveling companion: friend," and "value: cultural experience" into a travel application. In this case, the server retrieves data on tourist attractions, events, restaurants, and hotels related to Tokyo and generates a plan that emphasizes "cultural experience." If the user feels stressed during the trip, the device retrieves emotional data in real time, and the server analyzes this data and suggests cafes and hot springs where they can relax.

[2062] Here are some examples of prompts for generative AI models:

[2063] The user has entered "Tokyo", "budget 100,000 yen", "travelling companion: friends", and "values: cultural experience". Based on this information, generate an ideal travel plan. Also, if the user feels stressed during the trip based on sentiment analysis, suggest how to adjust the travel plan.

[2064] In this way, the present invention provides a system that enables travelers to efficiently plan optimal travel plans and receive emotion-based real-time support during their trip.

[2065] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2066] Step 1:

[2067] A user launches the travel application, enters their login information, and logs in. If they are a new user, they enter the required information, such as their name, email address, and password, on the registration screen.

[2068] Input: User login information (or new registration information)

[2069] Output: Login authentication result

[2070] Specific operation: When the login button is pressed, the terminal sends the input information to the server, and the server checks the database and returns the authentication result.

[2071] Step 2:

[2072] After authenticating the user, the device displays a form for entering travel information, including destination, budget, travel companions, and values.

[2073] Input: None (automatically operates based on user authentication results)

[2074] Output: Display of travel information input form

[2075] Specific operation: Upon receiving the authentication success message, the terminal displays the travel information input form on the screen.

[2076] Step 3:

[2077] The user enters information such as destination, budget, travel companions, and values, and presses the send button.

[2078] Input: Travel information such as destination, budget, travel companions, values, etc.

[2079] Output: Travel information submission request

[2080] Specific operation: After entering travel information, press the send button and the device will send this information to the server in JSON format.

[2081] Step 4:

[2082] The server analyzes the input information received from the user, for example, using a natural language processing algorithm.

[2083] Input: Travel information (JSON format)

[2084] Output: Traveler requirements as analysis results

[2085] Specific operation: The server analyzes the JSON format travel information received and breaks it down into the traveler's required specifications.

[2086] Step 5:

[2087] The server retrieves relevant local data from a database, using database queries to retrieve information about attractions, events, dining options, accommodations, etc. for the destination.

[2088] Input: Traveler's requirements (destination)

[2089] Output: Local data (tourist attractions, events, restaurants, accommodations, etc.)

[2090] Specific operation: The server generates the necessary query and accesses the database to retrieve information related to the destination.

[2091] Step 6:

[2092] The server integrates the acquired regional data with the user's input information and generates an optimal travel plan using an AI algorithm (e.g., Recurrent Neural Network, RNN).

[2093] Input: Acquired regional data, traveler requirements

[2094] Output: Optimal travel plan

[2095] Specific operation: The server inputs regional data and traveler requirements into an AI algorithm to generate an optimal travel plan.

[2096] Step 7:

[2097] The server transmits the generated itinerary to the terminal.

[2098] Input: Optimal Travel Plan

[2099] Output: Trip plan submission request

[2100] Specific operation: The generated travel plan is structured in JSON format and sent to the terminal as an HTTP response.

[2101] Step 8:

[2102] The terminal displays the travel plan on a user interface.

[2103] Input: Travel plan (JSON format)

[2104] Output: A visual display to the user

[2105] Specific operation: The device analyzes the received travel plan and displays it in an easy-to-read format for the user.

[2106] Step 9:

[2107] During the trip, the device uses facial recognition technology (OpenCV) and voice analysis technology (Google Cloud Speech-to-Text) to obtain the user's emotional data in real time.

[2108] Input: None (Real-time traveller data)

[2109] Output: Emotion data

[2110] Specific operation: Data is collected using the device's camera and microphone, and analyzed by an analysis engine to generate emotion data.

[2111] Step 10:

[2112] The emotion data acquired by the device is transmitted to the server.

[2113] Input: Emotion data

[2114] Output: Emotion data transmission request

[2115] Specific operation: Emotion data is composed in JSON format and sent to the server as an HTTP request.

[2116] Step 11:

[2117] The server analyzes the emotion data and adjusts the travel plan as needed.

[2118] Input: Emotion data

[2119] Output: Adjusted itinerary

[2120] How it works: The server analyzes the emotional data, recalculates the travel plan according to the level of stress or excitement, and makes necessary adjustments.

[2121] Step 12:

[2122] The server sends the adjusted travel plan to the terminal, which notifies the user.

[2123] Input: Adjusted travel plans

[2124] Output: Coordinated travel plan submission request, user notification

[2125] Specific operation: The adjusted plan is constructed in JSON format and sent to the device as an HTTP response, and the device notifies the user via push notification or in-app notification.

[2126] In this way, the system dynamically provides optimal travel plans based on travelers' input information and real-time emotional data, significantly improving travel comfort and satisfaction.

[2127] (Application example 2)

[2128] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2129] Conventional travel planning systems provide static itineraries without considering travelers' emotions, which means they cannot quickly respond to changes in travelers' emotions or the latest information during the trip. Furthermore, they lack the functionality to recommend appropriate activities and spots when travelers feel stressed or excited, making it difficult for travelers to have a satisfying experience.

[2130] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving input information from a traveler, means for acquiring related city data based on the input information of the traveler, means for integrating the related city data and the input information of the traveler to generate an optimal itinerary, means for acquiring emotion data from the traveler, means for adjusting the itinerary by analyzing the emotion data, and means for providing the optimal itinerary and the adjusted itinerary to the traveler. This allows the itinerary to be adjusted flexibly and appropriately based on the traveler's emotions and the latest information, enabling the traveler to have a comfortable and satisfying travel experience.

[2131] "Traveler input information" refers to information provided by a traveler when planning a trip, such as travel destination, budget, travel companions, and values.

[2132] "Related city data" refers to data related to tourist attractions, events, restaurants, accommodations, etc. in the city that is the travel destination.

[2133] The "optimal travel plan" is a plan that includes the most ideal travel itinerary and activity content for the traveler, generated by integrating the traveler's input information and related city data.

[2134] "Emotional data" is data that indicates a traveler's real-time emotional state, obtained using facial recognition and voice analysis technologies.

[2135] "Travel plan adjustment" refers to analyzing travelers' sentiment data and making appropriate changes to existing travel plans.

[2136] "Providing to travelers" refers to the act of displaying the optimal travel plan or an adjusted travel plan to travelers via their terminals.

[2137] "Location information" is geographical information that indicates where a traveler is located during a trip.

[2138] "Latest information" refers to real-time data such as changes in weather, traffic conditions, and events at your travel destination.

[2139] "Notifying" refers to the act of displaying information received from the server on the traveler's terminal.

[2140] "Tourist attractions" refer to places in a travel destination that are particularly popular with tourists or have historical or cultural significance.

[2141] "Events" refers to activities such as festivals, concerts, and exhibitions held at your travel destination.

[2142] "Restaurants" refers to establishments that serve meals at travel destinations.

[2143] "Accommodation" refers to facilities for travelers to stay, such as hotels, inns, and guesthouses.

[2144] "Transportation" refers to the means of transportation used by travelers to travel to each tourist attraction or facility.

[2145] A "timetable" refers to the time allocation for each activity in a travel plan.

[2146] System Overview

[2147] This invention is a system that enables travelers to plan travel plans that are both efficient and satisfying. In particular, it improves travel satisfaction by acquiring travelers' emotional data in real time and reflecting this in travel plans. Specific implementation methods of the system are described below.

[2148] Program processing

[2149] User Input Phase

[2150] A traveler (user) launches a travel planning application using a device such as a smartphone or tablet. The user enters login information and necessary information (travel destination, budget, travel companions, values). This information is sent from the device to the server.

[2151] Data Processing Phase

[2152] The server analyzes the input information received from the user and accesses a city database to retrieve relevant city data, including information on tourist attractions, events, restaurants, accommodations, etc. The server then integrates this data with the user's input information and uses AI algorithms to generate an optimal travel plan.

[2153] The server sends the generated itinerary to the traveler's device, which displays it on the user interface so that the user can check and modify it.

[2154] Acquiring and analyzing emotion data

[2155] During the trip, the device uses facial recognition and voice analysis technologies to capture real-time emotional data of the traveler. For example, it uses a camera to analyze the traveler's facial expressions and a microphone to analyze the tone and volume of the voice. This emotional data is sent to a server, which analyzes it in real time and also refers to past emotional data to determine the traveler's emotional state.

[2156] Adjusting travel plans

[2157] The server adjusts the travel plan based on the results of the emotion data analysis. For example, if the traveler feels stressed, it adds relaxing activities (such as cafes and hot springs), and if the traveler feels excited, it adds more exciting activities (such as amusement parks). The adjusted travel plan is sent to the terminal and displayed on the user interface.

[2158] Real-time Support Phase

[2159] During the trip, the server continuously monitors the traveler's location and local updates (such as changes in weather, traffic, and events). Based on this information and real-time emotion data, the server updates the travel plan in real time and sends important alert information to the device. The device then notifies the user of these updates and alerts.

[2160] Specific examples

[2161] If a user inputs "Tokyo," "budget 100,000 yen," "traveling companion: friend," and "values: cultural experience," the server retrieves data on Tokyo's tourist attractions, events, restaurants, and accommodations, and uses a generative AI model to generate an optimal travel plan that includes visits to Sensoji Temple, a kabuki performance, and a traditional craft experience.

[2162] If the user feels stressed during the trip, the server will analyze the emotional data to detect this and suggest additional cafes or hot springs where the user can relax, allowing the user to enjoy the entire trip more comfortably.

[2163] Prompt Sentence Examples

[2164] Generate a travel itinerary for Tokyo that emphasizes cultural experiences.

[2165] If the user feels stressed, suggest a place for them to relax.

[2166] In this way, the present invention provides a system that enables travelers to efficiently plan optimal travel plans and receive emotion-based real-time support during their trip.

[2167] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2168] Step 1:

[2169] A user launches a travel planning application and enters their login information. New users register with the necessary information. This information is saved on the user's device and sent to the server.

[2170] Input: User login information, new registration information

[2171] Output: Authenticated user information

[2172] Step 2:

[2173] The user inputs travel information such as destination, budget, travel companions, and values, and presses the send button. The terminal then sends this travel information to the server.

[2174] Input: Travel information such as destination, budget, travel companions, and values

[2175] Output: Trip information sent to the server

[2176] Step 3:

[2177] The server analyzes the received travel information and accesses a city database to retrieve relevant city data, including information on tourist attractions, events, restaurants, accommodations, etc. Data is dynamically extracted according to the travel destination.

[2178] Input: Travel information sent to the server, city database

[2179] Output: Retrieved city data

[2180] Step 4:

[2181] The server integrates the acquired city data and travel information and generates an optimal travel plan using a generative AI model. An example of a prompt sentence that can be input is, "Please generate a travel plan that emphasizes cultural experiences related to Tokyo."

[2182] Input: Captured city data, travel information, generative AI model

[2183] Output: Optimal travel plan

[2184] Step 5:

[2185] The server sends the generated optimal travel plan to the user's device, which displays it in a user interface, allowing the user to review it and make changes as needed.

[2186] Input: Best Travel Planner

[2187] Output: The itinerary displayed in the user interface

[2188] Step 6:

[2189] During the journey, the device will capture real-time emotional data using facial recognition and voice analysis technology, specifically using the device's camera and microphone.

[2190] Input: Real-time audio and video of the user while traveling

[2191] Output: Obtained emotion data

[2192] Step 7:

[2193] The acquired emotional data is transmitted to a server, which analyzes the emotional data in real time and determines the user's current emotional state.

[2194] Input: Captured emotion data

[2195] Output: Parsed emotional state

[2196] Step 8:

[2197] The server adjusts the itinerary based on the user's emotional state. For example, if the user is stressed, it adds relaxing activities, and if the user is excited, it adds exciting activities. An example prompt could be "If the user is stressed, please suggest places where he can relax."

[2198] Input: Parsed emotional state, original travel plan

[2199] Output: Adjusted itinerary

[2200] Step 9:

[2201] The adjusted itinerary is sent to the user's terminal and displayed on the user interface, allowing the user to confirm the adjusted itinerary.

[2202] Input: Adjusted travel plan

[2203] Output: The adjusted itinerary displayed in the user interface.

[2204] Step 10:

[2205] During the trip, the server continuously monitors the traveler's location and local updates (such as weather, traffic, and event changes), which are obtained and used in real time.

[2206] Input: Traveler location, local updates

[2207] Output: Retrieved location information and latest updates

[2208] Step 11:

[2209] The server updates the travel plan in real time based on the latest information and emotion data obtained, thereby constantly optimizing the user's travel experience.

[2210] Input: Obtained location information, updates, and emotion data

[2211] Output: Updated itinerary

[2212] Step 12:

[2213] The server sends update information and important alert information to the user's terminal, which then notifies the user.

[2214] Input: Updated travel plans, alert information

[2215] Output: Updates and alerts notified to the user

[2216] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2217] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2218] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2219] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2220] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[2221] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[2222] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[2223] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[2224] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[2225] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[2226] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[2227] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[2228] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[2229] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[2230] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[2231] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[2232] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[2233] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[2234] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[2235] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described d...

Claims

1. means for receiving traveler input information; means for acquiring relevant city data based on the input information of the traveler; means for integrating the relevant city data with the traveler's input information to generate an optimal travel plan; means for providing the optimal travel plan to a traveler; A system including:

2. a means of monitoring the traveler's location and local updates while traveling; means for updating the travel plan in real time based on the latest information; means for notifying the traveler of the updated travel plan; The system of claim 1 , comprising:

3. A means of analyzing information entered by travelers regarding their travel destination, budget, travel companions, and values; A means for selecting optimal tourist attractions, events, restaurants, and hotels based on the analysis results; means for sequencing the selected factors to optimize travel and timetables; The system of claim 1 , comprising:

Images