system

Abstract

We provide the system. [Solution] A means of obtaining travel conditions received from the user, A means of searching for information based on travel conditions and generating a travel plan, A means of presenting a generated travel plan to the user and modifying the plan based on user feedback, A means of executing a reservation based on the revised travel plan and providing the reservation information to the user, Means of providing users with additional information during their trip, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] It is required to reduce the burdensome information collection and reservation procedures faced by individual travelers when planning solo trips, and to enable effective and personalized travel planning. However, the travel planning process involves many options and fluctuating information, and there is a problem that it is difficult for travelers to manage all elements alone, especially in the case of solo trips.

Means for Solving the Problems

[0005] This invention provides a means for receiving travel conditions from a user and searching for information based on those conditions. Furthermore, it includes means for automatically generating an optimal travel plan using an artificial intelligence algorithm, presenting the plan to the user, and modifying the plan based on user feedback. It also includes means for automatically making reservations based on the modified travel plan and providing the reservation information to the user. This allows for the provision of additional relevant information to the user during their trip, improving the efficiency of planning and managing solo travel.

[0006] A "user" refers to an individual traveler who uses the system to plan and book solo trips.

[0007] "Travel conditions" refer to information such as the user's desired travel destination, dates, budget, and any special requests.

[0008] "Means of searching for information" refers to the function of collecting information such as relevant accommodations, transportation options, and tourist destinations based on the travel conditions provided by the user.

[0009] A "travel plan" refers to a detailed travel schedule that includes dates, destinations, accommodations, and transportation methods that match the user's travel preferences.

[0010] An "artificial intelligence algorithm" refers to a calculation method that analyzes input data and automatically generates a travel plan optimized for the user.

[0011] "Feedback" refers to requests for revisions or opinions that users provide regarding the travel plan presented.

[0012] "Means of executing reservations" refers to the function that allows users to make reservations for hotels, transportation, and other related services based on their confirmed travel plans.

[0013] "Additional information" refers to information provided to make the trip more comfortable for the user, such as information on local events and restaurants available during their trip. [Brief explanation of the drawing]

[0014] [Figure 1] It is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] It is a conceptual diagram showing an example of the main functions of a data processing device and a smart device according to the first embodiment. [Figure 3] It is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] It is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] It is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] It is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] It is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] It is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] It shows an emotion map to which a plurality of emotions are mapped. [Figure 10] It shows an emotion map to which a plurality of emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when an emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when an emotion engine is combined.

Embodiments for Carrying Out the Invention

[0015] Hereinafter, an example of an embodiment of the system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0016] First, the terms used in the following description will be explained.

[0017] In the following embodiments, a labeled processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0018] In the following embodiments, a labeled RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0019] In the following embodiments, a labeled storage is one or more non-volatile storage devices that store various programs, various parameters, and the like. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, and the like.

[0020] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0022] [First Embodiment]

[0023] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0024] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0025] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0027] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0029] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0030] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0032] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0034] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0035] This invention provides an "AI personal travel planner" that enables individual travelers to smoothly plan and streamline their solo trips. The system is implemented as follows:

[0036] First, the user enters travel conditions such as destination, dates, budget, and special requests through their device. The device then sends this information to the server.

[0037] The server receives travel requirements from the user and searches a large travel-related database to gather relevant information. This information includes accommodation, transportation, and tourist attractions at the destination.

[0038] Next, the server uses artificial intelligence algorithms based on this collected information to generate a travel plan optimized for the user's travel conditions. The generated plan includes potential accommodations, transportation options, and sightseeing destinations to visit.

[0039] The generated travel plan is sent to the device and displayed to the user. The user can review this plan and, if necessary, send feedback to the server via the device.

[0040] Upon receiving user feedback, the server recalculates the travel plan and makes any necessary adjustments. Once the final plan is decided, the server automatically makes accommodation reservations and transportation arrangements and sends this reservation information to the user's device.

[0041] Furthermore, useful information for travelers, such as recommendations for local events and restaurants, can be sent from the server to the user's device. This allows users to enjoy sightseeing comfortably while traveling.

[0042] For example, if a user enters the conditions "I want to spend three days in Tokyo, with a budget of 100,000 yen, and I especially want to visit tourist spot A," the server will automatically generate options for accommodation and transportation within that budget in Tokyo, as well as a sightseeing schedule including tourist spot A, and complete the booking process. This entire process allows users to easily plan a solo trip tailored to their preferences.

[0043] The following describes the processing flow.

[0044] Step 1:

[0045] The user enters travel conditions (destination, dates, budget, special requests) via a terminal and sends them to the server. The terminal converts this information into the appropriate data format and sends it to the server as required input data.

[0046] Step 2:

[0047] The server receives travel conditions sent from the terminal. It structures the received data and stores it in an internal database for use in the next processing step.

[0048] Step 3:

[0049] The server searches a large travel database for relevant information based on the user's travel criteria. This includes information on accommodations, transportation, and tourist attractions at the destination. The search results are then narrowed down to the best options by an algorithm.

[0050] Step 4:

[0051] The server uses an AI algorithm to generate a travel plan that matches the user's preferences from the collected information. The generated plan includes a list of potential accommodations, transportation options, and places to visit.

[0052] Step 5:

[0053] The server sends the generated travel plan to the device. The device receives it and displays it visually to the user. The user reviews the plan and, if not satisfied, sends feedback via the device.

[0054] Step 6:

[0055] The device receives feedback from the user and uses it to send a request to the server for revisions to the plan. The feedback includes requests for changes to the plan and additional requests.

[0056] Step 7:

[0057] The server analyzes user feedback and recalculates the travel plan. After making any necessary adjustments, it sends the updated plan back to the device.

[0058] Step 8:

[0059] After the user reviews and approves the final plan, the server automatically makes reservations for accommodation and transportation based on the plan. Reservation information is secured via an external API, and the server retrieves the confirmation information.

[0060] Step 9:

[0061] The server sends reservation confirmation information to the terminal and notifies the user of the details. The terminal displays this information and provides the user with confirmation that the reservation is complete.

[0062] Step 10:

[0063] The server periodically collects additional information useful during the trip (such as event information and restaurant recommendations) and sends it to the device at the appropriate time. This allows users to receive additional support even while traveling.

[0064] (Example 1)

[0065] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0066] For independent travelers, planning a solo trip is a complex and time-consuming task, requiring them to gather information based on their destination, budget, and preferences, as well as select appropriate accommodations and transportation. Furthermore, changing plans necessitates gathering information again, making flexible travel planning difficult.

[0067] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0068] In this invention, the server includes means for acquiring travel conditions received from the user, means for searching for relevant information based on the travel conditions and constructing an individualized travel plan, and means for presenting the constructed travel plan to the terminal and adjusting the plan based on user input. This enables the rapid creation and flexible adjustment of travel plans optimized for individual conditions.

[0069] A "user" refers to an individual who uses the system and enters travel-related conditions through a terminal.

[0070] "Travel conditions" refer to information necessary when planning a trip, including destination, itinerary, budget, and any special requests.

[0071] A "terminal" refers to an electronic device used by users to input travel-related conditions and receive the results of their travel plan.

[0072] A "server" refers to a computer system that processes information received from terminals and performs travel-related data processing and plan generation.

[0073] "Related information" refers to data on accommodations, transportation, and tourist destinations necessary for planning a trip.

[0074] A "personalized travel plan" refers to an optimized itinerary created based on the user's travel preferences.

[0075] "Construction" refers to the entire process of creating and generating a travel plan.

[0076] "Adjustment" refers to the process of modifying and optimizing existing travel plans based on user input.

[0077] This invention is an AI-powered personal travel planner system designed to enable individual travelers to smoothly plan and execute solo trips. In the implementation of the system, the server, terminal, and user exchange information with each other to optimize the travel plan.

[0078] The user enters the conditions for their travel plan into the terminal. The terminal provides an intuitive user interface that facilitates input, allowing the user to easily enter destination, dates, budget, special requests, etc. The entered information is sent to the server using a stable communication protocol.

[0079] After receiving information via the network, the server searches for relevant data based on travel conditions. This search process utilizes databases that provide the latest tourist destination information, accommodation availability, and transportation options. The server employs AI models to individually optimize travel plans based on the received information. This involves complex data calculations related to travel personalization, generating optimized plans tailored to the user's conditions.

[0080] The generated plan includes accommodation options, transportation, sightseeing destinations, and a schedule of the itinerary. The server sends this to the user's device for review. The user can evaluate whether they are satisfied with the plan and send feedback or additional requests to the server via their device. The server receives this feedback, recalculates and optimizes the plan, and applies changes as needed.

[0081] For example, if a user enters the conditions "I want to spend three days in Tokyo, with a budget of 100,000 yen, and I especially want to visit tourist spot A," the server will automatically generate a list of accommodation and transportation options within that budget in Tokyo, as well as a sightseeing schedule that includes tourist spot A. Based on this, the server will complete the booking process.

[0082] These functions can be used as "prompt statements to input into the generating AI model." For example, a specific instruction could be, "Create a 3-day travel plan in Tokyo with a budget of 100,000 yen, and include a visit to tourist destination A." Based on this instruction, the system can provide the user with the most suitable travel plan.

[0083] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0084] Step 1:

[0085] The user enters travel details via a terminal. This includes destination, dates, budget, and any special requests. The terminal verifies the entered information and sends the complete data to the server. This ensures that the user's requests are smoothly transmitted to the server.

[0086] Step 2:

[0087] The server receives travel conditions sent from the terminal. It analyzes the received data and searches the database for relevant information based on the conditions. Here, it collects information such as accommodation availability, transportation options, and tourist destination data. In this process, the server efficiently filters the data to match the user's conditions.

[0088] Step 3:

[0089] The server uses AI algorithms to generate an optimal travel plan from the collected information. This process optimizes accommodations and transportation based on travel dates and budget. The AI ​​evaluates multiple options based on the given conditions and selects the plan best suited to the user. The generated travel plan is then formalized as a specific schedule.

[0090] Step 4:

[0091] The server sends the generated travel plan to the terminal. The terminal displays the plan to the user, allowing them to review its contents. The user can provide feedback on the presented plan, for example, by specifying changes to the plan or entering additional requests. This feedback is then sent back to the server.

[0092] Step 5:

[0093] The server receives feedback from the user and recalculates and optimizes the travel plan. It incorporates corrections based on the feedback and applies necessary adjustments. In this recalculation, the generative AI model is utilized again to generate a revised plan that meets the user's preferences.

[0094] Step 6:

[0095] The server automatically processes reservations based on the final travel plan. Accommodation and transportation booking information is finalized and sent to the user's device. The device allows the user to confirm the booking details, ensuring smooth travel preparations.

[0096] Step 7:

[0097] During travel, the server pushes information on local events and restaurant recommendations to the user's device. Users receive this information in real time, improving the quality of their trip. This allows users to enjoy a comfortable and fulfilling travel experience.

[0098] (Application Example 1)

[0099] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0100] Currently, when individual travelers plan a solo trip, the research, planning, and booking procedures are complicated, time-consuming, and cumbersome. Furthermore, it is difficult to obtain timely additional information and local event information during the trip. Additionally, there is a lack of means to visually and participatoryly experience the travel plan. Solving these problems is essential.

[0101] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0102] In this invention, the server includes means for acquiring travel conditions using voice input and eye-tracking technology, means for visually presenting a travel plan in a virtual space and providing an interactive experience, and means for providing additional information to the user during the trip. This makes it possible for individual travelers to easily plan and experience a trip and acquire necessary information at their destination in a timely manner.

[0103] "Means for obtaining travel conditions received from users" refers to a function that receives data input such as travel destination, dates, budget, and special requests specified by the individual.

[0104] "A means of searching for information based on travel conditions and generating a travel plan" refers to the ability to search a database for accommodation, transportation, and tourist destination information that corresponds to the acquired travel conditions, and to automatically construct the optimal itinerary.

[0105] "A means of presenting a generated travel plan to the user and modifying the plan based on user feedback" refers to a function that displays the initially created travel schedule and adjusts the plan to reflect the user's opinions and requests.

[0106] "A means of executing reservations based on a revised travel plan and providing reservation information to the user" refers to a mechanism that automatically processes accommodation and transportation reservations based on the finalized itinerary and informs the user of the details.

[0107] "Means of providing users with additional information during their trip" refers to the ability to provide users with real-time information such as local events and recommended restaurants during their trip.

[0108] "Means for acquiring travel conditions using voice input and eye-tracking technology" refers to a method of detecting the user's verbal instructions and gaze to analyze their intentions and collect travel requirements.

[0109] "A means of visually presenting travel plans in a virtual space and providing participatory experiences" refers to a system that utilizes virtual reality technology to provide an environment in which users can intuitively and three-dimensionally rehearse their trips.

[0110] The system for realizing this invention consists of a user terminal, a server, and various other devices working together. The user terminal is responsible for acquiring travel conditions using voice input and eye-tracking technology and transmitting this information to the server. The server refers to a large-scale travel-related database, searches for the most suitable information based on the travel conditions, and generates a travel plan.

[0111] The server also has the ability to visually present the generated travel plan in a virtual space, providing users with an interactive experience. In this process, the server uses the Tobii SDK for eye tracking and ABBY SpeechKit for speech recognition to receive feedback from the user and revise the plan as needed. Furthermore, the server utilizes a generative AI model based on OpenAI's GPT-3 to propose a travel schedule optimized for the user's conditions.

[0112] When booking a trip, the server automatically arranges accommodation and transportation and sends the booking information to the user's device. While the user is traveling, the server provides information on local events and restaurant recommendations to support a comfortable travel experience.

[0113] For example, if a user requests to "plan a historical tour in London within a budget," the server will create an optimal schedule including famous London historical sites and present it to the user through a visual tour experience. After completing the necessary bookings for the trip, the server will continue to provide relevant local information throughout the trip. An example of a prompt might be: "Extract travel conditions from the user's voice. For example, based on 'a historical tour in London within a budget of 100,000 yen,' generate the optimal travel plan."

[0114] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0115] Step 1:

[0116] The user's device acquires travel information through voice input and eye-tracking. The user specifies destinations, dates, budget, and preferences by voice, and confirms selections with their eyes, allowing the device to collect this data. Based on this, the device converts the voice data to text, processes the eye-tracking data as coordinate information, and sends the generated data to the server.

[0117] Step 2:

[0118] The server uses OpenAI's GPT-3 AI model to analyze the received travel conditions. This data is then compared with travel-related databases to search for relevant information (accommodation, transportation, tourist destinations). Using travel conditions such as destination and budget as input, the server generates an optimal travel schedule and prepares the experience in the virtual space.

[0119] Step 3:

[0120] The server sends the generated travel plan to the user's terminal and visually presents the plan in a virtual space. The user reviews the presented travel plan and provides feedback through their gaze and voice through an interactive experience. This feedback is sent to the server and used to revise the plan. User interaction serves as input for revising the plan, which the server receives and recalculates.

[0121] Step 4:

[0122] The server recalculates the travel plan based on user feedback and modifies it. The recalculated plan is then presented to the user for final confirmation. During the recalculation process, the server constructs a new itinerary and adjusts it using an AI algorithm based on the input conditions.

[0123] Step 5:

[0124] Once the user approves the plan, the server automatically makes reservations for accommodation and transportation. It generates reservation information and provides the user with the reservation results. In this process, the server uses a reservation API to confirm the completion of the reservation process and records the reservation details.

[0125] Step 6:

[0126] During the trip, the server provides users with additional information. Recommendations for local events and restaurants are sent to the device in real time and updated as the trip progresses. This information is dynamically updated based on the user's geographical location data and travel conditions.

[0127] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0128] This invention provides a system that combines an "AI personal travel planner" with an emotion engine to enable individual travelers to effectively plan and book solo trips. It has the function of analyzing emotions based on user input and feedback, and optimizing and personalizing travel plans based on that analysis.

[0129] First, the user enters basic travel conditions such as destination, dates, budget, and special requests through the device. In addition to this information, the device provides an interface to sense the user's emotional state, analyzing their emotions from their voice tone and the content of the text they enter.

[0130] The server receives travel conditions and sentiment information transmitted from the terminal. The collected data is stored in an internal database and used in the subsequent travel planning process.

[0131] The server uses AI algorithms to create the optimal travel plan based on information gathered according to travel conditions. The emotion engine designs a travel plan that meets the user's expectations by incorporating personalized suggestions that respond to the user's emotions. For example, if the user is feeling stressed, it will suggest a sightseeing plan that emphasizes relaxation.

[0132] The generated travel plan is sent to the device. The user reviews the plan and provides feedback. This feedback, along with sentiment information, is sent to the server, and the plan is adjusted again if necessary.

[0133] Once the final travel plan is decided, the server automatically makes reservations for accommodations, transportation, etc., and provides the reservation information to the user. Furthermore, during the trip, new information and content are provided based on the user's real-time emotional state. For example, if the user is excited, information on active activities and events can be suggested.

[0134] As a concrete example, if a user enters conditions such as "prioritizing relaxation in Paris, with a budget of 150,000 yen," and the emotion engine detects that the user is feeling somewhat anxious, the server will generate a travel plan featuring resort hotels in quiet areas of Paris and relaxation spas, and guide the user through it. In this way, users can comfortably enjoy a solo trip tailored to their individual needs and emotions.

[0135] The following describes the processing flow.

[0136] Step 1:

[0137] Users input their destination, dates, budget, and preferences through the device. Furthermore, the device incorporates an emotion engine that analyzes the user's voice tone and entered text to determine their emotional state, and then sends this data to the server.

[0138] Step 2:

[0139] The server analyzes travel conditions and emotional information received from the terminal. The analyzed data is stored in an internal database and prepared for travel plan generation.

[0140] Step 3:

[0141] The server searches various travel information databases to collect information on destination accommodations, transportation, and tourist attractions. The emotion engine then identifies the optimal choices from this information, taking into account the user's emotional state.

[0142] Step 4:

[0143] The server uses an AI algorithm to generate a personalized travel plan based on the user's travel preferences and emotional state. The generated plan includes special suggestions tailored to the user's mood.

[0144] Step 5:

[0145] The server sends the completed travel plan to the terminal, which then displays the plan to the user. The user reviews the displayed information and sends feedback if they have any additional requests or corrections.

[0146] Step 6:

[0147] User feedback is sent from the device to the server. The server analyzes the feedback and recalculates and modifies the travel plan as needed.

[0148] Step 7:

[0149] The server automatically executes the booking process based on the user's final approved travel plan. Booking details are retrieved using an external API, and the server collects booking confirmation information.

[0150] Step 8:

[0151] The server sends reservation information to the terminal and notifies the user of the details. The terminal displays this information, providing the user with a means to confirm the reservation details.

[0152] Step 9:

[0153] During the trip, the server continuously monitors the user's real-time emotional state and sends information (events and recommended activities) to the device as needed, based on those emotions. This process allows users to enjoy their trip more fully.

[0154] (Example 2)

[0155] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0156] When planning individual trips, conventional systems often fail to adequately consider the user's emotional state, making it difficult to provide suitable travel plans, especially for users experiencing stress or anxiety. As a result, travel satisfaction decreases, and the system fails to fully meet user needs.

[0157] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0158] In this invention, the server includes means for analyzing the user's emotional state, means for optimizing the travel plan based on travel conditions and emotional state, and means for providing additional information based on the user's real-time emotional state during the trip. This makes it possible to provide a travel plan that is individually optimized while being attentive to the user's emotions, thereby improving travel satisfaction.

[0159] A "user" refers to an individual who plans their trip through this system.

[0160] A "terminal" refers to a device used by a user, specifically a device that performs information input, display, and sentiment analysis.

[0161] A "server" refers to a central device that processes information transmitted from terminals and performs tasks such as generating travel plans and performing sentiment analysis.

[0162] "Travel conditions" refer to information such as destination, dates, budget, and special requests that users enter when planning a trip.

[0163] "Emotional state" refers to the user's current emotional state and is a mental state analyzed from voice and text.

[0164] "Travel plan" refers to the detailed itinerary generated based on the user's travel conditions and emotional state.

[0165] "Feedback" refers to the opinions and evaluations that users provide regarding the generated travel plans.

[0166] An "artificial intelligence algorithm" refers to a computer program that automatically generates the optimal travel plan based on the input data.

[0167] "Additional information" refers to tourist destination information, event and activity guides provided based on the user's emotional state during their trip.

[0168] This invention is a system based on an "AI personal travel planner" that enables individual travelers to effectively plan their solo trips, and combines it with an emotion engine.

[0169] The device receives travel conditions from the user, including destination, travel dates, budget, and special requests. In addition, the device uses speech recognition APIs and natural language processing libraries to analyze the user's input text and voice tone, and to assess the user's emotional state.

[0170] The server receives travel conditions and sentiment analysis results sent from the terminal. This data is stored in an SQL database on the server and used in the travel plan generation process. The server uses a generative AI model to formulate the optimal travel plan based on the collected travel conditions and sentiment state. At this time, the artificial intelligence algorithm operates to personalize and incorporate suggestions that match the user's sentiment.

[0171] The generated travel plan is sent to the device and presented to the user. The user can review the plan and provide feedback. This feedback is sent back to the server, and a revised plan is generated as needed. Based on the finalized travel plan, the server automatically makes reservations for accommodations and transportation.

[0172] During travel, the device re-analyzes the user's real-time emotional state and provides new information and content from the server. For example, if the user is excited, it can suggest active activities.

[0173] For example, if a user enters conditions such as "prioritizing relaxation in Paris, with a budget of 150,000 yen," and the emotion engine detects that the user is feeling somewhat anxious, the server will generate a travel plan that includes a resort hotel and relaxation spa in a quiet area of ​​Paris. In this way, users can comfortably enjoy a solo trip tailored to their individual needs and emotions.

[0174] An example of a prompt message would be: "The user is planning a solo trip. The destination is Paris, and please provide a plan that emphasizes relaxation during the trip. The budget is 150,000 yen, and please include suggestions to alleviate the user's current anxieties."

[0175] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0176] Step 1:

[0177] The user enters their destination, travel itinerary, budget, and special requests through the device. The entered information is recognized as travel conditions. If voice input is available, the device uses a speech recognition API to analyze the voice tone. If text input is available, a natural language processing library is used to analyze the text content and evaluate the user's emotional state. Input data includes text and voice data, and the output is data on the analyzed travel conditions and emotional state.

[0178] Step 2:

[0179] The terminal sends the analyzed travel conditions and emotional state to the server. Here, data communication technology is used to ensure that user information reaches the server securely. The server receives this data and stores it in an SQL database. The input is data in JSON format, and the output is the state stored in the database.

[0180] Step 3:

[0181] The server extracts travel conditions and emotional states from an SQL database and generates a travel plan using a generative AI model. The artificial intelligence algorithm processes the information using prompts to create the optimal travel plan. For example, depending on the user's stress level, it selects travel options aimed at stress reduction. The input is the query results from the database, and the output is the generated travel plan.

[0182] Step 4:

[0183] The generated travel plan is sent from the server to the terminal and presented to the user. The user reviews the plan and provides feedback via the UI interface. At this time, the user's feedback information is obtained and sent back to the server for sentiment re-analysis. The input is the user's feedback data, and the output is sent to the server as feedback information.

[0184] Step 5:

[0185] The server readjusts the travel plan based on user feedback and re-analyzed emotional states. If necessary, it reapplies the generating AI model to create an updated, optimal plan. The generated plan is then sent back to the user for confirmation. The input is the update instructions including feedback, and the output is the revised travel plan.

[0186] Step 6:

[0187] Based on the final travel plan, the server automatically makes reservations for accommodation and transportation. It uses a reservation management API to retrieve the appropriate reservation information and provides confirmation data to the user. The input is the final travel plan, and the output is reservation confirmation information.

[0188] Step 7:

[0189] During travel, the device re-analyzes the user's emotional state in real time and retrieves new information and content from the server. This uses dynamic information processing technology to provide activity information tailored to the user's excitement level. The input is emotional data perceived in real time, and the output is activated travel and activity information.

[0190] (Application Example 2)

[0191] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0192] Traditional travel planning systems have the problem of not being able to take into account the user's emotional state, making it difficult to provide a personalized travel experience. Furthermore, there is a lack of methods to provide information and services that match the user's emotions in real time, even during travel. The aim is to solve these problems and provide travel planning and travel experiences that are more attentive to the user.

[0193] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0194] In this invention, the server includes means for acquiring travel conditions received from the user, means for retrieving information based on the travel conditions and emotional state and generating a travel plan, and means for presenting the generated travel plan to the user and modifying the plan based on the user's feedback and emotional information. This makes it possible to provide an optimal travel plan tailored to the user's emotional state in real time.

[0195] "Travel conditions received from the user" refers to information such as the destination, length of stay, cost, and any special requests entered by the user.

[0196] "Emotional state" refers to the user's psychological state and is emotional information measured through voice tone and text analysis.

[0197] "Generating" means automatically creating new plans or proposals based on specific conditions or data.

[0198] A "travel plan" is a plan that includes the overall schedule of the trip, places to visit, accommodations, and means of transportation.

[0199] "Feedback" refers to information about the user's reactions and opinions to the plan presented.

[0200] "Optimized additional information" refers to data and suggestions that are provided in the most appropriate format based on the user's current emotions and circumstances.

[0201] An "artificial intelligence algorithm" is a computer program or method that has the ability to analyze data, learn from it, and make predictions.

[0202] This invention is a system that personalizes travel plans based on the user's emotions. The server acquires travel conditions received from the user and emotional state information transmitted from the terminal. The hardware used is a smartphone that senses the user's voice and text input, and the software uses TENSORFLOW® for emotion analysis and an SQL database for data management.

[0203] The server uses AI algorithms to automatically generate a travel plan best suited to the user's travel conditions and emotional state. This involves synthesizing information from multiple data sources to provide the experience the user expects. The generated travel plan is presented to the user, who can provide feedback. This feedback is continuously sent to the server, and the plan is readjusted as needed.

[0204] For example, if a user specifies a condition such as "I want a trip that will calm my mind," and the system detects that the user's emotional state is anxious, the server will suggest relaxing tourist destinations and dining options, and plan a trip that will provide a peaceful experience. This system can take the user's emotional state into consideration and make travel suggestions in real time.

[0205] An example of a prompt to a generative AI model is, "Considering my current mood, please suggest a travel plan that is best suited for relaxation." In this way, users can enjoy a personalized trip that is tailored to their emotional state.

[0206] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0207] Step 1:

[0208] The device obtains travel conditions (destination, dates, budget, etc.) and emotional state from the user. Based on the input conditions, it analyzes voice tone and text content to quantify the emotional state. The output is the user's travel conditions and emotional state.

[0209] Step 2:

[0210] The server stores travel conditions and emotional states received from the terminal in an internal database. It collects travel data tailored to the user's needs and compares it with the database to provide optimal information. The output is a dataset based on travel conditions and emotional states.

[0211] Step 3:

[0212] The server uses stored data to generate travel plans using AI algorithms (generative AI models). An emotion engine is also used to create plans that include personalized travel suggestions tailored to the user's emotional state. The output is the generated travel plan.

[0213] Step 4:

[0214] The server sends the generated travel plan to the terminal. The user can review the presented plan and provide feedback. The input reflects the feedback in the database. The output is the user's feedback.

[0215] Step 5:

[0216] The server recalculates the travel plan based on user feedback and makes adjustments as needed. It updates the travel plan based on the latest emotional state and feedback. The output is the revised travel plan.

[0217] Step 6:

[0218] Once the final travel plan is decided, the server automatically handles the booking process, confirming reservations for accommodation and transportation. The user is then provided with the booking details on their device. The output is the booking information.

[0219] Step 7:

[0220] During the trip, the device continuously analyzes the user's emotions in real time. Based on the analysis results, the server provides necessary information and improved suggestions. The output includes additional information and real-time services during the trip.

[0221] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0222] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0223] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0224] [Second Embodiment]

[0225] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0226] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0227] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0228] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0229] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0230] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0231] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0232] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0233] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0234] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0235] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0236] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0237] This invention provides an "AI personal travel planner" that enables individual travelers to smoothly plan and streamline their solo trips. The system is implemented as follows:

[0238] First, the user enters travel conditions such as destination, dates, budget, and special requests through their device. The device then sends this information to the server.

[0239] The server receives travel requirements from the user and searches a large travel-related database to gather relevant information. This information includes accommodation, transportation, and tourist attractions at the destination.

[0240] Next, the server uses artificial intelligence algorithms based on this collected information to generate a travel plan optimized for the user's travel conditions. The generated plan includes potential accommodations, transportation options, and sightseeing destinations to visit.

[0241] The generated travel plan is sent to the device and displayed to the user. The user can review this plan and, if necessary, send feedback to the server via the device.

[0242] Upon receiving user feedback, the server recalculates the travel plan and makes any necessary adjustments. Once the final plan is decided, the server automatically makes accommodation reservations and transportation arrangements and sends this reservation information to the user's device.

[0243] Furthermore, useful information for travelers, such as recommendations for local events and restaurants, can be sent from the server to the user's device. This allows users to enjoy sightseeing comfortably while traveling.

[0244] For example, if a user enters the conditions "I want to spend three days in Tokyo, with a budget of 100,000 yen, and I especially want to visit tourist spot A," the server will automatically generate options for accommodation and transportation within that budget in Tokyo, as well as a sightseeing schedule including tourist spot A, and complete the booking process. This entire process allows users to easily plan a solo trip tailored to their preferences.

[0245] The following describes the processing flow.

[0246] Step 1:

[0247] The user enters travel conditions (destination, dates, budget, special requests) via a terminal and sends them to the server. The terminal converts this information into the appropriate data format and sends it to the server as required input data.

[0248] Step 2:

[0249] The server receives travel conditions sent from the terminal. It structures the received data and stores it in an internal database for use in the next processing step.

[0250] Step 3:

[0251] The server searches a large travel database for relevant information based on the user's travel criteria. This includes information on accommodations, transportation, and tourist attractions at the destination. The search results are then narrowed down to the best options by an algorithm.

[0252] Step 4:

[0253] The server uses an AI algorithm to generate a travel plan that matches the user's preferences from the collected information. The generated plan includes a list of potential accommodations, transportation options, and places to visit.

[0254] Step 5:

[0255] The server sends the generated travel plan to the device. The device receives it and displays it visually to the user. The user reviews the plan and, if not satisfied, sends feedback via the device.

[0256] Step 6:

[0257] The device receives feedback from the user and uses it to send a request to the server for revisions to the plan. The feedback includes requests for changes to the plan and additional requests.

[0258] Step 7:

[0259] The server analyzes user feedback and recalculates the travel plan. After making any necessary adjustments, it sends the updated plan back to the device.

[0260] Step 8:

[0261] After the user reviews and approves the final plan, the server automatically makes reservations for accommodation and transportation based on the plan. Reservation information is secured via an external API, and the server retrieves the confirmation information.

[0262] Step 9:

[0263] The server sends reservation confirmation information to the terminal and notifies the user of the details. The terminal displays this information and provides the user with confirmation that the reservation is complete.

[0264] Step 10:

[0265] The server periodically collects additional information useful during the trip (such as event information and restaurant recommendations) and sends it to the device at the appropriate time. This allows users to receive additional support even while traveling.

[0266] (Example 1)

[0267] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0268] For independent travelers, planning a solo trip is a complex and time-consuming task, requiring them to gather information based on their destination, budget, and preferences, as well as select appropriate accommodations and transportation. Furthermore, changing plans necessitates gathering information again, making flexible travel planning difficult.

[0269] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0270] In this invention, the server includes means for acquiring travel conditions received from the user, means for searching for relevant information based on the travel conditions and constructing an individualized travel plan, and means for presenting the constructed travel plan to the terminal and adjusting the plan based on user input. This enables the rapid creation and flexible adjustment of travel plans optimized for individual conditions.

[0271] A "user" refers to an individual who uses the system and enters travel-related conditions through a terminal.

[0272] "Travel conditions" refer to information necessary when planning a trip, including destination, itinerary, budget, and any special requests.

[0273] A "terminal" refers to an electronic device used by users to input travel-related conditions and receive the results of their travel plan.

[0274] A "server" refers to a computer system that processes information received from terminals and performs travel-related data processing and plan generation.

[0275] "Related information" refers to data on accommodations, transportation, and tourist destinations necessary for planning a trip.

[0276] A "personalized travel plan" refers to an optimized itinerary created based on the user's travel preferences.

[0277] "Construction" refers to the entire process of creating and generating a travel plan.

[0278] "Adjustment" refers to the process of modifying and optimizing existing travel plans based on user input.

[0279] This invention is an AI-powered personal travel planner system designed to enable individual travelers to smoothly plan and execute solo trips. In the implementation of the system, the server, terminal, and user exchange information with each other to optimize the travel plan.

[0280] The user inputs the conditions for the travel plan into the terminal. The terminal provides a user interface that intuitively facilitates the input, enabling the user to easily input the destination, schedule, budget, special wishes, etc. The input information is sent to the server using a stable communication protocol.

[0281] After receiving the information via the network, the server searches for relevant data based on the travel conditions. This search process uses databases that provide the latest tourist destination information, availability of accommodation facilities, and transportation options. The server utilizes an AI model to individually optimize the travel plan based on the received information. This involves complex data calculations related to travel personalization to generate an optimized plan suitable for the user's conditions.

[0282] The generated plan includes accommodation options, transportation means, tourist destinations to visit, and a schedule of the itinerary. The server sends this to the terminal so that the user can view it. The user can evaluate whether they are satisfied with the plan and send feedback or additional wishes to the server through the terminal. The server receives this feedback, recalculates and optimizes the plan, and applies changes if necessary.

[0283] As a specific example, when the user inputs conditions such as "I want to visit Tokyo for 3 days with a budget of 100,000 yen and specifically visit Tourist Destination A", the server automatically generates a tourism schedule that includes accommodation facilities and transportation options within the budget in Tokyo, as well as Tourist Destination A. Based on this, the server completes the reservation procedure.

[0284] These functions can be used as "prompt texts input into the generation AI model". For example, specific instructions such as "Create a 3-day travel plan for Tokyo with a budget of 100,000 yen and include a visit to Tourist Destination A" can be considered. Based on this instruction text, the system can provide an optimal travel plan for the user.

[0285] The flow of the specific process in Example 1 will be described using FIG. 11.

[0286] Step 1:

[0287] The user inputs travel conditions through the terminal. The input content includes the destination, schedule, budget, special requests, etc. The terminal checks the input information and sends the complete data to the server. This enables the user's requests to be smoothly transmitted to the server.

[0288] Step 2:

[0289] The server receives the travel conditions sent from the terminal. It analyzes the received data and searches the database for relevant information based on the conditions. Here, it collects vacancy information of accommodation facilities, transportation options, and tourist destination data. In this process, the server efficiently filters the data that matches the user's conditions.

[0290] Step 3:

[0291] The server uses an AI algorithm to generate an optimal travel plan from the collected information. In this process, the accommodation and transportation are optimized according to the travel schedule and budget. The AI evaluates multiple options based on the conditions and selects the plan most suitable for the user. The generated travel plan is formalized as a specific schedule.

[0292] Step 4:

[0293] The server sends the generated travel plan to the terminal. The terminal displays the plan to the user and allows the user to check the content of the plan. The user can provide feedback on the presented plan. For example, specify the changes to the plan or enter additional requests. This feedback is sent back to the server again.

[0294] Step 5:

[0295] The server receives feedback from the user and recalculates and optimizes the travel plan. It incorporates corrections based on the feedback and applies necessary adjustments. In this recalculation, the generative AI model is utilized again to generate a revised plan that meets the user's preferences.

[0296] Step 6:

[0297] The server automatically processes reservations based on the final travel plan. Accommodation and transportation booking information is finalized and sent to the user's device. The device allows the user to confirm the booking details, ensuring smooth travel preparations.

[0298] Step 7:

[0299] During travel, the server pushes information on local events and restaurant recommendations to the user's device. Users receive this information in real time, improving the quality of their trip. This allows users to enjoy a comfortable and fulfilling travel experience.

[0300] (Application Example 1)

[0301] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0302] Currently, when individual travelers plan a solo trip, the research, planning, and booking procedures are complicated, time-consuming, and cumbersome. Furthermore, it is difficult to obtain timely additional information and local event information during the trip. Additionally, there is a lack of means to visually and participatoryly experience the travel plan. Solving these problems is essential.

[0303] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0304] In this invention, the server includes means for obtaining travel conditions using voice input and eye-tracking technology, means for visually presenting a travel plan in a virtual space and providing a participatory experience, and means for providing additional information to the user during the trip. As a result, individual travelers can easily formulate and experience travel plans and obtain necessary information in a timely manner at their travel destinations.

[0305] The means for "obtaining travel conditions received from the user" is a function for receiving conditions such as the destination, schedule, budget, and special wishes of a trip specified by an individual as data input.

[0306] The means for "searching for information based on travel conditions and generating a travel plan" is the ability to search a database for accommodation facilities, transportation, tourist information, etc. corresponding to the obtained travel conditions and automatically construct an optimal itinerary.

[0307] The means for "presenting the generated travel plan to the user and modifying the plan based on the user's feedback" is a function for displaying the initially created travel schedule and adjusting the plan by reflecting the opinions and requests of the user.

[0308] The means for "executing reservations based on the modified travel plan and providing reservation information to the user" is a mechanism for automatically processing accommodation and transportation reservations based on the finally determined itinerary and notifying the user of the details.

[0309] The means for "providing additional information to the user during the trip" is the ability to supply real-time information such as local events and recommended restaurants during the user's trip.

[0310] The means for "obtaining travel conditions using voice input and eye-tracking technology" is a method for detecting the user's oral instructions and eye gaze, analyzing the intentions, and collecting travel requirements.

[0311] "A means of visually presenting travel plans in a virtual space and providing participatory experiences" refers to a system that utilizes virtual reality technology to provide an environment in which users can intuitively and three-dimensionally rehearse their trips.

[0312] The system for realizing this invention consists of a user terminal, a server, and various other devices working together. The user terminal is responsible for acquiring travel conditions using voice input and eye-tracking technology and transmitting this information to the server. The server refers to a large-scale travel-related database, searches for the most suitable information based on the travel conditions, and generates a travel plan.

[0313] The server also has the ability to visually present the generated travel plan in a virtual space, providing users with an interactive experience. In this process, the server uses the Tobii SDK for eye tracking and ABBY SpeechKit for speech recognition to receive user feedback and revise the plan as needed. Furthermore, the server utilizes a generative AI model based on OpenAI's GPT-3 to propose a travel schedule optimized for the user's conditions.

[0314] When booking a trip, the server automatically arranges accommodation and transportation and sends the booking information to the user's device. While the user is traveling, the server provides information on local events and restaurant recommendations to support a comfortable travel experience.

[0315] For example, if a user requests to "plan a historical tour in London within a budget," the server will create an optimal schedule including famous London historical sites and present it to the user through a visual tour experience. After completing the necessary bookings for the trip, the server will continue to provide relevant local information throughout the trip. An example of a prompt might be: "Extract travel conditions from the user's voice. For example, based on 'a historical tour in London within a budget of 100,000 yen,' generate the optimal travel plan."

[0316] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0317] Step 1:

[0318] The user's device acquires travel information through voice input and eye-tracking. The user specifies destinations, dates, budget, and preferences by voice, and confirms selections with their eyes, allowing the device to collect this data. Based on this, the device converts the voice data to text, processes the eye-tracking data as coordinate information, and sends the generated data to the server.

[0319] Step 2:

[0320] The server uses OpenAI's GPT-3 AI model to analyze the received travel conditions. This data is then compared with travel-related databases to search for relevant information (accommodation, transportation, tourist destinations). Using travel conditions such as destination and budget as input, the server generates an optimal travel schedule and prepares the experience in the virtual space.

[0321] Step 3:

[0322] The server sends the generated travel plan to the user's terminal and visually presents the plan in a virtual space. The user reviews the presented travel plan and provides feedback through their gaze and voice through an interactive experience. This feedback is sent to the server and used to revise the plan. User interaction serves as input for revising the plan, which the server receives and recalculates.

[0323] Step 4:

[0324] The server recalculates the travel plan based on user feedback and modifies it. The recalculated plan is then presented to the user for final confirmation. During the recalculation process, the server constructs a new itinerary and adjusts it using an AI algorithm based on the input conditions.

[0325] Step 5:

[0326] Once the user approves the plan, the server automatically makes reservations for accommodation and transportation. It generates reservation information and provides the user with the reservation results. In this process, the server uses a reservation API to confirm the completion of the reservation process and records the reservation details.

[0327] Step 6:

[0328] During the trip, the server provides users with additional information. Recommendations for local events and restaurants are sent to the device in real time and updated as the trip progresses. This information is dynamically updated based on the user's geographical location data and travel conditions.

[0329] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0330] This invention provides a system that combines an "AI personal travel planner" with an emotion engine to enable individual travelers to effectively plan and book solo trips. It has the function of analyzing emotions based on user input and feedback, and optimizing and personalizing travel plans based on that analysis.

[0331] First, the user enters basic travel conditions such as destination, dates, budget, and special requests through the device. In addition to this information, the device provides an interface to sense the user's emotional state, analyzing their emotions from their voice tone and the content of the text they enter.

[0332] The server receives travel conditions and sentiment information transmitted from the terminal. The collected data is stored in an internal database and used in the subsequent travel planning process.

[0333] The server uses AI algorithms to create the optimal travel plan based on information gathered according to travel conditions. The emotion engine designs a travel plan that meets the user's expectations by incorporating personalized suggestions that respond to the user's emotions. For example, if the user is feeling stressed, it will suggest a sightseeing plan that emphasizes relaxation.

[0334] The generated travel plan is sent to the device. The user reviews the plan and provides feedback. This feedback, along with sentiment information, is sent to the server, and the plan is adjusted again if necessary.

[0335] Once the final travel plan is decided, the server automatically makes reservations for accommodations, transportation, etc., and provides the reservation information to the user. Furthermore, during the trip, new information and content are provided based on the user's real-time emotional state. For example, if the user is excited, information on active activities and events can be suggested.

[0336] As a concrete example, if a user enters conditions such as "prioritizing relaxation in Paris, with a budget of 150,000 yen," and the emotion engine detects that the user is feeling somewhat anxious, the server will generate a travel plan featuring resort hotels in quiet areas of Paris and relaxation spas, and guide the user through it. In this way, users can comfortably enjoy a solo trip tailored to their individual needs and emotions.

[0337] The following describes the processing flow.

[0338] Step 1:

[0339] Users input their destination, dates, budget, and preferences through the device. Furthermore, the device incorporates an emotion engine that analyzes the user's voice tone and entered text to determine their emotional state, and then sends this data to the server.

[0340] Step 2:

[0341] The server analyzes travel conditions and emotional information received from the terminal. The analyzed data is stored in an internal database and prepared for travel plan generation.

[0342] Step 3:

[0343] The server searches various travel information databases to collect information on destination accommodations, transportation, and tourist attractions. The emotion engine then identifies the optimal choices from this information, taking into account the user's emotional state.

[0344] Step 4:

[0345] The server uses an AI algorithm to generate a personalized travel plan based on the user's travel preferences and emotional state. The generated plan includes special suggestions tailored to the user's mood.

[0346] Step 5:

[0347] The server sends the completed travel plan to the terminal, which then displays the plan to the user. The user reviews the displayed information and sends feedback if they have any additional requests or corrections.

[0348] Step 6:

[0349] User feedback is sent from the device to the server. The server analyzes the feedback and recalculates and modifies the travel plan as needed.

[0350] Step 7:

[0351] The server automatically executes the booking process based on the user's final approved travel plan. Booking details are retrieved using an external API, and the server collects booking confirmation information.

[0352] Step 8:

[0353] The server sends reservation information to the terminal and notifies the user of the details. The terminal displays this information, providing the user with a means to confirm the reservation details.

[0354] Step 9:

[0355] During the trip, the server continuously monitors the user's real-time emotional state and sends information (events and recommended activities) to the device as needed, based on those emotions. This process allows users to enjoy their trip more fully.

[0356] (Example 2)

[0357] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0358] When planning individual trips, conventional systems often fail to adequately consider the user's emotional state, making it difficult to provide suitable travel plans, especially for users experiencing stress or anxiety. As a result, travel satisfaction decreases, and the system fails to fully meet user needs.

[0359] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0360] In this invention, the server includes means for analyzing the user's emotional state, means for optimizing the travel plan based on travel conditions and emotional state, and means for providing additional information based on the user's real-time emotional state during the trip. This makes it possible to provide a travel plan that is individually optimized while being attentive to the user's emotions, thereby improving travel satisfaction.

[0361] A "user" refers to an individual who plans their trip through this system.

[0362] A "terminal" refers to a device used by a user, specifically a device that performs information input, display, and sentiment analysis.

[0363] A "server" refers to a central device that processes information transmitted from terminals and performs tasks such as generating travel plans and performing sentiment analysis.

[0364] "Travel conditions" refer to information such as destination, dates, budget, and special requests that users enter when planning a trip.

[0365] "Emotional state" refers to the user's current emotional state and is a mental state analyzed from voice and text.

[0366] "Travel plan" refers to the detailed itinerary generated based on the user's travel conditions and emotional state.

[0367] "Feedback" refers to the opinions and evaluations that users provide regarding the generated travel plans.

[0368] An "artificial intelligence algorithm" refers to a computer program that automatically generates the optimal travel plan based on the input data.

[0369] "Additional information" refers to tourist destination information, event and activity guides provided based on the user's emotional state during their trip.

[0370] This invention is a system based on an "AI personal travel planner" that enables individual travelers to effectively plan their solo trips, and combines it with an emotion engine.

[0371] The device receives travel conditions from the user, including destination, travel dates, budget, and special requests. In addition, the device uses speech recognition APIs and natural language processing libraries to analyze the user's input text and voice tone, and to assess the user's emotional state.

[0372] The server receives travel conditions and sentiment analysis results sent from the terminal. This data is stored in an SQL database on the server and used in the travel plan generation process. The server uses a generative AI model to formulate the optimal travel plan based on the collected travel conditions and sentiment state. At this time, the artificial intelligence algorithm operates to personalize and incorporate suggestions that match the user's sentiment.

[0373] The generated travel plan is sent to the device and presented to the user. The user can review the plan and provide feedback. This feedback is sent back to the server, and a revised plan is generated as needed. Based on the finalized travel plan, the server automatically makes reservations for accommodations and transportation.

[0374] During travel, the device re-analyzes the user's real-time emotional state and provides new information and content from the server. For example, if the user is excited, it can suggest active activities.

[0375] For example, if a user enters conditions such as "prioritizing relaxation in Paris, with a budget of 150,000 yen," and the emotion engine detects that the user is feeling somewhat anxious, the server will generate a travel plan that includes a resort hotel and relaxation spa in a quiet area of ​​Paris. In this way, users can comfortably enjoy a solo trip tailored to their individual needs and emotions.

[0376] An example of a prompt message would be: "The user is planning a solo trip. The destination is Paris, and please provide a plan that emphasizes relaxation during the trip. The budget is 150,000 yen, and please include suggestions to alleviate the user's current anxieties."

[0377] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0378] Step 1:

[0379] The user enters their destination, travel itinerary, budget, and special requests through the device. The entered information is recognized as travel conditions. If voice input is available, the device uses a speech recognition API to analyze the voice tone. If text input is available, a natural language processing library is used to analyze the text content and evaluate the user's emotional state. Input data includes text and voice data, and the output is data on the analyzed travel conditions and emotional state.

[0380] Step 2:

[0381] The terminal sends the analyzed travel conditions and emotional state to the server. Here, data communication technology is used to ensure that user information reaches the server securely. The server receives this data and stores it in an SQL database. The input is data in JSON format, and the output is the state stored in the database.

[0382] Step 3:

[0383] The server extracts travel conditions and emotional states from an SQL database and generates a travel plan using a generative AI model. The artificial intelligence algorithm processes the information using prompts to create the optimal travel plan. For example, depending on the user's stress level, it selects travel options aimed at stress reduction. The input is the query results from the database, and the output is the generated travel plan.

[0384] Step 4:

[0385] The generated travel plan is sent from the server to the terminal and presented to the user. The user reviews the plan and provides feedback via the UI interface. At this time, the user's feedback information is obtained and sent back to the server for sentiment re-analysis. The input is the user's feedback data, and the output is sent to the server as feedback information.

[0386] Step 5:

[0387] The server readjusts the travel plan based on user feedback and re-analyzed emotional states. If necessary, it reapplies the generating AI model to create an updated, optimal plan. The generated plan is then sent back to the user for confirmation. The input is the update instructions including feedback, and the output is the revised travel plan.

[0388] Step 6:

[0389] Based on the final travel plan, the server automatically makes reservations for accommodation and transportation. It uses a reservation management API to retrieve the appropriate reservation information and provides confirmation data to the user. The input is the final travel plan, and the output is reservation confirmation information.

[0390] Step 7:

[0391] During travel, the device re-analyzes the user's emotional state in real time and retrieves new information and content from the server. This uses dynamic information processing technology to provide activity information tailored to the user's excitement level. The input is emotional data perceived in real time, and the output is activated travel and activity information.

[0392] (Application Example 2)

[0393] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0394] Traditional travel planning systems have the problem of not being able to take into account the user's emotional state, making it difficult to provide a personalized travel experience. Furthermore, there is a lack of methods to provide information and services that match the user's emotions in real time, even during travel. The aim is to solve these problems and provide travel planning and travel experiences that are more attentive to the user.

[0395] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0396] In this invention, the server includes means for acquiring travel conditions received from the user, means for retrieving information based on the travel conditions and emotional state and generating a travel plan, and means for presenting the generated travel plan to the user and modifying the plan based on the user's feedback and emotional information. This makes it possible to provide an optimal travel plan tailored to the user's emotional state in real time.

[0397] "Travel conditions received from the user" refers to information such as the destination, length of stay, cost, and any special requests entered by the user.

[0398] "Emotional state" refers to the user's psychological state and is emotional information measured through voice tone and text analysis.

[0399] "Generating" means automatically creating new plans or proposals based on specific conditions or data.

[0400] A "travel plan" is a plan that includes the overall schedule of the trip, places to visit, accommodations, and means of transportation.

[0401] "Feedback" refers to information about the user's reactions and opinions to the plan presented.

[0402] "Optimized additional information" refers to data and suggestions that are provided in the most appropriate format based on the user's current emotions and circumstances.

[0403] An "artificial intelligence algorithm" is a computer program or method that has the ability to analyze data, learn from it, and make predictions.

[0404] This invention is a system that personalizes travel plans based on the user's emotions. The server acquires travel conditions received from the user and emotional state information transmitted from the terminal. The hardware used is a smartphone that senses the user's voice and text input, while the software uses TensorFlow for emotion analysis and an SQL database for data management.

[0405] The server uses AI algorithms to automatically generate a travel plan best suited to the user's travel conditions and emotional state. This involves synthesizing information from multiple data sources to provide the experience the user expects. The generated travel plan is presented to the user, who can provide feedback. This feedback is continuously sent to the server, and the plan is readjusted as needed.

[0406] For example, if a user specifies a condition such as "I want a trip that will calm my mind," and the system detects that the user's emotional state is anxious, the server will suggest relaxing tourist destinations and dining options, and plan a trip that will provide a peaceful experience. This system can take the user's emotional state into consideration and make travel suggestions in real time.

[0407] An example of a prompt to a generative AI model is, "Considering my current mood, please suggest a travel plan that is best suited for relaxation." In this way, users can enjoy a personalized trip that is tailored to their emotional state.

[0408] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0409] Step 1:

[0410] The device obtains travel conditions (destination, dates, budget, etc.) and emotional state from the user. Based on the input conditions, it analyzes voice tone and text content to quantify the emotional state. The output is the user's travel conditions and emotional state.

[0411] Step 2:

[0412] The server stores travel conditions and emotional states received from the terminal in an internal database. It collects travel data tailored to the user's needs and compares it with the database to provide optimal information. The output is a dataset based on travel conditions and emotional states.

[0413] Step 3:

[0414] The server uses stored data to generate travel plans using AI algorithms (generative AI models). An emotion engine is also used to create plans that include personalized travel suggestions tailored to the user's emotional state. The output is the generated travel plan.

[0415] Step 4:

[0416] The server sends the generated travel plan to the terminal. The user can review the presented plan and provide feedback. The input reflects the feedback in the database. The output is the user's feedback.

[0417] Step 5:

[0418] The server recalculates the travel plan based on user feedback and makes adjustments as needed. It updates the travel plan based on the latest emotional state and feedback. The output is the revised travel plan.

[0419] Step 6:

[0420] Once the final travel plan is decided, the server automatically handles the booking process, confirming reservations for accommodation and transportation. The user is then provided with the booking details on their device. The output is the booking information.

[0421] Step 7:

[0422] During the trip, the device continuously analyzes the user's emotions in real time. Based on the analysis results, the server provides necessary information and improved suggestions. The output includes additional information and real-time services during the trip.

[0423] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0424] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0425] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0426] [Third Embodiment]

[0427] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0428] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0429] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0430] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0431] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0432] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0433] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0434] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0435] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0436] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0437] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0438] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0439] This invention provides an "AI personal travel planner" that enables individual travelers to smoothly plan and streamline their solo trips. The system is implemented as follows:

[0440] First, the user enters travel conditions such as destination, dates, budget, and special requests through their device. The device then sends this information to the server.

[0441] The server receives travel requirements from the user and searches a large travel-related database to gather relevant information. This information includes accommodation, transportation, and tourist attractions at the destination.

[0442] Next, the server uses artificial intelligence algorithms based on this collected information to generate a travel plan optimized for the user's travel conditions. The generated plan includes potential accommodations, transportation options, and sightseeing destinations to visit.

[0443] The generated travel plan is sent to the device and displayed to the user. The user can review this plan and, if necessary, send feedback to the server via the device.

[0444] Upon receiving user feedback, the server recalculates the travel plan and makes any necessary adjustments. Once the final plan is decided, the server automatically makes accommodation reservations and transportation arrangements and sends this reservation information to the user's device.

[0445] Furthermore, useful information for travelers, such as recommendations for local events and restaurants, can be sent from the server to the user's device. This allows users to enjoy sightseeing comfortably while traveling.

[0446] For example, if a user enters the conditions "I want to spend three days in Tokyo, with a budget of 100,000 yen, and I especially want to visit tourist spot A," the server will automatically generate options for accommodation and transportation within that budget in Tokyo, as well as a sightseeing schedule including tourist spot A, and complete the booking process. This entire process allows users to easily plan a solo trip tailored to their preferences.

[0447] The following describes the processing flow.

[0448] Step 1:

[0449] The user enters travel conditions (destination, dates, budget, special requests) via a terminal and sends them to the server. The terminal converts this information into the appropriate data format and sends it to the server as required input data.

[0450] Step 2:

[0451] The server receives travel conditions sent from the terminal. It structures the received data and stores it in an internal database for use in the next processing step.

[0452] Step 3:

[0453] The server searches a large travel database for relevant information based on the user's travel criteria. This includes information on accommodations, transportation, and tourist attractions at the destination. The search results are then narrowed down to the best options by an algorithm.

[0454] Step 4:

[0455] The server uses an AI algorithm to generate a travel plan that matches the user's preferences from the collected information. The generated plan includes a list of potential accommodations, transportation options, and places to visit.

[0456] Step 5:

[0457] The server sends the generated travel plan to the device. The device receives it and displays it visually to the user. The user reviews the plan and, if not satisfied, sends feedback via the device.

[0458] Step 6:

[0459] The device receives feedback from the user and uses it to send a request to the server for revisions to the plan. The feedback includes requests for changes to the plan and additional requests.

[0460] Step 7:

[0461] The server analyzes user feedback and recalculates the travel plan. After making any necessary adjustments, it sends the updated plan back to the device.

[0462] Step 8:

[0463] After the user reviews and approves the final plan, the server automatically makes reservations for accommodation and transportation based on the plan. Reservation information is secured via an external API, and the server retrieves the confirmation information.

[0464] Step 9:

[0465] The server sends reservation confirmation information to the terminal and notifies the user of the details. The terminal displays this information and provides the user with confirmation that the reservation is complete.

[0466] Step 10:

[0467] The server periodically collects additional information useful during the trip (such as event information and restaurant recommendations) and sends it to the device at the appropriate time. This allows users to receive additional support even while traveling.

[0468] (Example 1)

[0469] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0470] For independent travelers, planning a solo trip is a complex and time-consuming task, requiring them to gather information based on their destination, budget, and preferences, as well as select appropriate accommodations and transportation. Furthermore, changing plans necessitates gathering information again, making flexible travel planning difficult.

[0471] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0472] In this invention, the server includes means for acquiring travel conditions received from the user, means for searching for relevant information based on the travel conditions and constructing an individualized travel plan, and means for presenting the constructed travel plan to the terminal and adjusting the plan based on user input. This enables the rapid creation and flexible adjustment of travel plans optimized for individual conditions.

[0473] A "user" refers to an individual who uses the system and enters travel-related conditions through a terminal.

[0474] "Travel conditions" refer to information necessary when planning a trip, including destination, itinerary, budget, and any special requests.

[0475] A "terminal" refers to an electronic device used by users to input travel-related conditions and receive the results of their travel plan.

[0476] A "server" refers to a computer system that processes information received from terminals and performs travel-related data processing and plan generation.

[0477] "Related information" refers to data on accommodations, transportation, and tourist destinations necessary for planning a trip.

[0478] A "personalized travel plan" refers to an optimized itinerary created based on the user's travel preferences.

[0479] "Construction" refers to the entire process of creating and generating a travel plan.

[0480] "Adjustment" refers to the process of modifying and optimizing existing travel plans based on user input.

[0481] This invention is an AI-powered personal travel planner system designed to enable individual travelers to smoothly plan and execute solo trips. In the implementation of the system, the server, terminal, and user exchange information with each other to optimize the travel plan.

[0482] The user enters the conditions for their travel plan into the terminal. The terminal provides an intuitive user interface that facilitates input, allowing the user to easily enter destination, dates, budget, special requests, etc. The entered information is sent to the server using a stable communication protocol.

[0483] After receiving information via the network, the server searches for relevant data based on travel conditions. This search process utilizes databases that provide the latest tourist destination information, accommodation availability, and transportation options. The server employs AI models to individually optimize travel plans based on the received information. This involves complex data calculations related to travel personalization, generating optimized plans tailored to the user's conditions.

[0484] The generated plan includes accommodation options, transportation, sightseeing destinations, and a schedule of the itinerary. The server sends this to the user's device for review. The user can evaluate whether they are satisfied with the plan and send feedback or additional requests to the server via their device. The server receives this feedback, recalculates and optimizes the plan, and applies changes as needed.

[0485] For example, if a user enters the conditions "I want to spend three days in Tokyo, with a budget of 100,000 yen, and I especially want to visit tourist spot A," the server will automatically generate a list of accommodation and transportation options within that budget in Tokyo, as well as a sightseeing schedule that includes tourist spot A. Based on this, the server will complete the booking process.

[0486] These functions can be used as "prompt statements to input into the generating AI model." For example, a specific instruction could be, "Create a 3-day travel plan in Tokyo with a budget of 100,000 yen, and include a visit to tourist destination A." Based on this instruction, the system can provide the user with the most suitable travel plan.

[0487] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0488] Step 1:

[0489] The user enters travel details via a terminal. This includes destination, dates, budget, and any special requests. The terminal verifies the entered information and sends the complete data to the server. This ensures that the user's requests are smoothly transmitted to the server.

[0490] Step 2:

[0491] The server receives travel conditions sent from the terminal. It analyzes the received data and searches the database for relevant information based on the conditions. Here, it collects information such as accommodation availability, transportation options, and tourist destination data. In this process, the server efficiently filters the data to match the user's conditions.

[0492] Step 3:

[0493] The server uses AI algorithms to generate an optimal travel plan from the collected information. This process optimizes accommodations and transportation based on travel dates and budget. The AI ​​evaluates multiple options based on the given conditions and selects the plan best suited to the user. The generated travel plan is then formalized as a specific schedule.

[0494] Step 4:

[0495] The server sends the generated travel plan to the terminal. The terminal displays the plan to the user, allowing them to review its contents. The user can provide feedback on the presented plan, for example, by specifying changes to the plan or entering additional requests. This feedback is then sent back to the server.

[0496] Step 5:

[0497] The server receives feedback from the user and recalculates and optimizes the travel plan. It incorporates corrections based on the feedback and applies necessary adjustments. In this recalculation, the generative AI model is utilized again to generate a revised plan that meets the user's preferences.

[0498] Step 6:

[0499] The server automatically processes reservations based on the final travel plan. Accommodation and transportation booking information is finalized and sent to the user's device. The device allows the user to confirm the booking details, ensuring smooth travel preparations.

[0500] Step 7:

[0501] During travel, the server pushes information on local events and restaurant recommendations to the user's device. Users receive this information in real time, improving the quality of their trip. This allows users to enjoy a comfortable and fulfilling travel experience.

[0502] (Application Example 1)

[0503] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0504] Currently, when individual travelers plan a solo trip, the research, planning, and booking procedures are complicated, time-consuming, and cumbersome. Furthermore, it is difficult to obtain timely additional information and local event information during the trip. Additionally, there is a lack of means to visually and participatoryly experience the travel plan. Solving these problems is essential.

[0505] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0506] In this invention, the server includes means for acquiring travel conditions using voice input and eye-tracking technology, means for visually presenting a travel plan in a virtual space and providing an interactive experience, and means for providing additional information to the user during the trip. This makes it possible for individual travelers to easily plan and experience a trip and acquire necessary information at their destination in a timely manner.

[0507] "Means for obtaining travel conditions received from users" refers to a function that receives data input such as travel destination, dates, budget, and special requests specified by the individual.

[0508] "A means of searching for information based on travel conditions and generating a travel plan" refers to the ability to search a database for accommodation, transportation, and tourist destination information that corresponds to the acquired travel conditions, and to automatically construct the optimal itinerary.

[0509] "A means of presenting a generated travel plan to the user and modifying the plan based on user feedback" refers to a function that displays the initially created travel schedule and adjusts the plan to reflect the user's opinions and requests.

[0510] "A means of executing reservations based on a revised travel plan and providing reservation information to the user" refers to a mechanism that automatically processes accommodation and transportation reservations based on the finalized itinerary and informs the user of the details.

[0511] "Means of providing users with additional information during their trip" refers to the ability to provide users with real-time information such as local events and recommended restaurants during their trip.

[0512] "Means for acquiring travel conditions using voice input and eye-tracking technology" refers to a method of detecting the user's verbal instructions and gaze to analyze their intentions and collect travel requirements.

[0513] "A means of visually presenting travel plans in a virtual space and providing participatory experiences" refers to a system that utilizes virtual reality technology to provide an environment in which users can intuitively and three-dimensionally rehearse their trips.

[0514] The system for realizing this invention consists of a user terminal, a server, and various other devices working together. The user terminal is responsible for acquiring travel conditions using voice input and eye-tracking technology and transmitting this information to the server. The server refers to a large-scale travel-related database, searches for the most suitable information based on the travel conditions, and generates a travel plan.

[0515] The server also has the ability to visually present the generated travel plan in a virtual space, providing users with an interactive experience. In this process, the server uses the Tobii SDK for eye tracking and ABBY SpeechKit for speech recognition to receive user feedback and revise the plan as needed. Furthermore, the server utilizes a generative AI model based on OpenAI's GPT-3 to propose a travel schedule optimized for the user's conditions.

[0516] When booking a trip, the server automatically arranges accommodation and transportation and sends the booking information to the user's device. While the user is traveling, the server provides information on local events and restaurant recommendations to support a comfortable travel experience.

[0517] For example, if a user requests to "plan a historical tour in London within a budget," the server will create an optimal schedule including famous London historical sites and present it to the user through a visual tour experience. After completing the necessary bookings for the trip, the server will continue to provide relevant local information throughout the trip. An example of a prompt might be: "Extract travel conditions from the user's voice. For example, based on 'a historical tour in London within a budget of 100,000 yen,' generate the optimal travel plan."

[0518] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0519] Step 1:

[0520] The user's device acquires travel information through voice input and eye-tracking. The user specifies destinations, dates, budget, and preferences by voice, and confirms selections with their eyes, allowing the device to collect this data. Based on this, the device converts the voice data to text, processes the eye-tracking data as coordinate information, and sends the generated data to the server.

[0521] Step 2:

[0522] The server uses OpenAI's GPT-3 AI model to analyze the received travel conditions. This data is then compared with travel-related databases to search for relevant information (accommodation, transportation, tourist destinations). Using travel conditions such as destination and budget as input, the server generates an optimal travel schedule and prepares the experience in the virtual space.

[0523] Step 3:

[0524] The server sends the generated travel plan to the user's terminal and visually presents the plan in a virtual space. The user reviews the presented travel plan and provides feedback through their gaze and voice through an interactive experience. This feedback is sent to the server and used to revise the plan. User interaction serves as input for revising the plan, which the server receives and recalculates.

[0525] Step 4:

[0526] The server recalculates the travel plan based on user feedback and modifies it. The recalculated plan is then presented to the user for final confirmation. During the recalculation process, the server constructs a new itinerary and adjusts it using an AI algorithm based on the input conditions.

[0527] Step 5:

[0528] Once the user approves the plan, the server automatically makes reservations for accommodation and transportation. It generates reservation information and provides the user with the reservation results. In this process, the server uses a reservation API to confirm the completion of the reservation process and records the reservation details.

[0529] Step 6:

[0530] During the trip, the server provides users with additional information. Recommendations for local events and restaurants are sent to the device in real time and updated as the trip progresses. This information is dynamically updated based on the user's geographical location data and travel conditions.

[0531] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0532] This invention provides a system that combines an "AI personal travel planner" with an emotion engine to enable individual travelers to effectively plan and book solo trips. It has the function of analyzing emotions based on user input and feedback, and optimizing and personalizing travel plans based on that analysis.

[0533] First, the user enters basic travel conditions such as destination, dates, budget, and special requests through the device. In addition to this information, the device provides an interface to sense the user's emotional state, analyzing their emotions from their voice tone and the content of the text they enter.

[0534] The server receives travel conditions and sentiment information transmitted from the terminal. The collected data is stored in an internal database and used in the subsequent travel plan generation process.

[0535] The server uses AI algorithms to create the optimal travel plan based on information gathered according to travel conditions. The emotion engine designs a travel plan that meets the user's expectations by incorporating personalized suggestions that respond to the user's emotions. For example, if the user is feeling stressed, it will suggest a sightseeing plan that emphasizes relaxation.

[0536] The generated travel plan is sent to the device. The user reviews the plan and provides feedback. This feedback, along with sentiment information, is sent to the server, and the plan is adjusted again if necessary.

[0537] Once the final travel plan is decided, the server automatically makes reservations for accommodations, transportation, etc., and provides the reservation information to the user. Furthermore, during the trip, new information and content are provided based on the user's real-time emotional state. For example, if the user is excited, information on active activities and events can be suggested.

[0538] As a concrete example, if a user enters conditions such as "prioritizing relaxation in Paris, with a budget of 150,000 yen," and the emotion engine detects that the user is feeling somewhat anxious, the server will generate a travel plan featuring resort hotels in quiet areas of Paris and relaxation spas, and guide the user through it. In this way, users can comfortably enjoy a solo trip tailored to their individual needs and emotions.

[0539] The following describes the processing flow.

[0540] Step 1:

[0541] Users input their destination, dates, budget, and preferences through the device. Furthermore, the device incorporates an emotion engine that analyzes the user's voice tone and entered text to determine their emotional state, and then sends this data to the server.

[0542] Step 2:

[0543] The server analyzes travel conditions and emotional information received from the terminal. The analyzed data is stored in an internal database and prepared for travel plan generation.

[0544] Step 3:

[0545] The server searches various travel information databases to collect information on destination accommodations, transportation, and tourist attractions. The emotion engine then identifies the optimal choices from this information, taking into account the user's emotional state.

[0546] Step 4:

[0547] The server uses an AI algorithm to generate a personalized travel plan based on the user's travel preferences and emotional state. The generated plan includes special suggestions tailored to the user's mood.

[0548] Step 5:

[0549] The server sends the completed travel plan to the terminal, which then displays the plan to the user. The user reviews the displayed information and sends feedback if they have any additional requests or corrections.

[0550] Step 6:

[0551] User feedback is sent from the device to the server. The server analyzes the feedback and recalculates and modifies the travel plan as needed.

[0552] Step 7:

[0553] The server automatically executes the booking process based on the user's final approved travel plan. Booking details are retrieved using an external API, and the server collects booking confirmation information.

[0554] Step 8:

[0555] The server sends reservation information to the terminal and notifies the user of the details. The terminal displays this information, providing the user with a means to confirm the reservation details.

[0556] Step 9:

[0557] During the trip, the server continuously monitors the user's real-time emotional state and sends information (events and recommended activities) to the device as needed, based on those emotions. This process allows users to enjoy their trip more fully.

[0558] (Example 2)

[0559] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0560] When planning individual trips, conventional systems often fail to adequately consider the user's emotional state, making it difficult to provide suitable travel plans, especially for users experiencing stress or anxiety. As a result, travel satisfaction decreases, and the system fails to fully meet user needs.

[0561] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0562] In this invention, the server includes means for analyzing the user's emotional state, means for optimizing the travel plan based on travel conditions and emotional state, and means for providing additional information based on the user's real-time emotional state during the trip. This makes it possible to provide a travel plan that is individually optimized while being attentive to the user's emotions, thereby improving travel satisfaction.

[0563] A "user" refers to an individual who plans their trip through this system.

[0564] A "terminal" refers to a device used by a user, specifically a device that performs information input, display, and sentiment analysis.

[0565] A "server" refers to a central device that processes information transmitted from terminals and performs tasks such as generating travel plans and performing sentiment analysis.

[0566] "Travel conditions" refer to information such as destination, dates, budget, and special requests that users enter when planning a trip.

[0567] "Emotional state" refers to the user's current emotional state and is a mental state analyzed from voice and text.

[0568] "Travel plan" refers to the detailed itinerary generated based on the user's travel conditions and emotional state.

[0569] "Feedback" refers to the opinions and evaluations that users provide regarding the generated travel plans.

[0570] An "artificial intelligence algorithm" refers to a computer program that automatically generates the optimal travel plan based on the input data.

[0571] "Additional information" refers to tourist destination information, event and activity guides provided based on the user's emotional state during their trip.

[0572] This invention is a system based on an "AI personal travel planner" that enables individual travelers to effectively plan their solo trips, and combines it with an emotion engine.

[0573] The device receives travel conditions from the user, including destination, travel dates, budget, and special requests. In addition, the device uses speech recognition APIs and natural language processing libraries to analyze the user's input text and voice tone, and to assess the user's emotional state.

[0574] The server receives travel conditions and sentiment analysis results sent from the terminal. This data is stored in an SQL database on the server and used in the travel plan generation process. The server uses a generative AI model to formulate the optimal travel plan based on the collected travel conditions and sentiment state. At this time, the artificial intelligence algorithm operates to personalize and incorporate suggestions that match the user's sentiment.

[0575] The generated travel plan is sent to the device and presented to the user. The user can review the plan and provide feedback. This feedback is sent back to the server, and a revised plan is generated as needed. Based on the finalized travel plan, the server automatically makes reservations for accommodations and transportation.

[0576] During travel, the device re-analyzes the user's real-time emotional state and provides new information and content from the server. For example, if the user is excited, it can suggest active activities.

[0577] For example, if a user enters conditions such as "prioritizing relaxation in Paris, with a budget of 150,000 yen," and the emotion engine detects that the user is feeling somewhat anxious, the server will generate a travel plan that includes a resort hotel and relaxation spa in a quiet area of ​​Paris. In this way, users can comfortably enjoy a solo trip tailored to their individual needs and emotions.

[0578] An example of a prompt message would be: "The user is planning a solo trip. The destination is Paris, and please provide a plan that emphasizes relaxation during the trip. The budget is 150,000 yen, and please include suggestions to alleviate the user's current anxieties."

[0579] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0580] Step 1:

[0581] The user enters their destination, travel itinerary, budget, and special requests through the device. The entered information is recognized as travel conditions. If voice input is available, the device uses a speech recognition API to analyze the voice tone. If text input is available, a natural language processing library is used to analyze the text content and evaluate the user's emotional state. Input data includes text and voice data, and the output is data on the analyzed travel conditions and emotional state.

[0582] Step 2:

[0583] The terminal sends the analyzed travel conditions and emotional state to the server. Here, data communication technology is used to ensure that user information reaches the server securely. The server receives this data and stores it in an SQL database. The input is data in JSON format, and the output is the state stored in the database.

[0584] Step 3:

[0585] The server extracts travel conditions and emotional states from an SQL database and generates a travel plan using a generative AI model. The artificial intelligence algorithm processes the information using prompts to create the optimal travel plan. For example, depending on the user's stress level, it selects travel options aimed at stress reduction. The input is the query results from the database, and the output is the generated travel plan.

[0586] Step 4:

[0587] The generated travel plan is sent from the server to the terminal and presented to the user. The user reviews the plan and provides feedback via the UI interface. At this time, the user's feedback information is obtained and sent back to the server for sentiment re-analysis. The input is the user's feedback data, and the output is sent to the server as feedback information.

[0588] Step 5:

[0589] The server readjusts the travel plan based on user feedback and re-analyzed emotional states. If necessary, it reapplies the generating AI model to create an updated, optimal plan. The generated plan is then sent back to the user for confirmation. The input is the update instructions including feedback, and the output is the revised travel plan.

[0590] Step 6:

[0591] Based on the final travel plan, the server automatically makes reservations for accommodation and transportation. It uses a reservation management API to retrieve the appropriate reservation information and provides confirmation data to the user. The input is the final travel plan, and the output is reservation confirmation information.

[0592] Step 7:

[0593] During travel, the device re-analyzes the user's emotional state in real time and retrieves new information and content from the server. This uses dynamic information processing technology to provide activity information tailored to the user's excitement level. The input is emotional data perceived in real time, and the output is activated travel and activity information.

[0594] (Application Example 2)

[0595] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0596] Traditional travel planning systems have the problem of not being able to take into account the user's emotional state, making it difficult to provide a personalized travel experience. Furthermore, there is a lack of methods to provide information and services that match the user's emotions in real time, even during travel. The aim is to solve these problems and provide travel planning and travel experiences that are more attentive to the user.

[0597] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0598] In this invention, the server includes means for acquiring travel conditions received from the user, means for retrieving information based on the travel conditions and emotional state and generating a travel plan, and means for presenting the generated travel plan to the user and modifying the plan based on the user's feedback and emotional information. This makes it possible to provide an optimal travel plan tailored to the user's emotional state in real time.

[0599] "Travel conditions received from the user" refers to information such as the destination, length of stay, cost, and any special requests entered by the user.

[0600] "Emotional state" refers to the user's psychological state and is emotional information measured through voice tone and text analysis.

[0601] "Generating" means automatically creating new plans or proposals based on specific conditions or data.

[0602] A "travel plan" is a plan that includes the overall schedule of the trip, places to visit, accommodations, and means of transportation.

[0603] "Feedback" refers to information about the user's reactions and opinions to the plan presented.

[0604] "Optimized additional information" refers to data and suggestions that are provided in the most appropriate format based on the user's current emotions and circumstances.

[0605] An "artificial intelligence algorithm" is a computer program or method that has the ability to analyze data, learn from it, and make predictions.

[0606] This invention is a system that personalizes travel plans based on the user's emotions. The server acquires travel conditions received from the user and emotional state information transmitted from the terminal. The hardware used is a smartphone that senses the user's voice and text input, while the software uses TensorFlow for emotion analysis and an SQL database for data management.

[0607] The server uses AI algorithms to automatically generate a travel plan best suited to the user's travel conditions and emotional state. This involves synthesizing information from multiple data sources to provide the experience the user expects. The generated travel plan is presented to the user, who can provide feedback. This feedback is continuously sent to the server, and the plan is readjusted as needed.

[0608] For example, if a user specifies a condition such as "I want a trip that will calm my mind," and the system detects that the user's emotional state is anxious, the server will suggest relaxing tourist destinations and dining options, and plan a trip that will provide a peaceful experience. This system can take the user's emotional state into consideration and make travel suggestions in real time.

[0609] An example of a prompt to a generative AI model is, "Considering my current mood, please suggest a travel plan that is best suited for relaxation." In this way, users can enjoy a personalized trip that is tailored to their emotional state.

[0610] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0611] Step 1:

[0612] The device obtains travel conditions (destination, dates, budget, etc.) and emotional state from the user. Based on the input conditions, it analyzes voice tone and text content to quantify the emotional state. The output is the user's travel conditions and emotional state.

[0613] Step 2:

[0614] The server stores travel conditions and emotional states received from the terminal in an internal database. It collects travel data tailored to the user's needs and compares it with the database to provide optimal information. The output is a dataset based on travel conditions and emotional states.

[0615] Step 3:

[0616] The server uses stored data to generate travel plans using AI algorithms (generative AI models). An emotion engine is also used to create plans that include personalized travel suggestions tailored to the user's emotional state. The output is the generated travel plan.

[0617] Step 4:

[0618] The server sends the generated travel plan to the terminal. The user can review the presented plan and provide feedback. The input reflects the feedback in the database. The output is the user's feedback.

[0619] Step 5:

[0620] The server recalculates the travel plan based on user feedback and makes adjustments as needed. It updates the travel plan based on the latest emotional state and feedback. The output is the revised travel plan.

[0621] Step 6:

[0622] Once the final travel plan is decided, the server automatically handles the booking process, confirming reservations for accommodation and transportation. The user is then provided with the booking details on their device. The output is the booking information.

[0623] Step 7:

[0624] During the trip, the device continuously analyzes the user's emotions in real time. Based on the analysis results, the server provides necessary information and improved suggestions. The output includes additional information and real-time services during the trip.

[0625] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0626] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0627] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0628] [Fourth Embodiment]

[0629] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0630] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0631] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0632] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0633] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0634] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0635] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0636] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0637] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0638] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0639] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0640] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0641] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0642] This invention provides an "AI personal travel planner" that enables individual travelers to smoothly plan and streamline their solo trips. The system is implemented as follows:

[0643] First, the user enters travel conditions such as destination, dates, budget, and special requests through their device. The device then sends this information to the server.

[0644] The server receives travel requirements from the user and searches a large travel-related database to gather relevant information. This information includes accommodation, transportation, and tourist attractions at the destination.

[0645] Next, the server uses artificial intelligence algorithms based on this collected information to generate a travel plan optimized for the user's travel conditions. The generated plan includes potential accommodations, transportation options, and sightseeing destinations to visit.

[0646] The generated travel plan is sent to the device and displayed to the user. The user can review this plan and, if necessary, send feedback to the server via the device.

[0647] Upon receiving user feedback, the server recalculates the travel plan and makes any necessary adjustments. Once the final plan is decided, the server automatically makes accommodation reservations and transportation arrangements and sends this reservation information to the user's device.

[0648] Furthermore, useful information for travelers, such as recommendations for local events and restaurants, can be sent from the server to the user's device. This allows users to enjoy sightseeing comfortably while traveling.

[0649] For example, if a user enters the conditions "I want to spend three days in Tokyo, with a budget of 100,000 yen, and I especially want to visit tourist spot A," the server will automatically generate options for accommodation and transportation within that budget in Tokyo, as well as a sightseeing schedule including tourist spot A, and complete the booking process. This entire process allows users to easily plan a solo trip tailored to their preferences.

[0650] The following describes the processing flow.

[0651] Step 1:

[0652] The user enters travel conditions (destination, dates, budget, special requests) via a terminal and sends them to the server. The terminal converts this information into the appropriate data format and sends it to the server as required input data.

[0653] Step 2:

[0654] The server receives travel conditions sent from the terminal. It structures the received data and stores it in an internal database for use in the next processing step.

[0655] Step 3:

[0656] The server searches a large travel database for relevant information based on the user's travel criteria. This includes information on accommodations, transportation, and tourist attractions at the destination. The search results are then narrowed down to the best options by an algorithm.

[0657] Step 4:

[0658] The server uses an AI algorithm to generate a travel plan that matches the user's preferences from the collected information. The generated plan includes a list of potential accommodations, transportation options, and places to visit.

[0659] Step 5:

[0660] The server sends the generated travel plan to the device. The device receives it and displays it visually to the user. The user reviews the plan and, if not satisfied, sends feedback via the device.

[0661] Step 6:

[0662] The device receives feedback from the user and uses it to send a request to the server for revisions to the plan. The feedback includes requests for changes to the plan and additional requests.

[0663] Step 7:

[0664] The server analyzes user feedback and recalculates the travel plan. After making any necessary adjustments, it sends the updated plan back to the device.

[0665] Step 8:

[0666] After the user reviews and approves the final plan, the server automatically makes reservations for accommodation and transportation based on the plan. Reservation information is secured via an external API, and the server retrieves the confirmation information.

[0667] Step 9:

[0668] The server sends reservation confirmation information to the terminal and notifies the user of the details. The terminal displays this information and provides the user with confirmation that the reservation is complete.

[0669] Step 10:

[0670] The server periodically collects additional information useful during the trip (such as event information and restaurant recommendations) and sends it to the device at the appropriate time. This allows users to receive additional support even while traveling.

[0671] (Example 1)

[0672] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0673] For independent travelers, planning a solo trip is a complex and time-consuming task, requiring them to gather information based on their destination, budget, and preferences, as well as select appropriate accommodations and transportation. Furthermore, changing plans necessitates gathering information again, making flexible travel planning difficult.

[0674] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0675] In this invention, the server includes means for acquiring travel conditions received from the user, means for searching for relevant information based on the travel conditions and constructing an individualized travel plan, and means for presenting the constructed travel plan to the terminal and adjusting the plan based on user input. This enables the rapid creation and flexible adjustment of travel plans optimized for individual conditions.

[0676] A "user" refers to an individual who uses the system and enters travel-related conditions through a terminal.

[0677] "Travel conditions" refer to information necessary when planning a trip, including destination, itinerary, budget, and any special requests.

[0678] A "terminal" refers to an electronic device used by users to input travel-related conditions and receive the results of their travel plan.

[0679] A "server" refers to a computer system that processes information received from terminals and performs travel-related data processing and plan generation.

[0680] "Related information" refers to data on accommodations, transportation, and tourist destinations necessary for planning a trip.

[0681] A "personalized travel plan" refers to an optimized itinerary created based on the user's travel preferences.

[0682] "Construction" refers to the entire process of creating and generating a travel plan.

[0683] "Adjustment" refers to the process of modifying and optimizing existing travel plans based on user input.

[0684] This invention is an AI-powered personal travel planner system designed to enable individual travelers to smoothly plan and execute solo trips. In the implementation of the system, the server, terminal, and user exchange information with each other to optimize the travel plan.

[0685] The user enters the conditions for their travel plan into the terminal. The terminal provides an intuitive user interface that facilitates input, allowing the user to easily enter destination, dates, budget, special requests, etc. The entered information is sent to the server using a stable communication protocol.

[0686] After receiving information via the network, the server searches for relevant data based on travel conditions. This search process utilizes databases that provide the latest tourist destination information, accommodation availability, and transportation options. The server employs AI models to individually optimize travel plans based on the received information. This involves complex data calculations related to travel personalization, generating optimized plans tailored to the user's conditions.

[0687] The generated plan includes accommodation options, transportation, sightseeing destinations, and a schedule of the itinerary. The server sends this to the user's device for review. The user can evaluate whether they are satisfied with the plan and send feedback or additional requests to the server via their device. The server receives this feedback, recalculates and optimizes the plan, and applies changes as needed.

[0688] For example, if a user enters the conditions "I want to spend three days in Tokyo, with a budget of 100,000 yen, and I especially want to visit tourist spot A," the server will automatically generate a list of accommodation and transportation options within that budget in Tokyo, as well as a sightseeing schedule that includes tourist spot A. Based on this, the server will complete the booking process.

[0689] These functions can be used as "prompt statements to input into the generating AI model." For example, a specific instruction could be, "Create a 3-day travel plan in Tokyo with a budget of 100,000 yen, and include a visit to tourist destination A." Based on this instruction, the system can provide the user with the most suitable travel plan.

[0690] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0691] Step 1:

[0692] The user enters travel details via a terminal. This includes destination, dates, budget, and any special requests. The terminal verifies the entered information and sends the complete data to the server. This ensures that the user's requests are smoothly transmitted to the server.

[0693] Step 2:

[0694] The server receives travel conditions sent from the terminal. It analyzes the received data and searches the database for relevant information based on the conditions. Here, it collects information such as accommodation availability, transportation options, and tourist destination data. In this process, the server efficiently filters the data to match the user's conditions.

[0695] Step 3:

[0696] The server uses AI algorithms to generate an optimal travel plan from the collected information. This process optimizes accommodations and transportation based on travel dates and budget. The AI ​​evaluates multiple options based on the given conditions and selects the plan best suited to the user. The generated travel plan is then formalized as a specific schedule.

[0697] Step 4:

[0698] The server sends the generated travel plan to the terminal. The terminal displays the plan to the user, allowing them to review its contents. The user can provide feedback on the presented plan, for example, by specifying changes to the plan or entering additional requests. This feedback is then sent back to the server.

[0699] Step 5:

[0700] The server receives feedback from the user and recalculates and optimizes the travel plan. It incorporates corrections based on the feedback and applies necessary adjustments. In this recalculation, the generative AI model is utilized again to generate a revised plan that meets the user's preferences.

[0701] Step 6:

[0702] The server automatically processes reservations based on the final travel plan. Accommodation and transportation booking information is finalized and sent to the user's device. The device allows the user to confirm the booking details, ensuring smooth travel preparations.

[0703] Step 7:

[0704] During travel, the server pushes information on local events and restaurant recommendations to the user's device. Users receive this information in real time, improving the quality of their trip. This allows users to enjoy a comfortable and fulfilling travel experience.

[0705] (Application Example 1)

[0706] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0707] Currently, when individual travelers plan a solo trip, the research, planning, and booking procedures are complicated, time-consuming, and cumbersome. Furthermore, it is difficult to obtain timely additional information and local event information during the trip. Additionally, there is a lack of means to visually and participatoryly experience the travel plan. Solving these problems is essential.

[0708] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0709] In this invention, the server includes means for acquiring travel conditions using voice input and eye-tracking technology, means for visually presenting a travel plan in a virtual space and providing an interactive experience, and means for providing additional information to the user during the trip. This makes it possible for individual travelers to easily plan and experience a trip and acquire necessary information at their destination in a timely manner.

[0710] "Means for obtaining travel conditions received from users" refers to a function that receives data input such as travel destination, dates, budget, and special requests specified by the individual.

[0711] "A means of searching for information based on travel conditions and generating a travel plan" refers to the ability to search a database for accommodation, transportation, and tourist destination information that corresponds to the acquired travel conditions, and to automatically construct the optimal itinerary.

[0712] "A means of presenting a generated travel plan to the user and modifying the plan based on user feedback" refers to a function that displays the initially created travel schedule and adjusts the plan to reflect the user's opinions and requests.

[0713] "A means of executing reservations based on a revised travel plan and providing reservation information to the user" refers to a mechanism that automatically processes accommodation and transportation reservations based on the finalized itinerary and informs the user of the details.

[0714] "Means of providing users with additional information during their trip" refers to the ability to provide users with real-time information such as local events and recommended restaurants during their trip.

[0715] "Means for acquiring travel conditions using voice input and eye-tracking technology" refers to a method of detecting the user's verbal instructions and gaze to analyze their intentions and collect travel requirements.

[0716] "A means of visually presenting travel plans in a virtual space and providing participatory experiences" refers to a system that utilizes virtual reality technology to provide an environment in which users can intuitively and three-dimensionally rehearse their trips.

[0717] The system for realizing this invention consists of a user terminal, a server, and various other devices working together. The user terminal is responsible for acquiring travel conditions using voice input and eye-tracking technology and transmitting this information to the server. The server refers to a large-scale travel-related database, searches for the most suitable information based on the travel conditions, and generates a travel plan.

[0718] The server also has the ability to visually present the generated travel plan in a virtual space, providing users with an interactive experience. In this process, the server uses the Tobii SDK for eye tracking and ABBY SpeechKit for speech recognition to receive user feedback and revise the plan as needed. Furthermore, the server utilizes a generative AI model based on OpenAI's GPT-3 to propose a travel schedule optimized for the user's conditions.

[0719] When booking a trip, the server automatically arranges accommodation and transportation and sends the booking information to the user's device. While the user is traveling, the server provides information on local events and restaurant recommendations to support a comfortable travel experience.

[0720] For example, if a user requests to "plan a historical tour in London within a budget," the server will create an optimal schedule including famous London historical sites and present it to the user through a visual tour experience. After completing the necessary bookings for the trip, the server will continue to provide relevant local information throughout the trip. An example of a prompt might be: "Extract travel conditions from the user's voice. For example, based on 'a historical tour in London within a budget of 100,000 yen,' generate the optimal travel plan."

[0721] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0722] Step 1:

[0723] The user's device acquires travel information through voice input and eye-tracking. The user specifies destinations, dates, budget, and preferences by voice, and confirms selections with their eyes, allowing the device to collect this data. Based on this, the device converts the voice data to text, processes the eye-tracking data as coordinate information, and sends the generated data to the server.

[0724] Step 2:

[0725] The server uses OpenAI's GPT-3 AI model to analyze the received travel conditions. This data is then compared with travel-related databases to search for relevant information (accommodation, transportation, tourist destinations). Using travel conditions such as destination and budget as input, the server generates an optimal travel schedule and prepares the experience in the virtual space.

[0726] Step 3:

[0727] The server sends the generated travel plan to the user's terminal and visually presents the plan in a virtual space. The user reviews the presented travel plan and provides feedback through their gaze and voice through an interactive experience. This feedback is sent to the server and used to revise the plan. User interaction serves as input for revising the plan, which the server receives and recalculates.

[0728] Step 4:

[0729] The server recalculates the travel plan based on user feedback and modifies it. The recalculated plan is then presented to the user for final confirmation. During the recalculation process, the server constructs a new itinerary and adjusts it using an AI algorithm based on the input conditions.

[0730] Step 5:

[0731] Once the user approves the plan, the server automatically makes reservations for accommodation and transportation. It generates reservation information and provides the user with the reservation results. In this process, the server uses a reservation API to confirm the completion of the reservation process and records the reservation details.

[0732] Step 6:

[0733] During the trip, the server provides users with additional information. Recommendations for local events and restaurants are sent to the device in real time and updated as the trip progresses. This information is dynamically updated based on the user's geographical location data and travel conditions.

[0734] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0735] This invention provides a system that combines an "AI personal travel planner" with an emotion engine to enable individual travelers to effectively plan and book solo trips. It has the function of analyzing emotions based on user input and feedback, and optimizing and personalizing travel plans based on that analysis.

[0736] First, the user enters basic travel conditions such as destination, dates, budget, and special requests through the device. In addition to this information, the device provides an interface to sense the user's emotional state, analyzing their emotions from their voice tone and the content of the text they enter.

[0737] The server receives travel conditions and sentiment information transmitted from the terminal. The collected data is stored in an internal database and used in the subsequent travel plan generation process.

[0738] The server uses AI algorithms to create the optimal travel plan based on information gathered according to travel conditions. The emotion engine designs a travel plan that meets the user's expectations by incorporating personalized suggestions that respond to the user's emotions. For example, if the user is feeling stressed, it will suggest a sightseeing plan that emphasizes relaxation.

[0739] The generated travel plan is sent to the device. The user reviews the plan and provides feedback. This feedback, along with sentiment information, is sent to the server, and the plan is adjusted again if necessary.

[0740] Once the final travel plan is decided, the server automatically makes reservations for accommodations, transportation, etc., and provides the reservation information to the user. Furthermore, during the trip, new information and content are provided based on the user's real-time emotional state. For example, if the user is excited, information on active activities and events can be suggested.

[0741] As a concrete example, if a user enters conditions such as "prioritizing relaxation in Paris, with a budget of 150,000 yen," and the emotion engine detects that the user is feeling somewhat anxious, the server will generate a travel plan featuring resort hotels in quiet areas of Paris and relaxation spas, and guide the user through it. In this way, users can comfortably enjoy a solo trip tailored to their individual needs and emotions.

[0742] The following describes the processing flow.

[0743] Step 1:

[0744] Users input their destination, dates, budget, and preferences through the device. Furthermore, the device incorporates an emotion engine that analyzes the user's voice tone and entered text to determine their emotional state, and then sends this data to the server.

[0745] Step 2:

[0746] The server analyzes travel conditions and emotional information received from the terminal. The analyzed data is stored in an internal database and prepared for travel plan generation.

[0747] Step 3:

[0748] The server searches various travel information databases to collect information on destination accommodations, transportation, and tourist attractions. The emotion engine then identifies the optimal choices from this information, taking into account the user's emotional state.

[0749] Step 4:

[0750] The server uses an AI algorithm to generate a personalized travel plan based on the user's travel preferences and emotional state. The generated plan includes special suggestions tailored to the user's mood.

[0751] Step 5:

[0752] The server sends the completed travel plan to the terminal, which then displays the plan to the user. The user reviews the displayed information and sends feedback if they have any additional requests or corrections.

[0753] Step 6:

[0754] User feedback is sent from the device to the server. The server analyzes the feedback and recalculates and modifies the travel plan as needed.

[0755] Step 7:

[0756] The server automatically executes the booking process based on the user's final approved travel plan. Booking details are retrieved using an external API, and the server collects booking confirmation information.

[0757] Step 8:

[0758] The server sends reservation information to the terminal and notifies the user of the details. The terminal displays this information, providing the user with a means to confirm the reservation details.

[0759] Step 9:

[0760] During the trip, the server continuously monitors the user's real-time emotional state and sends information (events and recommended activities) to the device as needed, based on those emotions. This process allows users to enjoy their trip more fully.

[0761] (Example 2)

[0762] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0763] When planning individual trips, conventional systems often fail to adequately consider the user's emotional state, making it difficult to provide suitable travel plans, especially for users experiencing stress or anxiety. As a result, travel satisfaction decreases, and the system fails to fully meet user needs.

[0764] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0765] In this invention, the server includes means for analyzing the user's emotional state, means for optimizing the travel plan based on travel conditions and emotional state, and means for providing additional information based on the user's real-time emotional state during the trip. This makes it possible to provide a travel plan that is individually optimized while being attentive to the user's emotions, thereby improving travel satisfaction.

[0766] A "user" refers to an individual who plans their trip through this system.

[0767] A "terminal" refers to a device used by a user, specifically a device that performs information input, display, and sentiment analysis.

[0768] A "server" refers to a central device that processes information transmitted from terminals and performs tasks such as generating travel plans and performing sentiment analysis.

[0769] "Travel conditions" refer to information such as destination, dates, budget, and special requests that users enter when planning a trip.

[0770] "Emotional state" refers to the user's current emotional state and is a mental state analyzed from voice and text.

[0771] "Travel plan" refers to the detailed itinerary generated based on the user's travel conditions and emotional state.

[0772] "Feedback" refers to the opinions and evaluations that users provide regarding the generated travel plans.

[0773] An "artificial intelligence algorithm" refers to a computer program that automatically generates the optimal travel plan based on the input data.

[0774] "Additional information" refers to tourist destination information, event and activity guides provided based on the user's emotional state during their trip.

[0775] This invention is a system based on an "AI personal travel planner" that enables individual travelers to effectively plan their solo trips, and combines it with an emotion engine.

[0776] The device receives travel conditions from the user, including destination, travel dates, budget, and special requests. In addition, the device uses speech recognition APIs and natural language processing libraries to analyze the user's input text and voice tone, and to assess the user's emotional state.

[0777] The server receives travel conditions and sentiment analysis results sent from the terminal. This data is stored in an SQL database on the server and used in the travel plan generation process. The server uses a generative AI model to formulate the optimal travel plan based on the collected travel conditions and sentiment state. At this time, the artificial intelligence algorithm operates to personalize and incorporate suggestions that match the user's sentiment.

[0778] The generated travel plan is sent to the device and presented to the user. The user can review the plan and provide feedback. This feedback is sent back to the server, and a revised plan is generated as needed. Based on the finalized travel plan, the server automatically makes reservations for accommodations and transportation.

[0779] During travel, the device re-analyzes the user's real-time emotional state and provides new information and content from the server. For example, if the user is excited, it can suggest active activities.

[0780] For example, if a user enters conditions such as "prioritizing relaxation in Paris, with a budget of 150,000 yen," and the emotion engine detects that the user is feeling somewhat anxious, the server will generate a travel plan that includes a resort hotel and relaxation spa in a quiet area of ​​Paris. In this way, users can comfortably enjoy a solo trip tailored to their individual needs and emotions.

[0781] An example of a prompt message would be: "The user is planning a solo trip. The destination is Paris, and please provide a plan that emphasizes relaxation during the trip. The budget is 150,000 yen, and please include suggestions to alleviate the user's current anxieties."

[0782] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0783] Step 1:

[0784] The user enters their destination, travel itinerary, budget, and special requests through the device. The entered information is recognized as travel conditions. If voice input is available, the device uses a speech recognition API to analyze the voice tone. If text input is available, a natural language processing library is used to analyze the text content and evaluate the user's emotional state. Input data includes text and voice data, and the output is data on the analyzed travel conditions and emotional state.

[0785] Step 2:

[0786] The terminal sends the analyzed travel conditions and emotional state to the server. Here, data communication technology is used to ensure that user information reaches the server securely. The server receives this data and stores it in an SQL database. The input is data in JSON format, and the output is the state stored in the database.

[0787] Step 3:

[0788] The server extracts travel conditions and emotional states from an SQL database and generates a travel plan using a generative AI model. The artificial intelligence algorithm processes the information using prompts to create the optimal travel plan. For example, depending on the user's stress level, it selects travel options aimed at stress reduction. The input is the query results from the database, and the output is the generated travel plan.

[0789] Step 4:

[0790] The generated travel plan is sent from the server to the terminal and presented to the user. The user reviews the plan and provides feedback via the UI interface. At this time, the user's feedback information is obtained and sent back to the server for sentiment re-analysis. The input is the user's feedback data, and the output is sent to the server as feedback information.

[0791] Step 5:

[0792] The server readjusts the travel plan based on user feedback and re-analyzed emotional states. If necessary, it reapplies the generating AI model to create an updated, optimal plan. The generated plan is then sent back to the user for confirmation. The input is the update instructions including feedback, and the output is the revised travel plan.

[0793] Step 6:

[0794] Based on the final travel plan, the server automatically makes reservations for accommodation and transportation. It uses a reservation management API to retrieve the appropriate reservation information and provides confirmation data to the user. The input is the final travel plan, and the output is reservation confirmation information.

[0795] Step 7:

[0796] During travel, the device re-analyzes the user's emotional state in real time and retrieves new information and content from the server. This uses dynamic information processing technology to provide activity information tailored to the user's excitement level. The input is emotional data perceived in real time, and the output is activated travel and activity information.

[0797] (Application Example 2)

[0798] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0799] Traditional travel planning systems have the problem of not being able to take into account the user's emotional state, making it difficult to provide a personalized travel experience. Furthermore, there is a lack of methods to provide information and services that match the user's emotions in real time, even during travel. The aim is to solve these problems and provide travel planning and travel experiences that are more attentive to the user.

[0800] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0801] In this invention, the server includes means for acquiring travel conditions received from the user, means for retrieving information based on the travel conditions and emotional state and generating a travel plan, and means for presenting the generated travel plan to the user and modifying the plan based on the user's feedback and emotional information. This makes it possible to provide an optimal travel plan tailored to the user's emotional state in real time.

[0802] "Travel conditions received from the user" refers to information such as the destination, length of stay, cost, and any special requests entered by the user.

[0803] "Emotional state" refers to the user's psychological state and is emotional information measured through voice tone and text analysis.

[0804] "Generating" means automatically creating new plans or proposals based on specific conditions or data.

[0805] A "travel plan" is a plan that includes the overall schedule of the trip, places to visit, accommodations, and means of transportation.

[0806] "Feedback" refers to information about the user's reactions and opinions to the plan presented.

[0807] "Optimized additional information" refers to data and suggestions that are provided in the most appropriate format based on the user's current emotions and circumstances.

[0808] An "artificial intelligence algorithm" is a computer program or method that has the ability to analyze data, learn from it, and make predictions.

[0809] This invention is a system that personalizes travel plans based on the user's emotions. The server acquires travel conditions received from the user and emotional state information transmitted from the terminal. The hardware used is a smartphone that senses the user's voice and text input, while the software uses TensorFlow for emotion analysis and an SQL database for data management.

[0810] The server uses AI algorithms to automatically generate a travel plan best suited to the user's travel conditions and emotional state. This involves synthesizing information from multiple data sources to provide the experience the user expects. The generated travel plan is presented to the user, who can provide feedback. This feedback is continuously sent to the server, and the plan is readjusted as needed.

[0811] For example, if a user specifies a condition such as "I want a trip that will calm my mind," and the system detects that the user's emotional state is anxious, the server will suggest relaxing tourist destinations and dining options, and plan a trip that will provide a peaceful experience. This system can take the user's emotional state into consideration and make travel suggestions in real time.

[0812] An example of a prompt to a generative AI model is, "Considering my current mood, please suggest a travel plan that is best suited for relaxation." In this way, users can enjoy a personalized trip that is tailored to their emotional state.

[0813] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0814] Step 1:

[0815] The device obtains travel conditions (destination, dates, budget, etc.) and emotional state from the user. Based on the input conditions, it analyzes voice tone and text content to quantify the emotional state. The output is the user's travel conditions and emotional state.

[0816] Step 2:

[0817] The server stores travel conditions and emotional states received from the terminal in an internal database. It collects travel data tailored to the user's needs and compares it with the database to provide optimal information. The output is a dataset based on travel conditions and emotional states.

[0818] Step 3:

[0819] The server uses stored data to generate travel plans using AI algorithms (generative AI models). An emotion engine is also used to create plans that include personalized travel suggestions tailored to the user's emotional state. The output is the generated travel plan.

[0820] Step 4:

[0821] The server sends the generated travel plan to the terminal. The user can review the presented plan and provide feedback. The input reflects the feedback in the database. The output is the user's feedback.

[0822] Step 5:

[0823] The server recalculates the travel plan based on user feedback and makes adjustments as needed. It updates the travel plan based on the latest emotional state and feedback. The output is the revised travel plan.

[0824] Step 6:

[0825] Once the final travel plan is decided, the server automatically handles the booking process, confirming reservations for accommodation and transportation. The user is then provided with the booking details on their device. The output is the booking information.

[0826] Step 7:

[0827] During the trip, the device continuously analyzes the user's emotions in real time. Based on the analysis results, the server provides necessary information and improved suggestions. The output includes additional information and real-time services during the trip.

[0828] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0829] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0830] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0831] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0832] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0833] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0834] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0835] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0836] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0837] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0838] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0839] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0840] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0841] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0842] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0843] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0844] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0845] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0846] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0847] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0848] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0849] The following is further disclosed regarding the embodiments described above.

[0850] (Claim 1)

[0851] A means of obtaining travel conditions received from the user,

[0852] A means of searching for information based on travel conditions and generating a travel plan,

[0853] A means of presenting a generated travel plan to the user and modifying the plan based on user feedback,

[0854] A means of executing a reservation based on the revised travel plan and providing the reservation information to the user,

[0855] Means of providing users with additional information during their trip,

[0856] A system that includes this.

[0857] (Claim 2)

[0858] The system according to claim 1, further comprising means for recalculating a travel plan based on user feedback.

[0859] (Claim 3)

[0860] The system according to claim 1, comprising an artificial intelligence algorithm for automatically generating an optimized travel plan based on travel conditions.

[0861] "Example 1"

[0862] (Claim 1)

[0863] A means of obtaining travel conditions received from the user,

[0864] A means of finding relevant information based on travel conditions and creating a personalized travel plan,

[0865] A means of presenting a constructed travel plan on a terminal and adjusting the plan based on user input,

[0866] A means of making reservations for accommodations and transportation based on the adjusted travel plan and providing that information to the user,

[0867] A means of providing users with local information during their travels,

[0868] A system that includes this.

[0869] (Claim 2)

[0870] The system according to claim 1, comprising means for re-evaluating a travel plan based on user input.

[0871] (Claim 3)

[0872] The system according to claim 1, comprising a machine learning algorithm for automatically constructing personalized travel plans based on travel conditions.

[0873] "Application Example 1"

[0874] (Claim 1)

[0875] A means of obtaining travel conditions received from the user,

[0876] A means of searching for information based on travel conditions and generating a travel plan,

[0877] A means of presenting a generated travel plan to the user and modifying the plan based on user feedback,

[0878] A means of executing a reservation based on the revised travel plan and providing the reservation information to the user,

[0879] Means of providing users with additional information during their trip,

[0880] A means of obtaining travel conditions using voice input and eye-tracking technology,

[0881] A means of visually presenting travel plans in a virtual space and providing an interactive experience,

[0882] A system that includes this.

[0883] (Claim 2)

[0884] The system according to claim 1, further comprising means for recalculating a travel plan based on user feedback.

[0885] (Claim 3)

[0886] The system according to claim 1, comprising an artificial intelligence algorithm for automatically generating an optimized travel plan based on travel conditions.

[0887] "Example 2 of combining an emotion engine"

[0888] (Claim 1)

[0889] A means of obtaining travel conditions entered by the user via a terminal,

[0890] A means by which the terminal analyzes the user's emotional state from voice and text,

[0891] A means by which a server optimizes and generates a travel plan based on travel conditions and analyzed emotional state,

[0892] A means for presenting a generated travel plan to the user and modifying the plan based on the user's feedback and re-analyzed emotional state,

[0893] A means of automatically executing reservations based on the revised travel plan and providing reservation information to the user,

[0894] A means of providing additional information based on the user's real-time emotional state during travel,

[0895] A system that includes this.

[0896] (Claim 2)

[0897] The system according to claim 1, further comprising means for readjusting a travel plan based on user sentiment analysis.

[0898] (Claim 3)

[0899] The system according to claim 1, comprising an artificial intelligence algorithm for automatically generating a travel plan optimized according to the user's emotions and travel conditions.

[0900] "Application example 2 when combining with an emotional engine"

[0901] (Claim 1)

[0902] A means of obtaining travel conditions received from the user,

[0903] A means of searching for information and generating a travel plan based on travel conditions and emotional state,

[0904] A means of presenting a generated travel plan to the user and modifying the plan based on the user's feedback and sentiment information,

[0905] A means of executing a reservation based on the revised travel plan and providing the reservation information to the user,

[0906] A means of providing optimized additional information based on the user's emotional state during travel,

[0907] A system that includes this.

[0908] (Claim 2)

[0909] The system according to claim 1, further comprising means for recalculating a travel plan based on user feedback and emotional information.

[0910] (Claim 3)

[0911] The system according to claim 1, comprising an artificial intelligence algorithm for automatically generating an optimized travel plan based on travel conditions and user sentiment information. [Explanation of Symbols]

[0912] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means of obtaining travel conditions received from the user, A means of searching for information based on travel conditions and generating a travel plan, A means of presenting a generated travel plan to the user and modifying the plan based on user feedback, A means of executing a reservation based on the revised travel plan and providing the reservation information to the user, Means of providing users with additional information during their trip, A system that includes this.

2. The system according to claim 1, further comprising means for recalculating the travel plan based on user feedback.

3. The system according to claim 1, comprising an artificial intelligence algorithm for automatically generating an optimized travel plan based on travel conditions.

Images