system

Abstract

We provide the system. [Solution] A means of receiving travel information entered by travelers, A means of using a generative model that automatically generates travel plans based on received information, A method of booking an itinerary via an external booking system based on an automatically generated travel plan, A means of displaying the generated plan and reservation information to travelers, A means of integrating urban transportation information and special offers and recommending them to travelers, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Conventional travel plans have problems such as being time-consuming, involving selecting a destination, choosing transportation means, making reservations for accommodation facilities, and deciding on activities to experience while referring to a large number of information sources. Furthermore, it is necessary to consider different preferences and conditions of travelers, and creating individualized travel plans is complicated. Also, there is a lack of means to select the optimal activities based on the latest information during the trip and to effectively utilize discount benefits.

Means for Solving the Problems

[0005] This invention provides a means for receiving travel information entered by travelers and automatically creating an optimal travel plan using a generative model based on that information. It also includes a system for directly making reservations based on the generated travel plan using an external reservation system. Furthermore, it adopts a configuration that displays the generated plan and reservation information to travelers, and during the trip suggests optimal activities in real time based on sensor data, and allows them to check discount and special offer information, thereby easily providing a personalized travel experience.

[0006] A "traveler" refers to a user who plans and makes reservations for a trip.

[0007] "Travel information" refers to data necessary for planning a trip, such as the destination, budget, duration of the trip, and desired activities.

[0008] A "generative model" refers to an algorithm that uses AI to analyze input data and automatically generate the optimal travel plan.

[0009] An "external booking system" refers to an external platform that allows users to make online reservations for flights, accommodations, activities, and other services.

[0010] A "travel plan" refers to a detailed plan of a trip, including the schedule of visits to the destination, accommodation, and selection of activities.

[0011] "Sensor data" is data used to understand the current situation and environment of travelers, and is utilized to suggest itineraries.

[0012] "Activities" refer to activities, tours, and other events that travelers want to experience during their trip.

[0013] "Discount and special offer information" refers to detailed information about discounts and special offers related to travel plans. [Brief explanation of the drawing]

[0014] [Figure 1] It is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] It is a conceptual diagram showing an example of the main functions of a data processing device and a smart device according to the first embodiment. [Figure 3] It is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] It is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] It is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] It is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] It is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] It is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] It shows an emotion map to which a plurality of emotions are mapped. [Figure 10] It shows an emotion map to which a plurality of emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when an emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when an emotion engine is combined.

Modes for Carrying Out the Invention

[0015] Hereinafter, an example of an embodiment of the system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0016] First, the terms used in the following description will be explained.

[0017] In the following embodiments, a numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Also, the processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0018] In the following embodiments, a numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0019] In the following embodiments, a numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, and the like.

[0020] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0022] [First Embodiment]

[0023] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0024] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0025] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0027] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0029] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0030] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0032] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0034] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0035] As an embodiment of this invention, a method for supporting travel planning using a smart travel agent system will be described.

[0036] Overall flow:

[0037] User: Access a dedicated application or web interface and enter basic travel information. This information includes details such as destination, desired total budget, travel duration, characteristics of travel companions (age and number), and activities you wish to experience.

[0038] Terminal: Sends information obtained from the user to the server. The information is pre-formatted and encrypted during server communication.

[0039] Server: Analyzes received data and automatically generates the optimal travel plan through an AI-powered generative model. This generative model optimizes the plan by integrating past travel databases, current tourist information, trends in accommodations and flights, and local special offers based on user-specified parameters.

[0040] Server: After automatically generating a plan, it uses an external online booking system to execute the booking process for flights, accommodations, and various activities. It not only checks the booking status but also performs the necessary processing to confirm the actual booking.

[0041] Device: The completed travel plan and confirmed booking information are immediately sent to the user via push notification. The confirmation screen also displays discount information and important notes regarding the travel destination.

[0042] Users can review the provided travel plan and request changes or adjustments as needed. There is also a function to provide feedback on the plan.

[0043] Specific example:

[0044] For example, if a user enters, "I want to plan a family trip to Hawaii next month (2 adults, 2 children) for under 200,000 yen. The trip will last 4 days, and we want to enjoy beach activities and theme parks," the system will instantly gather local information about Hawaii and propose the best plan that meets the requirements. The generated plan will include cost-effective flights, recommended beachfront hotels, snorkeling activities, and theme park admission arrangements, all of which the user can view with a single click. The system will also notify the user of any applicable perks or discounts.

[0045] In this way, it becomes possible to create customized travel plans that significantly reduce the burden on travelers.

[0046] The following describes the processing flow.

[0047] Step 1:

[0048] Users enter detailed information about their travel preferences into the application or web interface. Specifically, they include their travel destination, desired budget, travel duration, information about travel companions, and activities they wish to experience.

[0049] Step 2:

[0050] The terminal receives information entered by the user and converts it into a data format for transmission to the server. This information is encrypted and sent to the server via the network.

[0051] Step 3:

[0052] The server analyzes the data received from the terminal and prepares it for input into the travel plan generation model. The data is formatted as queries and applied to the internal travel database and external real-time information sources.

[0053] Step 4:

[0054] The server runs an AI-powered generative model to automatically generate optimized travel plans based on the received information. This model integrates data from various sources to create plans that match the user's preferences and budget.

[0055] Step 5:

[0056] The server uses the generated travel plan to coordinate with external booking systems to complete the necessary bookings. This includes confirming reservations for flights, accommodations, and activities.

[0057] Step 6:

[0058] The server compiles the finalized travel plan, booking information, and related discount offers, and sends them to the terminal.

[0059] Step 7:

[0060] The terminal notifies the user of information received from the server and displays it visually. The user can review the plan details and make adjustments or additional requests as needed.

[0061] Step 8:

[0062] In response to user feedback or additional requests, the device resends information to the server. It receives new information as needed and displays it to the user again.

[0063] (Example 1)

[0064] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0065] When planning a trip, it is necessary to reduce the complexity of gathering information, selecting the optimal itinerary, and booking procedures. Traditional methods require using different information sources and manually adjusting each step, which is burdensome for users and inefficient. In particular, providing customized plans that meet the needs of travelers has been difficult.

[0066] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0067] In this invention, the server includes means for acquiring traveler input and receiving travel-related data, means for formatting and encrypting the received data and transmitting it to a central processing unit, and means for generating an optimal travel plan using a generative model that integrates past travel data, the latest tourist information, accommodation, and transportation. This enables the automatic generation of an optimal travel plan based on the traveler's conditions and the efficient execution of booking procedures.

[0068] A "traveler" refers to an individual who plans, books, or carries out a trip.

[0069] "Data" refers to numerical or textual information that makes up information related to travel, such as destinations, budgets, dates, and desired activities.

[0070] "Formatting" refers to the process of converting data into a format that is easily interpretable by a central processing unit or system.

[0071] "Encryption" refers to a technology that uses specific algorithms to protect information in order to safeguard data from unauthorized access.

[0072] The term "central processing unit" refers to the core component of a computer system that processes, stores, and manages data.

[0073] A "generative model" refers to an AI-based program that integrates multiple data sources and creates travel plans based on user conditions.

[0074] A "travel plan" refers to the overall schedule proposed for travelers, including details of destinations, itinerary, accommodations, transportation, and activities.

[0075] A "reservation system" refers to an online platform that allows users to remotely book transportation, accommodation, or activities.

[0076] "Notification" refers to a means of communication that delivers the generated travel plan and related booking information to the traveler's device.

[0077] As an embodiment of this invention, a method for supporting travel planning using a smart travel agent system is described below.

[0078] User actions:

[0079] Users access an application or web interface for travel planning and enter travel information. This information includes destination, desired total budget, number of travel days, characteristics of travel companions (age, number), and details of activities they wish to experience. This establishes the basis for a customized travel plan tailored to individual needs.

[0080] Terminal processing:

[0081] The terminal receives information provided by the user, converts it to a pre-configured format, and then sends it to the server using encryption technology (e.g., SSL / TLS protocol) to ensure data security. This makes it possible to transmit information with peace of mind.

[0082] Server processing:

[0083] The server analyzes data received from the terminal and uses an AI-powered generative model to generate an optimal travel plan. Specifically, it integrates past travel data, the latest tourist information, and trends in accommodation and transportation, and customizes the plan according to the conditions set by the user. The generative model provides the best choices, especially based on the traveler's budget, preferences, and purpose.

[0084] Specific example:

[0085] For example, suppose a user enters the following: "Please create a travel plan for a family of four to Hawaii next month, with a budget of under 200,000 yen. We would like to enjoy beach activities and visit theme parks." In this case, the system will generate a plan that incorporates local Hawaiian tourist information, flights, accommodations, and suitable activities based on the budget. The user can then quickly understand the overall picture of the trip through the generated plan and review the options for booking the suggested activities.

[0086] This allows travelers to plan efficiently and make arrangements seamlessly. Based on a generative AI model, the system provides plans tailored to travelers' needs, reducing the burden of travel planning and enabling a more fulfilling travel experience.

[0087] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0088] Step 1:

[0089] User: Users use a travel planning application or web interface to input information such as destination, budget, duration, travel companions, and desired activities. This input information forms the basis for system processing.

[0090] Step 2:

[0091] Terminal: The terminal converts information obtained from the user into a specified format and protects the data using encryption technology. This enables secure communication and prevents information leakage when transmitted to the server. The input is travel information from the user, and the output is formatted encrypted data.

[0092] Step 3:

[0093] Server: The server receives encrypted data from the terminal, decrypts it, and retrieves the original travel information. This data serves as the basic input for analysis and the creation of optimized travel plans. The output is a dataset for analysis.

[0094] Step 4:

[0095] Server: The server inputs the analyzed data into an AI generation model to generate a travel plan optimized for the traveler's conditions. The generation AI model utilizes historical travel data and current tourist information to suggest the most suitable flights, accommodation options, and activities. The output is the travel plan suggested to the user.

[0096] Step 5:

[0097] Server: Based on the generated travel plan, the server interfaces with external booking systems to make necessary reservations. The server uses APIs to check the booking status of flights, accommodations, and activities in real time and confirm reservations as needed. The output is the booking confirmation information.

[0098] Step 6:

[0099] Terminal: Receives travel plans and booking information sent from the server and displays it to the user's device via push notifications. The terminal updates the user dashboard, including detailed plan information, discount offers, and important notes. It performs actions to allow the user to quickly view the information. The output is the displayed travel plan and booking details.

[0100] Step 7:

[0101] User: Users review information received via push notifications and send plan changes or feedback as needed. This allows users to adjust their plans, and the app generates prompts to reflect those changes. User interaction helps in creating the next plan.

[0102] (Application Example 1)

[0103] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0104] Modern travelers have to process a vast amount of information, from planning their trips to managing reservations, and the associated tasks are a significant burden. Furthermore, they need to individually research transportation options and discount information at their destinations, hindering an efficient travel experience. Therefore, there is a need for a system that allows travelers to enjoy their trips more efficiently and comfortably.

[0105] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0106] In this invention, the server includes means for receiving travel information entered by the traveler, means for utilizing a generative model that automatically generates a travel plan based on the received information, means for booking the itinerary via an external booking system based on the automatically generated travel plan, and means for integrating urban transportation information and reward information and recommending them to the traveler. This enables travelers to seamlessly create travel plans and to efficiently move around and utilize rewards at their destination.

[0107] A "traveler" refers to someone who plans and executes a trip.

[0108] "Means of receiving information" refers to an interface for acquiring travel-related data provided by travelers.

[0109] "Using generative models" refers to methods of creating travel plans using artificial intelligence and algorithms based on input information.

[0110] An "external reservation system" refers to an internet-based service that allows users to make online reservations for accommodations, transportation, and other services.

[0111] "Urban transportation information" refers to data on public transportation and means of transport in the city you are visiting.

[0112] "Special offers" refers to information about discounts and services that can be used during your trip.

[0113] "Automatically generating a plan" refers to the process where the system automatically creates the optimal travel plan based on the conditions set by the traveler.

[0114] In this invention, travelers input travel information via a device such as a smartphone or tablet. When the user enters their destination, budget, travel duration, and desired activities into a dedicated application, the device encrypts that information and transmits it to a server.

[0115] The server uses artificial intelligence systems, such as a "generative AI model," to analyze the received data. The AI ​​references past travel data and the latest tourist information to create the optimal travel plan based on the user's conditions. This generative model integrates with a database to streamline the plan creation process and consolidate necessary information.

[0116] Next, based on the automatically generated travel plan, the server connects with an external online booking system to execute the process of booking flights, accommodations, and activities. During this process, the entire process, from checking the booking status to confirming it, is handled in a single step.

[0117] The device will send push notifications to the user presenting completed travel plans and confirmed booking information. Furthermore, the plans will include information on local transportation and available benefits, allowing users to travel smoothly at their destination and take advantage of discounts and other benefits.

[0118] For example, if a family traveler sets conditions such as, "We want to visit tourist destination A next month. Our budget is under 100,000 yen, and we want to enjoy nature exploration and museum visits," the AI ​​will suggest the optimal flights, accommodations, and sightseeing routes at the destination. Transportation information and special offers are integrated, including local public transport passes and museum admission discounts. In this way, travelers can easily enjoy detailed travel plans.

[0119] An example of a prompt message would be: "The user is planning a trip to tourist destination A. Their budget is 100,000 yen, and they would like to explore nature and visit art museums. Based on these conditions, please suggest the best travel plan."

[0120] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0121] Step 1:

[0122] Users enter travel information into a dedicated application on their smartphones. This information includes destination, budget, travel duration, and desired activities. This entered data is properly formatted and encrypted within the device.

[0123] Step 2:

[0124] The terminal sends encrypted travel information to the server. The server decrypts the received data, identifies the necessary information, and prepares it for analysis. The input here is the traveler's information data, and the output is the data to be analyzed.

[0125] Step 3:

[0126] The server utilizes a generation AI model to automatically generate optimal travel plans based on the data being analyzed. The AI ​​model refers to past travel databases and current tourist information to generate plans that match the user's requests. In plan generation, the input data is used to output an optimized travel plan.

[0127] Step 4:

[0128] Based on the generated travel plan, the server interacts with an external booking system to execute the necessary booking procedures (flights, accommodations, activities). Based on the booking confirmation received from the booking system, the server updates and finalizes the booking information. The input is the travel plan, and the output is the finalized booking information.

[0129] Step 5:

[0130] The server sends the confirmed travel plan and booking information to the device. The device receives this information and presents it to the user via push notification. The input here is data from the server, and the output is the travel plan and booking information that the user can verify.

[0131] Step 6:

[0132] Users review the travel plan provided through their device and provide feedback requesting changes or adjustments as needed. The feedback function sends the user's change requests from the device to the server. The input is the user's feedback information, and the output is the updated plan.

[0133] Step 7:

[0134] The server receives user feedback and uses the generated AI model to adjust the plan again. During this process, necessary data calculations are performed, and the plan is updated to the optimal configuration. The final generated plan is then presented to the user.

[0135] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0136] As a specific embodiment for carrying out the present invention, a smart travel agent system integrating an emotion engine will be described. In this system, in the process of receiving input information from the user and proposing a travel plan, the emotion engine is used to make personalized suggestions that take the user's emotions into consideration.

[0137] Overall flow:

[0138] User: When starting to plan a trip, users enter basic travel information through a dedicated application or web interface. This includes data such as destination, duration of visit, budget, and desired activities. Furthermore, with the user's consent, the device collects emotional data using the camera and microphone. This includes methods of analyzing emotions from facial expressions and tone of voice.

[0139] Terminal: Sends travel information and sentiment data entered by the user to the server. The information is pre-formatted and encrypted over the network.

[0140] Server: Analyzes received travel information and emotional data to generate an AI-optimized travel plan. During this process, the emotional engine analyzes the user's emotions and incorporates them into the plan. For example, if the user needs relaxation, quiet tourist destinations and spa activities will be prioritized.

[0141] Server: The generated travel plan is integrated with an external booking system to automate the booking process for the necessary itinerary. The final plan is compiled, including information on completed bookings.

[0142] Terminal: Notifies the user of the complete travel plan, booking confirmation information, and related discount offers sent from the server. This includes visual displays and user-friendly, emotionally resonant messages.

[0143] User: You can review the proposed travel plan and request changes or additions as needed. User feedback, along with sentiment data, is sent back to the server to optimize the plan.

[0144] Specific example:

[0145] For example, if a user provides information such as, "I'm planning to visit Hawaii next month to relieve stress and seek some quiet time," the system uses its emotion engine to automatically generate a plan that includes relaxing spas and tranquil beaches. Furthermore, the plan incorporates a special relaxation package in addition to the regular sightseeing schedule. This provides a personalized travel experience that enhances the user's psychological satisfaction.

[0146] In this form, the present invention provides customized plans that respond to the traveler's emotions, thereby improving the quality of travel.

[0147] The following describes the processing flow.

[0148] Step 1:

[0149] Users enter basic information such as their travel destination, budget, travel duration, and desired activities into a dedicated application or web interface. Furthermore, only with their consent, the emotion engine collects emotional data from the user's facial expressions and voice tone using the camera and microphone.

[0150] Step 2:

[0151] The device sends the information entered by the user and the collected sentiment data to the server as a single data package. The information sent is encrypted to protect the privacy of the sentiment data.

[0152] Step 3:

[0153] The server analyzes the received travel information and sets the basic conditions for generating a travel plan. At the same time, it analyzes emotional data using an emotion engine and uses the results as parameters when generating the plan.

[0154] Step 4:

[0155] Based on the analyzed emotional data, the server uses AI to automatically generate travel plans tailored to the user's emotional state. For example, if the analysis indicates that the user is seeking relaxation, it will generate a plan that includes accommodation in quiet areas and relaxation activities.

[0156] Step 5:

[0157] The server interfaces with an external booking system based on the generated travel plan, automatically checking the availability of necessary accommodations, flights, and activities, and confirming the bookings.

[0158] Step 6:

[0159] The server compiles the finalized travel plan, booking confirmation, and discount offer information, and sends it to the user's device along with a personalized message tailored to their emotions.

[0160] Step 7:

[0161] The terminal notifies the user of information sent from the server and displays plan and reservation information in an intuitive and easy-to-understand interface. This allows the user to review and adjust their plans.

[0162] Step 8:

[0163] Users review the provided travel plan, make any necessary modifications or provide feedback, and send it to the server via their device along with new sentiment data. This allows for more detailed plan adjustments.

[0164] (Example 2)

[0165] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0166] In recent years, there has been a growing demand for systems that automatically provide optimal travel plans that take into account the individual emotions and specific needs of travelers. However, conventional systems have the drawback of failing to adequately reflect travelers' emotional states and only being able to provide uniform plans. As a result, it has been difficult to improve traveler satisfaction.

[0167] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0168] In this invention, the server includes means for receiving information provided by travelers and handling data including emotional information; means for generating a travel plan based on the received data and using a generative model that reflects the traveler's emotions in the generated plan; and means for booking and automating the itinerary via an external system based on the generated travel plan. This makes it possible to provide personalized travel plans that take into account the traveler's emotional state.

[0169] A "traveler" refers to an individual or group that plans and experiences a trip.

[0170] "Means of receiving information" refers to technical methods for receiving travel-related data and sentiment data provided by travelers.

[0171] "Emotional information" refers to quantifiable data that expresses a traveler's emotional state, such as their facial expressions and tone of voice.

[0172] A "generative model" refers to an algorithm or program that uses machine learning to create travel plans based on information provided by travelers.

[0173] "Methods of booking itineraries through external systems" refers to technologies that automatically arrange things like airline tickets and accommodations through external booking platforms.

[0174] "Notification and display means" refers to digital or analog devices used to visually or audibly communicate planning and booking information to travelers.

[0175] "Emotion-based guidance messages" refer to messages that take into account the traveler's emotional state and include information to support their travel planning and execution.

[0176] This invention is an advanced travel planning system for travelers that provides individually customized travel plans based on the user's emotional information. The system is based on a terminal, a server, and a generative AI model.

[0177] First, the user uses a device to input travel-related information. This device refers to a typical computer or mobile device, and its built-in camera and microphone can be used to acquire the user's emotional information. Emotional information is data that quantifies the user's emotions using facial recognition and voice analysis technologies.

[0178] Next, the terminal sends the collected data to the server. The server is a high-performance computing device that uses machine learning algorithms to create a travel plan based on the received data using a generative AI model. This AI model is integrated with existing databases and external booking systems accessed via the internet, and has the capability to make real-time itinerary reservations.

[0179] Finally, the results sent from the server are presented to the user via the terminal. These results include guidance messages based on the user's emotions, and visual or audio feedback is available. This allows the user to review and modify the suggested travel plan, and the plan is further optimized through this feedback.

[0180] For example, if a user provides information such as "I plan to visit Hawaii next month to seek relaxation," the system will automatically generate a travel plan that promotes relaxation. An example of a prompt message would be: "The user is feeling stressed and needs relaxation on their next trip. The destination is Hawaii, and please suggest a travel plan that includes quiet beaches and spas."

[0181] A system constructed in this way can improve the quality of travel by providing travelers with personalized and diverse travel experiences.

[0182] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0183] Step 1:

[0184] The user inputs travel information using a device. Specifically, they input information necessary for travel planning, such as destination, duration of visit, budget, and desired activities, into a dedicated application or web interface. Furthermore, the device uses a camera and microphone to collect the user's emotional information. As a result, the user's input information and emotional data are obtained as input.

[0185] Step 2:

[0186] Before sending collected user information and emotional data to the server, the terminal processes the data into a predetermined format and securely encrypts it. This process outputs data in a format suitable for external transmission.

[0187] Step 3:

[0188] The server receives data sent from the terminal and analyzes it using a database and a generative AI model. Specifically, it generates a travel plan based on user information and optimizes it by analyzing emotional data and reflecting it in the plan. In this process, if the user needs relaxation, data calculations are performed to incorporate quiet tourist destinations or spas with relaxing effects into the plan. The generated travel plan is obtained as output.

[0189] Step 4:

[0190] The server, based on the generated travel plan, integrates with an external booking system to automate the booking of necessary itineraries. Specifically, it handles flight bookings and hotel arrangements through an online platform. The completed booking information is output integrated into the plan.

[0191] Step 5:

[0192] The terminal receives the final travel plan sent from the server and displays it to the user in a visually easy-to-understand format. It also provides notifications that include guidance messages tailored to the user's emotions. This allows the user to review the proposed plan and receive the final details as output.

[0193] Step 6:

[0194] The user reviews the presented travel plan and requests changes or additions if necessary. In response, the terminal collects feedback from the user again and sends it to the server along with emotional data. Based on this input, the server optimizes the plan and outputs an updated plan.

[0195] (Application Example 2)

[0196] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0197] Traditional travel planning systems provide travel plans based on information entered by travelers, but they do not personalize them according to the traveler's emotions or circumstances, making it difficult to enhance the traveler's psychological satisfaction.

[0198] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0199] In this invention, the server includes a device that receives travel-related information and biometric data entered by the traveler, an information processing device that generates a travel plan that matches the traveler's emotional state based on the received information, and a processing device that confirms the itinerary via external reservation information based on the travel plan. This makes it possible to provide an optimal travel plan that is attentive to the traveler's emotions.

[0200] The term "traveler" refers to an individual involved in planning and carrying out a trip.

[0201] "Biometric data" refers to data that includes information about a traveler's emotions and physical condition, such as facial expressions and tone of voice.

[0202] "Device" refers to a mechanism or equipment designed to perform a specific function.

[0203] An "information processing device" is a device that has the ability to analyze received data and transform, store, or transmit that data according to a specific purpose.

[0204] "External booking information" refers to travel booking data obtained through other systems or services.

[0205] An "output device" is a device that provides information visually or audibly to inform the user of processed information.

[0206] This invention provides a concrete form for building a smart travel system that personalizes and optimizes the traveler's experience. The system receives the traveler's travel information and biometric data and uses them to generate a travel plan that responds to their emotions.

[0207] First, the device collects basic information from the traveler, such as destination, duration of visit, budget, and desired activities. It also acquires biometric data using a camera or voice input device for sentiment analysis. This data is sent to the system and analyzed by software such as Google® Cloud Speech-to-Text and Face++ API.

[0208] Next, the server uses a generative AI model to generate plans that are tailored to the traveler's emotions. Based on the emotion analysis results obtained from the Face++ API, the plans are optimized to suggest quiet locations and spas for users seeking relaxation, and outdoor activities for users seeking active experiences.

[0209] Furthermore, this system utilizes external booking information to secure activities and facilities that require reservations. The information is encrypted and the process is automated through integration with external booking systems.

[0210] Users are notified of suggested travel plans and booking information through voice guidance generated by Google Text-to-Speech and through their device's display. Travelers can also add further requests based on this information.

[0211] For example, if a traveler says by voice, "I want to go somewhere relaxing on the weekend next month," the system receives this along with emotional data and makes a suggestion such as, "Have a relaxing weekend. We recommend a hot spring resort. Would you like to confirm your reservation?"

[0212] An example of a prompt for a generative AI model is, "If the user needs to relax, suggest a travel plan that includes quiet tourist spots and spas." This improves the accuracy of planning that aligns with the traveler's emotions.

[0213] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0214] Step 1:

[0215] The user enters basic travel information and biometric data into the device based on their consent. This information includes destination, duration of visit, budget, and desired activities. The device then detects the user's facial expressions and voice tone from video data captured by the camera and audio data captured by the microphone, collecting biometric data. This data is then transmitted to a server.

[0216] Step 2:

[0217] The server inputs the received travel information and biometric data, converts the audio data to text using Google Cloud Speech-to-Text, and analyzes the video data using the Face++ API to determine the user's emotional state. This analysis outputs emotional data indicating the desired travel atmosphere and emotional requirements of the user.

[0218] Step 3:

[0219] The server activates a generative AI model and generates a personalized travel plan using prompts based on the analyzed emotional data and travel preference information. For example, if the user is feeling stressed, it generates a plan that includes quiet and relaxing places, and outputs the generated plan information as data.

[0220] Step 4:

[0221] The server executes a process to proceed with booking by linking travel plans with external booking systems. Inputs include detailed travel plan information for each item requiring booking, and output is confirmation of booking completion. This automatically secures reservations for related facilities and activities.

[0222] Step 5:

[0223] The device receives the completed travel plan from the server and notifies the user of the travel plan and booking details via voice using Google Text-to-Speech and visually on the display. This is to allow the user to easily understand and decide on their next action. User feedback is sent back to the server as input to optimize the plan.

[0224] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0225] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0226] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0227] [Second Embodiment]

[0228] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0229] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0230] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0231] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0232] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0233] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0234] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0235] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0236] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0237] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0238] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0239] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0240] As an embodiment of this invention, a method for supporting travel planning using a smart travel agent system will be described.

[0241] Overall flow:

[0242] User: Access a dedicated application or web interface and enter basic travel information. This information includes details such as destination, desired total budget, travel duration, characteristics of travel companions (age and number), and activities you wish to experience.

[0243] Terminal: Sends information obtained from the user to the server. The information is pre-formatted and encrypted during server communication.

[0244] Server: Analyzes received data and automatically generates the optimal travel plan through an AI-powered generative model. This generative model optimizes the plan by integrating past travel databases, current tourist information, trends in accommodations and flights, and local special offers based on user-specified parameters.

[0245] Server: After automatically generating a plan, it uses an external online booking system to execute the booking process for flights, accommodations, and various activities. It not only checks the booking status but also performs the necessary processing to confirm the actual booking.

[0246] Device: The completed travel plan and confirmed booking information are immediately sent to the user via push notification. The confirmation screen also displays discount information and important notes regarding the travel destination.

[0247] Users can review the provided travel plan and request changes or adjustments as needed. There is also a function to provide feedback on the plan.

[0248] Specific example:

[0249] For example, if a user enters, "I want to plan a family trip to Hawaii next month (2 adults, 2 children) for under 200,000 yen. The trip will last 4 days, and we want to enjoy beach activities and theme parks," the system will instantly gather local information about Hawaii and propose the best plan that meets the requirements. The generated plan will include cost-effective flights, recommended beachfront hotels, snorkeling activities, and theme park admission arrangements, all of which the user can view with a single click. The system will also notify the user of any applicable perks or discounts.

[0250] In this way, it becomes possible to create customized travel plans that significantly reduce the burden on travelers.

[0251] The following describes the processing flow.

[0252] Step 1:

[0253] Users enter detailed information about their travel preferences into the application or web interface. Specifically, they include their travel destination, desired budget, travel duration, information about travel companions, and activities they wish to experience.

[0254] Step 2:

[0255] The terminal receives information entered by the user and converts it into a data format for transmission to the server. This information is encrypted and sent to the server via the network.

[0256] Step 3:

[0257] The server analyzes the data received from the terminal and prepares it for input into the travel plan generation model. The data is formatted as queries and applied to the internal travel database and external real-time information sources.

[0258] Step 4:

[0259] The server runs an AI-powered generative model to automatically generate optimized travel plans based on the received information. This model integrates data from various sources to create plans that match the user's preferences and budget.

[0260] Step 5:

[0261] The server uses the generated travel plan to coordinate with external booking systems to complete the necessary bookings. This includes confirming reservations for flights, accommodations, and activities.

[0262] Step 6:

[0263] The server compiles the finalized travel plan, booking information, and related discount offers, and sends them to the terminal.

[0264] Step 7:

[0265] The terminal notifies the user of information received from the server and displays it visually. The user can review the plan details and make adjustments or additional requests as needed.

[0266] Step 8:

[0267] In response to user feedback or additional requests, the device resends information to the server. It receives new information as needed and displays it to the user again.

[0268] (Example 1)

[0269] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0270] When planning a trip, it is necessary to reduce the complexity of gathering information, selecting the optimal itinerary, and booking procedures. Traditional methods require using different information sources and manually adjusting each step, which is burdensome for users and inefficient. In particular, providing customized plans that meet the needs of travelers has been difficult.

[0271] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0272] In this invention, the server includes means for acquiring traveler input and receiving travel-related data, means for formatting and encrypting the received data and transmitting it to a central processing unit, and means for generating an optimal travel plan using a generative model that integrates past travel data, the latest tourist information, accommodation, and transportation. This enables the automatic generation of an optimal travel plan based on the traveler's conditions and the efficient execution of booking procedures.

[0273] A "traveler" refers to an individual who plans, books, or carries out a trip.

[0274] "Data" refers to numerical or textual information that makes up information related to travel, such as destinations, budgets, dates, and desired activities.

[0275] "Formatting" refers to the process of converting data into a format that is easily interpretable by a central processing unit or system.

[0276] "Encryption" refers to a technology that uses specific algorithms to protect information in order to safeguard data from unauthorized access.

[0277] The term "central processing unit" refers to the core component of a computer system that processes, stores, and manages data.

[0278] A "generative model" refers to an AI-based program that integrates multiple data sources and creates travel plans based on user conditions.

[0279] A "travel plan" refers to the overall schedule proposed for travelers, including details of destinations, itinerary, accommodations, transportation, and activities.

[0280] A "reservation system" refers to an online platform that allows users to remotely book transportation, accommodation, or activities.

[0281] "Notification" refers to the communication means that delivers the generated travel plan and related reservation information to the traveler's terminal.

[0282] As an embodiment of this invention, a travel plan support method using a smart travel agent system will be described below.

[0283] User operation:

[0284] The user accesses an application or web interface for travel planning and enters information related to the trip. The input information includes the destination, desired total budget, number of travel days, characteristics of companions (age, number), and details of activities to experience. This establishes the basis for a custom travel plan according to individual needs.

[0285] Terminal processing:

[0286] The terminal receives the information provided by the user, converts it into a pre-set format, and then transmits it to the server using encryption technology (e.g., SSL / TLS protocol) to ensure data security. This enables the information to be transmitted with confidence.

[0287] Server processing:

[0288] The server analyzes the data received from the terminal and generates an optimal travel plan by leveraging a generation model using AI. Specifically, it integrates past travel data, the latest tourism information, trends in accommodation and transportation, etc., and customizes the plan according to the conditions set by the user. The generation model provides optimal choices particularly according to the traveler's budget, preferences, and purposes.

[0289] Specific example:

[0290] For example, suppose a user enters the following: "Please create a travel plan for a family of four to Hawaii next month, with a budget of under 200,000 yen. We would like to enjoy beach activities and visit theme parks." In this case, the system will generate a plan that incorporates local Hawaiian tourist information, flights, accommodations, and suitable activities based on the budget. The user can then quickly understand the overall picture of the trip through the generated plan and review the options for booking the suggested activities.

[0291] This allows travelers to plan efficiently and make arrangements seamlessly. Based on a generative AI model, the system provides plans tailored to travelers' needs, reducing the burden of travel planning and enabling a more fulfilling travel experience.

[0292] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0293] Step 1:

[0294] User: Users use a travel planning application or web interface to input information such as destination, budget, duration, travel companions, and desired activities. This input information forms the basis for system processing.

[0295] Step 2:

[0296] Terminal: The terminal converts information obtained from the user into a specified format and protects the data using encryption technology. This enables secure communication and prevents information leakage when transmitted to the server. The input is travel information from the user, and the output is formatted encrypted data.

[0297] Step 3:

[0298] Server: The server receives encrypted data from the terminal, decrypts it, and retrieves the original travel information. This data serves as the basic input for analysis and the creation of optimized travel plans. The output is a dataset for analysis.

[0299] Step 4:

[0300] Server: The server inputs the analyzed data into an AI generation model to generate a travel plan optimized for the traveler's conditions. The generation AI model utilizes historical travel data and current tourist information to suggest the most suitable flights, accommodation options, and activities. The output is the travel plan suggested to the user.

[0301] Step 5:

[0302] Server: Based on the generated travel plan, the server interfaces with external booking systems to make necessary reservations. The server uses APIs to check the booking status of flights, accommodations, and activities in real time and confirm reservations as needed. The output is the booking confirmation information.

[0303] Step 6:

[0304] Terminal: Receives travel plans and booking information sent from the server and displays it to the user's device via push notifications. The terminal updates the user dashboard, including detailed plan information, discount offers, and important notes. It performs actions to allow the user to quickly view the information. The output is the displayed travel plan and booking details.

[0305] Step 7:

[0306] User: Users review information received via push notifications and send plan changes or feedback as needed. This allows users to adjust their plans, and the app generates prompts to reflect those changes. User interaction helps in creating the next plan.

[0307] (Application Example 1)

[0308] Next, Application Example 1 will be described. In the following description, the data processing device 12 is referred to as a "server", and the smart glasses 214 are referred to as a "terminal".

[0309] Modern travelers have to process a lot of information from travel plan formulation to reservation management, and the related work has become a heavy burden. In addition, it is necessary to individually check information on transportation means and discount privileges at the travel destination, which hinders an efficient travel experience. Therefore, there is a need for a system that allows travelers to enjoy their travels more efficiently and comfortably.

[0310] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0311] In this invention, the server includes means for receiving information related to travel input by the traveler, means for using a generation model that automatically generates a travel plan based on the received information, means for reserving a travel itinerary via an external reservation system based on the automatically generated travel plan, and means for integrating traffic information and privilege information within a city and recommending them to the traveler. As a result, travelers can seamlessly create travel plans and can also efficiently move around and utilize privileges at the travel destination.

[0312] A "traveler" refers to a person who formulates and executes a travel plan.

[0313] The "means for receiving information" refers to an interface for taking in data related to travel provided by the traveler.

[0314] The "means for using a generation model" refers to a method of creating a travel plan by utilizing artificial intelligence and algorithms based on the input information.

[0315] The "external reservation system" refers to an online service for making reservations for accommodation facilities, transportation, etc.

[0316] "Urban transportation information" refers to data on public transportation and means of transport in the city you are visiting.

[0317] "Special offers" refers to information about discounts and services that can be used during your trip.

[0318] "Automatically generating a plan" refers to the process where the system automatically creates the optimal travel plan based on the conditions set by the traveler.

[0319] In this invention, travelers input travel information via a device such as a smartphone or tablet. When the user enters their destination, budget, travel duration, and desired activities into a dedicated application, the device encrypts that information and transmits it to a server.

[0320] The server uses artificial intelligence systems, such as a "generative AI model," to analyze the received data. The AI ​​references past travel data and the latest tourist information to create the optimal travel plan based on the user's conditions. This generative model integrates with a database to streamline the plan creation process and consolidate necessary information.

[0321] Next, based on the automatically generated travel plan, the server connects with an external online booking system to execute the process of booking flights, accommodations, and activities. During this process, the entire process, from checking the booking status to confirming it, is handled in a single step.

[0322] The device will send push notifications to the user presenting completed travel plans and confirmed booking information. Furthermore, the plans will include information on local transportation and available benefits, allowing users to travel smoothly at their destination and take advantage of discounts and other benefits.

[0323] For example, if a family traveler sets conditions such as, "We want to visit tourist destination A next month. Our budget is under 100,000 yen, and we want to enjoy nature exploration and museum visits," the AI ​​will suggest the optimal flights, accommodations, and sightseeing routes at the destination. Transportation information and special offers are integrated, including local public transport passes and museum admission discounts. In this way, travelers can easily enjoy detailed travel plans.

[0324] An example of a prompt message would be: "The user is planning a trip to tourist destination A. Their budget is 100,000 yen, and they would like to explore nature and visit art museums. Based on these conditions, please suggest the best travel plan."

[0325] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0326] Step 1:

[0327] Users enter travel information into a dedicated application on their smartphones. This information includes destination, budget, travel duration, and desired activities. This entered data is properly formatted and encrypted within the device.

[0328] Step 2:

[0329] The terminal sends encrypted travel information to the server. The server decrypts the received data, identifies the necessary information, and prepares it for analysis. The input here is the traveler's information data, and the output is the data to be analyzed.

[0330] Step 3:

[0331] The server utilizes a generation AI model to automatically generate optimal travel plans based on the data being analyzed. The AI ​​model refers to past travel databases and current tourist information to generate plans that match the user's requests. In plan generation, the input data is used to output an optimized travel plan.

[0332] Step 4:

[0333] Based on the generated travel plan, the server interacts with an external booking system to execute the necessary booking procedures (flights, accommodations, activities). Based on the booking confirmation received from the booking system, the server updates and finalizes the booking information. The input is the travel plan, and the output is the finalized booking information.

[0334] Step 5:

[0335] The server sends the confirmed travel plan and booking information to the device. The device receives this information and presents it to the user via push notification. The input here is data from the server, and the output is the travel plan and booking information that the user can verify.

[0336] Step 6:

[0337] Users review the travel plan provided through their device and provide feedback requesting changes or adjustments as needed. The feedback function sends the user's change requests from the device to the server. The input is the user's feedback information, and the output is the updated plan.

[0338] Step 7:

[0339] The server receives user feedback and uses the generated AI model to adjust the plan again. During this process, necessary data calculations are performed, and the plan is updated to the optimal configuration. The final generated plan is then presented to the user.

[0340] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0341] As a specific embodiment for carrying out the present invention, a smart travel agent system integrating an emotion engine will be described. In this system, in the process of receiving input information from the user and proposing a travel plan, the emotion engine is used to make personalized suggestions that take the user's emotions into consideration.

[0342] Overall flow:

[0343] User: When starting to plan a trip, users enter basic travel information through a dedicated application or web interface. This includes data such as destination, duration of visit, budget, and desired activities. Furthermore, with the user's consent, the device collects emotional data using the camera and microphone. This includes methods of analyzing emotions from facial expressions and tone of voice.

[0344] Terminal: Sends travel information and sentiment data entered by the user to the server. The information is pre-formatted and encrypted over the network.

[0345] Server: Analyzes received travel information and emotional data to generate an AI-optimized travel plan. During this process, the emotional engine analyzes the user's emotions and incorporates them into the plan. For example, if the user needs relaxation, quiet tourist destinations and spa activities will be prioritized.

[0346] Server: The generated travel plan is integrated with an external booking system to automate the booking process for the necessary itinerary. The final plan is compiled, including information on completed bookings.

[0347] Terminal: Notifies the user of the complete travel plan, booking confirmation information, and related discount offers sent from the server. This includes visual displays and user-friendly, emotionally resonant messages.

[0348] User: You can review the proposed travel plan and request changes or additions as needed. User feedback, along with sentiment data, is sent back to the server to optimize the plan.

[0349] Specific example:

[0350] For example, if a user provides information such as, "I'm planning to visit Hawaii next month to relieve stress and seek some quiet time," the system uses its emotion engine to automatically generate a plan that includes relaxing spas and tranquil beaches. Furthermore, the plan incorporates a special relaxation package in addition to the regular sightseeing schedule. This provides a personalized travel experience that enhances the user's psychological satisfaction.

[0351] In this form, the present invention provides customized plans that respond to the traveler's emotions, thereby improving the quality of travel.

[0352] The following describes the processing flow.

[0353] Step 1:

[0354] Users enter basic information such as their travel destination, budget, travel duration, and desired activities into a dedicated application or web interface. Furthermore, only with their consent, the emotion engine collects emotional data from the user's facial expressions and voice tone using the camera and microphone.

[0355] Step 2:

[0356] The device sends the information entered by the user and the collected sentiment data to the server as a single data package. The information sent is encrypted to protect the privacy of the sentiment data.

[0357] Step 3:

[0358] The server analyzes the received travel information and sets the basic conditions for generating a travel plan. At the same time, it analyzes emotional data using an emotion engine and uses the results as parameters when generating the plan.

[0359] Step 4:

[0360] Based on the analyzed emotional data, the server uses AI to automatically generate travel plans tailored to the user's emotional state. For example, if the analysis indicates that the user is seeking relaxation, it will generate a plan that includes accommodation in quiet areas and relaxation activities.

[0361] Step 5:

[0362] The server interfaces with an external booking system based on the generated travel plan, automatically checking the availability of necessary accommodations, flights, and activities, and confirming the bookings.

[0363] Step 6:

[0364] The server compiles the finalized travel plan, booking confirmation, and discount offer information, and sends it to the user's device along with a personalized message tailored to their emotions.

[0365] Step 7:

[0366] The terminal notifies the user of information sent from the server and displays plan and reservation information in an intuitive and easy-to-understand interface. This allows the user to review and adjust their plans.

[0367] Step 8:

[0368] Users review the provided travel plan, make any necessary modifications or provide feedback, and send it to the server via their device along with new sentiment data. This allows for more detailed plan adjustments.

[0369] (Example 2)

[0370] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0371] In recent years, there has been a growing demand for systems that automatically provide optimal travel plans that take into account the individual emotions and specific needs of travelers. However, conventional systems have the drawback of failing to adequately reflect travelers' emotional states and only being able to provide uniform plans. As a result, it has been difficult to improve traveler satisfaction.

[0372] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0373] In this invention, the server includes means for receiving information provided by travelers and handling data including emotional information; means for generating a travel plan based on the received data and using a generative model that reflects the traveler's emotions in the generated plan; and means for booking and automating the itinerary via an external system based on the generated travel plan. This makes it possible to provide personalized travel plans that take into account the traveler's emotional state.

[0374] A "traveler" refers to an individual or group that plans and experiences a trip.

[0375] "Means of receiving information" refers to technical methods for receiving travel-related data and sentiment data provided by travelers.

[0376] "Emotional information" refers to quantifiable data that expresses a traveler's emotional state, such as their facial expressions and tone of voice.

[0377] A "generative model" refers to an algorithm or program that uses machine learning to create travel plans based on information provided by travelers.

[0378] "Methods of booking itineraries through external systems" refers to technologies that automatically arrange things like airline tickets and accommodations through external booking platforms.

[0379] "Notification and display means" refers to digital or analog devices used to visually or audibly communicate planning and booking information to travelers.

[0380] "Emotion-based guidance messages" refer to messages that take into account the traveler's emotional state and include information to support their travel planning and execution.

[0381] This invention is an advanced travel planning system for travelers that provides individually customized travel plans based on the user's emotional information. The system is based on a terminal, a server, and a generative AI model.

[0382] First, the user uses a device to input travel-related information. This device refers to a typical computer or mobile device, and its built-in camera and microphone can be used to acquire the user's emotional information. Emotional information is data that quantifies the user's emotions using facial recognition and voice analysis technologies.

[0383] Next, the terminal sends the collected data to the server. The server is a high-performance computing device that uses machine learning algorithms to create a travel plan based on the received data using a generative AI model. This AI model is integrated with existing databases and external booking systems accessed via the internet, and has the capability to make real-time itinerary reservations.

[0384] Finally, the results sent from the server are presented to the user via the terminal. These results include guidance messages based on the user's emotions, and visual or audio feedback is available. This allows the user to review and modify the suggested travel plan, and the plan is further optimized through this feedback.

[0385] For example, if a user provides information such as "I plan to visit Hawaii next month to seek relaxation," the system will automatically generate a travel plan that promotes relaxation. An example of a prompt message would be: "The user is feeling stressed and needs relaxation on their next trip. The destination is Hawaii, and please suggest a travel plan that includes quiet beaches and spas."

[0386] A system constructed in this way can improve the quality of travel by providing travelers with personalized and diverse travel experiences.

[0387] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0388] Step 1:

[0389] The user inputs travel information using a device. Specifically, they input information necessary for travel planning, such as destination, duration of visit, budget, and desired activities, into a dedicated application or web interface. Furthermore, the device uses a camera and microphone to collect the user's emotional information. As a result, the user's input information and emotional data are obtained as input.

[0390] Step 2:

[0391] Before sending collected user information and emotional data to the server, the terminal processes the data into a predetermined format and securely encrypts it. This process outputs data in a format suitable for external transmission.

[0392] Step 3:

[0393] The server receives data sent from the terminal and analyzes it using a database and a generative AI model. Specifically, it generates a travel plan based on user information and optimizes it by analyzing emotional data and reflecting it in the plan. In this process, if the user needs relaxation, data calculations are performed to incorporate quiet tourist destinations or spas with relaxing effects into the plan. The generated travel plan is obtained as output.

[0394] Step 4:

[0395] The server, based on the generated travel plan, integrates with an external booking system to automate the booking of necessary itineraries. Specifically, it handles flight bookings and hotel arrangements through an online platform. The completed booking information is output integrated into the plan.

[0396] Step 5:

[0397] The terminal receives the final travel plan sent from the server and displays it to the user in a visually easy-to-understand format. It also provides notifications that include guidance messages tailored to the user's emotions. This allows the user to review the proposed plan and receive the final details as output.

[0398] Step 6:

[0399] The user reviews the presented travel plan and requests changes or additions if necessary. In response, the terminal collects feedback from the user again and sends it to the server along with emotional data. Based on this input, the server optimizes the plan and outputs an updated plan.

[0400] (Application Example 2)

[0401] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0402] Traditional travel planning systems provide travel plans based on information entered by travelers, but they do not personalize them according to the traveler's emotions or circumstances, making it difficult to enhance the traveler's psychological satisfaction.

[0403] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0404] In this invention, the server includes a device that receives travel-related information and biometric data entered by the traveler, an information processing device that generates a travel plan that matches the traveler's emotional state based on the received information, and a processing device that confirms the itinerary via external reservation information based on the travel plan. This makes it possible to provide an optimal travel plan that is attentive to the traveler's emotions.

[0405] The term "traveler" refers to an individual involved in planning and carrying out a trip.

[0406] "Biometric data" refers to data that includes information about a traveler's emotions and physical condition, such as facial expressions and tone of voice.

[0407] "Device" refers to a mechanism or equipment designed to perform a specific function.

[0408] An "information processing device" is a device that has the ability to analyze received data and transform, store, or transmit that data according to a specific purpose.

[0409] "External booking information" refers to travel booking data obtained through other systems or services.

[0410] An "output device" is a device that provides information visually or audibly to inform the user of processed information.

[0411] This invention provides a concrete form for building a smart travel system that personalizes and optimizes the traveler's experience. The system receives the traveler's travel information and biometric data and uses them to generate a travel plan that responds to their emotions.

[0412] First, the device collects basic information from the traveler, such as destination, duration of visit, budget, and desired activities. It also acquires biometric data using a camera or voice input device for sentiment analysis. This data is sent to a system and analyzed by software such as Google Cloud Speech-to-Text and Face++ API.

[0413] Next, the server uses a generative AI model to generate plans that are tailored to the traveler's emotions. Based on the emotion analysis results obtained from the Face++ API, the plans are optimized to suggest quiet locations and spas for users seeking relaxation, and outdoor activities for users seeking active experiences.

[0414] Furthermore, this system utilizes external booking information to secure activities and facilities that require reservations. The information is encrypted and the process is automated through integration with external booking systems.

[0415] Users are notified of suggested travel plans and booking information through voice guidance generated by Google Text-to-Speech and through their device's display. Travelers can also add further requests based on this information.

[0416] For example, if a traveler says by voice, "I want to go somewhere relaxing on the weekend next month," the system receives this along with emotional data and makes a suggestion such as, "Have a relaxing weekend. We recommend a hot spring resort. Would you like to confirm your reservation?"

[0417] An example of a prompt for a generative AI model is, "If the user needs to relax, suggest a travel plan that includes quiet tourist spots and spas." This improves the accuracy of planning that aligns with the traveler's emotions.

[0418] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0419] Step 1:

[0420] The user enters basic travel information and biometric data into the device based on their consent. This information includes destination, duration of visit, budget, and desired activities. The device then detects the user's facial expressions and voice tone from video data captured by the camera and audio data captured by the microphone, collecting biometric data. This data is then transmitted to a server.

[0421] Step 2:

[0422] The server inputs the received travel information and biometric data, converts the audio data to text using Google Cloud Speech-to-Text, and analyzes the video data using the Face++ API to determine the user's emotional state. This analysis outputs emotional data indicating the desired travel atmosphere and emotional requirements of the user.

[0423] Step 3:

[0424] The server activates a generative AI model and generates a personalized travel plan using prompts based on the analyzed emotional data and travel preference information. For example, if the user is feeling stressed, it generates a plan that includes quiet and relaxing places, and outputs the generated plan information as data.

[0425] Step 4:

[0426] The server executes a process to proceed with booking by linking travel plans with external booking systems. Inputs include detailed travel plan information for each item requiring booking, and output is confirmation of booking completion. This automatically secures reservations for related facilities and activities.

[0427] Step 5:

[0428] The device receives the completed travel plan from the server and notifies the user of the travel plan and booking details via voice using Google Text-to-Speech and visually on the display. This is to allow the user to easily understand and decide on their next action. User feedback is sent back to the server as input to optimize the plan.

[0429] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0430] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0431] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0432] [Third Embodiment]

[0433] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0434] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0435] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0436] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0437] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0438] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0439] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0440] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0441] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0442] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0443] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0444] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0445] As an embodiment of this invention, a method for supporting travel planning using a smart travel agent system will be described.

[0446] Overall flow:

[0447] User: Access a dedicated application or web interface and enter basic travel information. This information includes details such as destination, desired total budget, travel duration, characteristics of travel companions (age and number), and activities you wish to experience.

[0448] Terminal: Sends information obtained from the user to the server. The information is pre-formatted and encrypted during server communication.

[0449] Server: Analyzes received data and automatically generates the optimal travel plan through an AI-powered generative model. This generative model optimizes the plan by integrating past travel databases, current tourist information, trends in accommodations and flights, and local special offers based on user-specified parameters.

[0450] Server: After automatically generating a plan, it uses an external online booking system to execute the booking process for flights, accommodations, and various activities. It not only checks the booking status but also performs the necessary processing to confirm the actual booking.

[0451] Device: The completed travel plan and confirmed booking information are immediately sent to the user via push notification. The confirmation screen also displays discount information and important notes regarding the travel destination.

[0452] Users can review the provided travel plan and request changes or adjustments as needed. There is also a function to provide feedback on the plan.

[0453] Specific example:

[0454] For example, if a user enters, "I want to plan a family trip to Hawaii next month (2 adults, 2 children) for under 200,000 yen. The trip will last 4 days, and we want to enjoy beach activities and theme parks," the system will instantly gather local information about Hawaii and propose the best plan that meets the requirements. The generated plan will include cost-effective flights, recommended beachfront hotels, snorkeling activities, and theme park admission arrangements, all of which the user can view with a single click. The system will also notify the user of any applicable perks or discounts.

[0455] In this way, it becomes possible to create customized travel plans that significantly reduce the burden on travelers.

[0456] The following describes the processing flow.

[0457] Step 1:

[0458] Users enter detailed information about their travel preferences into the application or web interface. Specifically, they include their travel destination, desired budget, travel duration, information about travel companions, and activities they wish to experience.

[0459] Step 2:

[0460] The terminal receives information entered by the user and converts it into a data format for transmission to the server. This information is encrypted and sent to the server via the network.

[0461] Step 3:

[0462] The server analyzes the data received from the terminal and prepares it for input into the travel plan generation model. The data is formatted as queries and applied to the internal travel database and external real-time information sources.

[0463] Step 4:

[0464] The server runs an AI-powered generative model to automatically generate optimized travel plans based on the received information. This model integrates data from various sources to create plans that match the user's preferences and budget.

[0465] Step 5:

[0466] The server uses the generated travel plan to coordinate with external booking systems to complete the necessary bookings. This includes confirming reservations for flights, accommodations, and activities.

[0467] Step 6:

[0468] The server compiles the finalized travel plan, booking information, and related discount offers, and sends them to the terminal.

[0469] Step 7:

[0470] The terminal notifies the user of information received from the server and displays it visually. The user can review the plan details and make adjustments or additional requests as needed.

[0471] Step 8:

[0472] In response to user feedback or additional requests, the device resends information to the server. It receives new information as needed and displays it to the user again.

[0473] (Example 1)

[0474] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0475] When planning a trip, it is necessary to reduce the complexity of gathering information, selecting the optimal itinerary, and booking procedures. Traditional methods require using different information sources and manually adjusting each step, which is burdensome for users and inefficient. In particular, providing customized plans that meet the needs of travelers has been difficult.

[0476] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0477] In this invention, the server includes means for acquiring traveler input and receiving travel-related data, means for formatting and encrypting the received data and transmitting it to a central processing unit, and means for generating an optimal travel plan using a generative model that integrates past travel data, the latest tourist information, accommodation, and transportation. This enables the automatic generation of an optimal travel plan based on the traveler's conditions and the efficient execution of booking procedures.

[0478] A "traveler" refers to an individual who plans, books, or carries out a trip.

[0479] "Data" refers to numerical or textual information that makes up information related to travel, such as destinations, budgets, dates, and desired activities.

[0480] "Formatting" refers to the process of converting data into a format that is easily interpretable by a central processing unit or system.

[0481] "Encryption" refers to a technology that uses specific algorithms to protect information in order to safeguard data from unauthorized access.

[0482] The term "central processing unit" refers to the core component of a computer system that processes, stores, and manages data.

[0483] A "generative model" refers to an AI-based program that integrates multiple data sources and creates travel plans based on user conditions.

[0484] A "travel plan" refers to the overall schedule proposed for travelers, including details of destinations, itinerary, accommodations, transportation, and activities.

[0485] A "reservation system" refers to an online platform that allows users to remotely book transportation, accommodation, or activities.

[0486] "Notification" refers to a means of communication that delivers the generated travel plan and related booking information to the traveler's device.

[0487] As an embodiment of this invention, a method for supporting travel planning using a smart travel agent system is described below.

[0488] User actions:

[0489] Users access an application or web interface for travel planning and enter travel information. This information includes destination, desired total budget, number of travel days, characteristics of travel companions (age, number), and details of activities they wish to experience. This establishes the basis for a customized travel plan tailored to individual needs.

[0490] Terminal processing:

[0491] The terminal receives information provided by the user, converts it to a pre-configured format, and then sends it to the server using encryption technology (e.g., SSL / TLS protocol) to ensure data security. This makes it possible to transmit information with peace of mind.

[0492] Server processing:

[0493] The server analyzes data received from the terminal and uses an AI-powered generative model to generate an optimal travel plan. Specifically, it integrates past travel data, the latest tourist information, and trends in accommodation and transportation, and customizes the plan according to the conditions set by the user. The generative model provides the best choices, especially based on the traveler's budget, preferences, and purpose.

[0494] Specific example:

[0495] For example, suppose a user enters the following: "Please create a travel plan for a family of four to Hawaii next month, with a budget of under 200,000 yen. We would like to enjoy beach activities and visit theme parks." In this case, the system will generate a plan that incorporates local Hawaiian tourist information, flights, accommodations, and suitable activities based on the budget. The user can then quickly understand the overall picture of the trip through the generated plan and review the options for booking the suggested activities.

[0496] This allows travelers to plan efficiently and make arrangements seamlessly. Based on a generative AI model, the system provides plans tailored to travelers' needs, reducing the burden of travel planning and enabling a more fulfilling travel experience.

[0497] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0498] Step 1:

[0499] User: Users use a travel planning application or web interface to input information such as destination, budget, duration, travel companions, and desired activities. This input information forms the basis for system processing.

[0500] Step 2:

[0501] Terminal: The terminal converts information obtained from the user into a specified format and protects the data using encryption technology. This enables secure communication and prevents information leakage when transmitted to the server. The input is travel information from the user, and the output is formatted encrypted data.

[0502] Step 3:

[0503] Server: The server receives encrypted data from the terminal, decrypts it, and retrieves the original travel information. This data serves as the basic input for analysis and the creation of optimized travel plans. The output is a dataset for analysis.

[0504] Step 4:

[0505] Server: The server inputs the analyzed data into an AI generation model to generate a travel plan optimized for the traveler's conditions. The generation AI model utilizes historical travel data and current tourist information to suggest the most suitable flights, accommodation options, and activities. The output is the travel plan suggested to the user.

[0506] Step 5:

[0507] Server: Based on the generated travel plan, the server interfaces with external booking systems to make necessary reservations. The server uses APIs to check the booking status of flights, accommodations, and activities in real time and confirm reservations as needed. The output is the booking confirmation information.

[0508] Step 6:

[0509] Terminal: Receives travel plans and booking information sent from the server and displays it to the user's device via push notifications. The terminal updates the user dashboard, including detailed plan information, discount offers, and important notes. It performs actions to allow the user to quickly view the information. The output is the displayed travel plan and booking details.

[0510] Step 7:

[0511] User: Users review information received via push notifications and send plan changes or feedback as needed. This allows users to adjust their plans, and the app generates prompts to reflect those changes. User interaction helps in creating the next plan.

[0512] (Application Example 1)

[0513] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0514] Modern travelers have to process a vast amount of information, from planning their trips to managing reservations, and the associated tasks are a significant burden. Furthermore, they need to individually research transportation options and discount information at their destinations, hindering an efficient travel experience. Therefore, there is a need for a system that allows travelers to enjoy their trips more efficiently and comfortably.

[0515] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0516] In this invention, the server includes means for receiving travel information entered by the traveler, means for utilizing a generative model that automatically generates a travel plan based on the received information, means for booking the itinerary via an external booking system based on the automatically generated travel plan, and means for integrating urban transportation information and reward information and recommending them to the traveler. This enables travelers to seamlessly create travel plans and to efficiently move around and utilize rewards at their destination.

[0517] A "traveler" refers to someone who plans and executes a trip.

[0518] "Means of receiving information" refers to an interface for acquiring travel-related data provided by travelers.

[0519] "Using generative models" refers to methods of creating travel plans using artificial intelligence and algorithms based on input information.

[0520] An "external reservation system" refers to an internet-based service that allows users to make online reservations for accommodations, transportation, and other services.

[0521] "Urban transportation information" refers to data on public transportation and means of transport in the city you are visiting.

[0522] "Special offers" refers to information about discounts and services that can be used during your trip.

[0523] "Automatically generating a plan" refers to the process where the system automatically creates the optimal travel plan based on the conditions set by the traveler.

[0524] In this invention, travelers input travel information via a device such as a smartphone or tablet. When the user enters their destination, budget, travel duration, and desired activities into a dedicated application, the device encrypts that information and transmits it to a server.

[0525] The server uses artificial intelligence systems, such as a "generative AI model," to analyze the received data. The AI ​​references past travel data and the latest tourist information to create the optimal travel plan based on the user's conditions. This generative model integrates with a database to streamline the plan creation process and consolidate necessary information.

[0526] Next, based on the automatically generated travel plan, the server connects with an external online booking system to execute the process of booking flights, accommodations, and activities. During this process, the entire process, from checking the booking status to confirming it, is handled in a single step.

[0527] The device will send push notifications to the user presenting completed travel plans and confirmed booking information. Furthermore, the plans will include information on local transportation and available benefits, allowing users to travel smoothly at their destination and take advantage of discounts and other benefits.

[0528] For example, if a family traveler sets conditions such as, "We want to visit tourist destination A next month. Our budget is under 100,000 yen, and we want to enjoy nature exploration and museum visits," the AI ​​will suggest the optimal flights, accommodations, and sightseeing routes at the destination. Transportation information and special offers are integrated, including local public transport passes and museum admission discounts. In this way, travelers can easily enjoy detailed travel plans.

[0529] An example of a prompt message would be: "The user is planning a trip to tourist destination A. Their budget is 100,000 yen, and they would like to explore nature and visit art museums. Based on these conditions, please suggest the best travel plan."

[0530] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0531] Step 1:

[0532] Users enter travel information into a dedicated application on their smartphones. This information includes destination, budget, travel duration, and desired activities. This entered data is properly formatted and encrypted within the device.

[0533] Step 2:

[0534] The terminal sends encrypted travel information to the server. The server decrypts the received data, identifies the necessary information, and prepares it for analysis. The input here is the traveler's information data, and the output is the data to be analyzed.

[0535] Step 3:

[0536] The server utilizes a generation AI model to automatically generate optimal travel plans based on the data being analyzed. The AI ​​model refers to past travel databases and current tourist information to generate plans that match the user's requests. In plan generation, the input data is used to output an optimized travel plan.

[0537] Step 4:

[0538] Based on the generated travel plan, the server interacts with an external booking system to execute the necessary booking procedures (flights, accommodations, activities). Based on the booking confirmation received from the booking system, the server updates and finalizes the booking information. The input is the travel plan, and the output is the finalized booking information.

[0539] Step 5:

[0540] The server sends the confirmed travel plan and booking information to the device. The device receives this information and presents it to the user via push notification. The input here is data from the server, and the output is the travel plan and booking information that the user can verify.

[0541] Step 6:

[0542] Users review the travel plan provided through their device and provide feedback requesting changes or adjustments as needed. The feedback function sends the user's change requests from the device to the server. The input is the user's feedback information, and the output is the updated plan.

[0543] Step 7:

[0544] The server receives user feedback and uses the generated AI model to adjust the plan again. During this process, necessary data calculations are performed, and the plan is updated to the optimal configuration. The final generated plan is then presented to the user.

[0545] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0546] As a specific embodiment for carrying out the present invention, a smart travel agent system integrating an emotion engine will be described. In this system, in the process of receiving input information from the user and proposing a travel plan, the emotion engine is used to make personalized suggestions that take the user's emotions into consideration.

[0547] Overall flow:

[0548] User: When starting to plan a trip, users enter basic travel information through a dedicated application or web interface. This includes data such as destination, duration of visit, budget, and desired activities. Furthermore, with the user's consent, the device collects emotional data using the camera and microphone. This includes methods of analyzing emotions from facial expressions and tone of voice.

[0549] Terminal: Sends travel information and sentiment data entered by the user to the server. The information is pre-formatted and encrypted over the network.

[0550] Server: Analyzes received travel information and emotional data to generate an AI-optimized travel plan. During this process, the emotional engine analyzes the user's emotions and incorporates them into the plan. For example, if the user needs relaxation, quiet tourist destinations and spa activities will be prioritized.

[0551] Server: The generated travel plan is integrated with an external booking system to automate the booking process for the necessary itinerary. The final plan is compiled, including information on completed bookings.

[0552] Terminal: Notifies the user of the complete travel plan, booking confirmation information, and related discount offers sent from the server. This includes visual displays and user-friendly, emotionally resonant messages.

[0553] User: You can review the proposed travel plan and request changes or additions as needed. User feedback, along with sentiment data, is sent back to the server to optimize the plan.

[0554] Specific example:

[0555] For example, if a user provides information such as, "I'm planning to visit Hawaii next month to relieve stress and seek some quiet time," the system uses its emotion engine to automatically generate a plan that includes relaxing spas and tranquil beaches. Furthermore, the plan incorporates a special relaxation package in addition to the regular sightseeing schedule. This provides a personalized travel experience that enhances the user's psychological satisfaction.

[0556] In this form, the present invention provides customized plans that respond to the traveler's emotions, thereby improving the quality of travel.

[0557] The following describes the processing flow.

[0558] Step 1:

[0559] Users enter basic information such as their travel destination, budget, travel duration, and desired activities into a dedicated application or web interface. Furthermore, only with their consent, the emotion engine collects emotional data from the user's facial expressions and voice tone using the camera and microphone.

[0560] Step 2:

[0561] The device sends the information entered by the user and the collected sentiment data to the server as a single data package. The information sent is encrypted to protect the privacy of the sentiment data.

[0562] Step 3:

[0563] The server analyzes the received travel information and sets the basic conditions for generating a travel plan. At the same time, it analyzes emotional data using an emotion engine and uses the results as parameters when generating the plan.

[0564] Step 4:

[0565] Based on the analyzed emotional data, the server uses AI to automatically generate travel plans tailored to the user's emotional state. For example, if the analysis indicates that the user is seeking relaxation, it will generate a plan that includes accommodation in quiet areas and relaxation activities.

[0566] Step 5:

[0567] The server interfaces with an external booking system based on the generated travel plan, automatically checking the availability of necessary accommodations, flights, and activities, and confirming the bookings.

[0568] Step 6:

[0569] The server compiles the finalized travel plan, booking confirmation, and discount offer information, and sends it to the user's device along with a personalized message tailored to their emotions.

[0570] Step 7:

[0571] The terminal notifies the user of information sent from the server and displays plan and reservation information in an intuitive and easy-to-understand interface. This allows the user to review and adjust their plans.

[0572] Step 8:

[0573] Users review the provided travel plan, make any necessary modifications or provide feedback, and send it to the server via their device along with new sentiment data. This allows for more detailed plan adjustments.

[0574] (Example 2)

[0575] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0576] In recent years, there has been a growing demand for systems that automatically provide optimal travel plans that take into account the individual emotions and specific needs of travelers. However, conventional systems have the drawback of failing to adequately reflect travelers' emotional states and only being able to provide uniform plans. As a result, it has been difficult to improve traveler satisfaction.

[0577] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0578] In this invention, the server includes means for receiving information provided by travelers and handling data including emotional information; means for generating a travel plan based on the received data and using a generative model that reflects the traveler's emotions in the generated plan; and means for booking and automating the itinerary via an external system based on the generated travel plan. This makes it possible to provide personalized travel plans that take into account the traveler's emotional state.

[0579] A "traveler" refers to an individual or group that plans and experiences a trip.

[0580] "Means of receiving information" refers to technical methods for receiving travel-related data and sentiment data provided by travelers.

[0581] "Emotional information" refers to quantifiable data that expresses a traveler's emotional state, such as their facial expressions and tone of voice.

[0582] A "generative model" refers to an algorithm or program that uses machine learning to create travel plans based on information provided by travelers.

[0583] "Methods of booking itineraries through external systems" refers to technologies that automatically arrange things like airline tickets and accommodations through external booking platforms.

[0584] "Notification and display means" refers to digital or analog devices used to visually or audibly communicate planning and booking information to travelers.

[0585] "Emotion-based guidance messages" refer to messages that take into account the traveler's emotional state and include information to support their travel planning and execution.

[0586] This invention is an advanced travel planning system for travelers that provides individually customized travel plans based on the user's emotional information. The system is based on a terminal, a server, and a generative AI model.

[0587] First, the user uses a device to input travel-related information. This device refers to a typical computer or mobile device, and its built-in camera and microphone can be used to acquire the user's emotional information. Emotional information is data that quantifies the user's emotions using facial recognition and voice analysis technologies.

[0588] Next, the terminal sends the collected data to the server. The server is a high-performance computing device that uses machine learning algorithms to create a travel plan based on the received data using a generative AI model. This AI model is integrated with existing databases and external booking systems accessed via the internet, and has the capability to make real-time itinerary reservations.

[0589] Finally, the results sent from the server are presented to the user via the terminal. These results include guidance messages based on the user's emotions, and visual or audio feedback is available. This allows the user to review and modify the suggested travel plan, and the plan is further optimized through this feedback.

[0590] For example, if a user provides information such as "I plan to visit Hawaii next month to seek relaxation," the system will automatically generate a travel plan that promotes relaxation. An example of a prompt message would be: "The user is feeling stressed and needs relaxation on their next trip. The destination is Hawaii, and please suggest a travel plan that includes quiet beaches and spas."

[0591] A system constructed in this way can improve the quality of travel by providing travelers with personalized and diverse travel experiences.

[0592] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0593] Step 1:

[0594] The user inputs travel information using a device. Specifically, they input information necessary for travel planning, such as destination, duration of visit, budget, and desired activities, into a dedicated application or web interface. Furthermore, the device uses a camera and microphone to collect the user's emotional information. As a result, the user's input information and emotional data are obtained as input.

[0595] Step 2:

[0596] Before sending collected user information and emotional data to the server, the terminal processes the data into a predetermined format and securely encrypts it. This process outputs data in a format suitable for external transmission.

[0597] Step 3:

[0598] The server receives data sent from the terminal and analyzes it using a database and a generative AI model. Specifically, it generates a travel plan based on user information and optimizes it by analyzing emotional data and reflecting it in the plan. In this process, if the user needs relaxation, data calculations are performed to incorporate quiet tourist destinations or spas with relaxing effects into the plan. The generated travel plan is obtained as output.

[0599] Step 4:

[0600] The server, based on the generated travel plan, integrates with an external booking system to automate the booking of necessary itineraries. Specifically, it handles flight bookings and hotel arrangements through an online platform. The completed booking information is output integrated into the plan.

[0601] Step 5:

[0602] The terminal receives the final travel plan sent from the server and displays it to the user in a visually easy-to-understand format. It also provides notifications that include guidance messages tailored to the user's emotions. This allows the user to review the proposed plan and receive the final details as output.

[0603] Step 6:

[0604] The user reviews the presented travel plan and requests changes or additions if necessary. In response, the terminal collects feedback from the user again and sends it to the server along with emotional data. Based on this input, the server optimizes the plan and outputs an updated plan.

[0605] (Application Example 2)

[0606] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0607] Traditional travel planning systems provide travel plans based on information entered by travelers, but they do not personalize them according to the traveler's emotions or circumstances, making it difficult to enhance the traveler's psychological satisfaction.

[0608] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0609] In this invention, the server includes a device that receives travel-related information and biometric data entered by the traveler, an information processing device that generates a travel plan that matches the traveler's emotional state based on the received information, and a processing device that confirms the itinerary via external reservation information based on the travel plan. This makes it possible to provide an optimal travel plan that is attentive to the traveler's emotions.

[0610] The term "traveler" refers to an individual involved in planning and carrying out a trip.

[0611] "Biometric data" refers to data that includes information about a traveler's emotions and physical condition, such as facial expressions and tone of voice.

[0612] "Device" refers to a mechanism or equipment designed to perform a specific function.

[0613] An "information processing device" is a device that has the ability to analyze received data and transform, store, or transmit that data according to a specific purpose.

[0614] "External booking information" refers to travel booking data obtained through other systems or services.

[0615] An "output device" is a device that provides information visually or audibly to inform the user of processed information.

[0616] This invention provides a concrete form for building a smart travel system that personalizes and optimizes the traveler's experience. The system receives the traveler's travel information and biometric data and uses them to generate a travel plan that responds to their emotions.

[0617] First, the device collects basic information from the traveler, such as destination, duration of visit, budget, and desired activities. It also acquires biometric data using a camera or voice input device for sentiment analysis. This data is sent to a system and analyzed by software such as Google Cloud Speech-to-Text and Face++ API.

[0618] Next, the server uses a generative AI model to generate plans that are tailored to the traveler's emotions. Based on the emotion analysis results obtained from the Face++ API, the plans are optimized to suggest quiet locations and spas for users seeking relaxation, and outdoor activities for users seeking active experiences.

[0619] Furthermore, this system utilizes external booking information to secure activities and facilities that require reservations. The information is encrypted and the process is automated through integration with external booking systems.

[0620] Users are notified of suggested travel plans and booking information through voice guidance generated by Google Text-to-Speech and through their device's display. Travelers can also add further requests based on this information.

[0621] For example, if a traveler says by voice, "I want to go somewhere relaxing on the weekend next month," the system receives this along with emotional data and makes a suggestion such as, "Have a relaxing weekend. We recommend a hot spring resort. Would you like to confirm your reservation?"

[0622] An example of a prompt for a generative AI model is, "If the user needs to relax, suggest a travel plan that includes quiet tourist spots and spas." This improves the accuracy of planning that aligns with the traveler's emotions.

[0623] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0624] Step 1:

[0625] The user enters basic travel information and biometric data into the device based on their consent. This information includes destination, duration of visit, budget, and desired activities. The device then detects the user's facial expressions and voice tone from video data captured by the camera and audio data captured by the microphone, collecting biometric data. This data is then transmitted to a server.

[0626] Step 2:

[0627] The server inputs the received travel information and biometric data, converts the audio data to text using Google Cloud Speech-to-Text, and analyzes the video data using the Face++ API to determine the user's emotional state. This analysis outputs emotional data indicating the desired travel atmosphere and emotional requirements of the user.

[0628] Step 3:

[0629] The server activates a generative AI model and generates a personalized travel plan using prompts based on the analyzed emotional data and travel preference information. For example, if the user is feeling stressed, it generates a plan that includes quiet and relaxing places, and outputs the generated plan information as data.

[0630] Step 4:

[0631] The server executes a process to proceed with booking by linking travel plans with external booking systems. Inputs include detailed travel plan information for each item requiring booking, and output is confirmation of booking completion. This automatically secures reservations for related facilities and activities.

[0632] Step 5:

[0633] The device receives the completed travel plan from the server and notifies the user of the travel plan and booking details via voice using Google Text-to-Speech and visually on the display. This is to allow the user to easily understand and decide on their next action. User feedback is sent back to the server as input to optimize the plan.

[0634] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0635] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0636] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0637] [Fourth Embodiment]

[0638] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0639] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0640] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0641] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0642] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0643] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0644] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0645] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0646] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0647] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0648] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0649] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0650] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0651] As an embodiment of this invention, a method for supporting travel planning using a smart travel agent system will be described.

[0652] Overall flow:

[0653] User: Access a dedicated application or web interface and enter basic travel information. This information includes details such as destination, desired total budget, travel duration, characteristics of travel companions (age and number), and activities you wish to experience.

[0654] Terminal: Sends information obtained from the user to the server. The information is pre-formatted and encrypted during server communication.

[0655] Server: Analyzes received data and automatically generates the optimal travel plan through an AI-powered generative model. This generative model optimizes the plan by integrating past travel databases, current tourist information, trends in accommodations and flights, and local special offers based on user-specified parameters.

[0656] Server: After automatically generating a plan, it uses an external online booking system to execute the booking process for flights, accommodations, and various activities. It not only checks the booking status but also performs the necessary processing to confirm the actual booking.

[0657] Device: The completed travel plan and confirmed booking information are immediately sent to the user via push notification. The confirmation screen also displays discount information and important notes regarding the travel destination.

[0658] Users can review the provided travel plan and request changes or adjustments as needed. There is also a function to provide feedback on the plan.

[0659] Specific example:

[0660] For example, if a user enters, "I want to plan a family trip to Hawaii next month (2 adults, 2 children) for under 200,000 yen. The trip will last 4 days, and we want to enjoy beach activities and theme parks," the system will instantly gather local information about Hawaii and propose the best plan that meets the requirements. The generated plan will include cost-effective flights, recommended beachfront hotels, snorkeling activities, and theme park admission arrangements, all of which the user can view with a single click. The system will also notify the user of any applicable perks or discounts.

[0661] In this way, it becomes possible to create customized travel plans that significantly reduce the burden on travelers.

[0662] The following describes the processing flow.

[0663] Step 1:

[0664] Users enter detailed information about their travel preferences into the application or web interface. Specifically, they include their travel destination, desired budget, travel duration, information about travel companions, and activities they wish to experience.

[0665] Step 2:

[0666] The terminal receives information entered by the user and converts it into a data format for transmission to the server. This information is encrypted and sent to the server via the network.

[0667] Step 3:

[0668] The server analyzes the data received from the terminal and prepares it for input into the travel plan generation model. The data is formatted as queries and applied to the internal travel database and external real-time information sources.

[0669] Step 4:

[0670] The server runs an AI-powered generative model to automatically generate optimized travel plans based on the received information. This model integrates data from various sources to create plans that match the user's preferences and budget.

[0671] Step 5:

[0672] The server uses the generated travel plan to coordinate with external booking systems to complete the necessary bookings. This includes confirming reservations for flights, accommodations, and activities.

[0673] Step 6:

[0674] The server compiles the finalized travel plan, booking information, and related discount offers, and sends them to the terminal.

[0675] Step 7:

[0676] The terminal notifies the user of information received from the server and displays it visually. The user can review the plan details and make adjustments or additional requests as needed.

[0677] Step 8:

[0678] In response to user feedback or additional requests, the device resends information to the server. It receives new information as needed and displays it to the user again.

[0679] (Example 1)

[0680] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0681] When planning a trip, it is necessary to reduce the complexity of gathering information, selecting the optimal itinerary, and booking procedures. Traditional methods require using different information sources and manually adjusting each step, which is burdensome for users and inefficient. In particular, providing customized plans that meet the needs of travelers has been difficult.

[0682] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0683] In this invention, the server includes means for acquiring traveler input and receiving travel-related data, means for formatting and encrypting the received data and transmitting it to a central processing unit, and means for generating an optimal travel plan using a generative model that integrates past travel data, the latest tourist information, accommodation, and transportation. This enables the automatic generation of an optimal travel plan based on the traveler's conditions and the efficient execution of booking procedures.

[0684] A "traveler" refers to an individual who plans, books, or carries out a trip.

[0685] "Data" refers to numerical or textual information that makes up information related to travel, such as destinations, budgets, dates, and desired activities.

[0686] "Formatting" refers to the process of converting data into a format that is easily interpretable by a central processing unit or system.

[0687] "Encryption" refers to a technology that uses specific algorithms to protect information in order to safeguard data from unauthorized access.

[0688] The term "central processing unit" refers to the core component of a computer system that processes, stores, and manages data.

[0689] A "generative model" refers to an AI-based program that integrates multiple data sources and creates travel plans based on user conditions.

[0690] A "travel plan" refers to the overall schedule proposed for travelers, including details of destinations, itinerary, accommodations, transportation, and activities.

[0691] A "reservation system" refers to an online platform that allows users to remotely book transportation, accommodation, or activities.

[0692] "Notification" refers to a means of communication that delivers the generated travel plan and related booking information to the traveler's device.

[0693] As an embodiment of this invention, a method for supporting travel planning using a smart travel agent system is described below.

[0694] User actions:

[0695] Users access an application or web interface for travel planning and enter travel information. This information includes destination, desired total budget, number of travel days, characteristics of travel companions (age, number), and details of activities they wish to experience. This establishes the basis for a customized travel plan tailored to individual needs.

[0696] Terminal processing:

[0697] The terminal receives information provided by the user, converts it to a pre-configured format, and then sends it to the server using encryption technology (e.g., SSL / TLS protocol) to ensure data security. This makes it possible to transmit information with peace of mind.

[0698] Server processing:

[0699] The server analyzes data received from the terminal and uses an AI-powered generative model to generate an optimal travel plan. Specifically, it integrates past travel data, the latest tourist information, and trends in accommodation and transportation, and customizes the plan according to the conditions set by the user. The generative model provides the best choices, especially based on the traveler's budget, preferences, and purpose.

[0700] Specific example:

[0701] For example, suppose a user enters the following: "Please create a travel plan for a family of four to Hawaii next month, with a budget of under 200,000 yen. We would like to enjoy beach activities and visit theme parks." In this case, the system will generate a plan that incorporates local Hawaiian tourist information, flights, accommodations, and suitable activities based on the budget. The user can then quickly understand the overall picture of the trip through the generated plan and review the options for booking the suggested activities.

[0702] This allows travelers to plan efficiently and make arrangements seamlessly. Based on a generative AI model, the system provides plans tailored to travelers' needs, reducing the burden of travel planning and enabling a more fulfilling travel experience.

[0703] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0704] Step 1:

[0705] User: Users use a travel planning application or web interface to input information such as destination, budget, duration, travel companions, and desired activities. This input information forms the basis for system processing.

[0706] Step 2:

[0707] Terminal: The terminal converts information obtained from the user into a specified format and protects the data using encryption technology. This enables secure communication and prevents information leakage when transmitted to the server. The input is travel information from the user, and the output is formatted encrypted data.

[0708] Step 3:

[0709] Server: The server receives encrypted data from the terminal, decrypts it, and retrieves the original travel information. This data serves as the basic input for analysis and the creation of optimized travel plans. The output is a dataset for analysis.

[0710] Step 4:

[0711] Server: The server inputs the analyzed data into an AI generation model to generate a travel plan optimized for the traveler's conditions. The generation AI model utilizes historical travel data and current tourist information to suggest the most suitable flights, accommodation options, and activities. The output is the travel plan suggested to the user.

[0712] Step 5:

[0713] Server: Based on the generated travel plan, the server interfaces with external booking systems to make necessary reservations. The server uses APIs to check the booking status of flights, accommodations, and activities in real time and confirm reservations as needed. The output is the booking confirmation information.

[0714] Step 6:

[0715] Terminal: Receives travel plans and booking information sent from the server and displays it to the user's device via push notifications. The terminal updates the user dashboard, including detailed plan information, discount offers, and important notes. It performs actions to allow the user to quickly view the information. The output is the displayed travel plan and booking details.

[0716] Step 7:

[0717] User: Users review information received via push notifications and send plan changes or feedback as needed. This allows users to adjust their plans, and the app generates prompts to reflect those changes. User interaction helps in creating the next plan.

[0718] (Application Example 1)

[0719] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0720] Modern travelers have to process a vast amount of information, from planning their trips to managing reservations, and the associated tasks are a significant burden. Furthermore, they need to individually research transportation options and discount information at their destinations, hindering an efficient travel experience. Therefore, there is a need for a system that allows travelers to enjoy their trips more efficiently and comfortably.

[0721] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0722] In this invention, the server includes means for receiving travel information entered by the traveler, means for utilizing a generative model that automatically generates a travel plan based on the received information, means for booking the itinerary via an external booking system based on the automatically generated travel plan, and means for integrating urban transportation information and reward information and recommending them to the traveler. This enables travelers to seamlessly create travel plans and to efficiently move around and utilize rewards at their destination.

[0723] A "traveler" refers to someone who plans and executes a trip.

[0724] "Means of receiving information" refers to an interface for acquiring travel-related data provided by travelers.

[0725] "Using generative models" refers to methods of creating travel plans using artificial intelligence and algorithms based on input information.

[0726] An "external reservation system" refers to an internet-based service that allows users to make online reservations for accommodations, transportation, and other services.

[0727] "Urban transportation information" refers to data on public transportation and means of transport in the city you are visiting.

[0728] "Special offers" refers to information about discounts and services that can be used during your trip.

[0729] "Automatically generating a plan" refers to the process where the system automatically creates the optimal travel plan based on the conditions set by the traveler.

[0730] In this invention, travelers input travel information via a device such as a smartphone or tablet. When the user enters their destination, budget, travel duration, and desired activities into a dedicated application, the device encrypts that information and transmits it to a server.

[0731] The server uses artificial intelligence systems, such as a "generative AI model," to analyze the received data. The AI ​​references past travel data and the latest tourist information to create the optimal travel plan based on the user's conditions. This generative model integrates with a database to streamline the plan creation process and consolidate necessary information.

[0732] Next, based on the automatically generated travel plan, the server connects with an external online booking system to execute the process of booking flights, accommodations, and activities. During this process, the entire process, from checking the booking status to confirming it, is handled in a single step.

[0733] The device will send push notifications to the user presenting completed travel plans and confirmed booking information. Furthermore, the plans will include information on local transportation and available benefits, allowing users to travel smoothly at their destination and take advantage of discounts and other benefits.

[0734] For example, if a family traveler sets conditions such as, "We want to visit tourist destination A next month. Our budget is under 100,000 yen, and we want to enjoy nature exploration and museum visits," the AI ​​will suggest the optimal flights, accommodations, and sightseeing routes at the destination. Transportation information and special offers are integrated, including local public transport passes and museum admission discounts. In this way, travelers can easily enjoy detailed travel plans.

[0735] An example of a prompt message would be: "The user is planning a trip to tourist destination A. Their budget is 100,000 yen, and they would like to explore nature and visit art museums. Based on these conditions, please suggest the best travel plan."

[0736] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0737] Step 1:

[0738] Users enter travel information into a dedicated application on their smartphones. This information includes destination, budget, travel duration, and desired activities. This entered data is properly formatted and encrypted within the device.

[0739] Step 2:

[0740] The terminal sends encrypted travel information to the server. The server decrypts the received data, identifies the necessary information, and prepares it for analysis. The input here is the traveler's information data, and the output is the data to be analyzed.

[0741] Step 3:

[0742] The server utilizes a generation AI model to automatically generate optimal travel plans based on the data being analyzed. The AI ​​model refers to past travel databases and current tourist information to generate plans that match the user's requests. In plan generation, the input data is used to output an optimized travel plan.

[0743] Step 4:

[0744] Based on the generated travel plan, the server interacts with an external booking system to execute the necessary booking procedures (flights, accommodations, activities). Based on the booking confirmation received from the booking system, the server updates and finalizes the booking information. The input is the travel plan, and the output is the finalized booking information.

[0745] Step 5:

[0746] The server sends the confirmed travel plan and booking information to the device. The device receives this information and presents it to the user via push notification. The input here is data from the server, and the output is the travel plan and booking information that the user can verify.

[0747] Step 6:

[0748] Users review the travel plan provided through their device and provide feedback requesting changes or adjustments as needed. The feedback function sends the user's change requests from the device to the server. The input is the user's feedback information, and the output is the updated plan.

[0749] Step 7:

[0750] The server receives user feedback and uses the generated AI model to adjust the plan again. During this process, necessary data calculations are performed, and the plan is updated to the optimal configuration. The final generated plan is then presented to the user.

[0751] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0752] As a specific embodiment for carrying out the present invention, a smart travel agent system integrating an emotion engine will be described. In this system, in the process of receiving input information from the user and proposing a travel plan, the emotion engine is used to make personalized suggestions that take the user's emotions into consideration.

[0753] Overall flow:

[0754] User: When starting to plan a trip, users enter basic travel information through a dedicated application or web interface. This includes data such as destination, duration of visit, budget, and desired activities. Furthermore, with the user's consent, the device collects emotional data using the camera and microphone. This includes methods of analyzing emotions from facial expressions and tone of voice.

[0755] Terminal: Sends travel information and sentiment data entered by the user to the server. The information is pre-formatted and encrypted over the network.

[0756] Server: Analyzes received travel information and emotional data to generate an AI-optimized travel plan. During this process, the emotional engine analyzes the user's emotions and incorporates them into the plan. For example, if the user needs relaxation, quiet tourist destinations and spa activities will be prioritized.

[0757] Server: The generated travel plan is integrated with an external booking system to automate the booking process for the necessary itinerary. The final plan is compiled, including information on completed bookings.

[0758] Terminal: Notifies the user of the complete travel plan, booking confirmation information, and related discount offers sent from the server. This includes visual displays and user-friendly, emotionally resonant messages.

[0759] User: You can review the proposed travel plan and request changes or additions as needed. User feedback, along with sentiment data, is sent back to the server to optimize the plan.

[0760] Specific example:

[0761] For example, if a user provides information such as, "I'm planning to visit Hawaii next month to relieve stress and seek some quiet time," the system uses its emotion engine to automatically generate a plan that includes relaxing spas and tranquil beaches. Furthermore, the plan incorporates a special relaxation package in addition to the regular sightseeing schedule. This provides a personalized travel experience that enhances the user's psychological satisfaction.

[0762] In this form, the present invention provides customized plans that respond to the traveler's emotions, thereby improving the quality of travel.

[0763] The following describes the processing flow.

[0764] Step 1:

[0765] Users enter basic information such as their travel destination, budget, travel duration, and desired activities into a dedicated application or web interface. Furthermore, only with their consent, the emotion engine collects emotional data from the user's facial expressions and voice tone using the camera and microphone.

[0766] Step 2:

[0767] The device sends the information entered by the user and the collected sentiment data to the server as a single data package. The information sent is encrypted to protect the privacy of the sentiment data.

[0768] Step 3:

[0769] The server analyzes the received travel information and sets the basic conditions for generating a travel plan. At the same time, it analyzes emotional data using an emotion engine and uses the results as parameters when generating the plan.

[0770] Step 4:

[0771] Based on the analyzed emotional data, the server uses AI to automatically generate travel plans tailored to the user's emotional state. For example, if the analysis indicates that the user is seeking relaxation, it will generate a plan that includes accommodation in quiet areas and relaxation activities.

[0772] Step 5:

[0773] The server interfaces with an external booking system based on the generated travel plan, automatically checking the availability of necessary accommodations, flights, and activities, and confirming the bookings.

[0774] Step 6:

[0775] The server compiles the finalized travel plan, booking confirmation, and discount offer information, and sends it to the user's device along with a personalized message tailored to their emotions.

[0776] Step 7:

[0777] The terminal notifies the user of information sent from the server and displays plan and reservation information in an intuitive and easy-to-understand interface. This allows the user to review and adjust their plans.

[0778] Step 8:

[0779] Users review the provided travel plan, make any necessary modifications or provide feedback, and send it to the server via their device along with new sentiment data. This allows for more detailed plan adjustments.

[0780] (Example 2)

[0781] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0782] In recent years, there has been a growing demand for systems that automatically provide optimal travel plans that take into account the individual emotions and specific needs of travelers. However, conventional systems have the drawback of failing to adequately reflect travelers' emotional states and only being able to provide uniform plans. As a result, it has been difficult to improve traveler satisfaction.

[0783] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0784] In this invention, the server includes means for receiving information provided by travelers and handling data including emotional information; means for generating a travel plan based on the received data and using a generative model that reflects the traveler's emotions in the generated plan; and means for booking and automating the itinerary via an external system based on the generated travel plan. This makes it possible to provide personalized travel plans that take into account the traveler's emotional state.

[0785] A "traveler" refers to an individual or group that plans and experiences a trip.

[0786] "Means of receiving information" refers to technical methods for receiving travel-related data and sentiment data provided by travelers.

[0787] "Emotional information" refers to quantifiable data that expresses a traveler's emotional state, such as their facial expressions and tone of voice.

[0788] A "generative model" refers to an algorithm or program that uses machine learning to create travel plans based on information provided by travelers.

[0789] "Methods of booking itineraries through external systems" refers to technologies that automatically arrange things like airline tickets and accommodations through external booking platforms.

[0790] "Notification and display means" refers to digital or analog devices used to visually or audibly communicate planning and booking information to travelers.

[0791] "Emotion-based guidance messages" refer to messages that take into account the traveler's emotional state and include information to support their travel planning and execution.

[0792] This invention is an advanced travel planning system for travelers that provides individually customized travel plans based on the user's emotional information. The system is based on a terminal, a server, and a generative AI model.

[0793] First, the user uses a device to input travel-related information. This device refers to a typical computer or mobile device, and its built-in camera and microphone can be used to acquire the user's emotional information. Emotional information is data that quantifies the user's emotions using facial recognition and voice analysis technologies.

[0794] Next, the terminal sends the collected data to the server. The server is a high-performance computing device that uses machine learning algorithms to create a travel plan based on the received data using a generative AI model. This AI model is integrated with existing databases and external booking systems accessed via the internet, and has the capability to make real-time itinerary reservations.

[0795] Finally, the results sent from the server are presented to the user via the terminal. These results include guidance messages based on the user's emotions, and visual or audio feedback is available. This allows the user to review and modify the suggested travel plan, and the plan is further optimized through this feedback.

[0796] For example, if a user provides information such as "I plan to visit Hawaii next month to seek relaxation," the system will automatically generate a travel plan that promotes relaxation. An example of a prompt message would be: "The user is feeling stressed and needs relaxation on their next trip. The destination is Hawaii, and please suggest a travel plan that includes quiet beaches and spas."

[0797] A system constructed in this way can improve the quality of travel by providing travelers with personalized and diverse travel experiences.

[0798] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0799] Step 1:

[0800] The user inputs travel information using a device. Specifically, they input information necessary for travel planning, such as destination, duration of visit, budget, and desired activities, into a dedicated application or web interface. Furthermore, the device uses a camera and microphone to collect the user's emotional information. As a result, the user's input information and emotional data are obtained as input.

[0801] Step 2:

[0802] Before sending collected user information and emotional data to the server, the terminal processes the data into a predetermined format and securely encrypts it. This process outputs data in a format suitable for external transmission.

[0803] Step 3:

[0804] The server receives data sent from the terminal and analyzes it using a database and a generative AI model. Specifically, it generates a travel plan based on user information and optimizes it by analyzing emotional data and reflecting it in the plan. In this process, if the user needs relaxation, data calculations are performed to incorporate quiet tourist destinations or spas with relaxing effects into the plan. The generated travel plan is obtained as output.

[0805] Step 4:

[0806] The server, based on the generated travel plan, integrates with an external booking system to automate the booking of necessary itineraries. Specifically, it handles flight bookings and hotel arrangements through an online platform. The completed booking information is output integrated into the plan.

[0807] Step 5:

[0808] The terminal receives the final travel plan sent from the server and displays it to the user in a visually easy-to-understand format. It also provides notifications that include guidance messages tailored to the user's emotions. This allows the user to review the proposed plan and receive the final details as output.

[0809] Step 6:

[0810] The user reviews the presented travel plan and requests changes or additions if necessary. In response, the terminal collects feedback from the user again and sends it to the server along with emotional data. Based on this input, the server optimizes the plan and outputs an updated plan.

[0811] (Application Example 2)

[0812] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0813] Traditional travel planning systems provide travel plans based on information entered by travelers, but they do not personalize them according to the traveler's emotions or circumstances, making it difficult to enhance the traveler's psychological satisfaction.

[0814] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0815] In this invention, the server includes a device that receives travel-related information and biometric data entered by the traveler, an information processing device that generates a travel plan that matches the traveler's emotional state based on the received information, and a processing device that confirms the itinerary via external reservation information based on the travel plan. This makes it possible to provide an optimal travel plan that is attentive to the traveler's emotions.

[0816] The term "traveler" refers to an individual involved in planning and carrying out a trip.

[0817] "Biometric data" refers to data that includes information about a traveler's emotions and physical condition, such as facial expressions and tone of voice.

[0818] "Device" refers to a mechanism or equipment designed to perform a specific function.

[0819] An "information processing device" is a device that has the ability to analyze received data and transform, store, or transmit that data according to a specific purpose.

[0820] "External booking information" refers to travel booking data obtained through other systems or services.

[0821] An "output device" is a device that provides information visually or audibly to inform the user of processed information.

[0822] This invention provides a concrete form for building a smart travel system that personalizes and optimizes the traveler's experience. The system receives the traveler's travel information and biometric data and uses them to generate a travel plan that responds to their emotions.

[0823] First, the device collects basic information from the traveler, such as destination, duration of visit, budget, and desired activities. It also acquires biometric data using a camera or voice input device for sentiment analysis. This data is sent to a system and analyzed by software such as Google Cloud Speech-to-Text and Face++ API.

[0824] Next, the server uses a generative AI model to generate plans that are tailored to the traveler's emotions. Based on the emotion analysis results obtained from the Face++ API, the plans are optimized to suggest quiet locations and spas for users seeking relaxation, and outdoor activities for users seeking active experiences.

[0825] Furthermore, this system utilizes external booking information to secure activities and facilities that require reservations. The information is encrypted and the process is automated through integration with external booking systems.

[0826] Users are notified of suggested travel plans and booking information through voice guidance generated by Google Text-to-Speech and through their device's display. Travelers can also add further requests based on this information.

[0827] For example, if a traveler says by voice, "I want to go somewhere relaxing on the weekend next month," the system receives this along with emotional data and makes a suggestion such as, "Have a relaxing weekend. We recommend a hot spring resort. Would you like to confirm your reservation?"

[0828] An example of a prompt for a generative AI model is, "If the user needs to relax, suggest a travel plan that includes quiet tourist spots and spas." This improves the accuracy of planning that aligns with the traveler's emotions.

[0829] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0830] Step 1:

[0831] The user enters basic travel information and biometric data into the device based on their consent. This information includes destination, duration of visit, budget, and desired activities. The device then detects the user's facial expressions and voice tone from video data captured by the camera and audio data captured by the microphone, collecting biometric data. This data is then transmitted to a server.

[0832] Step 2:

[0833] The server inputs the received travel information and biometric data, converts the audio data to text using Google Cloud Speech-to-Text, and analyzes the video data using the Face++ API to determine the user's emotional state. This analysis outputs emotional data indicating the desired travel atmosphere and emotional requirements of the user.

[0834] Step 3:

[0835] The server activates a generative AI model and generates a personalized travel plan using prompts based on the analyzed emotional data and travel preference information. For example, if the user is feeling stressed, it generates a plan that includes quiet and relaxing places, and outputs the generated plan information as data.

[0836] Step 4:

[0837] The server executes a process to proceed with booking by linking travel plans with external booking systems. Inputs include detailed travel plan information for each item requiring booking, and output is confirmation of booking completion. This automatically secures reservations for related facilities and activities.

[0838] Step 5:

[0839] The device receives the completed travel plan from the server and notifies the user of the travel plan and booking details via voice using Google Text-to-Speech and visually on the display. This is to allow the user to easily understand and decide on their next action. User feedback is sent back to the server as input to optimize the plan.

[0840] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0841] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0842] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0843] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0844] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0845] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0846] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0847] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0848] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0849] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0850] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0851] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0852] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0853] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0854] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0855] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0856] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0857] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0858] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0859] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0860] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0861] The following is further disclosed regarding the embodiments described above.

[0862] (Claim 1)

[0863] A means of receiving travel information entered by travelers,

[0864] A means of using a generative model that automatically generates travel plans based on received information,

[0865] A method of booking an itinerary via an external booking system based on an automatically generated travel plan,

[0866] A means of displaying the generated plan and reservation information to travelers,

[0867] A system that includes this.

[0868] (Claim 2)

[0869] The system according to claim 1, which uses sensor data to suggest the most suitable activities during a trip based on the traveler's current situation.

[0870] (Claim 3)

[0871] The system according to claim 1, which displays discount offer information when providing travel plans and reservation information.

[0872] "Example 1"

[0873] (Claim 1)

[0874] A means of obtaining traveler input and receiving travel-related data,

[0875] A means of formatting and encrypting the received data and then transmitting it to a central processing unit,

[0876] A means for generating an optimal travel plan using a generative model that integrates past travel data, the latest tourist information, accommodation, and transportation methods,

[0877] A means of communicating with an external booking system based on an automatically generated travel plan and making the necessary itinerary reservations,

[0878] Means for notifying and displaying the generated plan and confirmed booking information to the traveler,

[0879] A system that includes this.

[0880] (Claim 2)

[0881] The system according to claim 1, comprising means for collecting feedback from travelers and using it to improve travel plans.

[0882] (Claim 3)

[0883] The system according to claim 1, which displays available benefits information when providing travel plans and reservation information.

[0884] "Application Example 1"

[0885] (Claim 1)

[0886] A means of receiving travel information entered by travelers,

[0887] A means of using a generative model that automatically generates travel plans based on received information,

[0888] A method of booking an itinerary via an external booking system based on an automatically generated travel plan,

[0889] A means of displaying the generated plan and reservation information to travelers,

[0890] A means of integrating urban transportation information and special offers and recommending them to travelers,

[0891] A system that includes this.

[0892] (Claim 2)

[0893] The system according to claim 1, which uses sensor data to suggest the most suitable activities during a trip based on the traveler's current situation.

[0894] (Claim 3)

[0895] The system according to claim 1, which, when providing travel plans and reservation information, also displays discount offer information and information on local transportation within the city.

[0896] "Example 2 of combining an emotion engine"

[0897] (Claim 1)

[0898] A means of receiving information provided by travelers and handling data including emotional information,

[0899] A means of generating a travel plan based on received data and using a generative model that reflects the traveler's emotions in the generated plan,

[0900] Based on the generated travel plan, a means of booking and automating the itinerary via an external system,

[0901] A means of notifying and displaying to travelers the generated plans, booking information, and related benefits,

[0902] A system that includes this.

[0903] (Claim 2)

[0904] The system according to claim 1, comprising means for analyzing the emotional state of travelers and for personalizing their travel experience.

[0905] (Claim 3)

[0906] The system according to claim 1, comprising means for displaying emotion-based guidance messages when providing travel plans and reservation information.

[0907] "Application example 2 when combining with an emotional engine"

[0908] (Claim 1)

[0909] A device that receives travel information and biometric data entered by travelers,

[0910] An information processing device that generates individual travel plans that match the emotional state of travelers based on the information received,

[0911] A processing unit that confirms the itinerary based on the travel plan and via external booking information,

[0912] An output device that notifies travelers of information visually and aurally,

[0913] A system that includes this.

[0914] (Claim 2)

[0915] The system according to claim 1, which uses the results of sentiment analysis to make suggestions tailored to the traveler's preferences.

[0916] (Claim 3)

[0917] The system according to claim 1, which provides personalized notifications when offering travel plans that include special offers. [Explanation of Symbols]

[0918] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means of receiving travel information entered by travelers, A means of using a generative model that automatically generates travel plans based on received information, A method of booking an itinerary via an external booking system based on an automatically generated travel plan, A means of displaying the generated plan and reservation information to travelers, A means of integrating urban transportation information and special offers and recommending them to travelers, A system that includes this.

2. The system according to claim 1, which uses sensor data to suggest the most suitable activities during a trip based on the traveler's current situation.

3. The system according to claim 1, which, when providing travel plans and reservation information, also displays discount offer information and information on local transportation within the city.

Images