System

Abstract

A system is provided.SOLUTION: A system comprising: means for collecting basic information and preference information of a user; means for recommending a travel destination and a sightseeing spot based on the basic information and the preference information; and means for automatically generating and displaying a travel plan including the travel destination and the sightseeing spot.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Traditional travel planning requires a lot of time and effort, making it stressful for users. Furthermore, a lack of on-site support often makes it difficult to resolve problems during a trip. For example, factors such as weather changes or reservation cancellations can prevent users from enjoying their trip as planned. Furthermore, gathering information on tourist destinations and cultural assets is complicated, requiring real-time updates. Rapid and appropriate responses are especially required in emergencies, but current systems struggle to meet these demands. [Means for solving the problem]

[0005] The present invention provides a system that collects a user's basic information and preference information and recommends travel destinations and tourist spots based on the collected information. It also includes a means for automatically generating and displaying a travel plan. The system also includes a means for monitoring weather information and reservation status in real time and adjusting the travel plan. It also includes a means for providing virtual reality and augmented reality data of tourist spots and cultural properties and distributing them to a terminal. The system also includes a means for processing reservations and payments in a unified manner by linking with multiple travel service platforms. It also includes a means for monitoring emergency information and responding to health or traffic issues, and a means for implementing emergency response by linking with rescue organizations. This makes it possible to improve the efficiency of travel planning, resolve problems during travel, and provide users with a comfortable travel experience.

[0006] "Basic user information" refers to basic data about the traveler, including name, age, sex, nationality, etc.

[0007] "Preference information" is data about a traveler's individual preferences and interests regarding travel, including areas of interest, budget, travel style, etc.

[0008] "Destination" refers to the place or city that a traveler intends to visit.

[0009] "Tourist attractions" refer to places and famous places that are recommended to be visited while traveling.

[0010] A "travel plan" refers to a schedule that organizes the activities and places a traveler plans to visit during their stay, along with time allocation.

[0011] "Real-time" refers to the immediate processing and reflection of ongoing situations and data.

[0012] "Virtual reality data" refers to digital information generated using computer technology that allows users to visually experience an environment similar to reality.

[0013] "Augmented reality data" refers to digital information provided using technology that visualizes digital information overlaid on a real-world environment.

[0014] "Travel service platform" refers to an online system or website that provides travel-related services (such as reservations, accommodation, and tourist tickets).

[0015] "Reservation" means a traveler's advance arrangement to use a particular service.

[0016] "Payment" refers to the process by which a traveller pays money for the services booked.

[0017] "Emergency information" refers to information about urgent situations that arise during travel, such as health problems or traffic troubles.

[0018] "Rescue agencies" refer to organizations and facilities (hospitals, police, fire departments, etc.) that respond to emergencies.

[0019] "Health Issues" refers to any physical ailment or illness that may arise during travel.

[0020] "Transportation troubles" refer to problems such as delays, cancellations, and accidents during travel. [Brief explanation of the drawings]

[0021] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5]FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0022] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0023] First, the terms used in the following description will be explained.

[0024] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0025] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0026] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0027] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0028] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0029] [First embodiment]

[0030] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0031] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0032] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0033] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0034] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0035] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0036] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0037] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0038] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0039] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0040] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0041] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0042] The present invention is a system for recommending, planning, and adjusting smart travel plans according to travelers' needs, and is implemented as follows.

[0043] Creating a User Profile

[0044] A user accesses the application or web interface using a device (smartphone, tablet, PC, etc.) and enters basic information (name, age, gender, nationality, etc.) and travel preferences (areas of interest, budget, travel style, etc.). This information is sent to the server and stored in a database as a profile.

[0045] Automatic travel plan generation

[0046] The server references the database based on the saved user profile and automatically recommends travel destinations and tourist spots that match the user's preferences. Based on the recommended information, the server automatically generates a travel plan and creates a travel schedule. The device displays the generated travel plan to the user, who can check and modify it.

[0047] Real-time adjustments

[0048] The server monitors weather information and reservation status in real time and adjusts travel plans as needed based on the information it obtains. For example, if the weather worsens, the server will change the schedule and notify the device of the new plans. This allows users to always keep up to date with their travel plans.

[0049] Providing digital travel experiences

[0050] The server generates virtual reality (VR) and augmented reality (AR) data of tourist spots and cultural assets and distributes it to devices. Users can view this digital data on their devices and virtually experience tourist spots, thereby gaining a deeper understanding and enjoyment during their trip.

[0051] Reservation and payment

[0052] The server connects with multiple travel service platforms to make reservations for recommended tourist spots and accommodations in one place. The server also processes all payments for reservations and displays the results on the terminal. This allows users to skip the cumbersome process of going through multiple platforms and make reservations and payments easily.

[0053] Emergency support

[0054] The server monitors emergency information in real time and responds quickly if a health or traffic problem occurs during travel. The server connects with appropriate rescue agencies (hospitals, police, fire department, etc.) and coordinates rescue efforts. The device notifies the user of emergency response details and provides necessary instructions to ensure the user's safety.

[0055] Specific examples

[0056] For example, if a user is planning a trip from Japan to Paris, France, the following process is executed:

[0057] 1. The user enters their basic information and travel preferences into the terminal, and the server stores it in a database.

[0058] 2. The server recommends Paris and selects tourist spots such as the Eiffel Tower and the Louvre. An itinerary is automatically generated and displayed on the device.

[0059] 3. The server monitors weather information before and during the trip, and if the weather worsens, adjusts the schedule and notifies the terminal.

[0060] 4. The server generates VR and AR data for the tourist spot and distributes it to the device, allowing the user to enjoy the virtual experience.

[0061] 5. The server then makes all the bookings for accommodation and sightseeing tickets, processes the payments, and displays the results on the terminal.

[0062] 6. If the user reports a health issue during the trip, the server will initiate an emergency response and coordinate with the appropriate rescue agency for immediate action. The device will provide detailed instructions to the user.

[0063] With the above functions, users can enjoy a stress-free and comfortable travel experience. The present invention is a system for improving the efficiency of travel planning and resolving problems during travel, and it achieves significant improvements over conventional travel procedures.

[0064] The processing flow will be explained below.

[0065] Step 1:

[0066] A user accesses an application or web interface using a device (smartphone, tablet, PC, etc.) and enters basic information (name, age, gender, nationality, etc.).

[0067] Step 2:

[0068] Users input their areas of interest (history, nature, culture, etc.), budget, and travel style (adventure, relaxation, etc.) into the terminal.

[0069] Step 3:

[0070] The terminal transmits the input basic information and preference information to the server.

[0071] Step 4:

[0072] The server creates a user profile based on the received information and stores it in a database.

[0073] Step 5:

[0074] The server refers to the database and recommends travel destinations that match the user's preferences.

[0075] Step 6:

[0076] The server selects tourist attractions and activities from the recommended travel destinations.

[0077] Step 7:

[0078] The server automatically generates a travel plan based on tourist attractions and activities and creates a schedule.

[0079] Step 8:

[0080] The terminal displays the generated travel plan to the user, who can then confirm and modify the plan.

[0081] Step 9:

[0082] The server monitors weather information and reservation status in real time.

[0083] Step 10:

[0084] If the server detects changes in weather or reservations, it adjusts travel plans and updates schedules.

[0085] Step 11:

[0086] The terminal notifies the user of the updated schedule and allows the user to confirm it.

[0087] Step 12:

[0088] The server prepares virtual reality (VR) and augmented reality (AR) data of tourist attractions and cultural properties.

[0089] Step 13:

[0090] The server delivers VR and AR data to the device.

[0091] Step 14:

[0092] Users use the device to view VR and AR data and enjoy the virtual experience.

[0093] Step 15:

[0094] The server works in conjunction with the travel service platform to arrange reservations for accommodation and sightseeing tickets all at once.

[0095] Step 16:

[0096] The server calculates the total cost for the reservation and processes the payment in one lump sum.

[0097] Step 17:

[0098] The terminal displays a confirmation of the reservation completion to the user.

[0099] Step 18:

[0100] The server monitors emergency information occurring during travel in real time.

[0101] Step 19:

[0102] If the server detects an emergency (health problem or traffic trouble), it will coordinate with appropriate rescue agencies and implement emergency response.

[0103] Step 20:

[0104] The device will notify the user of emergency response details and provide necessary instructions.

[0105] Example 1

[0106] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0107] Traditionally, planning a trip has involved a lot of time-consuming and laborious tasks, such as gathering destination information, creating an itinerary, making reservations and payments, and even responding to emergencies. In addition, systems lacked the ability to monitor weather information and reservation status in real time, adjust travel plans as needed, and provide a digital experience. There is a need for more advanced systems that can solve these problems and allow users to enjoy stress-free, comfortable travel.

[0108] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0109] In this invention, the server includes means for collecting basic information and preference information of a user, means for recommending travel destinations and tourist attractions based on the basic information and preference information, means for automatically generating and displaying a travel itinerary including the travel destinations and tourist attractions, means for monitoring weather information and reservation status in real time and adjusting the travel itinerary, means for generating virtual reality data and augmented reality data of tourist attractions and distributing and displaying them to a user terminal, means for processing reservations and payments for travel services, and means for monitoring and responding to emergency information. This allows users to plan, execute, and respond to emergency situations all in one system, allowing them to enjoy a stress-free and comfortable trip.

[0110] "User" means an individual or organization that uses the system.

[0111] "Basic information" refers to personal data such as the user's name, age, gender, and nationality.

[0112] "Preference information" is data relating to the user's preferences such as areas of interest, budget, and travel style.

[0113] A "travel destination" is a destination such as a city or region that the user wants to visit.

[0114] "Tourist destinations" are famous places and tourist spots that are worth visiting when traveling.

[0115] A "travel plan" is a detailed itinerary that includes a user's travel schedule and list of places to visit.

[0116] "Means" refers to the methods or functions used to achieve a specific purpose.

[0117] A "server" is a central computer that processes and stores data.

[0118] A "database" is a system for systematically storing and managing large amounts of data.

[0119] A "generative AI model" is an algorithm or program that uses artificial intelligence to generate a specific outcome.

[0120] "VR (virtual reality) data" is data that allows users to create and experience a virtual environment using computer technology.

[0121] "AR (Augmented Reality) data" is data used to add virtual elements to the real environment.

[0122] A "reservation" is the process of reserving in advance the use of a particular service or facility.

[0123] "Payment" is the act of providing money for a service or product.

[0124] "Emergency information" refers to data related to emergencies such as health problems and traffic troubles that occur during travel.

[0125] "Notification" is a means of conveying information from the system to the user.

[0126] This invention is a system for making users' travel experiences more comfortable. Specifically, it is a system that automatically generates travel plans based on the user's basic information and preference information, and provides real-time adjustments, digital experiences, reservation and payment management, and even emergency support all in one.

[0127] Creating a User Profile

[0128] A user accesses the application or web interface using their device (smartphone, tablet, PC) and enters basic information (name, age, gender, nationality, etc.) and travel preferences (areas of interest, budget, travel style, etc.) into the system. This information is temporarily stored on the device and then sent to the server. The server stores the received information in a database and creates a user profile.

[0129] Automatic travel plan generation

[0130] The server references the saved user profile and recommends travel destinations and tourist attractions from its internal database that match the user's preferences. The server then uses a generative AI model to automatically generate an optimal travel plan, including the order in which tourist attractions should be visited, the means of transportation, and travel time. This generated travel plan is displayed on the device, allowing the user to review and modify it.

[0131] Real-time adjustments

[0132] The server monitors external weather information and reservation status in real time, automatically adjusting travel plans and notifying the device of changes based on the situation. For example, if bad weather is forecast, the server will suggest safe alternative activities and reschedule the trip.

[0133] Providing digital travel experiences

[0134] The server generates VR and AR data of tourist spots and cultural assets, optimizes it for streaming, and delivers it to devices. Users can use this digital data to virtually explore tourist spots through their devices.

[0135] Reservation and payment

[0136] The server connects with multiple travel service platforms via API to collectively arrange reservations for tourist attractions and accommodations recommended by users, and also handles payment processing. Reservation and payment details are displayed on the terminal for users to review.

[0137] Emergency support

[0138] The server monitors emergency information in real time and quickly contacts the appropriate rescue agency if an emergency situation is detected, while the device provides detailed instructions to the user to ensure their safety.

[0139] Specific examples

[0140] For example, if a user is planning a trip from Japan to Paris, France, the following process is executed:

[0141] 1. The user accesses the app from their device and enters their basic information and travel preferences, which are then received by the server and stored in a database.

[0142] 2. The server recommends Paris based on the user's profile, selects tourist attractions such as the Eiffel Tower and the Louvre, and generates a travel plan. The plan is displayed on the device.

[0143] 3. The server monitors weather information and adjusts the schedule and notifies the device if bad weather is predicted.

[0144] 4. The server generates VR and AR data of the Eiffel Tower and the Louvre Museum and delivers it to the device, allowing the user to enjoy the virtual experience.

[0145] 5. The server then makes all the bookings for accommodation and sightseeing tickets, processes the payments, and displays the information on the terminal.

[0146] 6. If the user reports a health issue during the trip, the server will initiate an emergency response and coordinate with the appropriate rescue agency for a prompt response. The device will provide the user with the necessary instructions.

[0147] Prompt Sentence Examples

[0148] "I'm planning a trip from Japan to Paris, France. I'd like to enter my basic information and travel preferences and access travel plans, tourist attractions, VR experiences, reservations and payments, and emergency support."

[0149] The above program processing allows the user to experience a stress-free and comfortable trip.

[0150] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0151] Step 1: Fill in your user profile

[0152] The user accesses the application or web interface using their device. The user enters basic information (name, age, gender, nationality, etc.) and travel preferences (areas of interest, budget, travel style, etc.). The entered information is temporarily stored on the device and then sent to the server.

[0153] Input: User's basic information and preferences

[0154] Output: User profile data (stored on the server)

[0155] Step 2: Save your user profile

[0156] The server stores the user's basic information and preference information received from the device in a database. When storing, the information is registered in the appropriate table using the user ID.

[0157] Input: User profile data

[0158] Output: User profile in the database

[0159] Step 3: Recommend travel destinations and attractions

[0160] The server refers to the database and recommends travel destinations and tourist spots that suit the user's preferences. SQL queries are used to search the database.

[0161] Input: User profile data

[0162] Output: A list of recommended travel destinations and tourist attractions

[0163] Step 4: Automatically generate travel plans

[0164] The server uses the generative AI model to automatically generate a travel plan based on the recommended travel destinations and tourist attractions, calculating the order of visits, transportation means, travel time, etc., and creating a travel schedule.

[0165] Input: A list of recommended travel destinations and tourist attractions

[0166] Output: Travel plan

[0167] Step 5: View and confirm your travel plans

[0168] The terminal displays the generated itinerary to the user, who can then review it and make any necessary modifications. The modifications are then sent back to the server.

[0169] Input: Generated itinerary

[0170] Output: User confirmation and correction

[0171] Step 6: Monitor weather and booking information

[0172] The server uses external web service APIs to monitor weather information and reservation status in real time, adjusting travel plans as needed based on new weather data or reservation status.

[0173] Input: Weather information and reservation status from external web services

[0174] Output: Adjusted itinerary

[0175] Step 7: Adjust and notify travel plans

[0176] The server adjusts the travel plan as needed based on weather and reservation information and notifies the device of the new plan.

[0177] Input: Adjusted travel plans

[0178] Output: User notification

[0179] Step 8: Generate and distribute VR and AR data

[0180] The server generates VR and AR data of tourist spots and cultural assets, optimizes it for streaming, and delivers it to the device, which then displays it to the user.

[0181] Input: Data on tourist destinations and cultural properties

[0182] Output: VR and AR data

[0183] Step 9: Processing bookings and payments

[0184] The server connects with multiple travel service platforms via API to process reservations and payments for recommended travel services in one place, and the processing results are displayed on the terminal.

[0185] Input: User's booking and payment information

[0186] Output: Booking and payment details

[0187] Step 10: Emergency Support

[0188] The server monitors emergency information in real time and quickly contacts the appropriate rescue agency if an abnormal situation is detected. The device provides detailed instructions to the user to ensure their safety.

[0189] Input: User location and emergency status data

[0190] Output: Emergency response instructions and contact

[0191] At each of the above steps, users are provided with optimal travel plans and real-time responses tailored to their needs, allowing them to enjoy a comfortable and efficient travel experience.

[0192] (Application example 1)

[0193] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0194] Traditionally, creating and adjusting travel plans required a lot of manual work, making it time-consuming for users. It was also difficult to obtain real-time information during the trip or respond quickly to emergencies, which led to lower travel satisfaction. Further improvements were needed, particularly in the areas of automatic generation of travel plans using smart devices, real-time acquisition of weather and emergency information, and digital travel experiences using virtual reality and augmented reality.

[0195] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0196] In this invention, the server includes means for collecting basic information and preference information of a user, means for recommending travel destinations and tourist spots based on the basic information and preference information, means for automatically generating and displaying a travel plan including the travel destinations and tourist spots, means for delivering and displaying virtual reality data and augmented reality data to a user terminal, and means for monitoring weather information and reservation status in real time and adjusting the travel plan. This allows the user to automatically generate a travel plan without hassle, respond immediately to changes in the situation during the trip, and enjoy a rich digital travel experience using virtual reality and augmented reality.

[0197] "Basic user information" refers to basic information for identifying an individual, such as the user's name, age, sex, and nationality.

[0198] "Preference information" is information based on a user's personal preferences and interests, such as areas of interest, budget, and travel style.

[0199] "Travel destination" refers to a destination or city that a user visits.

[0200] "Tourist spots" refer to places of interest such as historical sites, natural landscapes, cultural assets, and leisure facilities at travel destinations.

[0201] A "travel plan" refers to a plan or schedule for a user's entire trip.

[0202] "Virtual reality data" is data on a three-dimensional space that is virtually reproduced using computer graphics.

[0203] "Augmented reality data" is data that displays digital information overlaid on real landscapes and objects.

[0204] "User terminal" refers to a computing device used by a user, such as a smartphone, tablet, or smart glasses.

[0205] "Weather Information" refers to information about current and future weather conditions.

[0206] "Reservation status" refers to information about reservations, such as availability at accommodations and tourist attractions.

[0207] "Emergency Information" refers to information about emergencies, such as health issues or traffic troubles that may occur during travel.

[0208] "Real-time" refers to the immediate processing and provision of ongoing events and information.

[0209] This invention is a system that recommends, plans, and adjusts smart travel plans according to travelers' needs. The system collects basic information and preference information from users, recommends optimal travel destinations and tourist spots based on that information, and automatically generates and displays travel plans. It also monitors weather and emergency information in real time, adjusts travel plans as needed, and notifies users. It can also provide digital travel experiences of tourist spots and cultural assets using virtual reality (VR) and augmented reality (AR).

[0210] The system is implemented as an application installed on a user device such as smart glasses. A specific example is shown below.

[0211] Creating a User Profile

[0212] The user puts on the smart glasses and inputs basic information (such as name, age, gender, and nationality) and travel preferences (areas of interest, budget, travel style, etc.) through a voice recognition interface. The server receives this information and stores it in a database as a profile.

[0213] Automatic travel plan generation

[0214] The server references a database based on the saved user profile and recommends travel destinations and tourist spots that suit the user's preferences. Based on the recommended information, the server automatically generates a travel plan and displays it on the smart glasses. The user can confirm and modify the plan by eye contact or voice.

[0215] Real-time adjustments

[0216] The server monitors weather and reservation information in real time and adjusts travel plans as needed based on the information it receives. For example, if the weather worsens, the server will make schedule changes and notify the smart glasses of the new plans, ensuring users always have the most up-to-date information on their travel plans.

[0217] Providing digital travel experiences

[0218] The server generates virtual reality and augmented reality data of tourist spots and cultural assets and distributes it to user devices. Users can view this digital data using smart glasses and virtually experience tourist spots.

[0219] Emergency support

[0220] The server monitors emergency information in real time and, if a health or traffic emergency occurs during travel, coordinates with the appropriate rescue agencies to respond quickly, while also notifying the smart glasses of emergency response details and providing necessary instructions.

[0221] Specific examples

[0222] For example, if a user is planning a trip from Japan to Paris, France, the following process is executed:

[0223] Input Process

[0224] A user puts on the smart glasses and enters the following prompt sentence into the speech recognition interface:

[0225] Example prompt: "Hello, I'm a 30-year-old man living in Japan. I'm planning a trip to Paris. I love history, art, and nature, my budget is ¥200,000, and I prefer an active travel style."

[0226] System Operation

[0227] 1. The server receives the user's basic information and preference information and stores it in a database.

[0228] 2. The server recommends travel destinations and attractions based on the stored profile.

[0229] 3. The travel plan automatically generated by the server is displayed on the smart glasses.

[0230] 4. Monitor weather and booking information in real time and adjust your travel plans as needed.

[0231] 5. Deliver virtual reality and augmented reality data to user devices to provide a digital travel experience.

[0232] 6. Monitor emergency information and respond promptly to emergency situations in coordination with rescue agencies when necessary.

[0233] This system allows users to enjoy a stress-free and comfortable travel experience, and also ensures safety during travel by providing real-time information.

[0234] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0235] Step 1:

[0236] Creating a User Profile

[0237] The user puts on the smart glasses and inputs basic information (such as name, age, gender, and nationality) and travel preferences (areas of interest, budget, travel style, etc.) through a voice recognition interface. The input information is sent to the server and stored in a database as a user profile.

[0238] Input: Basic information and preference information entered by the user via voice

[0239] Output: User profile stored on the server

[0240] What happens: The user speaks a prompt like this: "Hello, I'm a 30-year-old man living in Japan. I'm planning a trip to Paris. I love history, art, and nature, my budget is ¥200,000, and I prefer an active travel style."

[0241] Step 2:

[0242] Automatic travel plan generation

[0243] The server recommends suitable travel destinations and tourist attractions from an internal database and external data sources based on the user profile, automatically generates a travel plan based on the recommended information, and displays the plan on the smart glasses.

[0244] Input: User profile

[0245] Output: A recommended list of travel destinations and attractions based on user preferences, along with a travel plan

[0246] Specific operation: The server retrieves tourist spot information that matches the user's interests from the database, generates a travel plan, and displays it on the smart glasses. The user can confirm and modify the plan using their eyes or voice.

[0247] Step 3:

[0248] Real-time adjustments

[0249] The server monitors weather information and reservation status in real time and adjusts the travel plan accordingly, which is then sent to the smart glasses.

[0250] Input: Real-time weather information and reservation status

[0251] Output: Adjusted itinerary

[0252] Specific operation: The server uses a weather API to continuously check local weather information, and if bad weather is forecast, it changes the travel plan and notifies the smart glasses of the new plan.

[0253] Step 4:

[0254] Providing digital travel experiences

[0255] The server generates virtual reality and augmented reality data of tourist spots and cultural properties and distributes it to user devices (smart glasses). Users can use this data to enjoy virtual travel.

[0256] Input: Digital content data related to tourist destinations and cultural properties

[0257] Output: Virtual reality and augmented reality data displayed on smart glasses

[0258] Specific operation: The server delivers VR data, including historical information about tourist spots, to the smart glasses, allowing users to experience the place as if they were actually there.

[0259] Step 5:

[0260] Emergency support

[0261] The server monitors emergency information in real time and responds promptly to any health or traffic issues that may arise during travel by coordinating with the appropriate rescue agencies. Emergency response details are then sent to the smart glasses, which provide necessary instructions to the user.

[0262] Input: Emergency information to obtain while traveling

[0263] Output: Contact rescue agencies and emergency response instructions

[0264] Specific operation: When a user reports a health problem, the server contacts the hospital and displays the route to the nearest hospital and emergency response procedures on the smart glasses.

[0265] Thus, the present invention provides a range of features that allow users to automatically generate travel plans, respond to situations in real time while traveling, and even provide digital experiences using virtual reality.

[0266] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0267] The present invention combines an emotion engine with a system for recommending, planning and adjusting smart travel plans according to travelers' needs, and is implemented as follows.

[0268] Creating a User Profile

[0269] A user accesses the application or web interface using a device (smartphone, tablet, PC, etc.) and enters basic information (name, age, gender, nationality, etc.) and travel preferences (areas of interest, budget, travel style, etc.). This information is sent to a server and stored in a database as a profile. The user's emotional information is also collected and integrated into the profile.

[0270] Automatic travel plan generation

[0271] The server references the database based on the saved user profile and automatically recommends travel destinations and tourist spots that match the user's preferences. Based on the recommended information, the server automatically generates a travel plan and creates a travel schedule. The device displays the generated travel plan to the user, who can check and modify it.

[0272] Combining Emotion Engines

[0273] The server uses an emotion engine to analyze the user's real-time emotional information. Based on this information, the contents of the travel plan and schedule can be adjusted. For example, if the user is feeling stressed, the server can add relaxation spots.

[0274] Real-time adjustments

[0275] The server monitors weather information and reservation status in real time and adjusts travel plans as necessary based on the information obtained. For example, if the weather worsens, the server changes the schedule and notifies the device of the new plans. This allows users to always keep up with the latest travel plans. In addition, changes in emotions detected by the emotion engine are reflected in real time.

[0276] Providing digital travel experiences

[0277] The server generates virtual reality (VR) and augmented reality (AR) data of tourist spots and cultural assets and distributes it to devices. Users can view this digital data on their devices and virtually experience tourist spots, thereby gaining a deeper understanding and enjoyment during their trip.

[0278] Reservation and payment

[0279] The server connects with multiple travel service platforms to make reservations for recommended tourist spots and accommodations in one place. The server also processes all payments for reservations and displays the results on the terminal. This allows users to skip the cumbersome process of going through multiple platforms and make reservations and payments easily.

[0280] Emergency support

[0281] The server monitors emergency information in real time and responds quickly if a health or traffic problem occurs during travel. The server connects with appropriate rescue agencies (hospitals, police, fire department, etc.) and coordinates rescue efforts. The device notifies the user of emergency response details and provides necessary instructions to ensure the user's safety.

[0282] Specific examples

[0283] For example, if a user is planning a trip from Japan to Paris, France, the following process is executed:

[0284] 1. Users enter their basic information and travel preferences into the device, and the server stores it in a database. The emotion engine then analyzes the user's emotions and integrates that information into the profile.

[0285] 2. The server recommends Paris and selects tourist spots such as the Eiffel Tower and the Louvre. An itinerary is automatically generated and displayed on the device.

[0286] 3. The server monitors weather information before and during the trip, and if the weather worsens, adjusts the schedule and notifies the terminal.

[0287] 4. The server generates VR and AR data for the tourist spot and distributes it to the device, allowing the user to enjoy the virtual experience.

[0288] 5. The server then makes all the bookings for accommodation and sightseeing tickets, processes the payments, and displays the results on the terminal.

[0289] 6. If the emotion engine detects that the user is feeling stressed during the trip, the server will add relaxation spots and adjust the schedule.

[0290] 7. In the event of a health issue, the server will initiate an emergency response and coordinate with the appropriate rescue agencies for immediate action. The device will provide detailed instructions to the user.

[0291] This allows users to enjoy a stress-free and comfortable travel experience.The present invention is a system for improving the efficiency of travel planning, resolving problems during travel, and responding based on emotions, and it represents a significant improvement over conventional travel procedures.

[0292] The processing flow will be explained below.

[0293] Step 1:

[0294] A user accesses an application or web interface using a device (smartphone, tablet, PC, etc.) and enters basic information (name, age, gender, nationality, etc.).

[0295] Step 2:

[0296] Users input their areas of interest (history, nature, culture, etc.), budget, and travel style (adventure, relaxation, etc.) into the terminal.

[0297] Step 3:

[0298] The terminal transmits the input basic information and preference information to the server.

[0299] Step 4:

[0300] The server creates a user profile based on the received information and stores it in a database.

[0301] Step 5:

[0302] The server also uses an emotion engine to collect the user's emotion information and integrate it into the profile.

[0303] Step 6:

[0304] The server refers to the database and recommends travel destinations that match the user's preferences.

[0305] Step 7:

[0306] The server selects tourist attractions and activities from the recommended travel destinations.

[0307] Step 8:

[0308] The server automatically generates a travel plan based on tourist attractions and activities and creates a schedule.

[0309] Step 9:

[0310] The terminal displays the generated travel plan to the user, who can then confirm and modify the plan.

[0311] Step 10:

[0312] The server monitors weather information and reservation status in real time.

[0313] Step 11:

[0314] If the server detects changes in weather or reservations, it adjusts travel plans and updates schedules.

[0315] Step 12:

[0316] The terminal notifies the user of the updated schedule and allows the user to confirm it.

[0317] Step 13:

[0318] The server prepares virtual reality (VR) and augmented reality (AR) data of tourist attractions and cultural properties.

[0319] Step 14:

[0320] The server delivers VR and AR data to the device.

[0321] Step 15:

[0322] Users use the device to view VR and AR data and enjoy the virtual experience.

[0323] Step 16:

[0324] The server works in conjunction with the travel service platform to arrange reservations for accommodation and sightseeing tickets all at once.

[0325] Step 17:

[0326] The server calculates the total cost for the reservation and processes the payment in one lump sum.

[0327] Step 18:

[0328] The terminal displays a confirmation of the reservation completion to the user.

[0329] Step 19:

[0330] The server monitors emergency information occurring during travel in real time.

[0331] Step 20:

[0332] If the server detects an emergency (health problem or traffic trouble), it will coordinate with appropriate rescue agencies and implement emergency response.

[0333] Step 21:

[0334] The device will notify the user of emergency response details and provide necessary instructions.

[0335] Step 22:

[0336] At any step, the server analyzes the user's emotional information using an emotion engine, and if it detects stress or dissatisfaction, it adjusts the itinerary, for example, by adding a relaxing spot or changing the order of activities.

[0337] Step 23:

[0338] The terminal notifies the user of the travel plan adjusted based on the emotion and allows the user to confirm it.

[0339] Example 2

[0340] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0341] Conventional travel planning systems not only recommend travel destinations and tourist spots that match a user's preferences, but also lack the ability to reflect the user's emotional and weather information in real time. They also lack the ability to respond to emergencies and process reservations and payments across multiple travel service platforms. This creates a demand for systems that can improve the quality of users' travel experiences.

[0342] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0343] In this invention, the server includes means for collecting basic information and preference information of a user, means for recommending travel destinations and tourist spots based on the basic information and preference information, means for automatically generating and displaying a travel plan including the travel destinations and tourist spots, means for collecting and analyzing user emotional information and reflecting the emotional information in the travel plan, means for monitoring weather information and reservation status in real time and adjusting the travel plan, means for generating virtual reality data and augmented reality data of tourist spots and cultural properties and distributing them to a user terminal, means for linking with multiple travel service platforms and processing reservations and payments in a lump sum, and means for linking with appropriate rescue organizations in the event of an emergency and providing instructions to the user terminal. This allows for the provision of a travel plan optimal for the user's preferences and emotional state, and enables real-time adjustments and emergency response.

[0344] A "user" is an individual or group that uses the system to create a travel plan and plan sightseeing.

[0345] "Basic information" is data for identifying an individual, such as the user's name, age, sex, and nationality.

[0346] "Preference information" is data indicating the user's individual preferences, such as areas of interest, travel style, and budget, which are necessary for selecting and planning a travel destination.

[0347] "Emotion information" is data that indicates the emotional state, such as stress or joy, that the user feels while traveling.

[0348] A "travel destination" is a region or city that a user aims to visit.

[0349] A "tourist attraction" is a place or facility of particular importance or interest in a travel destination.

[0350] A "travel plan" is a plan that includes a schedule of places to visit and activities, automatically generated based on the user's preferences and emotional information.

[0351] "Real-time" weather and reservation monitoring means getting the latest information instantly and adjusting your travel plans accordingly.

[0352] "Virtual reality data" is data on virtually recreated tourist spots and cultural assets.

[0353] "Augmented reality data" is information provided by overlaying digital information onto real-world scenes.

[0354] A "travel service platform" is a system or website that provides online reservations and payments for accommodation and sightseeing tickets.

[0355] An "emergency" is a situation in which a user faces an unexpected situation such as a health problem or traffic trouble while traveling.

[0356] "Rescue agencies" are organizations such as hospitals, police, and fire departments that deal with health issues, traffic accidents, etc.

[0357] A "terminal" is a device such as a smartphone, tablet, or PC that a user uses to access the system and input or retrieve travel planning information.

[0358] The present invention combines an emotion engine with a system for recommending, planning and adjusting smart travel plans according to traveler needs, and embodiments thereof are described in detail below.

[0359] Creating a User Profile

[0360] A user accesses the application or web interface using a device (smartphone, tablet, PC, etc.) and enters basic information (name, age, gender, nationality, etc.) and travel preferences (areas of interest, budget, travel style, etc.), including settings for entering emotional information. This information is sent to the server and stored in a database. The emotional engine evaluates the user's emotional state based on the information entered and integrates the results into a profile.

[0361] Recommendations for travel destinations and attractions

[0362] Based on the saved user profile, the server references a database and automatically recommends travel destinations and tourist attractions that match the user's preferences. A generative AI model is then used to generate a list of suitable travel destination and tourist attraction recommendations. This list is based on the user's profile information and emotional information, providing suggestions that best suit individual needs.

[0363] Automatic travel plan generation

[0364] The server automatically generates a detailed travel plan based on the generated recommendation list. The travel plan includes multiple itineraries and activities and is customized based on the user's preferences and emotional information. The generated travel plan is displayed to the user via their device, allowing them to review and modify the plan as needed.

[0365] Real-time adjustments

[0366] The server monitors weather information and reservation status in real time and can adjust travel plans as needed. For example, schedule changes are made in response to sudden changes in the weather or cancellations of reservations. Adjusted travel plans are notified to the device, providing the user with the latest information.

[0367] Providing digital travel experiences

[0368] The server generates virtual reality (VR) and augmented reality (AR) data of tourist spots and cultural assets and distributes it to devices. Users can view this digital data through their devices and virtually experience tourist spots, allowing them to enjoy their local travel experience more deeply.

[0369] Bulk booking and payment

[0370] The server connects with multiple travel service platforms to make reservations for recommended tourist spots and accommodations in one place. The server also processes all payments for reservations and displays the results on the terminal. This allows users to avoid the cumbersome process of going through multiple platforms and make reservations and payments easily.

[0371] Emergency support

[0372] The server monitors emergency information in real time and responds quickly if a health or traffic problem occurs during travel. It also coordinates necessary rescue operations by connecting with appropriate rescue agencies. The device notifies the user of emergency response details and provides necessary instructions to ensure the user's safety.

[0373] Specific examples

[0374] For example, if a user is planning a trip from Japan to Paris, France, they can input the following prompt into the generative AI model:

[0375] Please recommend suitable travel destinations based on the user profile below.

[0376] Name: User A

[0377] Age: 30

[0378] Gender: Male

[0379] Nationality: Japanese

[0380] Interests: Historical sites

[0381] Budget: 100,000 yen

[0382] This enables the system to provide optimal travel plans that meet the user's needs and improve the travel experience.

[0383] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0384] Step 1: Create a user profile

[0385] A user accesses the application or web interface using a device and enters basic information (such as name, age, gender, and nationality) and travel preferences (such as areas of interest, budget, and travel style). The device then sends the entered information to the server, which then stores the data in a database. At the same time, a prompt for emotional assessment is displayed, evaluating the user's emotional state and integrating that information into the profile. For example, if a user enters "I'm interested in historical tourist sites" and "My budget is within 100,000 yen," the emotional information is saved along with that information.

[0386] Input: User's basic information, preference information, emotional information

[0387] Output: User profile stored in the database

[0388] Step 2: Recommend travel destinations and attractions

[0389] The server searches the database for potential travel destinations based on the saved user profile. Using a generative AI model, the server generates a list of travel destinations and tourist attractions that match the user's preferences based on the user's profile information. For example, the Eiffel Tower and the Louvre Museum in Paris may be recommended. The generated list is sent to the device for the user to review.

[0390] Input: User profile

[0391] Output: A list of recommended travel destinations and attractions

[0392] Step 3: Automatically generate a travel plan

[0393] The server automatically generates a detailed travel plan based on the recommendation list. It takes into account the user's preferences and emotional information to optimize the schedule and activities. For example, if the user prioritizes relaxation, it will include relaxing spots in the schedule. The generated plan is sent to the device, where the user can review and modify it.

[0394] Input: List of recommended travel destinations and attractions, user profile

[0395] Output: An automatically generated itinerary

[0396] Step 4: Adjust in real time

[0397] The server monitors weather information and reservation status in real time and adjusts travel plans as needed. For example, if the weather worsens, it will change activities to indoors. Once the plan has been adjusted, it will be notified to the device, providing the user with the latest information.

[0398] Input: Weather information, reservation status, travel plans

[0399] Output: Adjusted itinerary

[0400] Step 5: Delivering digital travel experiences

[0401] The server generates virtual reality (VR) and augmented reality (AR) data of tourist attractions and cultural properties and delivers it to the device. The user can view this data on the device and virtually experience the tourist attractions. For example, if the user is at the Louvre Museum, they can view a 3D model through the device and obtain additional information.

[0402] Input: Information about tourist spots and cultural assets

[0403] Output: VR and AR data

[0404] Step 6: Batch booking and payment

[0405] The server connects with multiple travel service platforms to make reservations for recommended accommodations and sightseeing tickets in one place. The server also processes all payments for the reservations in one place, and the results are displayed on the terminal. For example, a notification such as "Reservation completed at XX hotel" or "Museum ticket purchase completed" is displayed.

[0406] Input: Travel plan, user profile

[0407] Output: Notification of reservation and payment completion

[0408] Step 7: Emergency Support

[0409] The server monitors emergency information in real time and responds quickly if a health or traffic problem occurs during travel. The device coordinates the necessary rescue operations by connecting with the appropriate rescue agencies, notifying the user of the details of the response and providing necessary instructions to ensure the user's safety. For example, if the user feels unwell, information about nearby hospitals and the best transportation options will be provided.

[0410] Input: Emergency information, user location information

[0411] Output: Emergency response instructions and rescue agency contact information

[0412] (Application example 2)

[0413] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0414] Conventional travel plan generation systems struggle to make real-time adjustments that fully reflect user preferences and emotions, making it difficult to increase user satisfaction. They also struggle to automatically generate travel plans that integrate multiple information sources and adapt to changing conditions during a trip. This often leaves users feeling stressed and detracts from their travel experience.

[0415] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for collecting basic information and preference information of a user; means for recommending travel destinations and tourist spots based on the basic information and preference information; means for automatically generating and displaying a travel plan including the travel destinations and tourist spots; means for collecting and analyzing user emotion information; means for adjusting the travel plan in real time based on the emotion information; means for monitoring weather information and reservation status in real time and adjusting the travel plan; means for notifying the user of the adjusted travel plan; means for providing virtual reality data and augmented reality data of tourist spots and cultural properties; means for delivering and displaying the virtual reality data and augmented reality data to a user terminal; means for automatically generating a travel plan using a generative AI model and adjusting it in real time based on the emotion information; and means for simplifying user input using prompt sentences to support travel plan generation. This enables automatic generation and real-time adjustment of an optimal travel plan based on a user's preferences and emotions.

[0416] "Basic information" refers to personal identification information such as the user's name, age, sex, and nationality.

[0417] "Preference information" is information that reflects the user's preferences, such as areas of interest, budget, and travel style.

[0418] A "travel destination" is a destination, such as a geographical location or city, that a user plans to visit.

[0419] "Tourist spots" are places that users visit, such as tourist attractions, cultural assets, and attractions at travel destinations.

[0420] A "travel plan" is a plan that includes a travel schedule and itinerary, created based on the user's preference information and basic information.

[0421] "Emotional information" is data that represents the user's current emotional state, including stress, relaxation, excitement, and the like.

[0422] "Real-time adjustment" is the process of instantly changing and updating travel plans in response to changing conditions during the trip (weather information, reservation status, emotional information, etc.).

[0423] "Weather information" is data about the current and forecast weather at a travel destination.

[0424] "Reservation status" is information indicating the reservation availability of facilities and transportation related to the trip.

[0425] "Virtual reality data" is digital data that provides users with an immersive virtual visual experience.

[0426] "Augmented reality data" is data used to display virtual information overlaid on the real world.

[0427] A "user terminal" is an electronic device (such as a smartphone, tablet, or PC) that a user uses to view or input information.

[0428] A "generative AI model" is an artificial intelligence model that learns patterns based on large amounts of data and automatically generates travel plans.

[0429] A "prompt sentence" is a standard sentence that simplifies the information that the user inputs and clarifies instructions to the system.

[0430] To implement this invention, a system that mainly uses a server, a user terminal, and some dedicated software is required. The main configuration and operation procedure of this system are as follows.

[0431] First, the user enters their basic information (name, age, gender, nationality, etc.) and preference information (areas of interest, budget, travel style, etc.) using a user device (smartphone, tablet, PC, etc.). This information is sent to the server, which then stores it in a database.

[0432] The server then recommends travel destinations and tourist attractions based on the collected basic information and preference information. Based on the recommended information, the server automatically generates a travel plan and displays it on the user's device. In this process, the server uses a generative AI model to generate the optimal travel plan. The generative AI model has learned a large amount of data in advance and is capable of providing a plan that best suits the user's preferences.

[0433] A visual interface is provided on the user's terminal to allow the user to review and modify the travel plan. Once the user approves the plan, the server confirms the plan. Prompt sentences are also used to simplify the user's input and assist in generating the optimal travel plan.

[0434] In addition, the server monitors weather and reservation status in real time and adjusts travel plans based on this information. For example, if a reservation for a planned tourist spot is canceled at the last minute, the server will automatically recommend an alternative tourist spot and notify the user. This process is also automatic and is reflected in real time on the user's device.

[0435] The system also incorporates an emotion engine that collects and analyzes the user's emotional information. If the user feels stressed during the trip, the server will make real-time adjustments, such as adding relaxation spots.

[0436] It also provides virtual reality (VR) and augmented reality (AR) data of tourist spots and cultural assets, allowing users to virtually experience tourist spots before or during their trip using dedicated AR / VR headsets or smartphones.

[0437] For example, if a user is planning a trip to Paris, the following happens:

[0438] 1. The user enters basic information and preferences into the app.

[0439] 2. The server recommends Paris and generates a travel plan that includes attractions such as the Eiffel Tower and the Louvre.

[0440] 3. Real-time analysis of when you feel stressed and adding a visit to a relaxing cafe.

[0441] 4. Providing a virtual experience of the Eiffel Tower through VR / AR content.

[0442] An example of a prompt is as follows:

[0443] "You enter your basic information and preferences to create a user profile. Then, the system generates a smart itinerary based on that, adjusting in real time. It also provides VR / AR experiences of tourist attractions. For example, if you enter, 'If I'm traveling to Paris, I want to visit the Eiffel Tower and the Louvre Museum. I also want to visit a relaxing cafe,' the system will automatically generate an itinerary for your Paris trip."

[0444] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0445] Step 1:

[0446] A user accesses the application using a terminal and inputs basic information and preferences. This input includes information such as name, age, gender, nationality, areas of interest, budget, and travel style. The terminal sends this information to the server. Data processing involves converting the input information into a standard format and storing it in a database. The output is a database entry that stores the user's basic information and preferences.

[0447] Step 2:

[0448] The server uses a generative AI model to recommend optimal travel destinations and tourist attractions based on the saved user profile. The server uses basic information and preference information as input data, and performs calculations by calling the generative AI model that has learned from past data and trends. The output is a list of recommended travel destinations and tourist attractions.

[0449] Step 3:

[0450] The server automatically generates a travel plan including recommended destinations and tourist attractions and displays it on the device. The travel plan includes travel dates, duration of stay, and access methods. The server creates the plan using a generative AI model and retrieves the necessary details from a database. The output is an automatically generated travel plan that is displayed on the user's device.

[0451] Step 4:

[0452] The server collects the user's emotional information and analyzes it using an emotion engine. The data required for emotion analysis (facial expressions, tone of voice, etc.) is collected from the camera and microphone installed on the user's device. The server inputs this data into the emotion engine and calculates the user's emotional state. The output is the user's emotional profile, updated in real time.

[0453] Step 5:

[0454] Based on the user's emotional information, the server adjusts the travel plan in real time. For example, if the user is feeling stressed, the server adds relaxing spots and activities to the plan. This generates a travel plan that reflects the user's emotional state. As a data calculation, a new plan is calculated using the emotional information and the existing travel plan as input data. The output is the adjusted travel plan.

[0455] Step 6:

[0456] The server monitors weather information and reservation status in real time. It accesses the weather information API and reservation management system to obtain the latest information. The server reflects this information in the travel plan and updates the plan as necessary. The output is the latest travel plan adjusted according to the weather and reservation status, and is notified to the user's device.

[0457] Step 7:

[0458] Virtual reality and augmented reality data of tourist spots and cultural assets are delivered to user devices. The server generates the corresponding VR / AR data and sends it to the user device. Users can view this digital data using their devices and virtually experience tourist spots. The output is VR / AR content displayed on the user device.

[0459] Step 8:

[0460] The user approves the itinerary, and the server finalizes the travel plan using the generative AI model. After receiving approval input from the user's device, the server saves the final plan in the database. The output is the finalized travel plan.

[0461] Step 9:

[0462] The server generates prompts to prompt the user to simply input details of their travel plans. The prompts are automatically generated based on pre-defined templates. The output is a prompt that facilitates intuitive input by the user.

[0463] Example prompt sentence:

[0464] "You enter your basic information and preferences to create a user profile. Then, the system generates a smart itinerary based on that, adjusting in real time. It also provides VR / AR experiences of tourist attractions. For example, if you enter, 'If I'm traveling to Paris, I want to visit the Eiffel Tower and the Louvre Museum. I also want to visit a relaxing cafe,' the system will automatically generate an itinerary for your Paris trip."

[0465] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0466] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0467] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0468] [Second embodiment]

[0469] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0470] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0471] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0472] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0473] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0474] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0475] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0476] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0477] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0478] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0479] In the smart glasses 214, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0480] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0481] The present invention is a system for recommending, planning, and adjusting smart travel plans according to travelers' needs, and is implemented as follows.

[0482] Creating a User Profile

[0483] A user accesses the application or web interface using a device (smartphone, tablet, PC, etc.) and enters basic information (name, age, gender, nationality, etc.) and travel preferences (areas of interest, budget, travel style, etc.). This information is sent to the server and stored in a database as a profile.

[0484] Automatic travel plan generation

[0485] The server references the database based on the saved user profile and automatically recommends travel destinations and tourist spots that match the user's preferences. Based on the recommended information, the server automatically generates a travel plan and creates a travel schedule. The device displays the generated travel plan to the user, who can check and modify it.

[0486] Real-time adjustments

[0487] The server monitors weather information and reservation status in real time and adjusts travel plans as needed based on the information it obtains. For example, if the weather worsens, the server will change the schedule and notify the device of the new plans. This allows users to always keep up to date with their travel plans.

[0488] Providing digital travel experiences

[0489] The server generates virtual reality (VR) and augmented reality (AR) data of tourist spots and cultural assets and distributes it to devices. Users can view this digital data on their devices and virtually experience tourist spots, thereby gaining a deeper understanding and enjoyment during their trip.

[0490] Reservation and payment

[0491] The server connects with multiple travel service platforms to make reservations for recommended tourist spots and accommodations in one place. The server also processes all payments for reservations and displays the results on the terminal. This allows users to skip the cumbersome process of going through multiple platforms and make reservations and payments easily.

[0492] Emergency support

[0493] The server monitors emergency information in real time and responds quickly if a health or traffic problem occurs during travel. The server connects with appropriate rescue agencies (hospitals, police, fire department, etc.) and coordinates rescue efforts. The device notifies the user of emergency response details and provides necessary instructions to ensure the user's safety.

[0494] Specific examples

[0495] For example, if a user is planning a trip from Japan to Paris, France, the following process is executed:

[0496] 1. The user enters their basic information and travel preferences into the terminal, and the server stores it in a database.

[0497] 2. The server recommends Paris and selects tourist spots such as the Eiffel Tower and the Louvre. An itinerary is automatically generated and displayed on the device.

[0498] 3. The server monitors weather information before and during the trip, and if the weather worsens, adjusts the schedule and notifies the terminal.

[0499] 4. The server generates VR and AR data for the tourist spot and distributes it to the device, allowing the user to enjoy the virtual experience.

[0500] 5. The server then makes all the bookings for accommodation and sightseeing tickets, processes the payments, and displays the results on the terminal.

[0501] 6. If the user reports a health issue during the trip, the server will initiate an emergency response and coordinate with the appropriate rescue agency for immediate action. The device will provide detailed instructions to the user.

[0502] With the above functions, users can enjoy a stress-free and comfortable travel experience. The present invention is a system for improving the efficiency of travel planning and resolving problems during travel, and it achieves significant improvements over conventional travel procedures.

[0503] The processing flow will be explained below.

[0504] Step 1:

[0505] A user accesses an application or web interface using a device (smartphone, tablet, PC, etc.) and enters basic information (name, age, gender, nationality, etc.).

[0506] Step 2:

[0507] Users input their areas of interest (history, nature, culture, etc.), budget, and travel style (adventure, relaxation, etc.) into the terminal.

[0508] Step 3:

[0509] The terminal transmits the input basic information and preference information to the server.

[0510] Step 4:

[0511] The server creates a user profile based on the received information and stores it in a database.

[0512] Step 5:

[0513] The server refers to the database and recommends travel destinations that match the user's preferences.

[0514] Step 6:

[0515] The server selects tourist attractions and activities from the recommended travel destinations.

[0516] Step 7:

[0517] The server automatically generates a travel plan based on tourist attractions and activities and creates a schedule.

[0518] Step 8:

[0519] The terminal displays the generated travel plan to the user, who can then confirm and modify the plan.

[0520] Step 9:

[0521] The server monitors weather information and reservation status in real time.

[0522] Step 10:

[0523] If the server detects changes in weather or reservations, it adjusts travel plans and updates schedules.

[0524] Step 11:

[0525] The terminal notifies the user of the updated schedule and allows the user to confirm it.

[0526] Step 12:

[0527] The server prepares virtual reality (VR) and augmented reality (AR) data of tourist attractions and cultural properties.

[0528] Step 13:

[0529] The server delivers VR and AR data to the device.

[0530] Step 14:

[0531] Users use the device to view VR and AR data and enjoy the virtual experience.

[0532] Step 15:

[0533] The server works in conjunction with the travel service platform to arrange reservations for accommodation and sightseeing tickets all at once.

[0534] Step 16:

[0535] The server calculates the total cost for the reservation and processes the payment in one lump sum.

[0536] Step 17:

[0537] The terminal displays a confirmation of the reservation completion to the user.

[0538] Step 18:

[0539] The server monitors emergency information occurring during travel in real time.

[0540] Step 19:

[0541] If the server detects an emergency (health problem or traffic trouble), it will coordinate with appropriate rescue agencies and implement emergency response.

[0542] Step 20:

[0543] The device will notify the user of emergency response details and provide necessary instructions.

[0544] Example 1

[0545] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0546] Traditionally, planning a trip has involved a lot of time-consuming and laborious tasks, such as gathering destination information, creating an itinerary, making reservations and payments, and even responding to emergencies. In addition, systems lacked the ability to monitor weather information and reservation status in real time, adjust travel plans as needed, and provide a digital experience. There is a need for more advanced systems that can solve these problems and allow users to enjoy stress-free, comfortable travel.

[0547] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0548] In this invention, the server includes means for collecting basic information and preference information of a user, means for recommending travel destinations and tourist attractions based on the basic information and preference information, means for automatically generating and displaying a travel itinerary including the travel destinations and tourist attractions, means for monitoring weather information and reservation status in real time and adjusting the travel itinerary, means for generating virtual reality data and augmented reality data of tourist attractions and distributing and displaying them to a user terminal, means for processing reservations and payments for travel services, and means for monitoring and responding to emergency information. This allows users to plan, execute, and respond to emergency situations all in one system, allowing them to enjoy a stress-free and comfortable trip.

[0549] "User" means an individual or organization that uses the system.

[0550] "Basic information" refers to personal data such as the user's name, age, gender, and nationality.

[0551] "Preference information" is data relating to the user's preferences such as areas of interest, budget, and travel style.

[0552] A "travel destination" is a destination such as a city or region that the user wants to visit.

[0553] "Tourist destinations" are famous places and tourist spots that are worth visiting when traveling.

[0554] A "travel plan" is a detailed itinerary that includes a user's travel schedule and list of places to visit.

[0555] "Means" refers to the methods or functions used to achieve a specific purpose.

[0556] A "server" is a central computer that processes and stores data.

[0557] A "database" is a system for systematically storing and managing large amounts of data.

[0558] A "generative AI model" is an algorithm or program that uses artificial intelligence to generate a specific outcome.

[0559] "VR (virtual reality) data" is data that allows users to create and experience a virtual environment using computer technology.

[0560] "AR (Augmented Reality) data" is data used to add virtual elements to the real environment.

[0561] A "reservation" is the process of reserving in advance the use of a particular service or facility.

[0562] "Payment" is the act of providing money for a service or product.

[0563] "Emergency information" refers to data related to emergencies such as health problems and traffic troubles that occur during travel.

[0564] "Notification" is a means of conveying information from the system to the user.

[0565] This invention is a system for making users' travel experiences more comfortable. Specifically, it is a system that automatically generates travel plans based on the user's basic information and preference information, and provides real-time adjustments, digital experiences, reservation and payment management, and even emergency support all in one.

[0566] Creating a User Profile

[0567] A user accesses the application or web interface using their device (smartphone, tablet, PC) and enters basic information (name, age, gender, nationality, etc.) and travel preferences (areas of interest, budget, travel style, etc.) into the system. This information is temporarily stored on the device and then sent to the server. The server stores the received information in a database and creates a user profile.

[0568] Automatic travel plan generation

[0569] The server references the saved user profile and recommends travel destinations and tourist attractions from its internal database that match the user's preferences. The server then uses a generative AI model to automatically generate an optimal travel plan, including the order in which tourist attractions should be visited, the means of transportation, and travel time. This generated travel plan is displayed on the device, allowing the user to review and modify it.

[0570] Real-time adjustments

[0571] The server monitors external weather information and reservation status in real time, automatically adjusting travel plans and notifying the device of changes based on the situation. For example, if bad weather is forecast, the server will suggest safe alternative activities and reschedule the trip.

[0572] Providing digital travel experiences

[0573] The server generates VR and AR data of tourist spots and cultural assets, optimizes it for streaming, and delivers it to devices. Users can use this digital data to virtually explore tourist spots through their devices.

[0574] Reservation and payment

[0575] The server connects with multiple travel service platforms via API to collectively arrange reservations for tourist attractions and accommodations recommended by users, and also handles payment processing. Reservation and payment details are displayed on the terminal for users to review.

[0576] Emergency support

[0577] The server monitors emergency information in real time and quickly contacts the appropriate rescue agency if an emergency situation is detected, while the device provides detailed instructions to the user to ensure their safety.

[0578] Specific examples

[0579] For example, if a user is planning a trip from Japan to Paris, France, the following process is executed:

[0580] 1. The user accesses the app from their device and enters their basic information and travel preferences, which are then received by the server and stored in a database.

[0581] 2. The server recommends Paris based on the user's profile, selects tourist attractions such as the Eiffel Tower and the Louvre, and generates a travel plan. The plan is displayed on the device.

[0582] 3. The server monitors weather information and adjusts the schedule and notifies the device if bad weather is predicted.

[0583] 4. The server generates VR and AR data of the Eiffel Tower and the Louvre Museum and delivers it to the device, allowing the user to enjoy the virtual experience.

[0584] 5. The server then makes all the bookings for accommodation and sightseeing tickets, processes the payments, and displays the information on the terminal.

[0585] 6. If the user reports a health issue during the trip, the server will initiate an emergency response and coordinate with the appropriate rescue agency for a prompt response. The device will provide the user with the necessary instructions.

[0586] Prompt Sentence Examples

[0587] "I'm planning a trip from Japan to Paris, France. I'd like to enter my basic information and travel preferences and access travel plans, tourist attractions, VR experiences, reservations and payments, and emergency support."

[0588] The above program processing allows the user to experience a stress-free and comfortable trip.

[0589] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0590] Step 1: Fill in your user profile

[0591] The user accesses the application or web interface using their device. The user enters basic information (name, age, gender, nationality, etc.) and travel preferences (areas of interest, budget, travel style, etc.). The entered information is temporarily stored on the device and then sent to the server.

[0592] Input: User's basic information and preferences

[0593] Output: User profile data (stored on the server)

[0594] Step 2: Save your user profile

[0595] The server stores the user's basic information and preference information received from the device in a database. When storing, the information is registered in the appropriate table using the user ID.

[0596] Input: User profile data

[0597] Output: User profile in the database

[0598] Step 3: Recommend travel destinations and attractions

[0599] The server refers to the database and recommends travel destinations and tourist spots that suit the user's preferences. SQL queries are used to search the database.

[0600] Input: User profile data

[0601] Output: A list of recommended travel destinations and tourist attractions

[0602] Step 4: Automatically generate travel plans

[0603] The server uses the generative AI model to automatically generate a travel plan based on the recommended travel destinations and tourist attractions, calculating the order of visits, transportation means, travel time, etc., and creating a travel schedule.

[0604] Input: A list of recommended travel destinations and tourist attractions

[0605] Output: Travel plan

[0606] Step 5: View and confirm your travel plans

[0607] The terminal displays the generated itinerary to the user, who can then review it and make any necessary modifications. The modifications are then sent back to the server.

[0608] Input: Generated itinerary

[0609] Output: User confirmation and correction

[0610] Step 6: Monitor weather and booking information

[0611] The server uses external web service APIs to monitor weather information and reservation status in real time, adjusting travel plans as needed based on new weather data or reservation status.

[0612] Input: Weather information and reservation status from external web services

[0613] Output: Adjusted itinerary

[0614] Step 7: Adjust and notify travel plans

[0615] The server adjusts the travel plan as needed based on weather and reservation information and notifies the device of the new plan.

[0616] Input: Adjusted travel plans

[0617] Output: User notification

[0618] Step 8: Generate and distribute VR and AR data

[0619] The server generates VR and AR data of tourist spots and cultural assets, optimizes it for streaming, and delivers it to the device, which then displays it to the user.

[0620] Input: Data on tourist destinations and cultural properties

[0621] Output: VR and AR data

[0622] Step 9: Processing bookings and payments

[0623] The server connects with multiple travel service platforms via API to process reservations and payments for recommended travel services in one place, and the processing results are displayed on the terminal.

[0624] Input: User's booking and payment information

[0625] Output: Booking and payment details

[0626] Step 10: Emergency Support

[0627] The server monitors emergency information in real time and quickly contacts the appropriate rescue agency if an abnormal situation is detected. The device provides detailed instructions to the user to ensure their safety.

[0628] Input: User location and emergency status data

[0629] Output: Emergency response instructions and contact

[0630] At each of the above steps, users are provided with optimal travel plans and real-time responses tailored to their needs, allowing them to enjoy a comfortable and efficient travel experience.

[0631] (Application example 1)

[0632] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0633] Traditionally, creating and adjusting travel plans required a lot of manual work, making it time-consuming for users. It was also difficult to obtain real-time information during the trip or respond quickly to emergencies, which led to lower travel satisfaction. Further improvements were needed, particularly in the areas of automatic generation of travel plans using smart devices, real-time acquisition of weather and emergency information, and digital travel experiences using virtual reality and augmented reality.

[0634] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0635] In this invention, the server includes means for collecting basic information and preference information of a user, means for recommending travel destinations and tourist spots based on the basic information and preference information, means for automatically generating and displaying a travel plan including the travel destinations and tourist spots, means for delivering and displaying virtual reality data and augmented reality data to a user terminal, and means for monitoring weather information and reservation status in real time and adjusting the travel plan. This allows the user to automatically generate a travel plan without hassle, respond immediately to changes in the situation during the trip, and enjoy a rich digital travel experience using virtual reality and augmented reality.

[0636] "Basic user information" refers to basic information for identifying an individual, such as the user's name, age, sex, and nationality.

[0637] "Preference information" is information based on a user's personal preferences and interests, such as areas of interest, budget, and travel style.

[0638] "Travel destination" refers to a destination or city that a user visits.

[0639] "Tourist spots" refer to places of interest such as historical sites, natural landscapes, cultural assets, and leisure facilities at travel destinations.

[0640] A "travel plan" refers to a plan or schedule for a user's entire trip.

[0641] "Virtual reality data" is data on a three-dimensional space that is virtually reproduced using computer graphics.

[0642] "Augmented reality data" is data that displays digital information overlaid on real landscapes and objects.

[0643] "User terminal" refers to a computing device used by a user, such as a smartphone, tablet, or smart glasses.

[0644] "Weather Information" refers to information about current and future weather conditions.

[0645] "Reservation status" refers to information about reservations, such as availability at accommodations and tourist attractions.

[0646] "Emergency Information" refers to information about emergencies, such as health issues or traffic troubles that may occur during travel.

[0647] "Real-time" refers to the immediate processing and provision of ongoing events and information.

[0648] This invention is a system that recommends, plans, and adjusts smart travel plans according to travelers' needs. The system collects basic information and preference information from users, recommends optimal travel destinations and tourist spots based on that information, and automatically generates and displays travel plans. It also monitors weather and emergency information in real time, adjusts travel plans as needed, and notifies users. It can also provide digital travel experiences of tourist spots and cultural assets using virtual reality (VR) and augmented reality (AR).

[0649] The system is implemented as an application installed on a user device such as smart glasses. A specific example is shown below.

[0650] Creating a User Profile

[0651] The user puts on the smart glasses and inputs basic information (such as name, age, gender, and nationality) and travel preferences (areas of interest, budget, travel style, etc.) through a voice recognition interface. The server receives this information and stores it in a database as a profile.

[0652] Automatic travel plan generation

[0653] The server references a database based on the saved user profile and recommends travel destinations and tourist spots that suit the user's preferences. Based on the recommended information, the server automatically generates a travel plan and displays it on the smart glasses. The user can confirm and modify the plan by eye contact or voice.

[0654] Real-time adjustments

[0655] The server monitors weather and reservation information in real time and adjusts travel plans as needed based on the information it receives. For example, if the weather worsens, the server will make schedule changes and notify the smart glasses of the new plans, ensuring users always have the most up-to-date information on their travel plans.

[0656] Providing digital travel experiences

[0657] The server generates virtual reality and augmented reality data of tourist spots and cultural assets and distributes it to user devices. Users can view this digital data using smart glasses and virtually experience tourist spots.

[0658] Emergency support

[0659] The server monitors emergency information in real time and, if a health or traffic emergency occurs during travel, coordinates with the appropriate rescue agencies to respond quickly, while also notifying the smart glasses of emergency response details and providing necessary instructions.

[0660] Specific examples

[0661] For example, if a user is planning a trip from Japan to Paris, France, the following process is executed:

[0662] Input Process

[0663] A user puts on the smart glasses and enters the following prompt sentence into the speech recognition interface:

[0664] Example prompt: "Hello, I'm a 30-year-old man living in Japan. I'm planning a trip to Paris. I love history, art, and nature, my budget is ¥200,000, and I prefer an active travel style."

[0665] System Operation

[0666] 1. The server receives the user's basic information and preference information and stores it in a database.

[0667] 2. The server recommends travel destinations and attractions based on the stored profile.

[0668] 3. The travel plan automatically generated by the server is displayed on the smart glasses.

[0669] 4. Monitor weather and booking information in real time and adjust your travel plans as needed.

[0670] 5. Deliver virtual reality and augmented reality data to user devices to provide a digital travel experience.

[0671] 6. Monitor emergency information and respond promptly to emergency situations in coordination with rescue agencies when necessary.

[0672] This system allows users to enjoy a stress-free and comfortable travel experience, and also ensures safety during travel by providing real-time information.

[0673] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0674] Step 1:

[0675] Creating a User Profile

[0676] The user puts on the smart glasses and inputs basic information (such as name, age, gender, and nationality) and travel preferences (areas of interest, budget, travel style, etc.) through a voice recognition interface. The input information is sent to the server and stored in a database as a user profile.

[0677] Input: Basic information and preference information entered by the user via voice

[0678] Output: User profile stored on the server

[0679] What happens: The user speaks a prompt like this: "Hello, I'm a 30-year-old man living in Japan. I'm planning a trip to Paris. I love history, art, and nature, my budget is ¥200,000, and I prefer an active travel style."

[0680] Step 2:

[0681] Automatic travel plan generation

[0682] The server recommends suitable travel destinations and tourist attractions from an internal database and external data sources based on the user profile, automatically generates a travel plan based on the recommended information, and displays the plan on the smart glasses.

[0683] Input: User profile

[0684] Output: A recommended list of travel destinations and attractions based on user preferences, along with a travel plan

[0685] Specific operation: The server retrieves tourist spot information that matches the user's interests from the database, generates a travel plan, and displays it on the smart glasses. The user can confirm and modify the plan using their eyes or voice.

[0686] Step 3:

[0687] Real-time adjustments

[0688] The server monitors weather information and reservation status in real time and adjusts the travel plan accordingly, which is then sent to the smart glasses.

[0689] Input: Real-time weather information and reservation status

[0690] Output: Adjusted itinerary

[0691] Specific operation: The server uses a weather API to continuously check local weather information, and if bad weather is forecast, it changes the travel plan and notifies the smart glasses of the new plan.

[0692] Step 4:

[0693] Providing digital travel experiences

[0694] The server generates virtual reality and augmented reality data of tourist spots and cultural properties and distributes it to user devices (smart glasses). Users can use this data to enjoy virtual travel.

[0695] Input: Digital content data related to tourist destinations and cultural properties

[0696] Output: Virtual reality and augmented reality data displayed on smart glasses

[0697] Specific operation: The server delivers VR data, including historical information about tourist spots, to the smart glasses, allowing users to experience the place as if they were actually there.

[0698] Step 5:

[0699] Emergency support

[0700] The server monitors emergency information in real time and responds promptly to any health or traffic issues that may arise during travel by coordinating with the appropriate rescue agencies. Emergency response details are then sent to the smart glasses, which provide necessary instructions to the user.

[0701] Input: Emergency information to obtain while traveling

[0702] Output: Contact rescue agencies and emergency response instructions

[0703] Specific operation: When a user reports a health problem, the server contacts the hospital and displays the route to the nearest hospital and emergency response procedures on the smart glasses.

[0704] Thus, the present invention provides a range of features that allow users to automatically generate travel plans, respond to situations in real time while traveling, and even provide digital experiences using virtual reality.

[0705] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0706] The present invention combines an emotion engine with a system for recommending, planning and adjusting smart travel plans according to travelers' needs, and is implemented as follows.

[0707] Creating a User Profile

[0708] A user accesses the application or web interface using a device (smartphone, tablet, PC, etc.) and enters basic information (name, age, gender, nationality, etc.) and travel preferences (areas of interest, budget, travel style, etc.). This information is sent to a server and stored in a database as a profile. The user's emotional information is also collected and integrated into the profile.

[0709] Automatic travel plan generation

[0710] The server references the database based on the saved user profile and automatically recommends travel destinations and tourist spots that match the user's preferences. Based on the recommended information, the server automatically generates a travel plan and creates a travel schedule. The device displays the generated travel plan to the user, who can check and modify it.

[0711] Combining Emotion Engines

[0712] The server uses an emotion engine to analyze the user's real-time emotional information. Based on this information, the contents of the travel plan and schedule can be adjusted. For example, if the user is feeling stressed, the server can add relaxation spots.

[0713] Real-time adjustments

[0714] The server monitors weather information and reservation status in real time and adjusts travel plans as necessary based on the information obtained. For example, if the weather worsens, the server changes the schedule and notifies the device of the new plans. This allows users to always keep up with the latest travel plans. In addition, changes in emotions detected by the emotion engine are reflected in real time.

[0715] Providing digital travel experiences

[0716] The server generates virtual reality (VR) and augmented reality (AR) data of tourist spots and cultural assets and distributes it to devices. Users can view this digital data on their devices and virtually experience tourist spots, thereby gaining a deeper understanding and enjoyment during their trip.

[0717] Reservation and payment

[0718] The server connects with multiple travel service platforms to make reservations for recommended tourist spots and accommodations in one place. The server also processes all payments for reservations and displays the results on the terminal. This allows users to skip the cumbersome process of going through multiple platforms and make reservations and payments easily.

[0719] Emergency support

[0720] The server monitors emergency information in real time and responds quickly if a health or traffic problem occurs during travel. The server connects with appropriate rescue agencies (hospitals, police, fire department, etc.) and coordinates rescue efforts. The device notifies the user of emergency response details and provides necessary instructions to ensure the user's safety.

[0721] Specific examples

[0722] For example, if a user is planning a trip from Japan to Paris, France, the following process is executed:

[0723] 1. Users enter their basic information and travel preferences into the device, and the server stores it in a database. The emotion engine then analyzes the user's emotions and integrates that information into the profile.

[0724] 2. The server recommends Paris and selects tourist spots such as the Eiffel Tower and the Louvre. An itinerary is automatically generated and displayed on the device.

[0725] 3. The server monitors weather information before and during the trip, and if the weather worsens, adjusts the schedule and notifies the terminal.

[0726] 4. The server generates VR and AR data for the tourist spot and distributes it to the device, allowing the user to enjoy the virtual experience.

[0727] 5. The server then makes all the bookings for accommodation and sightseeing tickets, processes the payments, and displays the results on the terminal.

[0728] 6. If the emotion engine detects that the user is feeling stressed during the trip, the server will add relaxation spots and adjust the schedule.

[0729] 7. In the event of a health issue, the server will initiate an emergency response and coordinate with the appropriate rescue agencies for immediate action. The device will provide detailed instructions to the user.

[0730] This allows users to enjoy a stress-free and comfortable travel experience.The present invention is a system for improving the efficiency of travel planning, resolving problems during travel, and responding based on emotions, and it represents a significant improvement over conventional travel procedures.

[0731] The processing flow will be explained below.

[0732] Step 1:

[0733] A user accesses an application or web interface using a device (smartphone, tablet, PC, etc.) and enters basic information (name, age, gender, nationality, etc.).

[0734] Step 2:

[0735] Users input their areas of interest (history, nature, culture, etc.), budget, and travel style (adventure, relaxation, etc.) into the terminal.

[0736] Step 3:

[0737] The terminal transmits the input basic information and preference information to the server.

[0738] Step 4:

[0739] The server creates a user profile based on the received information and stores it in a database.

[0740] Step 5:

[0741] The server also uses an emotion engine to collect the user's emotion information and integrate it into the profile.

[0742] Step 6:

[0743] The server refers to the database and recommends travel destinations that match the user's preferences.

[0744] Step 7:

[0745] The server selects tourist attractions and activities from the recommended travel destinations.

[0746] Step 8:

[0747] The server automatically generates a travel plan based on tourist attractions and activities and creates a schedule.

[0748] Step 9:

[0749] The terminal displays the generated travel plan to the user, who can then confirm and modify the plan.

[0750] Step 10:

[0751] The server monitors weather information and reservation status in real time.

[0752] Step 11:

[0753] If the server detects changes in weather or reservations, it adjusts travel plans and updates schedules.

[0754] Step 12:

[0755] The terminal notifies the user of the updated schedule and allows the user to confirm it.

[0756] Step 13:

[0757] The server prepares virtual reality (VR) and augmented reality (AR) data of tourist attractions and cultural properties.

[0758] Step 14:

[0759] The server delivers VR and AR data to the device.

[0760] Step 15:

[0761] Users use the device to view VR and AR data and enjoy the virtual experience.

[0762] Step 16:

[0763] The server works in conjunction with the travel service platform to arrange reservations for accommodation and sightseeing tickets all at once.

[0764] Step 17:

[0765] The server calculates the total cost for the reservation and processes the payment in one lump sum.

[0766] Step 18:

[0767] The terminal displays a confirmation of the reservation completion to the user.

[0768] Step 19:

[0769] The server monitors emergency information occurring during travel in real time.

[0770] Step 20:

[0771] If the server detects an emergency (health problem or traffic trouble), it will coordinate with appropriate rescue agencies and implement emergency response.

[0772] Step 21:

[0773] The device will notify the user of emergency response details and provide necessary instructions.

[0774] Step 22:

[0775] At any step, the server analyzes the user's emotional information using an emotion engine, and if it detects stress or dissatisfaction, it adjusts the itinerary, for example, by adding a relaxing spot or changing the order of activities.

[0776] Step 23:

[0777] The terminal notifies the user of the travel plan adjusted based on the emotion and allows the user to confirm it.

[0778] Example 2

[0779] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0780] Conventional travel planning systems not only recommend travel destinations and tourist spots that match a user's preferences, but also lack the ability to reflect the user's emotional and weather information in real time. They also lack the ability to respond to emergencies and process reservations and payments across multiple travel service platforms. This creates a demand for systems that can improve the quality of users' travel experiences.

[0781] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0782] In this invention, the server includes means for collecting basic information and preference information of a user, means for recommending travel destinations and tourist spots based on the basic information and preference information, means for automatically generating and displaying a travel plan including the travel destinations and tourist spots, means for collecting and analyzing user emotional information and reflecting the emotional information in the travel plan, means for monitoring weather information and reservation status in real time and adjusting the travel plan, means for generating virtual reality data and augmented reality data of tourist spots and cultural properties and distributing them to a user terminal, means for linking with multiple travel service platforms and processing reservations and payments in a lump sum, and means for linking with appropriate rescue organizations in the event of an emergency and providing instructions to the user terminal. This allows for the provision of a travel plan optimal for the user's preferences and emotional state, and enables real-time adjustments and emergency response.

[0783] A "user" is an individual or group that uses the system to create a travel plan and plan sightseeing.

[0784] "Basic information" is data for identifying an individual, such as the user's name, age, sex, and nationality.

[0785] "Preference information" is data indicating the user's individual preferences, such as areas of interest, travel style, and budget, which are necessary for selecting and planning a travel destination.

[0786] "Emotion information" is data that indicates the emotional state, such as stress or joy, that the user feels while traveling.

[0787] A "travel destination" is a region or city that a user aims to visit.

[0788] A "tourist attraction" is a place or facility of particular importance or interest in a travel destination.

[0789] A "travel plan" is a plan that includes a schedule of places to visit and activities, automatically generated based on the user's preferences and emotional information.

[0790] "Real-time" weather and reservation monitoring means getting the latest information instantly and adjusting your travel plans accordingly.

[0791] "Virtual reality data" is data on virtually recreated tourist spots and cultural assets.

[0792] "Augmented reality data" is information provided by overlaying digital information onto real-world scenes.

[0793] A "travel service platform" is a system or website that provides online reservations and payments for accommodation and sightseeing tickets.

[0794] An "emergency" is a situation in which a user faces an unexpected situation such as a health problem or traffic trouble while traveling.

[0795] "Rescue agencies" are organizations such as hospitals, police, and fire departments that deal with health issues, traffic accidents, etc.

[0796] A "terminal" is a device such as a smartphone, tablet, or PC that a user uses to access the system and input or retrieve travel planning information.

[0797] The present invention combines an emotion engine with a system for recommending, planning and adjusting smart travel plans according to traveler needs, and embodiments thereof are described in detail below.

[0798] Creating a User Profile

[0799] A user accesses the application or web interface using a device (smartphone, tablet, PC, etc.) and enters basic information (name, age, gender, nationality, etc.) and travel preferences (areas of interest, budget, travel style, etc.), including settings for entering emotional information. This information is sent to the server and stored in a database. The emotional engine evaluates the user's emotional state based on the information entered and integrates the results into a profile.

[0800] Recommendations for travel destinations and attractions

[0801] Based on the saved user profile, the server references a database and automatically recommends travel destinations and tourist attractions that match the user's preferences. A generative AI model is then used to generate a list of suitable travel destination and tourist attraction recommendations. This list is based on the user's profile information and emotional information, providing suggestions that best suit individual needs.

[0802] Automatic travel plan generation

[0803] The server automatically generates a detailed travel plan based on the generated recommendation list. The travel plan includes multiple itineraries and activities and is customized based on the user's preferences and emotional information. The generated travel plan is displayed to the user via their device, allowing them to review and modify the plan as needed.

[0804] Real-time adjustments

[0805] The server monitors weather information and reservation status in real time and can adjust travel plans as needed. For example, schedule changes are made in response to sudden changes in the weather or cancellations of reservations. Adjusted travel plans are notified to the device, providing the user with the latest information.

[0806] Providing digital travel experiences

[0807] The server generates virtual reality (VR) and augmented reality (AR) data of tourist spots and cultural assets and distributes it to devices. Users can view this digital data through their devices and virtually experience tourist spots, allowing them to enjoy their local travel experience more deeply.

[0808] Bulk booking and payment

[0809] The server connects with multiple travel service platforms to make reservations for recommended tourist spots and accommodations in one place. The server also processes all payments for reservations and displays the results on the terminal. This allows users to avoid the cumbersome process of going through multiple platforms and make reservations and payments easily.

[0810] Emergency support

[0811] The server monitors emergency information in real time and responds quickly if a health or traffic problem occurs during travel. It also coordinates necessary rescue operations by connecting with appropriate rescue agencies. The device notifies the user of emergency response details and provides necessary instructions to ensure the user's safety.

[0812] Specific examples

[0813] For example, if a user is planning a trip from Japan to Paris, France, they can input the following prompt into the generative AI model:

[0814] Please recommend suitable travel destinations based on the user profile below.

[0815] Name: User A

[0816] Age: 30

[0817] Gender: Male

[0818] Nationality: Japanese

[0819] Interests: Historical sites

[0820] Budget: 100,000 yen

[0821] This enables the system to provide optimal travel plans that meet the user's needs and improve the travel experience.

[0822] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0823] Step 1: Create a user profile

[0824] A user accesses the application or web interface using a device and enters basic information (such as name, age, gender, and nationality) and travel preferences (such as areas of interest, budget, and travel style). The device then sends the entered information to the server, which then stores the data in a database. At the same time, a prompt for emotional assessment is displayed, evaluating the user's emotional state and integrating that information into the profile. For example, if a user enters "I'm interested in historical tourist sites" and "My budget is within 100,000 yen," the emotional information is saved along with that information.

[0825] Input: User's basic information, preference information, emotional information

[0826] Output: User profile stored in the database

[0827] Step 2: Recommend travel destinations and attractions

[0828] The server searches the database for potential travel destinations based on the saved user profile. Using a generative AI model, the server generates a list of travel destinations and tourist attractions that match the user's preferences based on the user's profile information. For example, the Eiffel Tower and the Louvre Museum in Paris may be recommended. The generated list is sent to the device for the user to review.

[0829] Input: User profile

[0830] Output: A list of recommended travel destinations and attractions

[0831] Step 3: Automatically generate a travel plan

[0832] The server automatically generates a detailed travel plan based on the recommendation list. It takes into account the user's preferences and emotional information to optimize the schedule and activities. For example, if the user prioritizes relaxation, it will include relaxing spots in the schedule. The generated plan is sent to the device, where the user can review and modify it.

[0833] Input: List of recommended travel destinations and attractions, user profile

[0834] Output: An automatically generated itinerary

[0835] Step 4: Adjust in real time

[0836] The server monitors weather information and reservation status in real time and adjusts travel plans as needed. For example, if the weather worsens, it will change activities to indoors. Once the plan has been adjusted, it will be notified to the device, providing the user with the latest information.

[0837] Input: Weather information, reservation status, travel plans

[0838] Output: Adjusted itinerary

[0839] Step 5: Delivering digital travel experiences

[0840] The server generates virtual reality (VR) and augmented reality (AR) data of tourist attractions and cultural properties and delivers it to the device. The user can view this data on the device and virtually experience the tourist attractions. For example, if the user is at the Louvre Museum, they can view a 3D model through the device and obtain additional information.

[0841] Input: Information about tourist spots and cultural assets

[0842] Output: VR and AR data

[0843] Step 6: Batch booking and payment

[0844] The server connects with multiple travel service platforms to make reservations for recommended accommodations and sightseeing tickets in one place. The server also processes all payments for the reservations in one place, and the results are displayed on the terminal. For example, a notification such as "Reservation completed at XX hotel" or "Museum ticket purchase completed" is displayed.

[0845] Input: Travel plan, user profile

[0846] Output: Notification of reservation and payment completion

[0847] Step 7: Emergency Support

[0848] The server monitors emergency information in real time and responds quickly if a health or traffic problem occurs during travel. The device coordinates the necessary rescue operations by connecting with the appropriate rescue agencies, notifying the user of the details of the response and providing necessary instructions to ensure the user's safety. For example, if the user feels unwell, information about nearby hospitals and the best transportation options will be provided.

[0849] Input: Emergency information, user location information

[0850] Output: Emergency response instructions and rescue agency contact information

[0851] (Application example 2)

[0852] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0853] Conventional travel plan generation systems struggle to make real-time adjustments that fully reflect user preferences and emotions, making it difficult to increase user satisfaction. They also struggle to automatically generate travel plans that integrate multiple information sources and adapt to changing conditions during a trip. This often leaves users feeling stressed and detracts from their travel experience.

[0854] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for collecting basic information and preference information of a user; means for recommending travel destinations and tourist spots based on the basic information and preference information; means for automatically generating and displaying a travel plan including the travel destinations and tourist spots; means for collecting and analyzing user emotion information; means for adjusting the travel plan in real time based on the emotion information; means for monitoring weather information and reservation status in real time and adjusting the travel plan; means for notifying the user of the adjusted travel plan; means for providing virtual reality data and augmented reality data of tourist spots and cultural properties; means for delivering and displaying the virtual reality data and augmented reality data to a user terminal; means for automatically generating a travel plan using a generative AI model and adjusting it in real time based on the emotion information; and means for simplifying user input using prompt sentences to support travel plan generation. This enables automatic generation and real-time adjustment of an optimal travel plan based on a user's preferences and emotions.

[0855] "Basic information" refers to personal identification information such as the user's name, age, sex, and nationality.

[0856] "Preference information" is information that reflects the user's preferences, such as areas of interest, budget, and travel style.

[0857] A "travel destination" is a destination, such as a geographical location or city, that a user plans to visit.

[0858] "Tourist spots" are places that users visit, such as tourist attractions, cultural assets, and attractions at travel destinations.

[0859] A "travel plan" is a plan that includes a travel schedule and itinerary, created based on the user's preference information and basic information.

[0860] "Emotional information" is data that represents the user's current emotional state, including stress, relaxation, excitement, and the like.

[0861] "Real-time adjustment" is the process of instantly changing and updating travel plans in response to changing conditions during the trip (weather information, reservation status, emotional information, etc.).

[0862] "Weather information" is data about the current and forecast weather at a travel destination.

[0863] "Reservation status" is information indicating the reservation availability of facilities and transportation related to the trip.

[0864] "Virtual reality data" is digital data that provides users with an immersive virtual visual experience.

[0865] "Augmented reality data" is data used to display virtual information overlaid on the real world.

[0866] A "user terminal" is an electronic device (such as a smartphone, tablet, or PC) that a user uses to view or input information.

[0867] A "generative AI model" is an artificial intelligence model that learns patterns based on large amounts of data and automatically generates travel plans.

[0868] A "prompt sentence" is a standard sentence that simplifies the information that the user inputs and clarifies instructions to the system.

[0869] To implement this invention, a system that mainly uses a server, a user terminal, and some dedicated software is required. The main configuration and operation procedure of this system are as follows.

[0870] First, the user enters their basic information (name, age, gender, nationality, etc.) and preference information (areas of interest, budget, travel style, etc.) using a user device (smartphone, tablet, PC, etc.). This information is sent to the server, which then stores it in a database.

[0871] The server then recommends travel destinations and tourist attractions based on the collected basic information and preference information. Based on the recommended information, the server automatically generates a travel plan and displays it on the user's device. In this process, the server uses a generative AI model to generate the optimal travel plan. The generative AI model has learned a large amount of data in advance and is capable of providing a plan that best suits the user's preferences.

[0872] A visual interface is provided on the user's terminal to allow the user to review and modify the travel plan. Once the user approves the plan, the server confirms the plan. Prompt sentences are also used to simplify the user's input and assist in generating the optimal travel plan.

[0873] In addition, the server monitors weather and reservation status in real time and adjusts travel plans based on this information. For example, if a reservation for a planned tourist spot is canceled at the last minute, the server will automatically recommend an alternative tourist spot and notify the user. This process is also automatic and is reflected in real time on the user's device.

[0874] The system also incorporates an emotion engine that collects and analyzes the user's emotional information. If the user feels stressed during the trip, the server will make real-time adjustments, such as adding relaxation spots.

[0875] It also provides virtual reality (VR) and augmented reality (AR) data of tourist spots and cultural assets, allowing users to virtually experience tourist spots before or during their trip using dedicated AR / VR headsets or smartphones.

[0876] For example, if a user is planning a trip to Paris, the following happens:

[0877] 1. The user enters basic information and preferences into the app.

[0878] 2. The server recommends Paris and generates a travel plan that includes attractions such as the Eiffel Tower and the Louvre.

[0879] 3. Real-time analysis of when you feel stressed and adding a visit to a relaxing cafe.

[0880] 4. Providing a virtual experience of the Eiffel Tower through VR / AR content.

[0881] An example of a prompt is as follows:

[0882] "You enter your basic information and preferences to create a user profile. Then, the system generates a smart itinerary based on that, adjusting in real time. It also provides VR / AR experiences of tourist attractions. For example, if you enter, 'If I'm traveling to Paris, I want to visit the Eiffel Tower and the Louvre Museum. I also want to visit a relaxing cafe,' the system will automatically generate an itinerary for your Paris trip."

[0883] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0884] Step 1:

[0885] A user accesses the application using a terminal and inputs basic information and preferences. This input includes information such as name, age, gender, nationality, areas of interest, budget, and travel style. The terminal sends this information to the server. Data processing involves converting the input information into a standard format and storing it in a database. The output is a database entry that stores the user's basic information and preferences.

[0886] Step 2:

[0887] The server uses a generative AI model to recommend optimal travel destinations and tourist attractions based on the saved user profile. The server uses basic information and preference information as input data, and performs calculations by calling the generative AI model that has learned from past data and trends. The output is a list of recommended travel destinations and tourist attractions.

[0888] Step 3:

[0889] The server automatically generates a travel plan including recommended destinations and tourist attractions and displays it on the device. The travel plan includes travel dates, duration of stay, and access methods. The server creates the plan using a generative AI model and retrieves the necessary details from a database. The output is an automatically generated travel plan that is displayed on the user's device.

[0890] Step 4:

[0891] The server collects the user's emotional information and analyzes it using an emotion engine. The data required for emotion analysis (facial expressions, tone of voice, etc.) is collected from the camera and microphone installed on the user's device. The server inputs this data into the emotion engine and calculates the user's emotional state. The output is the user's emotional profile, updated in real time.

[0892] Step 5:

[0893] Based on the user's emotional information, the server adjusts the travel plan in real time. For example, if the user is feeling stressed, the server adds relaxing spots and activities to the plan. This generates a travel plan that reflects the user's emotional state. As a data calculation, a new plan is calculated using the emotional information and the existing travel plan as input data. The output is the adjusted travel plan.

[0894] Step 6:

[0895] The server monitors weather information and reservation status in real time. It accesses the weather information API and reservation management system to obtain the latest information. The server reflects this information in the travel plan and updates the plan as necessary. The output is the latest travel plan adjusted according to the weather and reservation status, and is notified to the user's device.

[0896] Step 7:

[0897] Virtual reality and augmented reality data of tourist spots and cultural assets are delivered to user devices. The server generates the corresponding VR / AR data and sends it to the user device. Users can view this digital data using their devices and virtually experience tourist spots. The output is VR / AR content displayed on the user device.

[0898] Step 8:

[0899] The user approves the itinerary, and the server finalizes the travel plan using the generative AI model. After receiving approval input from the user's device, the server saves the final plan in the database. The output is the finalized travel plan.

[0900] Step 9:

[0901] The server generates prompts to prompt the user to simply input details of their travel plans. The prompts are automatically generated based on pre-defined templates. The output is a prompt that facilitates intuitive input by the user.

[0902] Example prompt sentence:

[0903] "You enter your basic information and preferences to create a user profile. Then, the system generates a smart itinerary based on that, adjusting in real time. It also provides VR / AR experiences of tourist attractions. For example, if you enter, 'If I'm traveling to Paris, I want to visit the Eiffel Tower and the Louvre Museum. I also want to visit a relaxing cafe,' the system will automatically generate an itinerary for your Paris trip."

[0904] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0905] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0906] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0907] [Third embodiment]

[0908] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0909] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0910] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0911] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0912] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0913] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0914] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0915] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0916] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0917] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0918] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0919] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0920] The present invention is a system for recommending, planning, and adjusting smart travel plans according to travelers' needs, and is implemented as follows.

[0921] Creating a User Profile

[0922] A user accesses the application or web interface using a device (smartphone, tablet, PC, etc.) and enters basic information (name, age, gender, nationality, etc.) and travel preferences (areas of interest, budget, travel style, etc.). This information is sent to the server and stored in a database as a profile.

[0923] Automatic travel plan generation

[0924] The server references the database based on the saved user profile and automatically recommends travel destinations and tourist spots that match the user's preferences. Based on the recommended information, the server automatically generates a travel plan and creates a travel schedule. The device displays the generated travel plan to the user, who can check and modify it.

[0925] Real-time adjustments

[0926] The server monitors weather information and reservation status in real time and adjusts travel plans as needed based on the information it obtains. For example, if the weather worsens, the server will change the schedule and notify the device of the new plans. This allows users to always keep up to date with their travel plans.

[0927] Providing digital travel experiences

[0928] The server generates virtual reality (VR) and augmented reality (AR) data of tourist spots and cultural assets and distributes it to devices. Users can view this digital data on their devices and virtually experience tourist spots, thereby gaining a deeper understanding and enjoyment during their trip.

[0929] Reservation and payment

[0930] The server connects with multiple travel service platforms to make reservations for recommended tourist spots and accommodations in one place. The server also processes all payments for reservations and displays the results on the terminal. This allows users to skip the cumbersome process of going through multiple platforms and make reservations and payments easily.

[0931] Emergency support

[0932] The server monitors emergency information in real time and responds quickly if a health or traffic problem occurs during travel. The server connects with appropriate rescue agencies (hospitals, police, fire department, etc.) and coordinates rescue efforts. The device notifies the user of emergency response details and provides necessary instructions to ensure the user's safety.

[0933] Specific examples

[0934] For example, if a user is planning a trip from Japan to Paris, France, the following process is executed:

[0935] 1. The user enters their basic information and travel preferences into the terminal, and the server stores it in a database.

[0936] 2. The server recommends Paris and selects tourist spots such as the Eiffel Tower and the Louvre. An itinerary is automatically generated and displayed on the device.

[0937] 3. The server monitors weather information before and during the trip, and if the weather worsens, adjusts the schedule and notifies the terminal.

[0938] 4. The server generates VR and AR data for the tourist spot and distributes it to the device, allowing the user to enjoy the virtual experience.

[0939] 5. The server then makes all the bookings for accommodation and sightseeing tickets, processes the payments, and displays the results on the terminal.

[0940] 6. If the user reports a health issue during the trip, the server will initiate an emergency response and coordinate with the appropriate rescue agency for immediate action. The device will provide detailed instructions to the user.

[0941] With the above functions, users can enjoy a stress-free and comfortable travel experience. The present invention is a system for improving the efficiency of travel planning and resolving problems during travel, and it achieves significant improvements over conventional travel procedures.

[0942] The processing flow will be explained below.

[0943] Step 1:

[0944] A user accesses an application or web interface using a device (smartphone, tablet, PC, etc.) and enters basic information (name, age, gender, nationality, etc.).

[0945] Step 2:

[0946] Users input their areas of interest (history, nature, culture, etc.), budget, and travel style (adventure, relaxation, etc.) into the terminal.

[0947] Step 3:

[0948] The terminal transmits the input basic information and preference information to the server.

[0949] Step 4:

[0950] The server creates a user profile based on the received information and stores it in a database.

[0951] Step 5:

[0952] The server refers to the database and recommends travel destinations that match the user's preferences.

[0953] Step 6:

[0954] The server selects tourist attractions and activities from the recommended travel destinations.

[0955] Step 7:

[0956] The server automatically generates a travel plan based on tourist attractions and activities and creates a schedule.

[0957] Step 8:

[0958] The terminal displays the generated travel plan to the user, who can then confirm and modify the plan.

[0959] Step 9:

[0960] The server monitors weather information and reservation status in real time.

[0961] Step 10:

[0962] If the server detects changes in weather or reservations, it adjusts travel plans and updates schedules.

[0963] Step 11:

[0964] The terminal notifies the user of the updated schedule and allows the user to confirm it.

[0965] Step 12:

[0966] The server prepares virtual reality (VR) and augmented reality (AR) data of tourist attractions and cultural properties.

[0967] Step 13:

[0968] The server delivers VR and AR data to the device.

[0969] Step 14:

[0970] Users use the device to view VR and AR data and enjoy the virtual experience.

[0971] Step 15:

[0972] The server works in conjunction with the travel service platform to arrange reservations for accommodation and sightseeing tickets all at once.

[0973] Step 16:

[0974] The server calculates the total cost for the reservation and processes the payment in one lump sum.

[0975] Step 17:

[0976] The terminal displays a confirmation of the reservation completion to the user.

[0977] Step 18:

[0978] The server monitors emergency information occurring during travel in real time.

[0979] Step 19:

[0980] If the server detects an emergency (health problem or traffic trouble), it will coordinate with appropriate rescue agencies and implement emergency response.

[0981] Step 20:

[0982] The device will notify the user of emergency response details and provide necessary instructions.

[0983] Example 1

[0984] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0985] Traditionally, planning a trip has involved a lot of time-consuming and laborious tasks, such as gathering destination information, creating an itinerary, making reservations and payments, and even responding to emergencies. In addition, systems lacked the ability to monitor weather information and reservation status in real time, adjust travel plans as needed, and provide a digital experience. There is a need for more advanced systems that can solve these problems and allow users to enjoy stress-free, comfortable travel.

[0986] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0987] In this invention, the server includes means for collecting basic information and preference information of a user, means for recommending travel destinations and tourist attractions based on the basic information and preference information, means for automatically generating and displaying a travel itinerary including the travel destinations and tourist attractions, means for monitoring weather information and reservation status in real time and adjusting the travel itinerary, means for generating virtual reality data and augmented reality data of tourist attractions and distributing and displaying them to a user terminal, means for processing reservations and payments for travel services, and means for monitoring and responding to emergency information. This allows users to plan, execute, and respond to emergency situations all in one system, allowing them to enjoy a stress-free and comfortable trip.

[0988] "User" means an individual or organization that uses the system.

[0989] "Basic information" refers to personal data such as the user's name, age, gender, and nationality.

[0990] "Preference information" is data relating to the user's preferences such as areas of interest, budget, and travel style.

[0991] A "travel destination" is a destination such as a city or region that the user wants to visit.

[0992] "Tourist destinations" are famous places and tourist spots that are worth visiting when traveling.

[0993] A "travel plan" is a detailed itinerary that includes a user's travel schedule and list of places to visit.

[0994] "Means" refers to the methods or functions used to achieve a specific purpose.

[0995] A "server" is a central computer that processes and stores data.

[0996] A "database" is a system for systematically storing and managing large amounts of data.

[0997] A "generative AI model" is an algorithm or program that uses artificial intelligence to generate a specific outcome.

[0998] "VR (virtual reality) data" is data that allows users to create and experience a virtual environment using computer technology.

[0999] "AR (Augmented Reality) data" is data used to add virtual elements to the real environment.

[1000] A "reservation" is the process of reserving in advance the use of a particular service or facility.

[1001] "Payment" is the act of providing money for a service or product.

[1002] "Emergency information" refers to data related to emergencies such as health problems and traffic troubles that occur during travel.

[1003] "Notification" is a means of conveying information from the system to the user.

[1004] This invention is a system for making users' travel experiences more comfortable. Specifically, it is a system that automatically generates travel plans based on the user's basic information and preference information, and provides real-time adjustments, digital experiences, reservation and payment management, and even emergency support all in one.

[1005] Creating a User Profile

[1006] A user accesses the application or web interface using their device (smartphone, tablet, PC) and enters basic information (name, age, gender, nationality, etc.) and travel preferences (areas of interest, budget, travel style, etc.) into the system. This information is temporarily stored on the device and then sent to the server. The server stores the received information in a database and creates a user profile.

[1007] Automatic travel plan generation

[1008] The server references the saved user profile and recommends travel destinations and tourist attractions from its internal database that match the user's preferences. The server then uses a generative AI model to automatically generate an optimal travel plan, including the order in which tourist attractions should be visited, the means of transportation, and travel time. This generated travel plan is displayed on the device, allowing the user to review and modify it.

[1009] Real-time adjustments

[1010] The server monitors external weather information and reservation status in real time, automatically adjusting travel plans and notifying the device of changes based on the situation. For example, if bad weather is forecast, the server will suggest safe alternative activities and reschedule the trip.

[1011] Providing digital travel experiences

[1012] The server generates VR and AR data of tourist spots and cultural assets, optimizes it for streaming, and delivers it to devices. Users can use this digital data to virtually explore tourist spots through their devices.

[1013] Reservation and payment

[1014] The server connects with multiple travel service platforms via API to collectively arrange reservations for tourist attractions and accommodations recommended by users, and also handles payment processing. Reservation and payment details are displayed on the terminal for users to review.

[1015] Emergency support

[1016] The server monitors emergency information in real time and quickly contacts the appropriate rescue agency if an emergency situation is detected, while the device provides detailed instructions to the user to ensure their safety.

[1017] Specific examples

[1018] For example, if a user is planning a trip from Japan to Paris, France, the following process is executed:

[1019] 1. The user accesses the app from their device and enters their basic information and travel preferences, which are then received by the server and stored in a database.

[1020] 2. The server recommends Paris based on the user's profile, selects tourist attractions such as the Eiffel Tower and the Louvre, and generates a travel plan. The plan is displayed on the device.

[1021] 3. The server monitors weather information and adjusts the schedule and notifies the device if bad weather is predicted.

[1022] 4. The server generates VR and AR data of the Eiffel Tower and the Louvre Museum and delivers it to the device, allowing the user to enjoy the virtual experience.

[1023] 5. The server then makes all the bookings for accommodation and sightseeing tickets, processes the payments, and displays the information on the terminal.

[1024] 6. If the user reports a health issue during the trip, the server will initiate an emergency response and coordinate with the appropriate rescue agency for a prompt response. The device will provide the user with the necessary instructions.

[1025] Prompt Sentence Examples

[1026] "I'm planning a trip from Japan to Paris, France. I'd like to enter my basic information and travel preferences and access travel plans, tourist attractions, VR experiences, reservations and payments, and emergency support."

[1027] The above program processing allows the user to experience a stress-free and comfortable trip.

[1028] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1029] Step 1: Fill in your user profile

[1030] The user accesses the application or web interface using their device. The user enters basic information (name, age, gender, nationality, etc.) and travel preferences (areas of interest, budget, travel style, etc.). The entered information is temporarily stored on the device and then sent to the server.

[1031] Input: User's basic information and preferences

[1032] Output: User profile data (stored on the server)

[1033] Step 2: Save your user profile

[1034] The server stores the user's basic information and preference information received from the device in a database. When storing, the information is registered in the appropriate table using the user ID.

[1035] Input: User profile data

[1036] Output: User profile in the database

[1037] Step 3: Recommend travel destinations and attractions

[1038] The server refers to the database and recommends travel destinations and tourist spots that suit the user's preferences. SQL queries are used to search the database.

[1039] Input: User profile data

[1040] Output: A list of recommended travel destinations and tourist attractions

[1041] Step 4: Automatically generate travel plans

[1042] The server uses the generative AI model to automatically generate a travel plan based on the recommended travel destinations and tourist attractions, calculating the order of visits, transportation means, travel time, etc., and creating a travel schedule.

[1043] Input: A list of recommended travel destinations and tourist attractions

[1044] Output: Travel plan

[1045] Step 5: View and confirm your travel plans

[1046] The terminal displays the generated itinerary to the user, who can then review it and make any necessary modifications. The modifications are then sent back to the server.

[1047] Input: Generated itinerary

[1048] Output: User confirmation and correction

[1049] Step 6: Monitor weather and booking information

[1050] The server uses external web service APIs to monitor weather information and reservation status in real time, adjusting travel plans as needed based on new weather data or reservation status.

[1051] Input: Weather information and reservation status from external web services

[1052] Output: Adjusted itinerary

[1053] Step 7: Adjust and notify travel plans

[1054] The server adjusts the travel plan as needed based on weather and reservation information and notifies the device of the new plan.

[1055] Input: Adjusted travel plans

[1056] Output: User notification

[1057] Step 8: Generate and distribute VR and AR data

[1058] The server generates VR and AR data of tourist spots and cultural assets, optimizes it for streaming, and delivers it to the device, which then displays it to the user.

[1059] Input: Data on tourist destinations and cultural properties

[1060] Output: VR and AR data

[1061] Step 9: Processing bookings and payments

[1062] The server connects with multiple travel service platforms via API to process reservations and payments for recommended travel services in one place, and the processing results are displayed on the terminal.

[1063] Input: User's booking and payment information

[1064] Output: Booking and payment details

[1065] Step 10: Emergency Support

[1066] The server monitors emergency information in real time and quickly contacts the appropriate rescue agency if an abnormal situation is detected. The device provides detailed instructions to the user to ensure their safety.

[1067] Input: User location and emergency status data

[1068] Output: Emergency response instructions and contact

[1069] At each of the above steps, users are provided with optimal travel plans and real-time responses tailored to their needs, allowing them to enjoy a comfortable and efficient travel experience.

[1070] (Application example 1)

[1071] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1072] Traditionally, creating and adjusting travel plans required a lot of manual work, making it time-consuming for users. It was also difficult to obtain real-time information during the trip or respond quickly to emergencies, which led to lower travel satisfaction. Further improvements were needed, particularly in the areas of automatic generation of travel plans using smart devices, real-time acquisition of weather and emergency information, and digital travel experiences using virtual reality and augmented reality.

[1073] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1074] In this invention, the server includes means for collecting basic information and preference information of a user, means for recommending travel destinations and tourist spots based on the basic information and preference information, means for automatically generating and displaying a travel plan including the travel destinations and tourist spots, means for delivering and displaying virtual reality data and augmented reality data to a user terminal, and means for monitoring weather information and reservation status in real time and adjusting the travel plan. This allows the user to automatically generate a travel plan without hassle, respond immediately to changes in the situation during the trip, and enjoy a rich digital travel experience using virtual reality and augmented reality.

[1075] "Basic user information" refers to basic information for identifying an individual, such as the user's name, age, sex, and nationality.

[1076] "Preference information" is information based on a user's personal preferences and interests, such as areas of interest, budget, and travel style.

[1077] "Travel destination" refers to a destination or city that a user visits.

[1078] "Tourist spots" refer to places of interest such as historical sites, natural landscapes, cultural assets, and leisure facilities at travel destinations.

[1079] A "travel plan" refers to a plan or schedule for a user's entire trip.

[1080] "Virtual reality data" is data on a three-dimensional space that is virtually reproduced using computer graphics.

[1081] "Augmented reality data" is data that displays digital information overlaid on real landscapes and objects.

[1082] "User terminal" refers to a computing device used by a user, such as a smartphone, tablet, or smart glasses.

[1083] "Weather Information" refers to information about current and future weather conditions.

[1084] "Reservation status" refers to information about reservations, such as availability at accommodations and tourist attractions.

[1085] "Emergency Information" refers to information about emergencies, such as health issues or traffic troubles that may occur during travel.

[1086] "Real-time" refers to the immediate processing and provision of ongoing events and information.

[1087] This invention is a system that recommends, plans, and adjusts smart travel plans according to travelers' needs. The system collects basic information and preference information from users, recommends optimal travel destinations and tourist spots based on that information, and automatically generates and displays travel plans. It also monitors weather and emergency information in real time, adjusts travel plans as needed, and notifies users. It can also provide digital travel experiences of tourist spots and cultural assets using virtual reality (VR) and augmented reality (AR).

[1088] The system is implemented as an application installed on a user device such as smart glasses. A specific example is shown below.

[1089] Creating a User Profile

[1090] The user puts on the smart glasses and inputs basic information (such as name, age, gender, and nationality) and travel preferences (areas of interest, budget, travel style, etc.) through a voice recognition interface. The server receives this information and stores it in a database as a profile.

[1091] Automatic travel plan generation

[1092] The server references a database based on the saved user profile and recommends travel destinations and tourist spots that suit the user's preferences. Based on the recommended information, the server automatically generates a travel plan and displays it on the smart glasses. The user can confirm and modify the plan by eye contact or voice.

[1093] Real-time adjustments

[1094] The server monitors weather and reservation information in real time and adjusts travel plans as needed based on the information it receives. For example, if the weather worsens, the server will make schedule changes and notify the smart glasses of the new plans, ensuring users always have the most up-to-date information on their travel plans.

[1095] Providing digital travel experiences

[1096] The server generates virtual reality and augmented reality data of tourist spots and cultural assets and distributes it to user devices. Users can view this digital data using smart glasses and virtually experience tourist spots.

[1097] Emergency support

[1098] The server monitors emergency information in real time and, if a health or traffic emergency occurs during travel, coordinates with the appropriate rescue agencies to respond quickly, while also notifying the smart glasses of emergency response details and providing necessary instructions.

[1099] Specific examples

[1100] For example, if a user is planning a trip from Japan to Paris, France, the following process is executed:

[1101] Input Process

[1102] A user puts on the smart glasses and enters the following prompt sentence into the speech recognition interface:

[1103] Example prompt: "Hello, I'm a 30-year-old man living in Japan. I'm planning a trip to Paris. I love history, art, and nature, my budget is ¥200,000, and I prefer an active travel style."

[1104] System Operation

[1105] 1. The server receives the user's basic information and preference information and stores it in a database.

[1106] 2. The server recommends travel destinations and attractions based on the stored profile.

[1107] 3. The travel plan automatically generated by the server is displayed on the smart glasses.

[1108] 4. Monitor weather and booking information in real time and adjust your travel plans as needed.

[1109] 5. Deliver virtual reality and augmented reality data to user devices to provide a digital travel experience.

[1110] 6. Monitor emergency information and respond promptly to emergency situations in coordination with rescue agencies when necessary.

[1111] This system allows users to enjoy a stress-free and comfortable travel experience, and also ensures safety during travel by providing real-time information.

[1112] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1113] Step 1:

[1114] Creating a User Profile

[1115] The user puts on the smart glasses and inputs basic information (such as name, age, gender, and nationality) and travel preferences (areas of interest, budget, travel style, etc.) through a voice recognition interface. The input information is sent to the server and stored in a database as a user profile.

[1116] Input: Basic information and preference information entered by the user via voice

[1117] Output: User profile stored on the server

[1118] What happens: The user speaks a prompt like this: "Hello, I'm a 30-year-old man living in Japan. I'm planning a trip to Paris. I love history, art, and nature, my budget is ¥200,000, and I prefer an active travel style."

[1119] Step 2:

[1120] Automatic travel plan generation

[1121] The server recommends suitable travel destinations and tourist attractions from an internal database and external data sources based on the user profile, automatically generates a travel plan based on the recommended information, and displays the plan on the smart glasses.

[1122] Input: User profile

[1123] Output: A recommended list of travel destinations and attractions based on user preferences, along with a travel plan

[1124] Specific operation: The server retrieves tourist spot information that matches the user's interests from the database, generates a travel plan, and displays it on the smart glasses. The user can confirm and modify the plan using their eyes or voice.

[1125] Step 3:

[1126] Real-time adjustments

[1127] The server monitors weather information and reservation status in real time and adjusts the travel plan accordingly, which is then sent to the smart glasses.

[1128] Input: Real-time weather information and reservation status

[1129] Output: Adjusted itinerary

[1130] Specific operation: The server uses a weather API to continuously check local weather information, and if bad weather is forecast, it changes the travel plan and notifies the smart glasses of the new plan.

[1131] Step 4:

[1132] Providing digital travel experiences

[1133] The server generates virtual reality and augmented reality data of tourist spots and cultural properties and distributes it to user devices (smart glasses). Users can use this data to enjoy virtual travel.

[1134] Input: Digital content data related to tourist destinations and cultural properties

[1135] Output: Virtual reality and augmented reality data displayed on smart glasses

[1136] Specific operation: The server delivers VR data, including historical information about tourist spots, to the smart glasses, allowing users to experience the place as if they were actually there.

[1137] Step 5:

[1138] Emergency support

[1139] The server monitors emergency information in real time and responds promptly to any health or traffic issues that may arise during travel by coordinating with the appropriate rescue agencies. Emergency response details are then sent to the smart glasses, which provide necessary instructions to the user.

[1140] Input: Emergency information to obtain while traveling

[1141] Output: Contact rescue agencies and emergency response instructions

[1142] Specific operation: When a user reports a health problem, the server contacts the hospital and displays the route to the nearest hospital and emergency response procedures on the smart glasses.

[1143] Thus, the present invention provides a range of features that allow users to automatically generate travel plans, respond to situations in real time while traveling, and even provide digital experiences using virtual reality.

[1144] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1145] The present invention combines an emotion engine with a system for recommending, planning and adjusting smart travel plans according to travelers' needs, and is implemented as follows.

[1146] Creating a User Profile

[1147] A user accesses the application or web interface using a device (smartphone, tablet, PC, etc.) and enters basic information (name, age, gender, nationality, etc.) and travel preferences (areas of interest, budget, travel style, etc.). This information is sent to a server and stored in a database as a profile. The user's emotional information is also collected and integrated into the profile.

[1148] Automatic travel plan generation

[1149] The server references the database based on the saved user profile and automatically recommends travel destinations and tourist spots that match the user's preferences. Based on the recommended information, the server automatically generates a travel plan and creates a travel schedule. The device displays the generated travel plan to the user, who can check and modify it.

[1150] Combining Emotion Engines

[1151] The server uses an emotion engine to analyze the user's real-time emotional information. Based on this information, the contents of the travel plan and schedule can be adjusted. For example, if the user is feeling stressed, the server can add relaxation spots.

[1152] Real-time adjustments

[1153] The server monitors weather information and reservation status in real time and adjusts travel plans as necessary based on the information obtained. For example, if the weather worsens, the server changes the schedule and notifies the device of the new plans. This allows users to always keep up with the latest travel plans. In addition, changes in emotions detected by the emotion engine are reflected in real time.

[1154] Providing digital travel experiences

[1155] The server generates virtual reality (VR) and augmented reality (AR) data of tourist spots and cultural assets and distributes it to devices. Users can view this digital data on their devices and virtually experience tourist spots, thereby gaining a deeper understanding and enjoyment during their trip.

[1156] Reservation and payment

[1157] The server connects with multiple travel service platforms to make reservations for recommended tourist spots and accommodations in one place. The server also processes all payments for reservations and displays the results on the terminal. This allows users to skip the cumbersome process of going through multiple platforms and make reservations and payments easily.

[1158] Emergency support

[1159] The server monitors emergency information in real time and responds quickly if a health or traffic problem occurs during travel. The server connects with appropriate rescue agencies (hospitals, police, fire department, etc.) and coordinates rescue efforts. The device notifies the user of emergency response details and provides necessary instructions to ensure the user's safety.

[1160] Specific examples

[1161] For example, if a user is planning a trip from Japan to Paris, France, the following process is executed:

[1162] 1. Users enter their basic information and travel preferences into the device, and the server stores it in a database. The emotion engine then analyzes the user's emotions and integrates that information into the profile.

[1163] 2. The server recommends Paris and selects tourist spots such as the Eiffel Tower and the Louvre. An itinerary is automatically generated and displayed on the device.

[1164] 3. The server monitors weather information before and during the trip, and if the weather worsens, adjusts the schedule and notifies the terminal.

[1165] 4. The server generates VR and AR data for the tourist spot and distributes it to the device, allowing the user to enjoy the virtual experience.

[1166] 5. The server then makes all the bookings for accommodation and sightseeing tickets, processes the payments, and displays the results on the terminal.

[1167] 6. If the emotion engine detects that the user is feeling stressed during the trip, the server will add relaxation spots and adjust the schedule.

[1168] 7. In the event of a health issue, the server will initiate an emergency response and coordinate with the appropriate rescue agencies for immediate action. The device will provide detailed instructions to the user.

[1169] This allows users to enjoy a stress-free and comfortable travel experience.The present invention is a system for improving the efficiency of travel planning, resolving problems during travel, and responding based on emotions, and it represents a significant improvement over conventional travel procedures.

[1170] The processing flow will be explained below.

[1171] Step 1:

[1172] A user accesses an application or web interface using a device (smartphone, tablet, PC, etc.) and enters basic information (name, age, gender, nationality, etc.).

[1173] Step 2:

[1174] Users input their areas of interest (history, nature, culture, etc.), budget, and travel style (adventure, relaxation, etc.) into the terminal.

[1175] Step 3:

[1176] The terminal transmits the input basic information and preference information to the server.

[1177] Step 4:

[1178] The server creates a user profile based on the received information and stores it in a database.

[1179] Step 5:

[1180] The server also uses an emotion engine to collect the user's emotion information and integrate it into the profile.

[1181] Step 6:

[1182] The server refers to the database and recommends travel destinations that match the user's preferences.

[1183] Step 7:

[1184] The server selects tourist attractions and activities from the recommended travel destinations.

[1185] Step 8:

[1186] The server automatically generates a travel plan based on tourist attractions and activities and creates a schedule.

[1187] Step 9:

[1188] The terminal displays the generated travel plan to the user, who can then confirm and modify the plan.

[1189] Step 10:

[1190] The server monitors weather information and reservation status in real time.

[1191] Step 11:

[1192] If the server detects changes in weather or reservations, it adjusts travel plans and updates schedules.

[1193] Step 12:

[1194] The terminal notifies the user of the updated schedule and allows the user to confirm it.

[1195] Step 13:

[1196] The server prepares virtual reality (VR) and augmented reality (AR) data of tourist attractions and cultural properties.

[1197] Step 14:

[1198] The server delivers VR and AR data to the device.

[1199] Step 15:

[1200] Users use the device to view VR and AR data and enjoy the virtual experience.

[1201] Step 16:

[1202] The server works in conjunction with the travel service platform to arrange reservations for accommodation and sightseeing tickets all at once.

[1203] Step 17:

[1204] The server calculates the total cost for the reservation and processes the payment in one lump sum.

[1205] Step 18:

[1206] The terminal displays a confirmation of the reservation completion to the user.

[1207] Step 19:

[1208] The server monitors emergency information occurring during travel in real time.

[1209] Step 20:

[1210] If the server detects an emergency (health problem or traffic trouble), it will coordinate with appropriate rescue agencies and implement emergency response.

[1211] Step 21:

[1212] The device will notify the user of emergency response details and provide necessary instructions.

[1213] Step 22:

[1214] At any step, the server analyzes the user's emotional information using an emotion engine, and if it detects stress or dissatisfaction, it adjusts the itinerary, for example, by adding a relaxing spot or changing the order of activities.

[1215] Step 23:

[1216] The terminal notifies the user of the travel plan adjusted based on the emotion and allows the user to confirm it.

[1217] Example 2

[1218] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1219] Conventional travel planning systems not only recommend travel destinations and tourist spots that match a user's preferences, but also lack the ability to reflect the user's emotional and weather information in real time. They also lack the ability to respond to emergencies and process reservations and payments across multiple travel service platforms. This creates a demand for systems that can improve the quality of users' travel experiences.

[1220] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1221] In this invention, the server includes means for collecting basic information and preference information of a user, means for recommending travel destinations and tourist spots based on the basic information and preference information, means for automatically generating and displaying a travel plan including the travel destinations and tourist spots, means for collecting and analyzing user emotional information and reflecting the emotional information in the travel plan, means for monitoring weather information and reservation status in real time and adjusting the travel plan, means for generating virtual reality data and augmented reality data of tourist spots and cultural properties and distributing them to a user terminal, means for linking with multiple travel service platforms and processing reservations and payments in a lump sum, and means for linking with appropriate rescue organizations in the event of an emergency and providing instructions to the user terminal. This allows for the provision of a travel plan optimal for the user's preferences and emotional state, and enables real-time adjustments and emergency response.

[1222] A "user" is an individual or group that uses the system to create a travel plan and plan sightseeing.

[1223] "Basic information" is data for identifying an individual, such as the user's name, age, sex, and nationality.

[1224] "Preference information" is data indicating the user's individual preferences, such as areas of interest, travel style, and budget, which are necessary for selecting and planning a travel destination.

[1225] "Emotion information" is data that indicates the emotional state, such as stress or joy, that the user feels while traveling.

[1226] A "travel destination" is a region or city that a user aims to visit.

[1227] A "tourist attraction" is a place or facility of particular importance or interest in a travel destination.

[1228] A "travel plan" is a plan that includes a schedule of places to visit and activities, automatically generated based on the user's preferences and emotional information.

[1229] "Real-time" weather and reservation monitoring means getting the latest information instantly and adjusting your travel plans accordingly.

[1230] "Virtual reality data" is data on virtually recreated tourist spots and cultural assets.

[1231] "Augmented reality data" is information provided by overlaying digital information onto real-world scenes.

[1232] A "travel service platform" is a system or website that provides online reservations and payments for accommodation and sightseeing tickets.

[1233] An "emergency" is a situation in which a user faces an unexpected situation such as a health problem or traffic trouble while traveling.

[1234] "Rescue agencies" are organizations such as hospitals, police, and fire departments that deal with health issues, traffic accidents, etc.

[1235] A "terminal" is a device such as a smartphone, tablet, or PC that a user uses to access the system and input or retrieve travel planning information.

[1236] The present invention combines an emotion engine with a system for recommending, planning and adjusting smart travel plans according to traveler needs, and embodiments thereof are described in detail below.

[1237] Creating a User Profile

[1238] A user accesses the application or web interface using a device (smartphone, tablet, PC, etc.) and enters basic information (name, age, gender, nationality, etc.) and travel preferences (areas of interest, budget, travel style, etc.), including settings for entering emotional information. This information is sent to the server and stored in a database. The emotional engine evaluates the user's emotional state based on the information entered and integrates the results into a profile.

[1239] Recommendations for travel destinations and attractions

[1240] Based on the saved user profile, the server references a database and automatically recommends travel destinations and tourist attractions that match the user's preferences. A generative AI model is then used to generate a list of suitable travel destination and tourist attraction recommendations. This list is based on the user's profile information and emotional information, providing suggestions that best suit individual needs.

[1241] Automatic travel plan generation

[1242] The server automatically generates a detailed travel plan based on the generated recommendation list. The travel plan includes multiple itineraries and activities and is customized based on the user's preferences and emotional information. The generated travel plan is displayed to the user via their device, allowing them to review and modify the plan as needed.

[1243] Real-time adjustments

[1244] The server monitors weather information and reservation status in real time and can adjust travel plans as needed. For example, schedule changes are made in response to sudden changes in the weather or cancellations of reservations. Adjusted travel plans are notified to the device, providing the user with the latest information.

[1245] Providing digital travel experiences

[1246] The server generates virtual reality (VR) and augmented reality (AR) data of tourist spots and cultural assets and distributes it to devices. Users can view this digital data through their devices and virtually experience tourist spots, allowing them to enjoy their local travel experience more deeply.

[1247] Bulk booking and payment

[1248] The server connects with multiple travel service platforms to make reservations for recommended tourist spots and accommodations in one place. The server also processes all payments for reservations and displays the results on the terminal. This allows users to avoid the cumbersome process of going through multiple platforms and make reservations and payments easily.

[1249] Emergency support

[1250] The server monitors emergency information in real time and responds quickly if a health or traffic problem occurs during travel. It also coordinates necessary rescue operations by connecting with appropriate rescue agencies. The device notifies the user of emergency response details and provides necessary instructions to ensure the user's safety.

[1251] Specific examples

[1252] For example, if a user is planning a trip from Japan to Paris, France, they can input the following prompt into the generative AI model:

[1253] Please recommend suitable travel destinations based on the user profile below.

[1254] Name: User A

[1255] Age: 30

[1256] Gender: Male

[1257] Nationality: Japanese

[1258] Interests: Historical sites

[1259] Budget: 100,000 yen

[1260] This enables the system to provide optimal travel plans that meet the user's needs and improve the travel experience.

[1261] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1262] Step 1: Create a user profile

[1263] A user accesses the application or web interface using a device and enters basic information (such as name, age, gender, and nationality) and travel preferences (such as areas of interest, budget, and travel style). The device then sends the entered information to the server, which then stores the data in a database. At the same time, a prompt for emotional assessment is displayed, evaluating the user's emotional state and integrating that information into the profile. For example, if a user enters "I'm interested in historical tourist sites" and "My budget is within 100,000 yen," the emotional information is saved along with that information.

[1264] Input: User's basic information, preference information, emotional information

[1265] Output: User profile stored in the database

[1266] Step 2: Recommend travel destinations and attractions

[1267] The server searches the database for potential travel destinations based on the saved user profile. Using a generative AI model, the server generates a list of travel destinations and tourist attractions that match the user's preferences based on the user's profile information. For example, the Eiffel Tower and the Louvre Museum in Paris may be recommended. The generated list is sent to the device for the user to review.

[1268] Input: User profile

[1269] Output: A list of recommended travel destinations and attractions

[1270] Step 3: Automatically generate a travel plan

[1271] The server automatically generates a detailed travel plan based on the recommendation list. It takes into account the user's preferences and emotional information to optimize the schedule and activities. For example, if the user prioritizes relaxation, it will include relaxing spots in the schedule. The generated plan is sent to the device, where the user can review and modify it.

[1272] Input: List of recommended travel destinations and attractions, user profile

[1273] Output: An automatically generated itinerary

[1274] Step 4: Adjust in real time

[1275] The server monitors weather information and reservation status in real time and adjusts travel plans as needed. For example, if the weather worsens, it will change activities to indoors. Once the plan has been adjusted, it will be notified to the device, providing the user with the latest information.

[1276] Input: Weather information, reservation status, travel plans

[1277] Output: Adjusted itinerary

[1278] Step 5: Delivering digital travel experiences

[1279] The server generates virtual reality (VR) and augmented reality (AR) data of tourist attractions and cultural properties and delivers it to the device. The user can view this data on the device and virtually experience the tourist attractions. For example, if the user is at the Louvre Museum, they can view a 3D model through the device and obtain additional information.

[1280] Input: Information about tourist spots and cultural assets

[1281] Output: VR and AR data

[1282] Step 6: Batch booking and payment

[1283] The server connects with multiple travel service platforms to make reservations for recommended accommodations and sightseeing tickets in one place. The server also processes all payments for the reservations in one place, and the results are displayed on the terminal. For example, a notification such as "Reservation completed at XX hotel" or "Museum ticket purchase completed" is displayed.

[1284] Input: Travel plan, user profile

[1285] Output: Notification of reservation and payment completion

[1286] Step 7: Emergency Support

[1287] The server monitors emergency information in real time and responds quickly if a health or traffic problem occurs during travel. The device coordinates the necessary rescue operations by connecting with the appropriate rescue agencies, notifying the user of the details of the response and providing necessary instructions to ensure the user's safety. For example, if the user feels unwell, information about nearby hospitals and the best transportation options will be provided.

[1288] Input: Emergency information, user location information

[1289] Output: Emergency response instructions and rescue agency contact information

[1290] (Application example 2)

[1291] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1292] Conventional travel plan generation systems struggle to make real-time adjustments that fully reflect user preferences and emotions, making it difficult to increase user satisfaction. They also struggle to automatically generate travel plans that integrate multiple information sources and adapt to changing conditions during a trip. This often leaves users feeling stressed and detracts from their travel experience.

[1293] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for collecting basic information and preference information of a user; means for recommending travel destinations and tourist spots based on the basic information and preference information; means for automatically generating and displaying a travel plan including the travel destinations and tourist spots; means for collecting and analyzing user emotion information; means for adjusting the travel plan in real time based on the emotion information; means for monitoring weather information and reservation status in real time and adjusting the travel plan; means for notifying the user of the adjusted travel plan; means for providing virtual reality data and augmented reality data of tourist spots and cultural properties; means for delivering and displaying the virtual reality data and augmented reality data to a user terminal; means for automatically generating a travel plan using a generative AI model and adjusting it in real time based on the emotion information; and means for simplifying user input using prompt sentences to support travel plan generation. This enables automatic generation and real-time adjustment of an optimal travel plan based on a user's preferences and emotions.

[1294] "Basic information" refers to personal identification information such as the user's name, age, sex, and nationality.

[1295] "Preference information" is information that reflects the user's preferences, such as areas of interest, budget, and travel style.

[1296] A "travel destination" is a destination, such as a geographical location or city, that a user plans to visit.

[1297] "Tourist spots" are places that users visit, such as tourist attractions, cultural assets, and attractions at travel destinations.

[1298] A "travel plan" is a plan that includes a travel schedule and itinerary, created based on the user's preference information and basic information.

[1299] "Emotional information" is data that represents the user's current emotional state, including stress, relaxation, excitement, and the like.

[1300] "Real-time adjustment" is the process of instantly changing and updating travel plans in response to changing conditions during the trip (weather information, reservation status, emotional information, etc.).

[1301] "Weather information" is data about the current and forecast weather at a travel destination.

[1302] "Reservation status" is information indicating the reservation availability of facilities and transportation related to the trip.

[1303] "Virtual reality data" is digital data that provides users with an immersive virtual visual experience.

[1304] "Augmented reality data" is data used to display virtual information overlaid on the real world.

[1305] A "user terminal" is an electronic device (such as a smartphone, tablet, or PC) that a user uses to view or input information.

[1306] A "generative AI model" is an artificial intelligence model that learns patterns based on large amounts of data and automatically generates travel plans.

[1307] A "prompt sentence" is a standard sentence that simplifies the information that the user inputs and clarifies instructions to the system.

[1308] To implement this invention, a system that mainly uses a server, a user terminal, and some dedicated software is required. The main configuration and operation procedure of this system are as follows.

[1309] First, the user enters their basic information (name, age, gender, nationality, etc.) and preference information (areas of interest, budget, travel style, etc.) using a user device (smartphone, tablet, PC, etc.). This information is sent to the server, which then stores it in a database.

[1310] The server then recommends travel destinations and tourist attractions based on the collected basic information and preference information. Based on the recommended information, the server automatically generates a travel plan and displays it on the user's device. In this process, the server uses a generative AI model to generate the optimal travel plan. The generative AI model has learned a large amount of data in advance and is capable of providing a plan that best suits the user's preferences.

[1311] A visual interface is provided on the user's terminal to allow the user to review and modify the travel plan. Once the user approves the plan, the server confirms the plan. Prompt sentences are also used to simplify the user's input and assist in generating the optimal travel plan.

[1312] In addition, the server monitors weather and reservation status in real time and adjusts travel plans based on this information. For example, if a reservation for a planned tourist spot is canceled at the last minute, the server will automatically recommend an alternative tourist spot and notify the user. This process is also automatic and is reflected in real time on the user's device.

[1313] The system also incorporates an emotion engine that collects and analyzes the user's emotional information. If the user feels stressed during the trip, the server will make real-time adjustments, such as adding relaxation spots.

[1314] It also provides virtual reality (VR) and augmented reality (AR) data of tourist spots and cultural assets, allowing users to virtually experience tourist spots before or during their trip using dedicated AR / VR headsets or smartphones.

[1315] For example, if a user is planning a trip to Paris, the following happens:

[1316] 1. The user enters basic information and preferences into the app.

[1317] 2. The server recommends Paris and generates a travel plan that includes attractions such as the Eiffel Tower and the Louvre.

[1318] 3. Real-time analysis of when you feel stressed and adding a visit to a relaxing cafe.

[1319] 4. Providing a virtual experience of the Eiffel Tower through VR / AR content.

[1320] An example of a prompt is as follows:

[1321] "You enter your basic information and preferences to create a user profile. Then, the system generates a smart itinerary based on that, adjusting in real time. It also provides VR / AR experiences of tourist attractions. For example, if you enter, 'If I'm traveling to Paris, I want to visit the Eiffel Tower and the Louvre Museum. I also want to visit a relaxing cafe,' the system will automatically generate an itinerary for your Paris trip."

[1322] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1323] Step 1:

[1324] A user accesses the application using a terminal and inputs basic information and preferences. This input includes information such as name, age, gender, nationality, areas of interest, budget, and travel style. The terminal sends this information to the server. Data processing involves converting the input information into a standard format and storing it in a database. The output is a database entry that stores the user's basic information and preferences.

[1325] Step 2:

[1326] The server uses a generative AI model to recommend optimal travel destinations and tourist attractions based on the saved user profile. The server uses basic information and preference information as input data, and performs calculations by calling the generative AI model that has learned from past data and trends. The output is a list of recommended travel destinations and tourist attractions.

[1327] Step 3:

[1328] The server automatically generates a travel plan including recommended destinations and tourist attractions and displays it on the device. The travel plan includes travel dates, duration of stay, and access methods. The server creates the plan using a generative AI model and retrieves the necessary details from a database. The output is an automatically generated travel plan that is displayed on the user's device.

[1329] Step 4:

[1330] The server collects the user's emotional information and analyzes it using an emotion engine. The data required for emotion analysis (facial expressions, tone of voice, etc.) is collected from the camera and microphone installed on the user's device. The server inputs this data into the emotion engine and calculates the user's emotional state. The output is the user's emotional profile, updated in real time.

[1331] Step 5:

[1332] Based on the user's emotional information, the server adjusts the travel plan in real time. For example, if the user is feeling stressed, the server adds relaxing spots and activities to the plan. This generates a travel plan that reflects the user's emotional state. As a data calculation, a new plan is calculated using the emotional information and the existing travel plan as input data. The output is the adjusted travel plan.

[1333] Step 6:

[1334] The server monitors weather information and reservation status in real time. It accesses the weather information API and reservation management system to obtain the latest information. The server reflects this information in the travel plan and updates the plan as necessary. The output is the latest travel plan adjusted according to the weather and reservation status, and is notified to the user's device.

[1335] Step 7:

[1336] Virtual reality and augmented reality data of tourist spots and cultural assets are delivered to user devices. The server generates the corresponding VR / AR data and sends it to the user device. Users can view this digital data using their devices and virtually experience tourist spots. The output is VR / AR content displayed on the user device.

[1337] Step 8:

[1338] The user approves the itinerary, and the server finalizes the travel plan using the generative AI model. After receiving approval input from the user's device, the server saves the final plan in the database. The output is the finalized travel plan.

[1339] Step 9:

[1340] The server generates prompts to prompt the user to simply input details of their travel plans. The prompts are automatically generated based on pre-defined templates. The output is a prompt that facilitates intuitive input by the user.

[1341] Example prompt sentence:

[1342] "You enter your basic information and preferences to create a user profile. Then, the system generates a smart itinerary based on that, adjusting in real time. It also provides VR / AR experiences of tourist attractions. For example, if you enter, 'If I'm traveling to Paris, I want to visit the Eiffel Tower and the Louvre Museum. I also want to visit a relaxing cafe,' the system will automatically generate an itinerary for your Paris trip."

[1343] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1344] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1345] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1346] [Fourth embodiment]

[1347] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1348] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1349] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1350] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1351] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1352] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1353] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1354] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1355] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1356] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1357] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1358] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1359] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1360] The present invention is a system for recommending, planning, and adjusting smart travel plans according to travelers' needs, and is implemented as follows.

[1361] Creating a User Profile

[1362] A user accesses the application or web interface using a device (smartphone, tablet, PC, etc.) and enters basic information (name, age, gender, nationality, etc.) and travel preferences (areas of interest, budget, travel style, etc.). This information is sent to the server and stored in a database as a profile.

[1363] Automatic travel plan generation

[1364] The server references the database based on the saved user profile and automatically recommends travel destinations and tourist spots that match the user's preferences. Based on the recommended information, the server automatically generates a travel plan and creates a travel schedule. The device displays the generated travel plan to the user, who can check and modify it.

[1365] Real-time adjustments

[1366] The server monitors weather information and reservation status in real time and adjusts travel plans as needed based on the information it obtains. For example, if the weather worsens, the server will change the schedule and notify the device of the new plans. This allows users to always keep up to date with their travel plans.

[1367] Providing digital travel experiences

[1368] The server generates virtual reality (VR) and augmented reality (AR) data of tourist spots and cultural assets and distributes it to devices. Users can view this digital data on their devices and virtually experience tourist spots, thereby gaining a deeper understanding and enjoyment during their trip.

[1369] Reservation and payment

[1370] The server connects with multiple travel service platforms to make reservations for recommended tourist spots and accommodations in one place. The server also processes all payments for reservations and displays the results on the terminal. This allows users to skip the cumbersome process of going through multiple platforms and make reservations and payments easily.

[1371] Emergency support

[1372] The server monitors emergency information in real time and responds quickly if a health or traffic problem occurs during travel. The server connects with appropriate rescue agencies (hospitals, police, fire department, etc.) and coordinates rescue efforts. The device notifies the user of emergency response details and provides necessary instructions to ensure the user's safety.

[1373] Specific examples

[1374] For example, if a user is planning a trip from Japan to Paris, France, the following process is executed:

[1375] 1. The user enters their basic information and travel preferences into the terminal, and the server stores it in a database.

[1376] 2. The server recommends Paris and selects tourist spots such as the Eiffel Tower and the Louvre. An itinerary is automatically generated and displayed on the device.

[1377] 3. The server monitors weather information before and during the trip, and if the weather worsens, adjusts the schedule and notifies the terminal.

[1378] 4. The server generates VR and AR data for the tourist spot and distributes it to the device, allowing the user to enjoy the virtual experience.

[1379] 5. The server then makes all the bookings for accommodation and sightseeing tickets, processes the payments, and displays the results on the terminal.

[1380] 6. If the user reports a health issue during the trip, the server will initiate an emergency response and coordinate with the appropriate rescue agency for immediate action. The device will provide detailed instructions to the user.

[1381] With the above functions, users can enjoy a stress-free and comfortable travel experience. The present invention is a system for improving the efficiency of travel planning and resolving problems during travel, and it achieves significant improvements over conventional travel procedures.

[1382] The processing flow will be explained below.

[1383] Step 1:

[1384] A user accesses an application or web interface using a device (smartphone, tablet, PC, etc.) and enters basic information (name, age, gender, nationality, etc.).

[1385] Step 2:

[1386] Users input their areas of interest (history, nature, culture, etc.), budget, and travel style (adventure, relaxation, etc.) into the terminal.

[1387] Step 3:

[1388] The terminal transmits the input basic information and preference information to the server.

[1389] Step 4:

[1390] The server creates a user profile based on the received information and stores it in a database.

[1391] Step 5:

[1392] The server refers to the database and recommends travel destinations that match the user's preferences.

[1393] Step 6:

[1394] The server selects tourist attractions and activities from the recommended travel destinations.

[1395] Step 7:

[1396] The server automatically generates a travel plan based on tourist attractions and activities and creates a schedule.

[1397] Step 8:

[1398] The terminal displays the generated travel plan to the user, who can then confirm and modify the plan.

[1399] Step 9:

[1400] The server monitors weather information and reservation status in real time.

[1401] Step 10:

[1402] If the server detects changes in weather or reservations, it adjusts travel plans and updates schedules.

[1403] Step 11:

[1404] The terminal notifies the user of the updated schedule and allows the user to confirm it.

[1405] Step 12:

[1406] The server prepares virtual reality (VR) and augmented reality (AR) data of tourist attractions and cultural properties.

[1407] Step 13:

[1408] The server delivers VR and AR data to the device.

[1409] Step 14:

[1410] Users use the device to view VR and AR data and enjoy the virtual experience.

[1411] Step 15:

[1412] The server works in conjunction with the travel service platform to arrange reservations for accommodation and sightseeing tickets all at once.

[1413] Step 16:

[1414] The server calculates the total cost for the reservation and processes the payment in one lump sum.

[1415] Step 17:

[1416] The terminal displays a confirmation of the reservation completion to the user.

[1417] Step 18:

[1418] The server monitors emergency information occurring during travel in real time.

[1419] Step 19:

[1420] If the server detects an emergency (health problem or traffic trouble), it will coordinate with appropriate rescue agencies and implement emergency response.

[1421] Step 20:

[1422] The device will notify the user of emergency response details and provide necessary instructions.

[1423] Example 1

[1424] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1425] Traditionally, planning a trip has involved a lot of time-consuming and laborious tasks, such as gathering destination information, creating an itinerary, making reservations and payments, and even responding to emergencies. In addition, systems lacked the ability to monitor weather information and reservation status in real time, adjust travel plans as needed, and provide a digital experience. There is a need for more advanced systems that can solve these problems and allow users to enjoy stress-free, comfortable travel.

[1426] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1427] In this invention, the server includes means for collecting basic information and preference information of a user, means for recommending travel destinations and tourist attractions based on the basic information and preference information, means for automatically generating and displaying a travel itinerary including the travel destinations and tourist attractions, means for monitoring weather information and reservation status in real time and adjusting the travel itinerary, means for generating virtual reality data and augmented reality data of tourist attractions and distributing and displaying them to a user terminal, means for processing reservations and payments for travel services, and means for monitoring and responding to emergency information. This allows users to plan, execute, and respond to emergency situations all in one system, allowing them to enjoy a stress-free and comfortable trip.

[1428] "User" means an individual or organization that uses the system.

[1429] "Basic information" refers to personal data such as the user's name, age, gender, and nationality.

[1430] "Preference information" is data relating to the user's preferences such as areas of interest, budget, and travel style.

[1431] A "travel destination" is a destination such as a city or region that the user wants to visit.

[1432] "Tourist destinations" are famous places and tourist spots that are worth visiting when traveling.

[1433] A "travel plan" is a detailed itinerary that includes a user's travel schedule and list of places to visit.

[1434] "Means" refers to the methods or functions used to achieve a specific purpose.

[1435] A "server" is a central computer that processes and stores data.

[1436] A "database" is a system for systematically storing and managing large amounts of data.

[1437] A "generative AI model" is an algorithm or program that uses artificial intelligence to generate a specific outcome.

[1438] "VR (virtual reality) data" is data that allows users to create and experience a virtual environment using computer technology.

[1439] "AR (Augmented Reality) data" is data used to add virtual elements to the real environment.

[1440] A "reservation" is the process of reserving in advance the use of a particular service or facility.

[1441] "Payment" is the act of providing money for a service or product.

[1442] "Emergency information" refers to data related to emergencies such as health problems and traffic troubles that occur during travel.

[1443] "Notification" is a means of conveying information from the system to the user.

[1444] This invention is a system for making users' travel experiences more comfortable. Specifically, it is a system that automatically generates travel plans based on the user's basic information and preference information, and provides real-time adjustments, digital experiences, reservation and payment management, and even emergency support all in one.

[1445] Creating a User Profile

[1446] A user accesses the application or web interface using their device (smartphone, tablet, PC) and enters basic information (name, age, gender, nationality, etc.) and travel preferences (areas of interest, budget, travel style, etc.) into the system. This information is temporarily stored on the device and then sent to the server. The server stores the received information in a database and creates a user profile.

[1447] Automatic travel plan generation

[1448] The server references the saved user profile and recommends travel destinations and tourist attractions from its internal database that match the user's preferences. The server then uses a generative AI model to automatically generate an optimal travel plan, including the order in which tourist attractions should be visited, the means of transportation, and travel time. This generated travel plan is displayed on the device, allowing the user to review and modify it.

[1449] Real-time adjustments

[1450] The server monitors external weather information and reservation status in real time, automatically adjusting travel plans and notifying the device of changes based on the situation. For example, if bad weather is forecast, the server will suggest safe alternative activities and reschedule the trip.

[1451] Providing digital travel experiences

[1452] The server generates VR and AR data of tourist spots and cultural assets, optimizes it for streaming, and delivers it to devices. Users can use this digital data to virtually explore tourist spots through their devices.

[1453] Reservation and payment

[1454] The server connects with multiple travel service platforms via API to collectively arrange reservations for tourist attractions and accommodations recommended by users, and also handles payment processing. Reservation and payment details are displayed on the terminal for users to review.

[1455] Emergency support

[1456] The server monitors emergency information in real time and quickly contacts the appropriate rescue agency if an emergency situation is detected, while the device provides detailed instructions to the user to ensure their safety.

[1457] Specific examples

[1458] For example, if a user is planning a trip from Japan to Paris, France, the following process is executed:

[1459] 1. The user accesses the app from their device and enters their basic information and travel preferences, which are then received by the server and stored in a database.

[1460] 2. The server recommends Paris based on the user's profile, selects tourist attractions such as the Eiffel Tower and the Louvre, and generates a travel plan. The plan is displayed on the device.

[1461] 3. The server monitors weather information and adjusts the schedule and notifies the device if bad weather is predicted.

[1462] 4. The server generates VR and AR data of the Eiffel Tower and the Louvre Museum and delivers it to the device, allowing the user to enjoy the virtual experience.

[1463] 5. The server then makes all the bookings for accommodation and sightseeing tickets, processes the payments, and displays the information on the terminal.

[1464] 6. If the user reports a health issue during the trip, the server will initiate an emergency response and coordinate with the appropriate rescue agency for a prompt response. The device will provide the user with the necessary instructions.

[1465] Prompt Sentence Examples

[1466] "I'm planning a trip from Japan to Paris, France. I'd like to enter my basic information and travel preferences and access travel plans, tourist attractions, VR experiences, reservations and payments, and emergency support."

[1467] The above program processing allows the user to experience a stress-free and comfortable trip.

[1468] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1469] Step 1: Fill in your user profile

[1470] The user accesses the application or web interface using their device. The user enters basic information (name, age, gender, nationality, etc.) and travel preferences (areas of interest, budget, travel style, etc.). The entered information is temporarily stored on the device and then sent to the server.

[1471] Input: User's basic information and preferences

[1472] Output: User profile data (stored on the server)

[1473] Step 2: Save your user profile

[1474] The server stores the user's basic information and preference information received from the device in a database. When storing, the information is registered in the appropriate table using the user ID.

[1475] Input: User profile data

[1476] Output: User profile in the database

[1477] Step 3: Recommend travel destinations and attractions

[1478] The server refers to the database and recommends travel destinations and tourist spots that suit the user's preferences. SQL queries are used to search the database.

[1479] Input: User profile data

[1480] Output: A list of recommended travel destinations and tourist attractions

[1481] Step 4: Automatically generate travel plans

[1482] The server uses the generative AI model to automatically generate a travel plan based on the recommended travel destinations and tourist attractions, calculating the order of visits, transportation means, travel time, etc., and creating a travel schedule.

[1483] Input: A list of recommended travel destinations and tourist attractions

[1484] Output: Travel plan

[1485] Step 5: View and confirm your travel plans

[1486] The terminal displays the generated itinerary to the user, who can then review it and make any necessary modifications. The modifications are then sent back to the server.

[1487] Input: Generated itinerary

[1488] Output: User confirmation and correction

[1489] Step 6: Monitor weather and booking information

[1490] The server uses external web service APIs to monitor weather information and reservation status in real time, adjusting travel plans as needed based on new weather data or reservation status.

[1491] Input: Weather information and reservation status from external web services

[1492] Output: Adjusted itinerary

[1493] Step 7: Adjust and notify travel plans

[1494] The server adjusts the travel plan as needed based on weather and reservation information and notifies the device of the new plan.

[1495] Input: Adjusted travel plans

[1496] Output: User notification

[1497] Step 8: Generate and distribute VR and AR data

[1498] The server generates VR and AR data of tourist spots and cultural assets, optimizes it for streaming, and delivers it to the device, which then displays it to the user.

[1499] Input: Data on tourist destinations and cultural properties

[1500] Output: VR and AR data

[1501] Step 9: Processing bookings and payments

[1502] The server connects with multiple travel service platforms via API to process reservations and payments for recommended travel services in one place, and the processing results are displayed on the terminal.

[1503] Input: User's booking and payment information

[1504] Output: Booking and payment details

[1505] Step 10: Emergency Support

[1506] The server monitors emergency information in real time and quickly contacts the appropriate rescue agency if an abnormal situation is detected. The device provides detailed instructions to the user to ensure their safety.

[1507] Input: User location and emergency status data

[1508] Output: Emergency response instructions and contact

[1509] At each of the above steps, users are provided with optimal travel plans and real-time responses tailored to their needs, allowing them to enjoy a comfortable and efficient travel experience.

[1510] (Application example 1)

[1511] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1512] Traditionally, creating and adjusting travel plans required a lot of manual work, making it time-consuming for users. It was also difficult to obtain real-time information during the trip or respond quickly to emergencies, which led to lower travel satisfaction. Further improvements were needed, particularly in the areas of automatic generation of travel plans using smart devices, real-time acquisition of weather and emergency information, and digital travel experiences using virtual reality and augmented reality.

[1513] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1514] In this invention, the server includes means for collecting basic information and preference information of a user, means for recommending travel destinations and tourist spots based on the basic information and preference information, means for automatically generating and displaying a travel plan including the travel destinations and tourist spots, means for delivering and displaying virtual reality data and augmented reality data to a user terminal, and means for monitoring weather information and reservation status in real time and adjusting the travel plan. This allows the user to automatically generate a travel plan without hassle, respond immediately to changes in the situation during the trip, and enjoy a rich digital travel experience using virtual reality and augmented reality.

[1515] "Basic user information" refers to basic information for identifying an individual, such as the user's name, age, sex, and nationality.

[1516] "Preference information" is information based on a user's personal preferences and interests, such as areas of interest, budget, and travel style.

[1517] "Travel destination" refers to a destination or city that a user visits.

[1518] "Tourist spots" refer to places of interest such as historical sites, natural landscapes, cultural assets, and leisure facilities at travel destinations.

[1519] A "travel plan" refers to a plan or schedule for a user's entire trip.

[1520] "Virtual reality data" is data on a three-dimensional space that is virtually reproduced using computer graphics.

[1521] "Augmented reality data" is data that displays digital information overlaid on real landscapes and objects.

[1522] "User terminal" refers to a computing device used by a user, such as a smartphone, tablet, or smart glasses.

[1523] "Weather Information" refers to information about current and future weather conditions.

[1524] "Reservation status" refers to information about reservations, such as availability at accommodations and tourist attractions.

[1525] "Emergency Information" refers to information about emergencies, such as health issues or traffic troubles that may occur during travel.

[1526] "Real-time" refers to the immediate processing and provision of ongoing events and information.

[1527] This invention is a system that recommends, plans, and adjusts smart travel plans according to travelers' needs. The system collects basic information and preference information from users, recommends optimal travel destinations and tourist spots based on that information, and automatically generates and displays travel plans. It also monitors weather and emergency information in real time, adjusts travel plans as needed, and notifies users. It can also provide digital travel experiences of tourist spots and cultural assets using virtual reality (VR) and augmented reality (AR).

[1528] The system is implemented as an application installed on a user device such as smart glasses. A specific example is shown below.

[1529] Creating a User Profile

[1530] The user puts on the smart glasses and inputs basic information (such as name, age, gender, and nationality) and travel preferences (areas of interest, budget, travel style, etc.) through a voice recognition interface. The server receives this information and stores it in a database as a profile.

[1531] Automatic travel plan generation

[1532] The server references a database based on the saved user profile and recommends travel destinations and tourist spots that suit the user's preferences. Based on the recommended information, the server automatically generates a travel plan and displays it on the smart glasses. The user can confirm and modify the plan by eye contact or voice.

[1533] Real-time adjustments

[1534] The server monitors weather and reservation information in real time and adjusts travel plans as needed based on the information it receives. For example, if the weather worsens, the server will make schedule changes and notify the smart glasses of the new plans, ensuring users always have the most up-to-date information on their travel plans.

[1535] Providing digital travel experiences

[1536] The server generates virtual reality and augmented reality data of tourist spots and cultural assets and distributes it to user devices. Users can view this digital data using smart glasses and virtually experience tourist spots.

[1537] Emergency support

[1538] The server monitors emergency information in real time and, if a health or traffic emergency occurs during travel, coordinates with the appropriate rescue agencies to respond quickly, while also notifying the smart glasses of emergency response details and providing necessary instructions.

[1539] Specific examples

[1540] For example, if a user is planning a trip from Japan to Paris, France, the following process is executed:

[1541] Input Process

[1542] A user puts on the smart glasses and enters the following prompt sentence into the speech recognition interface:

[1543] Example prompt: "Hello, I'm a 30-year-old man living in Japan. I'm planning a trip to Paris. I love history, art, and nature, my budget is ¥200,000, and I prefer an active travel style."

[1544] System Operation

[1545] 1. The server receives the user's basic information and preference information and stores it in a database.

[1546] 2. The server recommends travel destinations and attractions based on the stored profile.

[1547] 3. The travel plan automatically generated by the server is displayed on the smart glasses.

[1548] 4. Monitor weather and booking information in real time and adjust your travel plans as needed.

[1549] 5. Deliver virtual reality and augmented reality data to user devices to provide a digital travel experience.

[1550] 6. Monitor emergency information and respond promptly to emergency situations in coordination with rescue agencies when necessary.

[1551] This system allows users to enjoy a stress-free and comfortable travel experience, and also ensures safety during travel by providing real-time information.

[1552] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1553] Step 1:

[1554] Creating a User Profile

[1555] The user puts on the smart glasses and inputs basic information (such as name, age, gender, and nationality) and travel preferences (areas of interest, budget, travel style, etc.) through a voice recognition interface. The input information is sent to the server and stored in a database as a user profile.

[1556] Input: Basic information and preference information entered by the user via voice

[1557] Output: User profile stored on the server

[1558] What happens: The user speaks a prompt like this: "Hello, I'm a 30-year-old man living in Japan. I'm planning a trip to Paris. I love history, art, and nature, my budget is ¥200,000, and I prefer an active travel style."

[1559] Step 2:

[1560] Automatic travel plan generation

[1561] The server recommends suitable travel destinations and tourist attractions from an internal database and external data sources based on the user profile, automatically generates a travel plan based on the recommended information, and displays the plan on the smart glasses.

[1562] Input: User profile

[1563] Output: A recommended list of travel destinations and attractions based on user preferences, along with a travel plan

[1564] Specific operation: The server retrieves tourist spot information that matches the user's interests from the database, generates a travel plan, and displays it on the smart glasses. The user can confirm and modify the plan using their eyes or voice.

[1565] Step 3:

[1566] Real-time adjustments

[1567] The server monitors weather information and reservation status in real time and adjusts the travel plan accordingly, which is then sent to the smart glasses.

[1568] Input: Real-time weather information and reservation status

[1569] Output: Adjusted itinerary

[1570] Specific operation: The server uses a weather API to continuously check local weather information, and if bad weather is forecast, it changes the travel plan and notifies the smart glasses of the new plan.

[1571] Step 4:

[1572] Providing digital travel experiences

[1573] The server generates virtual reality and augmented reality data of tourist spots and cultural properties and distributes it to user devices (smart glasses). Users can use this data to enjoy virtual travel.

[1574] Input: Digital content data related to tourist destinations and cultural properties

[1575] Output: Virtual reality and augmented reality data displayed on smart glasses

[1576] Specific operation: The server delivers VR data, including historical information about tourist spots, to the smart glasses, allowing users to experience the place as if they were actually there.

[1577] Step 5:

[1578] Emergency support

[1579] The server monitors emergency information in real time and responds promptly to any health or traffic issues that may arise during travel by coordinating with the appropriate rescue agencies. Emergency response details are then sent to the smart glasses, which provide necessary instructions to the user.

[1580] Input: Emergency information to obtain while traveling

[1581] Output: Contact rescue agencies and emergency response instructions

[1582] Specific operation: When a user reports a health problem, the server contacts the hospital and displays the route to the nearest hospital and emergency response procedures on the smart glasses.

[1583] Thus, the present invention provides a range of features that allow users to automatically generate travel plans, respond to situations in real time while traveling, and even provide digital experiences using virtual reality.

[1584] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1585] The present invention combines an emotion engine with a system for recommending, planning and adjusting smart travel plans according to travelers' needs, and is implemented as follows.

[1586] Creating a User Profile

[1587] A user accesses the application or web interface using a device (smartphone, tablet, PC, etc.) and enters basic information (name, age, gender, nationality, etc.) and travel preferences (areas of interest, budget, travel style, etc.). This information is sent to a server and stored in a database as a profile. The user's emotional information is also collected and integrated into the profile.

[1588] Automatic travel plan generation

[1589] The server references the database based on the saved user profile and automatically recommends travel destinations and tourist spots that match the user's preferences. Based on the recommended information, the server automatically generates a travel plan and creates a travel schedule. The device displays the generated travel plan to the user, who can check and modify it.

[1590] Combining Emotion Engines

[1591] The server uses an emotion engine to analyze the user's real-time emotional information. Based on this information, the contents of the travel plan and schedule can be adjusted. For example, if the user is feeling stressed, the server can add relaxation spots.

[1592] Real-time adjustments

[1593] The server monitors weather information and reservation status in real time and adjusts travel plans as necessary based on the information obtained. For example, if the weather worsens, the server changes the schedule and notifies the device of the new plans. This allows users to always keep up with the latest travel plans. In addition, changes in emotions detected by the emotion engine are reflected in real time.

[1594] Providing digital travel experiences

[1595] The server generates virtual reality (VR) and augmented reality (AR) data of tourist spots and cultural assets and distributes it to devices. Users can view this digital data on their devices and virtually experience tourist spots, thereby gaining a deeper understanding and enjoyment during their trip.

[1596] Reservation and payment

[1597] The server connects with multiple travel service platforms to make reservations for recommended tourist spots and accommodations in one place. The server also processes all payments for reservations and displays the results on the terminal. This allows users to skip the cumbersome process of going through multiple platforms and make reservations and payments easily.

[1598] Emergency support

[1599] The server monitors emergency information in real time and responds quickly if a health or traffic problem occurs during travel. The server connects with appropriate rescue agencies (hospitals, police, fire department, etc.) and coordinates rescue efforts. The device notifies the user of emergency response details and provides necessary instructions to ensure the user's safety.

[1600] Specific examples

[1601] For example, if a user is planning a trip from Japan to Paris, France, the following process is executed:

[1602] 1. Users enter their basic information and travel preferences into the device, and the server stores it in a database. The emotion engine then analyzes the user's emotions and integrates that information into the profile.

[1603] 2. The server recommends Paris and selects tourist spots such as the Eiffel Tower and the Louvre. An itinerary is automatically generated and displayed on the device.

[1604] 3. The server monitors weather information before and during the trip, and if the weather worsens, adjusts the schedule and notifies the terminal.

[1605] 4. The server generates VR and AR data for the tourist spot and distributes it to the device, allowing the user to enjoy the virtual experience.

[1606] 5. The server then makes all the bookings for accommodation and sightseeing tickets, processes the payments, and displays the results on the terminal.

[1607] 6. If the emotion engine detects that the user is feeling stressed during the trip, the server will add relaxation spots and adjust the schedule.

[1608] 7. In the event of a health issue, the server will initiate an emergency response and coordinate with the appropriate rescue agencies for immediate action. The device will provide detailed instructions to the user.

[1609] This allows users to enjoy a stress-free and comfortable travel experience.The present invention is a system for improving the efficiency of travel planning, resolving problems during travel, and responding based on emotions, and it represents a significant improvement over conventional travel procedures.

[1610] The processing flow will be explained below.

[1611] Step 1:

[1612] A user accesses an application or web interface using a device (smartphone, tablet, PC, etc.) and enters basic information (name, age, gender, nationality, etc.).

[1613] Step 2:

[1614] Users input their areas of interest (history, nature, culture, etc.), budget, and travel style (adventure, relaxation, etc.) into the terminal.

[1615] Step 3:

[1616] The terminal transmits the input basic information and preference information to the server.

[1617] Step 4:

[1618] The server creates a user profile based on the received information and stores it in a database.

[1619] Step 5:

[1620] The server also uses an emotion engine to collect the user's emotion information and integrate it into the profile.

[1621] Step 6:

[1622] The server refers to the database and recommends travel destinations that match the user's preferences.

[1623] Step 7:

[1624] The server selects tourist attractions and activities from the recommended travel destinations.

[1625] Step 8:

[1626] The server automatically generates a travel plan based on tourist attractions and activities and creates a schedule.

[1627] Step 9:

[1628] The terminal displays the generated travel plan to the user, who can then confirm and modify the plan.

[1629] Step 10:

[1630] The server monitors weather information and reservation status in real time.

[1631] Step 11:

[1632] If the server detects changes in weather or reservations, it adjusts travel plans and updates schedules.

[1633] Step 12:

[1634] The terminal notifies the user of the updated schedule and allows the user to confirm it.

[1635] Step 13:

[1636] The server prepares virtual reality (VR) and augmented reality (AR) data of tourist attractions and cultural properties.

[1637] Step 14:

[1638] The server delivers VR and AR data to the device.

[1639] Step 15:

[1640] Users use the device to view VR and AR data and enjoy the virtual experience.

[1641] Step 16:

[1642] The server works in conjunction with the travel service platform to arrange reservations for accommodation and sightseeing tickets all at once.

[1643] Step 17:

[1644] The server calculates the total cost for the reservation and processes the payment in one lump sum.

[1645] Step 18:

[1646] The terminal displays a confirmation of the reservation completion to the user.

[1647] Step 19:

[1648] The server monitors emergency information occurring during travel in real time.

[1649] Step 20:

[1650] If the server detects an emergency (health problem or traffic trouble), it will coordinate with appropriate rescue agencies and implement emergency response.

[1651] Step 21:

[1652] The device will notify the user of emergency response details and provide necessary instructions.

[1653] Step 22:

[1654] At any step, the server analyzes the user's emotional information using an emotion engine, and if it detects stress or dissatisfaction, it adjusts the itinerary, for example, by adding a relaxing spot or changing the order of activities.

[1655] Step 23:

[1656] The terminal notifies the user of the travel plan adjusted based on the emotion and allows the user to confirm it.

[1657] Example 2

[1658] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1659] Conventional travel planning systems not only recommend travel destinations and tourist spots that match a user's preferences, but also lack the ability to reflect the user's emotional and weather information in real time. They also lack the ability to respond to emergencies and process reservations and payments across multiple travel service platforms. This creates a demand for systems that can improve the quality of users' travel experiences.

[1660] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1661] In this invention, the server includes means for collecting basic information and preference information of a user, means for recommending travel destinations and tourist spots based on the basic information and preference information, means for automatically generating and displaying a travel plan including the travel destinations and tourist spots, means for collecting and analyzing user emotional information and reflecting the emotional information in the travel plan, means for monitoring weather information and reservation status in real time and adjusting the travel plan, means for generating virtual reality data and augmented reality data of tourist spots and cultural properties and distributing them to a user terminal, means for linking with multiple travel service platforms and processing reservations and payments in a lump sum, and means for linking with appropriate rescue organizations in the event of an emergency and providing instructions to the user terminal. This allows for the provision of a travel plan optimal for the user's preferences and emotional state, and enables real-time adjustments and emergency response.

[1662] A "user" is an individual or group that uses the system to create a travel plan and plan sightseeing.

[1663] "Basic information" is data for identifying an individual, such as the user's name, age, sex, and nationality.

[1664] "Preference information" is data indicating the user's individual preferences, such as areas of interest, travel style, and budget, which are necessary for selecting and planning a travel destination.

[1665] "Emotion information" is data that indicates the emotional state, such as stress or joy, that the user feels while traveling.

[1666] A "travel destination" is a region or city that a user aims to visit.

[1667] A "tourist attraction" is a place or facility of particular importance or interest in a travel destination.

[1668] A "travel plan" is a plan that includes a schedule of places to visit and activities, automatically generated based on the user's preferences and emotional information.

[1669] "Real-time" weather and reservation monitoring means getting the latest information instantly and adjusting your travel plans accordingly.

[1670] "Virtual reality data" is data on virtually recreated tourist spots and cultural assets.

[1671] "Augmented reality data" is information provided by overlaying digital information onto real-world scenes.

[1672] A "travel service platform" is a system or website that provides online reservations and payments for accommodation and sightseeing tickets.

[1673] An "emergency" is a situation in which a user faces an unexpected situation such as a health problem or traffic trouble while traveling.

[1674] "Rescue agencies" are organizations such as hospitals, police, and fire departments that deal with health issues, traffic accidents, etc.

[1675] A "terminal" is a device such as a smartphone, tablet, or PC that a user uses to access the system and input or retrieve travel planning information.

[1676] The present invention combines an emotion engine with a system for recommending, planning and adjusting smart travel plans according to traveler needs, and embodiments thereof are described in detail below.

[1677] Creating a User Profile

[1678] A user accesses the application or web interface using a device (smartphone, tablet, PC, etc.) and enters basic information (name, age, gender, nationality, etc.) and travel preferences (areas of interest, budget, travel style, etc.), including settings for entering emotional information. This information is sent to the server and stored in a database. The emotional engine evaluates the user's emotional state based on the information entered and integrates the results into a profile.

[1679] Recommendations for travel destinations and attractions

[1680] Based on the saved user profile, the server references a database and automatically recommends travel destinations and tourist attractions that match the user's preferences. A generative AI model is then used to generate a list of suitable travel destination and tourist attraction recommendations. This list is based on the user's profile information and emotional information, providing suggestions that best suit individual needs.

[1681] Automatic travel plan generation

[1682] The server automatically generates a detailed travel plan based on the generated recommendation list. The travel plan includes multiple itineraries and activities and is customized based on the user's preferences and emotional information. The generated travel plan is displayed to the user via their device, allowing them to review and modify the plan as needed.

[1683] Real-time adjustments

[1684] The server monitors weather information and reservation status in real time and can adjust travel plans as needed. For example, schedule changes are made in response to sudden changes in the weather or cancellations of reservations. Adjusted travel plans are notified to the device, providing the user with the latest information.

[1685] Providing digital travel experiences

[1686] The server generates virtual reality (VR) and augmented reality (AR) data of tourist spots and cultural assets and distributes it to devices. Users can view this digital data through their devices and virtually experience tourist spots, allowing them to enjoy their local travel experience more deeply.

[1687] Bulk booking and payment

[1688] The server connects with multiple travel service platforms to make reservations for recommended tourist spots and accommodations in one place. The server also processes all payments for reservations and displays the results on the terminal. This allows users to avoid the cumbersome process of going through multiple platforms and make reservations and payments easily.

[1689] Emergency support

[1690] The server monitors emergency information in real time and responds quickly if a health or traffic problem occurs during travel. It also coordinates necessary rescue operations by connecting with appropriate rescue agencies. The device notifies the user of emergency response details and provides necessary instructions to ensure the user's safety.

[1691] Specific examples

[1692] For example, if a user is planning a trip from Japan to Paris, France, they can input the following prompt into the generative AI model:

[1693] Please recommend suitable travel destinations based on the user profile below.

[1694] Name: User A

[1695] Age: 30

[1696] Gender: Male

[1697] Nationality: Japanese

[1698] Interests: Historical sites

[1699] Budget: 100,000 yen

[1700] This enables the system to provide optimal travel plans that meet the user's needs and improve the travel experience.

[1701] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1702] Step 1: Create a user profile

[1703] A user accesses the application or web interface using a device and enters basic information (such as name, age, gender, and nationality) and travel preferences (such as areas of interest, budget, and travel style). The device then sends the entered information to the server, which then stores the data in a database. At the same time, a prompt for emotional assessment is displayed, evaluating the user's emotional state and integrating that information into the profile. For example, if a user enters "I'm interested in historical tourist sites" and "My budget is within 100,000 yen," the emotional information is saved along with that information.

[1704] Input: User's basic information, preference information, emotional information

[1705] Output: User profile stored in the database

[1706] Step 2: Recommend travel destinations and attractions

[1707] The server searches the database for potential travel destinations based on the saved user profile. Using a generative AI model, the server generates a list of travel destinations and tourist attractions that match the user's preferences based on the user's profile information. For example, the Eiffel Tower and the Louvre Museum in Paris may be recommended. The generated list is sent to the device for the user to review.

[1708] Input: User profile

[1709] Output: A list of recommended travel destinations and attractions

[1710] Step 3: Automatically generate a travel plan

[1711] The server automatically generates a detailed travel plan based on the recommendation list. It takes into account the user's preferences and emotional information to optimize the schedule and activities. For example, if the user prioritizes relaxation, it will include relaxing spots in the schedule. The generated plan is sent to the device, where the user can review and modify it.

[1712] Input: List of recommended travel destinations and attractions, user profile

[1713] Output: An automatically generated itinerary

[1714] Step 4: Adjust in real time

[1715] The server monitors weather information and reservation status in real time and adjusts travel plans as needed. For example, if the weather worsens, it will change activities to indoors. Once the plan has been adjusted, it will be notified to the device, providing the user with the latest information.

[1716] Input: Weather information, reservation status, travel plans

[1717] Output: Adjusted itinerary

[1718] Step 5: Delivering digital travel experiences

[1719] The server generates virtual reality (VR) and augmented reality (AR) data of tourist attractions and cultural properties and delivers it to the device. The user can view this data on the device and virtually experience the tourist attractions. For example, if the user is at the Louvre Museum, they can view a 3D model through the device and obtain additional information.

[1720] Input: Information about tourist spots and cultural assets

[1721] Output: VR and AR data

[1722] Step 6: Batch booking and payment

[1723] The server connects with multiple travel service platforms to make reservations for recommended accommodations and sightseeing tickets in one place. The server also processes all payments for the reservations in one place, and the results are displayed on the terminal. For example, a notification such as "Reservation completed at XX hotel" or "Museum ticket purchase completed" is displayed.

[1724] Input: Travel plan, user profile

[1725] Output: Notification of reservation and payment completion

[1726] Step 7: Emergency Support

[1727] The server monitors emergency information in real time and responds quickly if a health or traffic problem occurs during travel. The device coordinates the necessary rescue operations by connecting with the appropriate rescue agencies, notifying the user of the details of the response and providing necessary instructions to ensure the user's safety. For example, if the user feels unwell, information about nearby hospitals and the best transportation options will be provided.

[1728] Input: Emergency information, user location information

[1729] Output: Emergency response instructions and rescue agency contact information

[1730] (Application example 2)

[1731] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1732] Conventional travel plan generation systems struggle to make real-time adjustments that fully reflect user preferences and emotions, making it difficult to increase user satisfaction. They also struggle to automatically generate travel plans that integrate multiple information sources and adapt to changing conditions during a trip. This often leaves users feeling stressed and detracts from their travel experience.

[1733] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for collecting basic information and preference information of a user; means for recommending travel destinations and tourist spots based on the basic information and preference information; means for automatically generating and displaying a travel plan including the travel destinations and tourist spots; means for collecting and analyzing user emotion information; means for adjusting the travel plan in real time based on the emotion information; means for monitoring weather information and reservation status in real time and adjusting the travel plan; means for notifying the user of the adjusted travel plan; means for providing virtual reality data and augmented reality data of tourist spots and cultural properties; means for delivering and displaying the virtual reality data and augmented reality data to a user terminal; means for automatically generating a travel plan using a generative AI model and adjusting it in real time based on the emotion information; and means for simplifying user input using prompt sentences to support travel plan generation. This enables automatic generation and real-time adjustment of an optimal travel plan based on a user's preferences and emotions.

[1734] "Basic information" refers to personal identification information such as the user's name, age, sex, and nationality.

[1735] "Preference information" is information that reflects the user's preferences, such as areas of interest, budget, and travel style.

[1736] A "travel destination" is a destination, such as a geographical location or city, that a user plans to visit.

[1737] "Tourist spots" are places that users visit, such as tourist attractions, cultural assets, and attractions at travel destinations.

[1738] A "travel plan" is a plan that includes a travel schedule and itinerary, created based on the user's preference information and basic information.

[1739] "Emotional information" is data that represents the user's current emotional state, including stress, relaxation, excitement, and the like.

[1740] "Real-time adjustment" is the process of instantly changing and updating travel plans in response to changing conditions during the trip (weather information, reservation status, emotional information, etc.).

[1741] "Weather information" is data about the current and forecast weather at a travel destination.

[1742] "Reservation status" is information indicating the reservation availability of facilities and transportation related to the trip.

[1743] "Virtual reality data" is digital data that provides users with an immersive virtual visual experience.

[1744] "Augmented reality data" is data used to display virtual information overlaid on the real world.

[1745] A "user terminal" is an electronic device (such as a smartphone, tablet, or PC) that a user uses to view or input information.

[1746] A "generative AI model" is an artificial intelligence model that learns patterns based on large amounts of data and automatically generates travel plans.

[1747] A "prompt sentence" is a standard sentence that simplifies the information that the user inputs and clarifies instructions to the system.

[1748] To implement this invention, a system that mainly uses a server, a user terminal, and some dedicated software is required. The main configuration and operation procedure of this system are as follows.

[1749] First, the user enters their basic information (name, age, gender, nationality, etc.) and preference information (areas of interest, budget, travel style, etc.) using a user device (smartphone, tablet, PC, etc.). This information is sent to the server, which then stores it in a database.

[1750] The server then recommends travel destinations and tourist attractions based on the collected basic information and preference information. Based on the recommended information, the server automatically generates a travel plan and displays it on the user's device. In this process, the server uses a generative AI model to generate the optimal travel plan. The generative AI model has learned a large amount of data in advance and is capable of providing a plan that best suits the user's preferences.

[1751] A visual interface is provided on the user's terminal to allow the user to review and modify the travel plan. Once the user approves the plan, the server confirms the plan. Prompt sentences are also used to simplify the user's input and assist in generating the optimal travel plan.

[1752] In addition, the server monitors weather and reservation status in real time and adjusts travel plans based on this information. For example, if a reservation for a planned tourist spot is canceled at the last minute, the server will automatically recommend an alternative tourist spot and notify the user. This process is also automatic and is reflected in real time on the user's device.

[1753] The system also incorporates an emotion engine that collects and analyzes the user's emotional information. If the user feels stressed during the trip, the server will make real-time adjustments, such as adding relaxation spots.

[1754] It also provides virtual reality (VR) and augmented reality (AR) data of tourist spots and cultural assets, allowing users to virtually experience tourist spots before or during their trip using dedicated AR / VR headsets or smartphones.

[1755] For example, if a user is planning a trip to Paris, the following happens:

[1756] 1. The user enters basic information and preferences into the app.

[1757] 2. The server recommends Paris and generates a travel plan that includes attractions such as the Eiffel Tower and the Louvre.

[1758] 3. Real-time analysis of when you feel stressed and adding a visit to a relaxing cafe.

[1759] 4. Providing a virtual experience of the Eiffel Tower through VR / AR content.

[1760] An example of a prompt is as follows:

[1761] "You enter your basic information and preferences to create a user profile. Then, the system generates a smart itinerary based on that, adjusting in real time. It also provides VR / AR experiences of tourist attractions. For example, if you enter, 'If I'm traveling to Paris, I want to visit the Eiffel Tower and the Louvre Museum. I also want to visit a relaxing cafe,' the system will automatically generate an itinerary for your Paris trip."

[1762] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1763] Step 1:

[1764] A user accesses the application using a terminal and inputs basic information and preferences. This input includes information such as name, age, gender, nationality, areas of interest, budget, and travel style. The terminal sends this information to the server. Data processing involves converting the input information into a standard format and storing it in a database. The output is a database entry that stores the user's basic information and preferences.

[1765] Step 2:

[1766] The server uses a generative AI model to recommend optimal travel destinations and tourist attractions based on the saved user profile. The server uses basic information and preference information as input data, and performs calculations by calling the generative AI model that has learned from past data and trends. The output is a list of recommended travel destinations and tourist attractions.

[1767] Step 3:

[1768] The server automatically generates a travel plan including recommended destinations and tourist attractions and displays it on the device. The travel plan includes travel dates, duration of stay, and access methods. The server creates the plan using a generative AI model and retrieves the necessary details from a database. The output is an automatically generated travel plan that is displayed on the user's device.

[1769] Step 4:

[1770] The server collects the user's emotional information and analyzes it using an emotion engine. The data required for emotion analysis (facial expressions, tone of voice, etc.) is collected from the camera and microphone installed on the user's device. The server inputs this data into the emotion engine and calculates the user's emotional state. The output is the user's emotional profile, updated in real time.

[1771] Step 5:

[1772] Based on the user's emotional information, the server adjusts the travel plan in real time. For example, if the user is feeling stressed, the server adds relaxing spots and activities to the plan. This generates a travel plan that reflects the user's emotional state. As a data calculation, a new plan is calculated using the emotional information and the existing travel plan as input data. The output is the adjusted travel plan.

[1773] Step 6:

[1774] The server monitors weather information and reservation status in real time. It accesses the weather information API and reservation management system to obtain the latest information. The server reflects this information in the travel plan and updates the plan as necessary. The output is the latest travel plan adjusted according to the weather and reservation status, and is notified to the user's device.

[1775] Step 7:

[1776] Virtual reality and augmented reality data of tourist spots and cultural assets are delivered to user devices. The server generates the corresponding VR / AR data and sends it to the user device. Users can view this digital data using their devices and virtually experience tourist spots. The output is VR / AR content displayed on the user device.

[1777] Step 8:

[1778] The user approves the itinerary, and the server finalizes the travel plan using the generative AI model. After receiving approval input from the user's device, the server saves the final plan in the database. The output is the finalized travel plan.

[1779] Step 9:

[1780] The server generates prompts to prompt the user to simply input details of their travel plans. The prompts are automatically generated based on pre-defined templates. The output is a prompt that facilitates intuitive input by the user.

[1781] Example prompt sentence:

[1782] "You enter your basic information and preferences to create a user profile. Then, the system generates a smart itinerary based on that, adjusting in real time. It also provides VR / AR experiences of tourist attractions. For example, if you enter, 'If I'm traveling to Paris, I want to visit the Eiffel Tower and the Louvre Museum. I also want to visit a relaxing cafe,' the system will automatically generate an itinerary for your Paris trip."

[1783] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1784] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1785] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1786] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1787] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1788] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1789] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1790] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1791] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1792] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1793] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1794] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1795] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1796] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1797] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1798] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1799] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1800] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1801] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1802] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1803] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1804] The following is further disclosed regarding the above embodiment.

[1805] (Claim 1)

[1806] A means for collecting basic information and preference information of users;

[1807] a means for recommending travel destinations and tourist spots based on the basic information and preference information;

[1808] means for automatically generating and displaying a travel plan including the travel destinations and tourist spots;

[1809] A system including:

[1810] (Claim 2)

[1811] means for monitoring weather information and reservation status in real time and adjusting said travel plan;

[1812] means for notifying the user of the adjusted travel plans;

[1813] The system of claim 1 further comprising:

[1814] (Claim 3)

[1815] means for providing virtual reality data and augmented reality data of tourist sites and cultural properties;

[1816] means for delivering and displaying the virtual reality data and augmented reality data to a user terminal;

[1817] The system of claim 1 further comprising:

[1818] (Claim 4)

[1819] A means to process reservations and payments centrally by linking with multiple travel service platforms;

[1820] means for displaying said reservation and payment confirmation to the user;

[1821] The system of claim 1 further comprising:

[1822] (Claim 5)

[1823] A means of monitoring emergency information and responding accordingly to health or traffic issues;

[1824] means of coordinating with rescue agencies to implement emergency response;

[1825] means for notifying a user terminal of the emergency response;

[1826] The system of claim 1 further comprising:

[1827] "Example 1"

[1828] (Claim 1)

[1829] A means for collecting basic information and preference information of users;

[1830] means for recommending travel destinations and tourist spots based on the basic information and preference information;

[1831] a means for automatically generating and displaying a travel plan including the travel destinations and tourist spots;

[1832] means for monitoring weather information and reservation status in real time and adjusting said travel plans;

[1833] means for generating virtual reality data and augmented reality data of tourist attractions, and distributing and displaying the data to a user terminal;

[1834] a means of processing reservations and payments for travel services;

[1835] a means of monitoring and responding to emergency information;

[1836] A system including:

[1837] (Claim 2)

[1838] means for notifying the user of the adjusted travel plans;

[1839] a means of confirming and amending travel plans;

[1840] The system of claim 1 further comprising:

[1841] (Claim 3)

[1842] means for delivering and displaying virtual reality data and augmented reality data to a user terminal;

[1843] The system of claim 1 further comprising:

[1844] "Application Example 1"

[1845] (Claim 1)

[1846] A means for collecting basic information and preference information of users;

[1847] a means for recommending travel destinations and tourist spots based on the basic information and preference information;

[1848] means for automatically generating and displaying a travel plan including the travel destinations and tourist spots;

[1849] means for delivering and displaying virtual reality data and augmented reality data to a user terminal;

[1850] A way to monitor weather information and reservations in real time and adjust travel plans;

[1851] A system including:

[1852] (Claim 2)

[1853] means for notifying the user of the adjusted travel plans;

[1854] a display means for visually checking weather information and emergency information; ...

Claims

1. A means for collecting basic information and preference information of users; a means for recommending travel destinations and tourist spots based on the basic information and preference information; means for automatically generating and displaying a travel plan including the travel destinations and tourist spots; A system including:

2. means for monitoring weather information and reservation status in real time and adjusting said travel plan; means for notifying the user of the adjusted travel plans; The system of claim 1 further comprising:

3. means for providing virtual reality data and augmented reality data of tourist sites and cultural properties; means for delivering and displaying the virtual reality data and augmented reality data to a user terminal; The system of claim 1 further comprising:

4. A means to process reservations and payments centrally by linking with multiple travel service platforms; means for displaying said reservation and payment confirmation to the user; The system of claim 1 further comprising:

5. A means of monitoring emergency information and responding accordingly to health or traffic issues; means of coordinating with rescue agencies to implement emergency response; means for notifying a user terminal of the emergency response; The system of claim 1 further comprising:

Images