system

Abstract

We provide the system. [Solution] A means of acquiring data such as user preferences, budget, and desired travel period, A means of formulating a travel plan using a generative model based on acquired data, A means of creating and providing experiences of tourist destinations that do not exist in the real world using virtual reality technology, based on a planned travel itinerary. A means of presenting a generated travel plan to the user and initiating a virtual experience based on the user's selection, A means of supplying generated virtual tourist destinations through a visual device, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance as a response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] There is a problem that it is difficult for a user who wishes to travel to easily obtain an optimal travel plan according to their own preferences and budget. In addition, there is a lack of tourism experience in places where actual visits are difficult or under time constraints. Furthermore, due to new infectious diseases and economic factors, there are restrictions that prevent free travel. To address these problems, it is necessary to provide a personalized travel experience for users.

Means for Solving the Problems

[0005] This invention provides a system that uses a generative model to create travel plans according to the user's preferences and budget. Furthermore, by including means for generating and providing experiences of tourist destinations that do not exist in reality using virtual reality technology, it enables a fulfilling travel experience that is not dependent on actual travel. This provides users with the optimal travel plan and realizes a new travel experience that transcends the limitations of reality.

[0006] "User preferences" refer to information that indicates a traveler's personal interests and preferences regarding tourist destinations, activities, themes, and other topics.

[0007] "Budget" refers to the maximum amount of money a user plans to spend on their trip.

[0008] "Desired travel period" refers to the specific dates or duration that the user wishes to travel.

[0009] A "generative model" is a program that uses AI technology to automatically generate individually tailored travel plans based on the information entered.

[0010] A "travel plan" is a plan that includes a schedule of sightseeing destinations and activities suggested based on the user's preferences and circumstances.

[0011] "Virtual reality technology" is a technology that allows users to experience a computer-generated 3D environment through their sight and hearing.

[0012] A "tourist destination" is a geographical or virtual location intended for travel.

[0013] "Providing an experience" means enabling users to instantly experience a specified activity or situation. [Brief explanation of the drawing]

[0014] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] It is a conceptual diagram showing an example of the main functions of a data processing device and a smart device according to the first embodiment. [Figure 3] It is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] It is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] It is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] It is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] It is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] It is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] It shows an emotion map to which multiple emotions are mapped. [Figure 10] It shows an emotion map to which multiple emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when an emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when an emotion engine is combined.

MODE FOR CARRYING OUT THE INVENTION

[0015] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0016] First, the terms used in the following description will be explained.

[0017] In the following embodiments, the labeled processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0018] In the following embodiments, the labeled RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0019] In the following embodiments, the labeled storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, etc.

[0020] In the following embodiments, the labeled communication I / F (Interface) is an interface including a communication processor and an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark), etc.

[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0022] [First Embodiment]

[0023] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0024] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0025] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0027] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0029] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0030] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0032] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0034] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0035] This invention is a system that generates travel plans that take into account the user's preferences, budget, and desired travel dates, and provides a special sightseeing experience using virtual reality technology. The following describes an embodiment of this system with specific examples.

[0036] The system first collects travel information from the user via a terminal. The user inputs information about their preferred tourist destinations, budget, desired travel dates, and specific activities or themes. The terminal then sends this information to a server. The server analyzes the received information and activates an AI-based generative model to generate the best travel plan.

[0037] The generative model creates a specific and personalized travel plan, taking into account the user's given conditions. This plan includes not only visits to traditional tourist destinations, but also special sightseeing experiences utilizing virtual reality technology. For example, if a user is interested in natural landscapes and historical sites, the generative model would create a travel plan incorporating "climbing Mount Fuji" and "visiting temples in Kyoto." It would also offer the option to experience a non-existent "hanging garden" using virtual reality technology.

[0038] Next, the server sends the generated travel plan to the device. The device visually presents the plan to the user and offers options. The user can select the most appealing plan from several options and confirm their selection on the device. Based on the plan selected by the user, the device proceeds with the necessary booking procedures and preparations for the virtual experience.

[0039] Ultimately, users can follow their chosen travel plan and engage in on-site visits and virtual reality-based sightseeing experiences. The server provides data related to the virtual tourist destination to the terminal, enabling users to enjoy these experiences through their virtual reality devices. In this way, the system provides users with a personalized travel experience, realizing a new experience that goes beyond the realm of actual travel.

[0040] The following describes the processing flow.

[0041] Step 1:

[0042] Users enter their travel preferences using their device. This includes desired tourist destinations, activities of interest, budget, and travel dates.

[0043] Step 2:

[0044] The terminal sends the information entered by the user to the server. This data forms the basis for generating travel plans.

[0045] Step 3:

[0046] The server analyzes the received data to understand the user's preferences and circumstances. Through this analysis, it identifies which tourist destinations and experiences are suitable for the user.

[0047] Step 4:

[0048] The server uses an AI-based generative model to create a travel plan based on the analysis results. This plan incorporates actual destinations and experiences utilizing virtual reality technology.

[0049] Step 5:

[0050] The server sends the generated travel plan to the device. Multiple plans may be included, each with different elements.

[0051] Step 6:

[0052] The device presents the user with travel plans and explains the details of each. The user selects the plan that best matches their interests.

[0053] Step 7:

[0054] Once the user confirms their selection, the device sends the result to the server. Based on the selected plan, preparations for the experience or reservation are made.

[0055] Step 8:

[0056] The server provides the terminal with data on virtual tourist destinations and information necessary for real-world travel. This prepares the user to carry out their planned travel experience.

[0057] Step 9:

[0058] Users either visit a real travel destination or begin an experience using virtual reality technology through their device. The server continuously provides the necessary data to support this experience.

[0059] (Example 1)

[0060] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0061] Traditional travel planning has challenges in adequately reflecting the preferences and circumstances of individual users, and in providing new travel experiences for users who are not satisfied with just visiting standard tourist destinations. There is a need for a method that can provide users with optimal travel plans within tight time and budget constraints, and furthermore, offer opportunities to experience virtual tourist destinations that do not actually exist.

[0062] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0063] In this invention, the server includes means for acquiring information via a communication device and analyzing information including the user's preferences, budget, and desired travel period; means for generating a personalized travel itinerary using a generative AI model based on the acquired information; and means for generating non-existent tourist destinations as content using virtual reality technology for the generated travel itinerary, and providing the user with an experience. This makes it possible to provide users with a personalized travel experience and enable a new tourism experience that combines reality and virtuality.

[0064] "Information" refers to data necessary for planning a trip, such as the user's preferences, budget, and desired travel dates.

[0065] A "communication device" is a device used to transmit information from a terminal to a server.

[0066] A "generative AI model" is an artificial intelligence technology that automatically creates the optimal travel itinerary based on information provided by the user.

[0067] A "personalized travel itinerary" is a travel plan that is specially customized according to the user's preferences and circumstances.

[0068] "Virtual reality technology" is a technology that allows users to experience computer-generated virtual environments in a realistic way.

[0069] "Visual devices" are devices used to experience virtual reality technology and provide users with visual information.

[0070] "Content" refers to information and materials, including virtual tourist destinations and experiences, generated using virtual reality technology.

[0071] This invention is a system for generating personalized travel plans based on user preferences and conditions, and for providing special sightseeing experiences using virtual reality technology. Specific embodiments are described below.

[0072] First, the terminal collects travel-related information from the user. The user accesses a dedicated interface and enters their interests, budget, desired travel dates, and specific activities or themes. This information is collected by the terminal and then transmitted to a server using a communication device.

[0073] The server analyzes the received information and activates a generative AI model. This model uses the data provided by the user to generate a personalized travel itinerary. Specifically, it uses natural language processing technology and machine learning algorithms to select the most suitable tourist destinations and activities that meet the user's criteria and formulate a plan.

[0074] The generated plan includes not only visits to regular tourist attractions, but also special sightseeing experiences utilizing virtual reality technology. The virtual reality experience is delivered to the user through visual devices. For example, it becomes possible to have experiences that cannot be obtained through normal travel, such as visiting a "hanging garden" or historical buildings that do not exist in reality.

[0075] For example, if a user enters the prompt message, "I'm interested in natural landscapes and historical sites. My budget is under 100,000 yen, and I'd like to travel next month," the server will provide a travel plan that includes "climbing Mount Fuji" and "visiting temples in Kyoto." It will also suggest an option to experience a "hanging garden" using virtual reality technology.

[0076] This system allows users to enjoy unique travel experiences that go beyond local and international travel. It also helps users easily select and implement the most suitable travel plan for their needs.

[0077] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0078] Step 1:

[0079] Users enter their travel requirements into the terminal. This includes detailed information such as budget, desired travel dates, regions they want to visit, and activities or themes of interest. This input process clearly defines the user's unique travel needs.

[0080] Step 2:

[0081] The terminal transmits the information collected from the user to the server via a communication device. At this point, the terminal processes the user information collected as raw data and formats it into a format that the server can receive.

[0082] Step 3:

[0083] The server analyzes the received user information and activates a generative AI model. The analysis classifies the data based on the user's interests and constraints, extracting necessary features. The model uses machine learning algorithms to generate personalized travel plans. The output is a travel itinerary optimized for the user's needs.

[0084] Step 4:

[0085] The server incorporates special experiences into the generated travel itinerary using virtual reality technology. Specifically, it adds virtual tourist destinations and activities to the travel plan. This determines the content of the virtual experiences that can be offered to the user.

[0086] Step 5:

[0087] The server sends the final travel plan to the terminal. The terminal uses a visual display to show the user the details of the plan. The user can compare multiple options and select the most suitable travel itinerary.

[0088] Step 6:

[0089] Based on the travel plan selected by the user, the device proceeds with the necessary booking procedures and preparations for the virtual reality experience. This process involves arranging accommodations and transportation services through integration with the booking system. Digital content for the virtual experience is also prepared as needed.

[0090] Step 7:

[0091] Users will experience both actual visits and virtual reality activities according to their selected travel plan. The server will provide virtual tourist destination-related data to the device as needed to ensure a smooth user experience.

[0092] (Application Example 1)

[0093] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0094] Modern travel planning lacks travel experiences that reflect individual user preferences, making it difficult to propose novel sightseeing experiences. Furthermore, there are few effective means of providing real-time cultural and historical guidance tailored to user interests during their trip. To address these challenges, it is necessary to provide users with more satisfying travel experiences.

[0095] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0096] In this invention, the server includes means for acquiring data such as the user's preferences, budget, and desired travel period; means for formulating a travel plan using a generative model based on the acquired data; means for generating tourist destinations that do not exist in the real world using virtual reality technology and providing an experience based on the formulated travel plan; means for presenting the generated travel plan to the user and initiating a virtual experience based on the user's selection; and means for supplying the generated virtual tourist destinations through a visual device. This enables the formulation of travel plans tailored to the individual user's preferences and the creation of novel tourist destination experiences.

[0097] "User preferences, budget, and desired travel dates" refers to information indicating a user's personal preferences, budget constraints, and preferred travel dates.

[0098] "Means of acquisition" refers to technology or devices that have the function of collecting data from users and receiving it in a system.

[0099] A "generative model" is an algorithm or program that uses AI technology to generate specific results or plans based on user data.

[0100] "Means for planning travel" refers to technology or devices that have the function of creating an optimal travel plan, taking into account the user's interests and constraints.

[0101] "Virtual reality technology" refers to digital technologies and devices that enable users to experience a virtual space different from the real world.

[0102] A "tourist destination that does not exist in the real world" refers to a virtual tourist location that does not exist in reality but is constructed through virtual reality technology and can be experienced by users.

[0103] "Means of providing an experience" refers to a technology or device that has the function of providing a user with a specific experience through digital technology.

[0104] "Means of supplying through visual devices" refers to technologies or devices that visually deliver a virtual reality experience to the user.

[0105] "Real-time cultural and historical guidance" refers to commentary that provides the cultural background and historical information necessary at that moment in relation to the virtual tourist destination the user is experiencing.

[0106] A "personalized virtual travel experience" is a virtual travel experience that is customized according to the individual interests and preferences of the user.

[0107] The system implementing this invention comprises a server and a user terminal. First, the user terminal provides an interface for inputting data regarding the user's preferences, budget, and desired travel dates. This data is transmitted from the terminal to the server. The server receives the data and activates an AI-based generative model. This generative model, implemented using Python and Tensorflow®, creates a travel plan optimized for the user's conditions. The generated plan includes tourist destinations that do not exist in the real world, using virtual reality technology. The virtual reality experience is realized using Unity and the Oculus SDK.

[0108] For example, if a user is interested in "medieval castles," the server generates a "Medieval European Castle Tour" and makes this tour available for VR experience. The generated travel plan is presented to the user through the device screen, and they can start the selected virtual experience in real time using their visual device.

[0109] Furthermore, the server provides users with real-time information about the culture and history associated with the generated virtual tourist destinations. This allows users to have a deeper virtual travel experience through their visual devices.

[0110] As an example, here is a sample prompt given to a generative AI model: "The user is interested in medieval castles. Generate a travel plan that will captivate them during their virtual journey, integrating information that encompasses their culture and history." This allows the system to provide the user with a personalized virtual travel experience.

[0111] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0112] Step 1:

[0113] The user enters their preferences, budget, and desired travel dates through an interface on their device. This data is acquired as input from the user's device and sent to the server. The output of this step is a dataset of the user's travel conditions.

[0114] Step 2:

[0115] The server analyzes the data received from the user. This analysis generates prompt statements that take into account the user's preferences and conditions, preparing them for input into an AI-based generative model. As a result of the data analysis, input data for the generative model is obtained. This process includes database searches and combinatorial logic.

[0116] Step 3:

[0117] The generative AI model receives prompt text on the server and generates a corresponding travel plan. The model uses a predictive algorithm to select travel destinations and experiences that are suitable for the user's interests and preferences. The output is a proposed travel plan, which includes special tourist destinations that can be experienced in virtual reality. This process is performed using a TensorFlow machine learning model.

[0118] Step 4:

[0119] The server sends the generated travel plan to the user's device. The device receives this data and displays it visually on the screen. The user can choose the most appealing option from multiple suggestions. The output of this step is the travel plan selected by the user.

[0120] Step 5:

[0121] Based on the selected travel plan, the server prepares an experience using virtual reality technology. Specifically, it uses Unity and the Oculus SDK to build a scene of a virtual tourist destination and delivers it to the user's visual device in real time. The output is a virtual reality tour experienced through the user's visual device.

[0122] Step 6:

[0123] During the tour, the server delivers real-time explanations of the culture and history related to the virtual tourist destination the user is visiting, via visual devices. This allows users to receive educational information and enrich their travel experience. The output is real-time guide information in the form of audio and text.

[0124] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0125] This invention is a system that generates travel plans tailored to the user's preferences, budget, and desired travel period, and further adjusts the plan by recognizing the user's emotions. This system uses virtual reality technology to create tourist destinations that do not exist in reality, providing the user with a special travel experience. Specific embodiments of this system are described below.

[0126] In the initial stages of the system, users input their travel preferences via a terminal. This includes desired tourist destinations, activities of interest, budget, and travel dates. The terminal sends this information, along with an emotion engine, to the server. At this time, the emotion engine analyzes the user's emotional state and provides feedback to the server based on that analysis.

[0127] Based on the received data and information from the emotion engine, the server uses an AI generative model to create a travel plan tailored to the user's preferences. The generative model takes emotional data into consideration and optimizes the suggested plan to be more appealing and comfortable for the user. For example, if the user desires a relaxing travel experience, the generative model will prioritize plans that include nature retreats and quiet tourist destinations.

[0128] Next, the server sends the generated travel plan to the terminal, which then presents it to the user. The user selects a plan from the displayed options that best matches their emotional state. During this process, the emotion engine checks the user's reaction to their selection, and if dissatisfaction is detected, the plan may be adjusted.

[0129] Once the user has decided on a plan, the device sends the result to the server, which then prepares for the virtual reality experience and the actual trip. The server provides data on the virtual tourist destination to the device, allowing the user to enjoy the new experience through their visual device. In addition, the emotion engine monitors the user's emotions during the virtual reality experience and modifies the experience as needed to ensure a more comfortable trip.

[0130] In this way, this system provides personalized travel experiences based on the user's preferences and emotions, proposing a new form of tourism that could not be achieved with existing technologies.

[0131] The following describes the processing flow.

[0132] Step 1:

[0133] Users use their devices to enter their travel preferences. Specifically, they enter detailed information such as the tourist destinations they want to visit, activities they are interested in, their budget, and their travel itinerary.

[0134] Step 2:

[0135] The terminal sends user input information to the server. At the same time, an emotion engine built into the terminal analyzes the user's emotions from their facial expressions and voice, and sends that data along with the server.

[0136] Step 3:

[0137] The server analyzes the received travel information and sentiment data, and activates an AI generation model to create a travel plan that suits the user's preferences and emotions.

[0138] Step 4:

[0139] The server uses a generative model to create an optimized travel plan based on the user's preferences and emotional state. For example, if the emotional analysis determines that the user is tired, it will prioritize a relaxing plan.

[0140] Step 5:

[0141] The server sends the created travel plans to the terminal. The terminal visually presents these to the user and explains the details.

[0142] Step 6:

[0143] Users review travel plans presented through their devices and select one that matches their preferences and current emotions. Their emotions are analyzed again upon selection, allowing for feedback to fine-tune the plan.

[0144] Step 7:

[0145] Once the user's selected plan is confirmed, the device sends the result back to the server and begins preparing for the plan's execution.

[0146] Step 8:

[0147] The server provides the virtual reality experience data to the device based on the selected plan. The device then uses a visual device to deliver the experience to the user.

[0148] Step 9:

[0149] Throughout the experience, the emotion engine continuously monitors the user's emotions. If necessary, it dynamically adjusts the experience, for example, by suggesting new, engaging content if the user appears bored.

[0150] Through these steps, users can always enjoy optimized travel plans and virtual experiences.

[0151] (Example 2)

[0152] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0153] Traditional travel planning services only offer plans based on users' basic preferences and budgets, making it difficult to provide personalized experiences that adapt to users' emotional states. Furthermore, the limitation to real-world geography restricts the ability to offer truly unique and novel travel experiences. Additionally, the difficulty in dynamically adjusting plans based on user feedback makes it challenging to maximize travel satisfaction.

[0154] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0155] In this invention, the server includes means for collecting information such as the user's characteristics, budget, and desired travel dates; means for generating a travel plan tailored to the user's wishes using a generative AI model based on the collected information and sentiment analysis technology; and means for generating a non-existent destination using virtual technology and providing a virtual experience. This provides an attractive and dynamic travel experience based on the user's emotional state, enabling a new tourism experience that transcends the limitations of reality.

[0156] "User characteristics" refer to the individual user's preferences, behavioral patterns, emotional states, and other distinctive features.

[0157] "Budget" refers to the range of funds or spending that a user can use for travel.

[0158] "Desired travel period" refers to information indicating the specific date, time, or duration that the user wishes to travel.

[0159] "Emotional analysis technology" refers to analytical techniques that determine a user's emotional state based on text data and other input data obtained from the user.

[0160] A "generative AI model" refers to artificial intelligence technology that automatically generates an optimal travel plan tailored to the user's preferences based on collected data.

[0161] "Virtual technology" refers to technologies that digitally generate environments and landscapes that do not exist in reality, allowing users to virtually experience them.

[0162] "Travel plan" refers to a travel schedule and activity suggestions designed according to the user's preferences.

[0163] "Virtual experience" refers to the process of providing users with an experience through unrealistic environments and activities created using digital technology.

[0164] This invention is a system that generates travel plans tailored to the user's characteristics, budget, and desired travel period, and further adjusts the plan by recognizing the user's emotional state. The system uses virtual technology to generate destinations that do not exist in reality, providing the user with a special virtual experience.

[0165] The user first enters their travel preferences via a device. This data includes desired tourist destinations, activities of interest, budget, and travel dates. The device then transmits this information, along with the user's emotional state, to a server using sentiment analysis technology.

[0166] The server uses a generative AI model to generate a travel plan based on the user's preferences, using the received data and information obtained from sentiment analysis technology. The generated plan reflects the sentiment information and is optimized for the user.

[0167] For example, if a user enters a request such as "I want to relax in a quiet natural environment on the weekend," the server will use a generative AI model to suggest a plan that includes nature retreats and quiet tourist destinations. An example of a prompt message would be: "User input information: Desired destination: Undecided, Activities of interest: Nature walks, Budget: Moderate, Travel dates: 2 days. Emotional state: Desires relaxation. Based on this, please generate a relaxing travel plan."

[0168] Once a plan is generated, the server sends it to the terminal and presents it to the user. The user can review the presented plan and select the one that best matches their emotional state. If the user expresses dissatisfaction, the server uses the generation AI model again to adjust the plan and optimize it based on the user's feedback.

[0169] Once the user reviews and approves the plan, the device works with the server to utilize virtual technology and prepare a virtual experience of the selected destination. Through the visual device, the user can virtually experience the generated, unrealistic destination, and emotion analysis technology monitors the user's emotions, adjusting the experience as needed to ensure a comfortable journey.

[0170] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0171] Step 1:

[0172] Users input their travel preferences via a terminal. This includes desired tourist destinations, activities of interest, budget, and travel dates. The entered data, along with the user's emotional state, is sent to the server by the terminal using sentiment analysis technology. The input consists of user preference data and emotional information, which the terminal uses to analyze the user's preferences and emotional state.

[0173] Step 2:

[0174] The server receives user preference data and emotional information from the terminal. The server then prompts a generative AI model to generate a travel plan based on the user's preferences. For example, the input the generative AI model receives might be "User input information: Desired destination: Undecided, Activities of interest: Nature walks, Budget: Moderate, Travel duration: 2 days. Emotional state: Desired to relax." Based on this, the AI ​​model outputs the most suitable plan for the user.

[0175] Step 3:

[0176] The server sends the generated travel plan to the terminal. The terminal then presents this plan to the user, displaying it on the computer screen. The user reviews the displayed plan and provides feedback via the terminal. Here, it is crucial to present a plan that is appropriate to the user's emotional state.

[0177] Step 4:

[0178] Upon receiving user feedback, the device uses sentiment analysis technology again to confirm the user's current emotional state. If necessary, the device sends feedback data to the server for adjustment. Specifically, if the user expresses dissatisfaction, the device will use that information to request a readjustment of the plan.

[0179] Step 5:

[0180] The server finalizes the travel plan approved by the user and prepares a virtual experience of the selected destination using virtual technology. The server provides data of the virtual destination to the terminal, specifically preparing to deliver a new virtual experience to the user through visual devices. Through this virtual experience, the user virtually experiences a pre-set, unrealistic destination, and their emotional state during the experience is monitored in real time using emotion analysis technology.

[0181] (Application Example 2)

[0182] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0183] Real-world travel plans struggle to provide personalized experiences tailored to individual user preferences and emotional states. Furthermore, the inability to experience non-existent tourist destinations limits the diversity and personalization of travel experiences.

[0184] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0185] In this invention, the server includes means for collecting information on the user's attributes and budget, means for creating an itinerary using a model based on the collected information, means for generating non-existent tourist destinations using virtual technology and providing experiences based on the created itinerary, and means for analyzing the user's emotional state and optimizing the itinerary using the model. This makes it possible to provide customized travel plans for each user and to realize a rich diversity of experiences by including virtual tourist destinations.

[0186] "User attributes" refer to the characteristics and traits associated with individual users, including information such as age, interests, and travel preferences.

[0187] "Budget information" refers to information that indicates the range of funds and expenses available to the user for their trip.

[0188] "A method of creating itineraries using models" refers to the process of automatically generating appropriate travel plans using machine learning models based on collected data.

[0189] "Virtual technology" refers to technologies that include virtual reality and augmented reality, which simulate places and experiences that do not exist in reality through computer graphics.

[0190] "Emotional state" refers to a psychological or physiological state that represents a user's feelings and mood, and influences their experience and decision-making.

[0191] "Methods for optimizing travel itineraries" refer to techniques that adjust each element of a travel plan based on user information and emotional data to create a more personalized and engaging experience.

[0192] This invention is a system that generates personalized travel plans using user attributes and budget information, and further provides a virtual tourist experience. This system mainly consists of a server, terminals, and a visual device.

[0193] The server first receives user input information via an interface. This information includes travel destination preferences, budget, and the user's emotional state. The terminal is a mobile information device such as a smartphone or tablet, where user data entry takes place. The server processes the acquired information and uses a machine learning model to generate a customized itinerary based on the user's preferences. Here, TensorFlow or similar is used for the machine learning model.

[0194] The generated itineraries are combined with virtual tourist destinations using virtual technology. The virtual technology is built using development platforms such as Unity and Unreal Engine, and users experience these virtual spaces through visual devices (such as smart glasses). The server uses IBM Watson® to analyze the user's emotions, monitoring their feelings in real time and fine-tuning the experience as needed.

[0195] For example, if a user desires a relaxing trip, the server will suggest a virtual tourist destination that replicates a tranquil natural environment. Furthermore, if the user's emotions change during the trip, the server can detect this and offer a more active experience. By using a prompt such as, "Recommend some tourist spots for an energetic traveler," it's possible to understand what kind of experience the user desires and provide a more accurate and tailored experience.

[0196] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0197] Step 1:

[0198] The device receives information from the user, such as their travel destination preferences, budget, and travel itinerary. Based on this input, the device sends data to the server. The user's emotional state is also analyzed simultaneously, and feedback is provided from the device to the server. The input data consists of string and numerical formats.

[0199] Step 2:

[0200] The server stores information received from the terminal in a database and generates a travel plan using a machine learning model (e.g., TensorFlow). Based on the input data, the server predicts the plan best suited to the user's preferences. The model compares the proposed travel plan with similar past data and adjusts it accordingly, providing an optimized travel plan as output.

[0201] Step 3:

[0202] The server adds virtual tourist destinations to travel plans generated using virtual technology. In this process, virtual reality platforms such as Unity and Unreal Engine are used to generate visually engaging content for the user. This allows the virtual tourist destinations to be output as digital data, enabling a flexible and responsive experience.

[0203] Step 4:

[0204] The server returns the generated final travel plan to the device, which then presents it to the user. The user can select the plan that best suits their preferences from the available options. Feedback from the user's selection is sent back to the server, and if there are any complaints, the plan is adjusted.

[0205] Step 5:

[0206] Once the final travel plan is determined based on the user's selections, the server prepares to begin the virtual reality experience. Digital data of the virtual tourist destination is transferred to the device, and the user can enjoy the new experience through their visual device. Throughout this process, the user's emotional state is continuously monitored, and the experience is adjusted as needed.

[0207] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0208] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0209] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0210] [Second Embodiment]

[0211] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0212] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0213] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0214] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0215] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0216] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0217] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0218] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0219] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0220] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0221] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0222] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0223] This invention is a system that generates travel plans that take into account the user's preferences, budget, and desired travel dates, and provides a special sightseeing experience using virtual reality technology. The following describes an embodiment of this system with specific examples.

[0224] The system first collects travel information from the user via a terminal. The user inputs information about their preferred tourist destinations, budget, desired travel dates, and specific activities or themes. The terminal then sends this information to a server. The server analyzes the received information and activates an AI-based generative model to generate the best travel plan.

[0225] The generative model creates a specific and personalized travel plan, taking into account the user's given conditions. This plan includes not only visits to traditional tourist destinations, but also special sightseeing experiences utilizing virtual reality technology. For example, if a user is interested in natural landscapes and historical sites, the generative model would create a travel plan incorporating "climbing Mount Fuji" and "visiting temples in Kyoto." It would also offer the option to experience a non-existent "hanging garden" using virtual reality technology.

[0226] Next, the server sends the generated travel plan to the device. The device visually presents the plan to the user and offers options. The user can select the most appealing plan from several options and confirm their selection on the device. Based on the plan selected by the user, the device proceeds with the necessary booking procedures and preparations for the virtual experience.

[0227] Ultimately, users can follow their chosen travel plan and engage in on-site visits and virtual reality-based sightseeing experiences. The server provides data related to the virtual tourist destination to the terminal, enabling users to enjoy these experiences through their virtual reality devices. In this way, the system provides users with a personalized travel experience, realizing a new experience that goes beyond the realm of actual travel.

[0228] The following describes the processing flow.

[0229] Step 1:

[0230] Users enter their travel preferences using their device. This includes desired tourist destinations, activities of interest, budget, and travel dates.

[0231] Step 2:

[0232] The terminal sends the information entered by the user to the server. This data forms the basis for generating travel plans.

[0233] Step 3:

[0234] The server analyzes the received data to understand the user's preferences and circumstances. Through this analysis, it identifies which tourist destinations and experiences are suitable for the user.

[0235] Step 4:

[0236] The server uses an AI-based generative model to create a travel plan based on the analysis results. This plan incorporates actual destinations and experiences utilizing virtual reality technology.

[0237] Step 5:

[0238] The server sends the generated travel plan to the device. Multiple plans may be included, each with different elements.

[0239] Step 6:

[0240] The device presents the user with travel plans and explains the details of each. The user selects the plan that best matches their interests.

[0241] Step 7:

[0242] Once the user confirms their selection, the device sends the result to the server. Based on the selected plan, preparations for the experience or reservation are made.

[0243] Step 8:

[0244] The server provides the terminal with data on virtual tourist destinations and information necessary for real-world travel. This prepares the user to carry out their planned travel experience.

[0245] Step 9:

[0246] Users either visit a real travel destination or begin an experience using virtual reality technology through their device. The server continuously provides the necessary data to support this experience.

[0247] (Example 1)

[0248] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0249] Traditional travel planning has challenges in adequately reflecting the preferences and circumstances of individual users, and in providing new travel experiences for users who are not satisfied with just visiting standard tourist destinations. There is a need for a method that can provide users with optimal travel plans within tight time and budget constraints, and furthermore, offer opportunities to experience virtual tourist destinations that do not actually exist.

[0250] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0251] In this invention, the server includes means for acquiring information via a communication device and analyzing information including the user's preferences, budget, and desired travel period; means for generating a personalized travel itinerary using a generative AI model based on the acquired information; and means for generating non-existent tourist destinations as content using virtual reality technology for the generated travel itinerary, and providing the user with an experience. This makes it possible to provide users with a personalized travel experience and enable a new tourism experience that combines reality and virtuality.

[0252] "Information" refers to data necessary for planning a trip, such as the user's preferences, budget, and desired travel dates.

[0253] A "communication device" is a device used to transmit information from a terminal to a server.

[0254] A "generative AI model" is an artificial intelligence technology that automatically creates the optimal travel itinerary based on information provided by the user.

[0255] A "personalized travel itinerary" is a travel plan that is specially customized according to the user's preferences and circumstances.

[0256] "Virtual reality technology" is a technology that allows users to experience computer-generated virtual environments in a realistic way.

[0257] "Visual devices" are devices used to experience virtual reality technology and provide users with visual information.

[0258] "Content" refers to information and materials, including virtual tourist destinations and experiences, generated using virtual reality technology.

[0259] This invention is a system for generating personalized travel plans based on user preferences and conditions, and for providing special sightseeing experiences using virtual reality technology. Specific embodiments are described below.

[0260] First, the terminal collects travel-related information from the user. The user accesses a dedicated interface and enters their interests, budget, desired travel dates, and specific activities or themes. This information is collected by the terminal and then transmitted to a server using a communication device.

[0261] The server analyzes the received information and activates a generative AI model. This model uses the data provided by the user to generate a personalized travel itinerary. Specifically, it uses natural language processing technology and machine learning algorithms to select the most suitable tourist destinations and activities that meet the user's criteria and formulate a plan.

[0262] The generated plan includes not only visits to regular tourist attractions, but also special sightseeing experiences utilizing virtual reality technology. The virtual reality experience is delivered to the user through visual devices. For example, it becomes possible to have experiences that cannot be obtained through normal travel, such as visiting a "hanging garden" or historical buildings that do not exist in reality.

[0263] For example, if a user enters the prompt message, "I'm interested in natural landscapes and historical sites. My budget is under 100,000 yen, and I'd like to travel next month," the server will provide a travel plan that includes "climbing Mount Fuji" and "visiting temples in Kyoto." It will also suggest an option to experience a "hanging garden" using virtual reality technology.

[0264] This system allows users to enjoy unique travel experiences that go beyond local and international travel. It also helps users easily select and implement the most suitable travel plan for their needs.

[0265] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0266] Step 1:

[0267] Users enter their travel requirements into the terminal. This includes detailed information such as budget, desired travel dates, regions they want to visit, and activities or themes of interest. This input process clearly defines the user's specific travel needs.

[0268] Step 2:

[0269] The terminal transmits the information collected from the user to the server via a communication device. At this point, the terminal processes the user information collected as raw data and formats it into a format that the server can receive.

[0270] Step 3:

[0271] The server analyzes the received user information and activates a generative AI model. The analysis classifies the data based on the user's interests and constraints, extracting necessary features. The model uses machine learning algorithms to generate personalized travel plans. The output is a travel itinerary optimized for the user's needs.

[0272] Step 4:

[0273] The server incorporates special experiences into the generated travel itinerary using virtual reality technology. Specifically, it adds virtual tourist destinations and activities to the travel plan. This determines the content of the virtual experiences that can be offered to the user.

[0274] Step 5:

[0275] The server sends the final travel plan to the terminal. The terminal uses a visual display to show the user the details of the plan. The user can compare multiple options and select the most suitable travel itinerary.

[0276] Step 6:

[0277] Based on the travel plan selected by the user, the device proceeds with the necessary booking procedures and preparations for the virtual reality experience. This process involves arranging accommodations and transportation services through integration with the booking system. Digital content for the virtual experience is also prepared as needed.

[0278] Step 7:

[0279] Users will experience both actual visits and virtual reality activities according to their selected travel plan. The server will provide virtual tourist destination-related data to the device as needed to ensure a smooth user experience.

[0280] (Application Example 1)

[0281] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0282] Modern travel planning lacks travel experiences that reflect individual user preferences, making it difficult to propose novel sightseeing experiences. Furthermore, there are few effective means of providing real-time cultural and historical guidance tailored to user interests during their trip. To address these challenges, it is necessary to provide users with more satisfying travel experiences.

[0283] The specific processing by the specific processing unit 290 of the data processing apparatus 12 in Application Example 1 is realized by the following means.

[0284] In this invention, the server includes means for acquiring data such as the user's preferences, budget, travel desired time, etc., means for formulating a travel plan using a generation model based on the acquired data, means for generating a tourist destination that does not exist in the real world using virtual reality technology for the formulated travel plan and providing an experience, means for presenting the generated travel plan to the user and starting a virtual experience based on the user's selection, and means for supplying the generated virtual tourist destination through a visual device. Thereby, it becomes possible to formulate a travel plan according to the individual preferences of the user and to experience at a novel tourist destination.

[0285] The "data such as the user's preferences, budget, travel desired time, etc." refers to information indicating the user's personal preferences, budgetary constraints, and the time when a specific travel is desired.

[0286] The "means for acquiring" is a technology or device having a function of collecting data from the user and the system receiving it.

[0287] The "generation model" is an algorithm or program for generating a specific result or plan based on the user's data using AI technology.

[0288] The "means for formulating a travel plan" is a technology or device having a function of creating an optimal travel plan considering the user's interests and constraints.

[0289] The "virtual reality technology" is a digital technology and device that enables the user to experience a virtual space different from the real world.

[0290] The "tourist destination that does not exist in the real world" refers to a virtual tourist place that does not exist in reality but is constructed through virtual reality technology and can be experienced by the user.

[0291] "Means of providing an experience" refers to a technology or device that has the function of providing a user with a specific experience through digital technology.

[0292] "Means of supplying through visual devices" refers to technologies or devices that visually deliver a virtual reality experience to the user.

[0293] "Real-time cultural and historical guidance" refers to commentary that provides the cultural background and historical information necessary at that moment in relation to the virtual tourist destination the user is experiencing.

[0294] A "personalized virtual travel experience" is a virtual travel experience that is customized according to the individual interests and preferences of the user.

[0295] The system implementing this invention comprises a server and a user terminal. First, the user terminal provides an interface for inputting data regarding the user's preferences, budget, and desired travel dates. This data is sent from the terminal to the server. The server receives the data and activates an AI-based generative model. This generative model, implemented using Python and TensorFlow, generates a travel plan optimized for the user's conditions. The generated plan includes tourist destinations that do not exist in the real world, using virtual reality technology. The virtual reality experience is realized using Unity and the Oculus SDK.

[0296] For example, if a user is interested in "medieval castles," the server generates a "medieval European castle tour" and makes this tour available for VR experience. The generated travel plan is presented to the user through the device screen, and they can start the selected virtual experience in real time using their visual device.

[0297] Furthermore, the server provides users with real-time information about the culture and history associated with the generated virtual tourist destinations. This allows users to have a deeper virtual travel experience through their visual devices.

[0298] As an example, here is a sample prompt given to a generative AI model: "The user is interested in medieval castles. Generate a travel plan that will captivate them during their virtual journey, integrating information that encompasses their culture and history." This allows the system to provide the user with a personalized virtual travel experience.

[0299] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0300] Step 1:

[0301] The user enters their preferences, budget, and desired travel dates through an interface on their device. This data is acquired as input from the user's device and sent to the server. The output of this step is a dataset of the user's travel conditions.

[0302] Step 2:

[0303] The server analyzes the data received from the user. This analysis generates prompt statements that take into account the user's preferences and conditions, preparing them for input into an AI-based generative model. As a result of the data analysis, input data for the generative model is obtained. This process includes database searches and combinatorial logic.

[0304] Step 3:

[0305] The generative AI model receives prompt text on the server and generates a corresponding travel plan. The model uses a predictive algorithm to select travel destinations and experiences that are suitable for the user's interests and preferences. The output is a proposed travel plan, which includes special tourist destinations that can be experienced in virtual reality. This process is performed using a TensorFlow machine learning model.

[0306] Step 4:

[0307] The server sends the generated travel plan to the user's terminal. The terminal receives this data and visually presents it on the screen. The user can select the most attractive one from the multiple proposals. The output of this step is the travel plan selected by the user.

[0308] Step 5:

[0309] Based on the selected travel plan, the server prepares an experience using virtual reality technology. Specifically, using Unity and the Oculus SDK, it constructs scenes of virtual tourist destinations and provides them in real time to the user's visual device. The output is a virtual reality tour experienced on the user's visual device.

[0310] Step 6:

[0311] During the tour, the server distributes in real time explanations of the culture and history related to the virtual tourist destination that the user is visiting through the visual device. As a result, the user receives educational information and enriches the travel experience. The output is real-time guide information in the form of voice or text.

[0312] Furthermore, an emotion engine for estimating the user's emotions may be combined. That is, the specific processing unit 290 may estimate the user's emotions using the emotion recognition model 59 and perform specific processing using the user's emotions.

[0313] The present invention is a system that generates a travel plan according to the user's preferences, budget, and desired travel time, and further adjusts the plan by recognizing the user's emotions. This system uses virtual reality technology to generate tourist destinations that do not actually exist and provides a special tourist experience to the user. Specific embodiments of this system will be described below.

[0314] In the initial stages of the system, users input their travel preferences via a terminal. This includes desired tourist destinations, activities of interest, budget, and travel dates. The terminal sends this information, along with an emotion engine, to the server. At this time, the emotion engine analyzes the user's emotional state and provides feedback to the server based on that analysis.

[0315] Based on the received data and information from the emotion engine, the server uses an AI generative model to create a travel plan tailored to the user's preferences. The generative model takes emotional data into consideration and optimizes the suggested plan to be more appealing and comfortable for the user. For example, if the user desires a relaxing travel experience, the generative model will prioritize plans that include nature retreats and quiet tourist destinations.

[0316] Next, the server sends the generated travel plan to the terminal, which then presents it to the user. The user selects a plan from the displayed options that best matches their emotional state. During this process, the emotion engine checks the user's reaction to their selection, and if dissatisfaction is detected, the plan may be adjusted.

[0317] Once the user has decided on a plan, the device sends the result to the server, which then prepares for the virtual reality experience and the actual trip. The server provides data on the virtual tourist destination to the device, allowing the user to enjoy the new experience through their visual device. In addition, the emotion engine monitors the user's emotions during the virtual reality experience and modifies the experience as needed to ensure a more comfortable trip.

[0318] In this way, this system provides personalized travel experiences based on the user's preferences and emotions, proposing a new form of tourism that could not be achieved with existing technologies.

[0319] The following describes the processing flow.

[0320] Step 1:

[0321] Users use their devices to enter their travel preferences. Specifically, they enter detailed information such as the tourist destinations they want to visit, activities they are interested in, their budget, and their travel itinerary.

[0322] Step 2:

[0323] The terminal sends user input information to the server. At the same time, an emotion engine built into the terminal analyzes the user's emotions from their facial expressions and voice, and sends that data along with the server.

[0324] Step 3:

[0325] The server analyzes the received travel information and sentiment data, and activates an AI generation model to create a travel plan that suits the user's preferences and emotions.

[0326] Step 4:

[0327] The server uses a generative model to create an optimized travel plan based on the user's preferences and emotional state. For example, if the emotional analysis determines that the user is tired, it will prioritize a relaxing plan.

[0328] Step 5:

[0329] The server sends the created travel plans to the terminal. The terminal visually presents these to the user and explains the details.

[0330] Step 6:

[0331] Users review travel plans presented through their devices and select one that matches their preferences and current emotions. Their emotions are analyzed again during the selection process, allowing for feedback to fine-tune the plan.

[0332] Step 7:

[0333] Once the user's selected plan is confirmed, the device sends the result back to the server and begins preparing for the plan's execution.

[0334] Step 8:

[0335] The server provides the virtual reality experience data to the device based on the selected plan. The device then uses a visual device to deliver the experience to the user.

[0336] Step 9:

[0337] Throughout the experience, the emotion engine continuously monitors the user's emotions. If necessary, it dynamically adjusts the experience, for example, by suggesting new, engaging content if the user appears bored.

[0338] Through these steps, users can always enjoy optimized travel plans and virtual experiences.

[0339] (Example 2)

[0340] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0341] Traditional travel planning services only offer plans based on users' basic preferences and budgets, making it difficult to provide personalized experiences that adapt to users' emotional states. Furthermore, the limitation to real-world geography restricts the ability to offer truly unique and novel travel experiences. Additionally, the difficulty in dynamically adjusting plans based on user feedback makes it challenging to maximize travel satisfaction.

[0342] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0343] In this invention, the server includes means for collecting information such as the user's characteristics, budget, and desired travel dates; means for generating a travel plan tailored to the user's wishes using a generative AI model based on the collected information and sentiment analysis technology; and means for generating a non-existent destination using virtual technology and providing a virtual experience. This provides an attractive and dynamic travel experience based on the user's emotional state, enabling a new tourism experience that transcends the limitations of reality.

[0344] "User characteristics" refer to the individual user's preferences, behavioral patterns, emotional states, and other distinctive features.

[0345] "Budget" refers to the range of funds or spending that a user can use for travel.

[0346] "Desired travel period" refers to information indicating the specific date, time, or duration that the user wishes to travel.

[0347] "Emotional analysis technology" refers to analytical techniques that determine a user's emotional state based on text data and other input data obtained from the user.

[0348] A "generative AI model" refers to artificial intelligence technology that automatically generates an optimal travel plan tailored to the user's preferences based on collected data.

[0349] "Virtual technology" refers to technologies that digitally generate environments and landscapes that do not exist in reality, allowing users to virtually experience them.

[0350] "Travel plan" refers to a travel schedule and activity suggestions designed according to the user's preferences.

[0351] "Virtual experience" refers to the process of providing users with an experience through unrealistic environments and activities created using digital technology.

[0352] This invention is a system that generates travel plans tailored to the user's characteristics, budget, and desired travel period, and further adjusts the plan by recognizing the user's emotional state. The system uses virtual technology to generate destinations that do not exist in reality, providing the user with a special virtual experience.

[0353] The user first enters their travel preferences via a terminal. This data includes desired tourist destinations, activities of interest, budget, and travel dates. The terminal then transmits this information, along with the user's emotional state, to a server using sentiment analysis technology.

[0354] The server uses a generative AI model to generate a travel plan based on the user's preferences, using the received data and information obtained from sentiment analysis technology. The generated plan reflects the sentiment information and is optimized for the user.

[0355] For example, if a user enters a request such as "I want to relax in a quiet natural environment on the weekend," the server will use a generative AI model to suggest a plan that includes nature retreats and quiet tourist destinations. An example of a prompt message would be: "User input information: Desired destination: Undecided, Activities of interest: Nature walks, Budget: Moderate, Travel dates: 2 days. Emotional state: Desires relaxation. Based on this, please generate a relaxing travel plan."

[0356] Once a plan is generated, the server sends it to the terminal and presents it to the user. The user can review the presented plan and select the one that best matches their emotional state. If the user expresses dissatisfaction, the server uses the generation AI model again to adjust the plan and optimize it based on the user's feedback.

[0357] Once the user reviews and approves the plan, the device works with the server to utilize virtual technology and prepare a virtual experience of the selected destination. Through the visual device, the user can virtually experience the generated, unrealistic destination, and emotion analysis technology monitors the user's emotions, adjusting the experience as needed to ensure a comfortable journey.

[0358] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0359] Step 1:

[0360] Users input their travel preferences via a terminal. This includes desired tourist destinations, activities of interest, budget, and travel dates. The entered data, along with the user's emotional state, is sent to the server by the terminal using sentiment analysis technology. The input consists of user preference data and emotional information, which the terminal uses to analyze the user's preferences and emotional state.

[0361] Step 2:

[0362] The server receives user preference data and emotional information from the terminal. The server then prompts a generative AI model to generate a travel plan based on the user's preferences. For example, the input the generative AI model receives might be "User input information: Desired destination: Undecided, Activities of interest: Nature walks, Budget: Moderate, Travel duration: 2 days. Emotional state: Desired to relax." Based on this, the AI ​​model outputs the most suitable plan for the user.

[0363] Step 3:

[0364] The server sends the generated travel plan to the terminal. The terminal then presents this plan to the user, displaying it on the computer screen. The user reviews the displayed plan and provides feedback via the terminal. Here, it is crucial to present a plan that is appropriate to the user's emotional state.

[0365] Step 4:

[0366] Upon receiving user feedback, the device uses sentiment analysis technology again to confirm the user's current emotional state. If necessary, the device sends feedback data to the server for adjustment. Specifically, if the user expresses dissatisfaction, the device will use that information to request a readjustment of the plan.

[0367] Step 5:

[0368] The server finalizes the travel plan approved by the user and prepares a virtual experience of the selected destination using virtual technology. The server provides data of the virtual destination to the terminal, specifically preparing to deliver a new virtual experience to the user through visual devices. Through this virtual experience, the user virtually experiences a pre-set, unrealistic destination, and their emotional state during the experience is monitored in real time using emotion analysis technology.

[0369] (Application Example 2)

[0370] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0371] Real-world travel plans struggle to provide personalized experiences tailored to individual user preferences and emotional states. Furthermore, the inability to experience non-existent tourist destinations limits the diversity and personalization of travel experiences.

[0372] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0373] In this invention, the server includes means for collecting information on the user's attributes and budget, means for creating an itinerary using a model based on the collected information, means for generating non-existent tourist destinations using virtual technology and providing experiences based on the created itinerary, and means for analyzing the user's emotional state and optimizing the itinerary using the model. This makes it possible to provide customized travel plans for each user and to realize a rich diversity of experiences by including virtual tourist destinations.

[0374] "User attributes" refer to the characteristics and traits associated with individual users, including information such as age, interests, and travel preferences.

[0375] "Budget information" refers to information that indicates the range of funds and expenses available to the user for their trip.

[0376] "A method for creating itineraries using models" refers to the process of automatically generating appropriate travel plans using machine learning models based on collected data.

[0377] "Virtual technology" refers to technologies that include virtual reality and augmented reality, which simulate places and experiences that do not exist in reality through computer graphics.

[0378] "Emotional state" refers to a psychological or physiological state that represents a user's feelings and mood, and influences their experience and decision-making.

[0379] "Methods for optimizing travel itineraries" refer to techniques that adjust each element of a travel plan based on user information and emotional data to create a more personalized and engaging experience.

[0380] This invention is a system that generates personalized travel plans using user attributes and budget information, and further provides a virtual tourist experience. This system mainly consists of a server, terminals, and a visual device.

[0381] The server first receives user input information via an interface. This information includes travel destination preferences, budget, and the user's emotional state. The terminal is a mobile information device such as a smartphone or tablet, where user data entry takes place. The server processes the acquired information and uses a machine learning model to generate a customized itinerary based on the user's preferences. Here, TensorFlow or similar is used for the machine learning model.

[0382] The generated itineraries are combined with virtual tourist destinations using virtual technology. The virtual technology is built using development platforms such as Unity and Unreal Engine, and users experience these virtual spaces through visual devices (such as smart glasses). The server uses IBM Watson for user emotion analysis, monitoring the user's emotions in real time and fine-tuning the experience as needed.

[0383] For example, if a user desires a relaxing trip, the server will suggest a virtual tourist destination that replicates a tranquil natural environment. Furthermore, if the user's emotions change during the trip, the server can detect this and offer a more active experience. By using a prompt such as, "Recommend some tourist spots for an energetic traveler," it's possible to understand what kind of experience the user desires and provide a more accurate and tailored experience.

[0384] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0385] Step 1:

[0386] The device receives information from the user, such as their travel destination preferences, budget, and travel itinerary. Based on this input, the device sends data to the server. The user's emotional state is also analyzed simultaneously, and feedback is provided from the device to the server. The input data consists of string and numerical formats.

[0387] Step 2:

[0388] The server stores information received from the terminal in a database and generates a travel plan using a machine learning model (e.g., TensorFlow). Based on the input data, the server predicts the plan best suited to the user's preferences. The model compares the proposed travel plan with similar past data and adjusts it accordingly, providing an optimized travel plan as output.

[0389] Step 3:

[0390] The server adds virtual tourist destinations to travel plans generated using virtual technology. In this process, virtual reality platforms such as Unity and Unreal Engine are used to generate visually engaging content for the user. This allows the virtual tourist destinations to be output as digital data, enabling a flexible and responsive experience.

[0391] Step 4:

[0392] The server returns the generated final travel plan to the device, which then presents it to the user. The user can select the plan that best suits their preferences from the available options. Feedback based on the user's selection is sent back to the server, and if there are any complaints, the plan is adjusted.

[0393] Step 5:

[0394] Once the final travel plan is determined based on the user's selections, the server prepares to begin the virtual reality experience. Digital data of the virtual tourist destination is transferred to the device, and the user can enjoy the new experience through their visual device. Throughout this process, the user's emotional state is continuously monitored, and the experience is adjusted as needed.

[0395] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0396] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0397] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0398] [Third Embodiment]

[0399] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0400] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0401] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0402] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0403] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0404] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0405] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0406] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0407] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0408] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0409] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0410] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0411] This invention is a system that generates travel plans that take into account the user's preferences, budget, and desired travel dates, and provides a special sightseeing experience using virtual reality technology. The following describes an embodiment of this system with specific examples.

[0412] The system first collects travel information from the user via a terminal. The user inputs information about their preferred tourist destinations, budget, desired travel dates, and specific activities or themes. The terminal then sends this information to a server. The server analyzes the received information and activates an AI-based generative model to generate the best travel plan.

[0413] The generative model creates a specific and personalized travel plan, taking into account the user's given conditions. This plan includes not only visits to traditional tourist destinations, but also special sightseeing experiences utilizing virtual reality technology. For example, if a user is interested in natural landscapes and historical sites, the generative model would create a travel plan incorporating "climbing Mount Fuji" and "visiting temples in Kyoto." It would also offer the option to experience a non-existent "hanging garden" using virtual reality technology.

[0414] Next, the server sends the generated travel plan to the device. The device visually presents the plan to the user and offers options. The user can select the most appealing plan from several options and confirm their selection on the device. Based on the plan selected by the user, the device proceeds with the necessary booking procedures and preparations for the virtual experience.

[0415] Ultimately, users can follow their chosen travel plan and engage in on-site visits and virtual reality-based sightseeing experiences. The server provides data related to the virtual tourist destination to the terminal, enabling users to enjoy these experiences through their virtual reality devices. In this way, the system provides users with a personalized travel experience, realizing a new experience that goes beyond the realm of actual travel.

[0416] The following describes the processing flow.

[0417] Step 1:

[0418] Users enter their travel preferences using their device. This includes desired tourist destinations, activities of interest, budget, and travel dates.

[0419] Step 2:

[0420] The terminal sends the information entered by the user to the server. This data forms the basis for generating travel plans.

[0421] Step 3:

[0422] The server analyzes the received data to understand the user's preferences and circumstances. Through this analysis, it identifies which tourist destinations and experiences are suitable for the user.

[0423] Step 4:

[0424] The server uses an AI-based generative model to create a travel plan based on the analysis results. This plan incorporates actual destinations and experiences utilizing virtual reality technology.

[0425] Step 5:

[0426] The server sends the generated travel plan to the device. Multiple plans may be included, each with different elements.

[0427] Step 6:

[0428] The device presents the user with travel plans and explains the details of each. The user selects the plan that best matches their interests.

[0429] Step 7:

[0430] Once the user confirms their selection, the device sends the result to the server. Based on the selected plan, preparations for the experience or reservation are made.

[0431] Step 8:

[0432] The server provides the terminal with data on virtual tourist destinations and information necessary for real-world travel. This prepares the user to carry out their planned travel experience.

[0433] Step 9:

[0434] Users either visit a real travel destination or begin an experience using virtual reality technology through their device. The server continuously provides the necessary data to support this experience.

[0435] (Example 1)

[0436] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0437] Traditional travel planning has challenges in adequately reflecting the preferences and circumstances of individual users, and in providing new travel experiences for users who are not satisfied with just visiting standard tourist destinations. There is a need for a method that can provide users with optimal travel plans within tight time and budget constraints, and furthermore, offer opportunities to experience virtual tourist destinations that do not actually exist.

[0438] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0439] In this invention, the server includes means for acquiring information via a communication device and analyzing information including the user's preferences, budget, and desired travel period; means for generating a personalized travel itinerary using a generative AI model based on the acquired information; and means for generating non-existent tourist destinations as content using virtual reality technology for the generated travel itinerary, and providing the user with an experience. This makes it possible to provide users with a personalized travel experience and enable a new tourism experience that combines reality and virtuality.

[0440] "Information" refers to data necessary for planning a trip, such as the user's preferences, budget, and desired travel dates.

[0441] A "communication device" is a device used to transmit information from a terminal to a server.

[0442] A "generative AI model" is an artificial intelligence technology that automatically creates the optimal travel itinerary based on information provided by the user.

[0443] A "personalized travel itinerary" is a travel plan that is specially customized according to the user's preferences and circumstances.

[0444] "Virtual reality technology" is a technology that allows users to experience computer-generated virtual environments in a realistic way.

[0445] "Visual devices" are devices used to experience virtual reality technology and provide users with visual information.

[0446] "Content" refers to information and materials, including virtual tourist destinations and experiences, generated using virtual reality technology.

[0447] This invention is a system for generating personalized travel plans based on user preferences and conditions, and for providing special sightseeing experiences using virtual reality technology. Specific embodiments are described below.

[0448] First, the terminal collects travel-related information from the user. The user accesses a dedicated interface and enters their interests, budget, desired travel dates, and specific activities or themes. This information is collected by the terminal and then transmitted to a server using a communication device.

[0449] The server analyzes the received information and activates a generative AI model. This model uses the data provided by the user to generate a personalized travel itinerary. Specifically, it uses natural language processing technology and machine learning algorithms to select the most suitable tourist destinations and activities that meet the user's criteria and formulate a plan.

[0450] The generated plan includes not only visits to regular tourist attractions, but also special sightseeing experiences utilizing virtual reality technology. The virtual reality experience is delivered to the user through visual devices. For example, it becomes possible to have experiences that cannot be obtained through normal travel, such as visiting a "hanging garden" or historical buildings that do not exist in reality.

[0451] For example, if a user enters the prompt message, "I'm interested in natural landscapes and historical sites. My budget is under 100,000 yen, and I'd like to travel next month," the server will provide a travel plan that includes "climbing Mount Fuji" and "visiting temples in Kyoto." It will also suggest an option to experience a "hanging garden" using virtual reality technology.

[0452] This system allows users to enjoy unique travel experiences that go beyond local and international travel. It also helps users easily select and implement the most suitable travel plan for their needs.

[0453] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0454] Step 1:

[0455] Users enter their travel requirements into the terminal. This includes detailed information such as budget, desired travel dates, regions they want to visit, and activities or themes of interest. This input process clearly defines the user's specific travel needs.

[0456] Step 2:

[0457] The terminal transmits the information collected from the user to the server via a communication device. At this point, the terminal processes the user information collected as raw data and formats it into a format that the server can receive.

[0458] Step 3:

[0459] The server analyzes the received user information and activates a generative AI model. The analysis classifies the data based on the user's interests and constraints, extracting necessary features. The model uses machine learning algorithms to generate personalized travel plans. The output is a travel itinerary optimized for the user's needs.

[0460] Step 4:

[0461] The server incorporates special experiences into the generated travel itinerary using virtual reality technology. Specifically, it adds virtual tourist destinations and activities to the travel plan. This determines the content of the virtual experiences that can be offered to the user.

[0462] Step 5:

[0463] The server sends the final travel plan to the terminal. The terminal uses a visual display to show the user the details of the plan. The user can compare multiple options and select the most suitable travel itinerary.

[0464] Step 6:

[0465] Based on the travel plan selected by the user, the device proceeds with the necessary booking procedures and preparations for the virtual reality experience. This process involves arranging accommodations and transportation services through integration with the booking system. Digital content for the virtual experience is also prepared as needed.

[0466] Step 7:

[0467] Users will experience both actual visits and virtual reality activities according to their selected travel plan. The server will provide virtual tourist destination-related data to the device as needed to ensure a smooth user experience.

[0468] (Application Example 1)

[0469] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0470] Modern travel planning lacks travel experiences that reflect individual user preferences, making it difficult to propose novel sightseeing experiences. Furthermore, there are few effective means of providing real-time cultural and historical guidance tailored to user interests during their trip. To address these challenges, it is necessary to provide users with more satisfying travel experiences.

[0471] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0472] In this invention, the server includes means for acquiring data such as the user's preferences, budget, and desired travel period; means for formulating a travel plan using a generative model based on the acquired data; means for generating tourist destinations that do not exist in the real world using virtual reality technology and providing an experience based on the formulated travel plan; means for presenting the generated travel plan to the user and initiating a virtual experience based on the user's selection; and means for supplying the generated virtual tourist destinations through a visual device. This enables the formulation of travel plans tailored to the individual user's preferences and the creation of novel tourist destination experiences.

[0473] "User preferences, budget, and desired travel dates" refers to information indicating a user's personal preferences, budget constraints, and preferred travel dates.

[0474] "Means of acquisition" refers to technology or devices that have the function of collecting data from users and receiving it in a system.

[0475] A "generative model" is an algorithm or program that uses AI technology to generate specific results or plans based on user data.

[0476] "Means for planning travel" refers to technology or devices that have the function of creating an optimal travel plan, taking into account the user's interests and constraints.

[0477] "Virtual reality technology" refers to digital technologies and devices that enable users to experience a virtual space different from the real world.

[0478] A "tourist destination that does not exist in the real world" refers to a virtual tourist location that does not exist in reality but is constructed through virtual reality technology and can be experienced by users.

[0479] "Means of providing an experience" refers to a technology or device that has the function of providing a user with a specific experience through digital technology.

[0480] "Means of supplying through visual devices" refers to technologies or devices that visually deliver a virtual reality experience to the user.

[0481] "Real-time cultural and historical guidance" refers to commentary that provides the cultural background and historical information necessary at that moment in relation to the virtual tourist destination the user is experiencing.

[0482] A "personalized virtual travel experience" is a virtual travel experience that is customized according to the individual interests and preferences of the user.

[0483] The system implementing this invention comprises a server and a user terminal. First, the user terminal provides an interface for inputting data regarding the user's preferences, budget, and desired travel dates. This data is sent from the terminal to the server. The server receives the data and activates an AI-based generative model. This generative model, implemented using Python and TensorFlow, generates a travel plan optimized for the user's conditions. The generated plan includes tourist destinations that do not exist in the real world, using virtual reality technology. The virtual reality experience is realized using Unity and the Oculus SDK.

[0484] For example, if a user is interested in "medieval castles," the server generates a "medieval European castle tour" and makes this tour available for VR experience. The generated travel plan is presented to the user through the device screen, and they can start the selected virtual experience in real time using their visual device.

[0485] Furthermore, the server provides users with real-time information about the culture and history associated with the generated virtual tourist destinations. This allows users to have a deeper virtual travel experience through their visual devices.

[0486] As an example, here is a sample prompt given to a generative AI model: "The user is interested in medieval castles. Generate a travel plan that will captivate them during their virtual journey, integrating information that encompasses their culture and history." This allows the system to provide the user with a personalized virtual travel experience.

[0487] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0488] Step 1:

[0489] The user enters their preferences, budget, and desired travel dates through an interface on their device. This data is acquired as input from the user's device and sent to the server. The output of this step is a dataset of the user's travel conditions.

[0490] Step 2:

[0491] The server analyzes the data received from the user. This analysis generates prompt statements that take into account the user's preferences and conditions, preparing them for input into an AI-based generative model. As a result of the data analysis, input data for the generative model is obtained. This process includes database searches and combinatorial logic.

[0492] Step 3:

[0493] The generative AI model receives prompt text on the server and generates a corresponding travel plan. The model uses a predictive algorithm to select travel destinations and experiences that are suitable for the user's interests and preferences. The output is a proposed travel plan, which includes special tourist destinations that can be experienced in virtual reality. This process is performed using a TensorFlow machine learning model.

[0494] Step 4:

[0495] The server sends the generated travel plan to the user's device. The device receives this data and displays it visually on the screen. The user can choose the most appealing option from multiple suggestions. The output of this step is the travel plan selected by the user.

[0496] Step 5:

[0497] Based on the selected travel plan, the server prepares an experience using virtual reality technology. Specifically, it uses Unity and the Oculus SDK to build a scene of a virtual tourist destination and delivers it to the user's visual device in real time. The output is a virtual reality tour experienced through the user's visual device.

[0498] Step 6:

[0499] During the tour, the server delivers real-time explanations of the culture and history related to the virtual tourist destination the user is visiting, via visual devices. This allows users to receive educational information and enrich their travel experience. The output is real-time guide information in the form of audio and text.

[0500] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0501] This invention is a system that generates travel plans tailored to the user's preferences, budget, and desired travel period, and further adjusts the plan by recognizing the user's emotions. This system uses virtual reality technology to create tourist destinations that do not exist in reality, providing the user with a special travel experience. Specific embodiments of this system are described below.

[0502] In the initial stages of the system, users input their travel preferences via a terminal. This includes desired tourist destinations, activities of interest, budget, and travel dates. The terminal sends this information, along with an emotion engine, to the server. At this time, the emotion engine analyzes the user's emotional state and provides feedback to the server based on that analysis.

[0503] Based on the received data and information from the emotion engine, the server uses an AI generative model to create a travel plan tailored to the user's preferences. The generative model takes emotional data into consideration and optimizes the suggested plan to be more appealing and comfortable for the user. For example, if the user desires a relaxing travel experience, the generative model will prioritize plans that include nature retreats and quiet tourist destinations.

[0504] Next, the server sends the generated travel plan to the terminal, which then presents it to the user. The user selects a plan from the displayed options that best matches their emotional state. During this process, the emotion engine checks the user's reaction to their selection, and if dissatisfaction is detected, the plan may be adjusted.

[0505] Once the user has decided on a plan, the device sends the result to the server, which then prepares for the virtual reality experience and the actual trip. The server provides data on the virtual tourist destination to the device, allowing the user to enjoy the new experience through their visual device. In addition, the emotion engine monitors the user's emotions during the virtual reality experience and modifies the experience as needed to ensure a more comfortable trip.

[0506] In this way, this system provides personalized travel experiences based on the user's preferences and emotions, proposing a new form of tourism that could not be achieved with existing technologies.

[0507] The following describes the processing flow.

[0508] Step 1:

[0509] Users use their devices to enter their travel preferences. Specifically, they enter detailed information such as the tourist destinations they want to visit, activities they are interested in, their budget, and their travel itinerary.

[0510] Step 2:

[0511] The terminal sends user input information to the server. At the same time, an emotion engine built into the terminal analyzes the user's emotions from their facial expressions and voice, and sends that data along with the server.

[0512] Step 3:

[0513] The server analyzes the received travel information and sentiment data, and activates an AI generation model to create a travel plan that suits the user's preferences and emotions.

[0514] Step 4:

[0515] The server uses a generative model to create an optimized travel plan based on the user's preferences and emotional state. For example, if the emotional analysis determines that the user is tired, it will prioritize a relaxing plan.

[0516] Step 5:

[0517] The server sends the created travel plans to the terminal. The terminal visually presents these to the user and explains the details.

[0518] Step 6:

[0519] Users review travel plans presented through their devices and select one that matches their preferences and current emotions. Their emotions are analyzed again during the selection process, allowing for feedback to fine-tune the plan.

[0520] Step 7:

[0521] Once the user's selected plan is confirmed, the device sends the result back to the server and begins preparing for the plan's execution.

[0522] Step 8:

[0523] The server provides the virtual reality experience data to the device based on the selected plan. The device then uses a visual device to deliver the experience to the user.

[0524] Step 9:

[0525] Throughout the experience, the emotion engine continuously monitors the user's emotions. If necessary, it dynamically adjusts the experience, for example, by suggesting new, engaging content if the user appears bored.

[0526] Through these steps, users can always enjoy optimized travel plans and virtual experiences.

[0527] (Example 2)

[0528] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0529] Traditional travel planning services only offer plans based on users' basic preferences and budgets, making it difficult to provide personalized experiences that adapt to users' emotional states. Furthermore, the limitation to real-world geography restricts the ability to offer truly unique and novel travel experiences. Additionally, the difficulty in dynamically adjusting plans based on user feedback makes it challenging to maximize travel satisfaction.

[0530] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0531] In this invention, the server includes means for collecting information such as the user's characteristics, budget, and desired travel dates; means for generating a travel plan tailored to the user's wishes using a generative AI model based on the collected information and sentiment analysis technology; and means for generating a non-existent destination using virtual technology and providing a virtual experience. This provides an attractive and dynamic travel experience based on the user's emotional state, enabling a new tourism experience that transcends the limitations of reality.

[0532] "User characteristics" refer to the individual user's preferences, behavioral patterns, emotional states, and other distinctive features.

[0533] "Budget" refers to the range of funds or spending that a user can use for travel.

[0534] "Desired travel period" refers to information indicating the specific date, time, or duration that the user wishes to travel.

[0535] "Emotional analysis technology" refers to analytical techniques that determine a user's emotional state based on text data and other input data obtained from the user.

[0536] A "generative AI model" refers to artificial intelligence technology that automatically generates an optimal travel plan tailored to the user's preferences based on collected data.

[0537] "Virtual technology" refers to technologies that digitally generate environments and landscapes that do not exist in reality, allowing users to virtually experience them.

[0538] "Travel plan" refers to a travel schedule and activity suggestions designed according to the user's preferences.

[0539] "Virtual experience" refers to the process of providing users with an experience through unrealistic environments and activities created using digital technology.

[0540] This invention is a system that generates travel plans tailored to the user's characteristics, budget, and desired travel period, and further adjusts the plan by recognizing the user's emotional state. The system uses virtual technology to generate destinations that do not exist in reality, providing the user with a special virtual experience.

[0541] The user first enters their travel preferences via a terminal. This data includes desired tourist destinations, activities of interest, budget, and travel dates. The terminal then transmits this information, along with the user's emotional state, to a server using sentiment analysis technology.

[0542] The server uses a generative AI model to generate a travel plan based on the user's preferences, using the received data and information obtained from sentiment analysis technology. The generated plan reflects the sentiment information and is optimized for the user.

[0543] For example, if a user enters a request such as "I want to relax in a quiet natural environment on the weekend," the server will use a generative AI model to suggest a plan that includes nature retreats and quiet tourist destinations. An example of a prompt message would be: "User input information: Desired destination: Undecided, Activities of interest: Nature walks, Budget: Moderate, Travel dates: 2 days. Emotional state: Desires relaxation. Based on this, please generate a relaxing travel plan."

[0544] Once a plan is generated, the server sends it to the terminal and presents it to the user. The user can review the presented plan and select the one that best matches their emotional state. If the user expresses dissatisfaction, the server uses the generation AI model again to adjust the plan and optimize it based on the user's feedback.

[0545] Once the user reviews and approves the plan, the device works with the server to utilize virtual technology and prepare a virtual experience of the selected destination. Through the visual device, the user can virtually experience the generated, unrealistic destination, and emotion analysis technology monitors the user's emotions, adjusting the experience as needed to ensure a comfortable journey.

[0546] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0547] Step 1:

[0548] Users input their travel preferences via a terminal. This includes desired tourist destinations, activities of interest, budget, and travel dates. The entered data, along with the user's emotional state, is sent to the server by the terminal using sentiment analysis technology. The input consists of user preference data and emotional information, which the terminal uses to analyze the user's preferences and emotional state.

[0549] Step 2:

[0550] The server receives user preference data and emotional information from the terminal. The server then prompts a generative AI model to generate a travel plan based on the user's preferences. For example, the input the generative AI model receives might be "User input information: Desired destination: Undecided, Activities of interest: Nature walks, Budget: Moderate, Travel duration: 2 days. Emotional state: Desired to relax." Based on this, the AI ​​model outputs the most suitable plan for the user.

[0551] Step 3:

[0552] The server sends the generated travel plan to the terminal. The terminal then presents this plan to the user, displaying it on the computer screen. The user reviews the displayed plan and provides feedback via the terminal. Here, it is crucial to present a plan that is appropriate to the user's emotional state.

[0553] Step 4:

[0554] Upon receiving user feedback, the device uses sentiment analysis technology again to confirm the user's current emotional state. If necessary, the device sends feedback data to the server for adjustment. Specifically, if the user expresses dissatisfaction, the device will use that information to request a readjustment of the plan.

[0555] Step 5:

[0556] The server finalizes the travel plan approved by the user and prepares a virtual experience of the selected destination using virtual technology. The server provides data of the virtual destination to the terminal, specifically preparing to deliver a new virtual experience to the user through visual devices. Through this virtual experience, the user virtually experiences a pre-set, unrealistic destination, and their emotional state during the experience is monitored in real time using emotion analysis technology.

[0557] (Application Example 2)

[0558] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0559] Real-world travel plans struggle to provide personalized experiences tailored to individual user preferences and emotional states. Furthermore, the inability to experience non-existent tourist destinations limits the diversity and personalization of travel experiences.

[0560] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0561] In this invention, the server includes means for collecting information on the user's attributes and budget, means for creating an itinerary using a model based on the collected information, means for generating non-existent tourist destinations using virtual technology and providing experiences based on the created itinerary, and means for analyzing the user's emotional state and optimizing the itinerary using the model. This makes it possible to provide customized travel plans for each user and to realize a rich diversity of experiences by including virtual tourist destinations.

[0562] "User attributes" refer to the characteristics and traits associated with individual users, including information such as age, interests, and travel preferences.

[0563] "Budget information" refers to information that indicates the range of funds and expenses available to the user for their trip.

[0564] "A method for creating itineraries using models" refers to the process of automatically generating appropriate travel plans using machine learning models based on collected data.

[0565] "Virtual technology" refers to technologies that include virtual reality and augmented reality, which simulate places and experiences that do not exist in reality through computer graphics.

[0566] "Emotional state" refers to a psychological or physiological state that represents a user's feelings and mood, and influences their experience and decision-making.

[0567] "Methods for optimizing travel itineraries" refer to techniques that adjust each element of a travel plan based on user information and emotional data to create a more personalized and engaging experience.

[0568] This invention is a system that generates personalized travel plans using user attributes and budget information, and further provides a virtual tourist experience. This system mainly consists of a server, terminals, and a visual device.

[0569] The server first receives user input information via an interface. This information includes travel destination preferences, budget, and the user's emotional state. The terminal is a mobile information device such as a smartphone or tablet, where user data entry takes place. The server processes the acquired information and uses a machine learning model to generate a customized itinerary based on the user's preferences. Here, TensorFlow or similar is used for the machine learning model.

[0570] The generated itineraries are combined with virtual tourist destinations using virtual technology. The virtual technology is built using development platforms such as Unity and Unreal Engine, and users experience these virtual spaces through visual devices (such as smart glasses). The server uses IBM Watson for user emotion analysis, monitoring the user's emotions in real time and fine-tuning the experience as needed.

[0571] For example, if a user desires a relaxing trip, the server will suggest a virtual tourist destination that replicates a tranquil natural environment. Furthermore, if the user's emotions change during the trip, the server can detect this and offer a more active experience. By using a prompt such as, "Recommend some tourist spots for an energetic traveler," it's possible to understand what kind of experience the user desires and provide a more accurate and tailored experience.

[0572] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0573] Step 1:

[0574] The device receives information from the user, such as their travel destination preferences, budget, and travel itinerary. Based on this input, the device sends data to the server. The user's emotional state is also analyzed simultaneously, and feedback is provided from the device to the server. The input data consists of string and numerical formats.

[0575] Step 2:

[0576] The server stores information received from the terminal in a database and generates a travel plan using a machine learning model (e.g., TensorFlow). Based on the input data, the server predicts the plan best suited to the user's preferences. The model compares the proposed travel plan with similar past data and adjusts it accordingly, providing an optimized travel plan as output.

[0577] Step 3:

[0578] The server adds virtual tourist destinations to travel plans generated using virtual technology. In this process, virtual reality platforms such as Unity and Unreal Engine are used to generate visually engaging content for the user. This allows the virtual tourist destinations to be output as digital data, enabling a flexible and responsive experience.

[0579] Step 4:

[0580] The server returns the generated final travel plan to the device, which then presents it to the user. The user can select the plan that best suits their preferences from the available options. Feedback based on the user's selection is sent back to the server, and if there are any complaints, the plan is adjusted.

[0581] Step 5:

[0582] Once the final travel plan is determined based on the user's selections, the server prepares to begin the virtual reality experience. Digital data of the virtual tourist destination is transferred to the device, and the user can enjoy the new experience through their visual device. Throughout this process, the user's emotional state is continuously monitored, and the experience is adjusted as needed.

[0583] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0584] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0585] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[0586] [Fourth Embodiment]

[0587] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0588] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0589] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0590] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0591] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0592] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0593] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0594] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0595] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0596] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0597] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0598] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0599] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0600] This invention is a system that generates travel plans that take into account the user's preferences, budget, and desired travel dates, and provides a special sightseeing experience using virtual reality technology. The following describes an embodiment of this system with specific examples.

[0601] The system first collects travel information from the user via a terminal. The user inputs information about their preferred tourist destinations, budget, desired travel dates, and specific activities or themes. The terminal then sends this information to a server. The server analyzes the received information and activates an AI-based generative model to generate the best travel plan.

[0602] The generative model creates a specific and personalized travel plan, taking into account the user's given conditions. This plan includes not only visits to traditional tourist destinations, but also special sightseeing experiences utilizing virtual reality technology. For example, if a user is interested in natural landscapes and historical sites, the generative model would create a travel plan incorporating "climbing Mount Fuji" and "visiting temples in Kyoto." It would also offer the option to experience a non-existent "hanging garden" using virtual reality technology.

[0603] Next, the server sends the generated travel plan to the device. The device visually presents the plan to the user and offers options. The user can select the most appealing plan from several options and confirm their selection on the device. Based on the plan selected by the user, the device proceeds with the necessary booking procedures and preparations for the virtual experience.

[0604] Ultimately, users can follow their chosen travel plan and engage in on-site visits and virtual reality-based sightseeing experiences. The server provides data related to the virtual tourist destination to the terminal, enabling users to enjoy these experiences through their virtual reality devices. In this way, the system provides users with a personalized travel experience, realizing a new experience that goes beyond the realm of actual travel.

[0605] The following describes the processing flow.

[0606] Step 1:

[0607] Users enter their travel preferences using their device. This includes desired tourist destinations, activities of interest, budget, and travel dates.

[0608] Step 2:

[0609] The terminal sends the information entered by the user to the server. This data forms the basis for generating travel plans.

[0610] Step 3:

[0611] The server analyzes the received data to understand the user's preferences and circumstances. Through this analysis, it identifies which tourist destinations and experiences are suitable for the user.

[0612] Step 4:

[0613] The server uses an AI-based generative model to create a travel plan based on the analysis results. This plan incorporates actual destinations and experiences utilizing virtual reality technology.

[0614] Step 5:

[0615] The server sends the generated travel plan to the device. Multiple plans may be included, each with different elements.

[0616] Step 6:

[0617] The device presents the user with travel plans and explains the details of each. The user selects the plan that best matches their interests.

[0618] Step 7:

[0619] Once the user confirms their selection, the device sends the result to the server. Based on the selected plan, preparations for the experience or reservation are made.

[0620] Step 8:

[0621] The server provides the terminal with data on virtual tourist destinations and information necessary for real-world travel. This prepares the user to carry out their planned travel experience.

[0622] Step 9:

[0623] Users either visit a real travel destination or begin an experience using virtual reality technology through their device. The server continuously provides the necessary data to support this experience.

[0624] (Example 1)

[0625] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0626] Traditional travel planning has challenges in adequately reflecting the preferences and circumstances of individual users, and in providing new travel experiences for users who are not satisfied with just visiting standard tourist destinations. There is a need for a method that can provide users with optimal travel plans within tight time and budget constraints, and furthermore, offer opportunities to experience virtual tourist destinations that do not actually exist.

[0627] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0628] In this invention, the server includes means for acquiring information via a communication device and analyzing information including the user's preferences, budget, and desired travel period; means for generating a personalized travel itinerary using a generative AI model based on the acquired information; and means for generating non-existent tourist destinations as content using virtual reality technology for the generated travel itinerary, and providing the user with an experience. This makes it possible to provide users with a personalized travel experience and enable a new tourism experience that combines reality and virtuality.

[0629] "Information" refers to data necessary for planning a trip, such as the user's preferences, budget, and desired travel dates.

[0630] A "communication device" is a device used to transmit information from a terminal to a server.

[0631] A "generative AI model" is an artificial intelligence technology that automatically creates the optimal travel itinerary based on information provided by the user.

[0632] A "personalized travel itinerary" is a travel plan that is specially customized according to the user's preferences and circumstances.

[0633] "Virtual reality technology" is a technology that allows users to experience computer-generated virtual environments in a realistic way.

[0634] "Visual devices" are devices used to experience virtual reality technology and provide users with visual information.

[0635] "Content" refers to information and materials, including virtual tourist destinations and experiences, generated using virtual reality technology.

[0636] This invention is a system for generating personalized travel plans based on user preferences and conditions, and for providing special sightseeing experiences using virtual reality technology. Specific embodiments are described below.

[0637] First, the terminal collects travel-related information from the user. The user accesses a dedicated interface and enters their interests, budget, desired travel dates, and specific activities or themes. This information is collected by the terminal and then transmitted to a server using a communication device.

[0638] The server analyzes the received information and activates a generative AI model. This model uses the data provided by the user to generate a personalized travel itinerary. Specifically, it uses natural language processing technology and machine learning algorithms to select the most suitable tourist destinations and activities that meet the user's criteria and formulate a plan.

[0639] The generated plan includes not only visits to regular tourist attractions, but also special sightseeing experiences utilizing virtual reality technology. The virtual reality experience is delivered to the user through visual devices. For example, it becomes possible to have experiences that cannot be obtained through normal travel, such as visiting a "hanging garden" or historical buildings that do not exist in reality.

[0640] For example, if a user enters the prompt message, "I'm interested in natural landscapes and historical sites. My budget is under 100,000 yen, and I'd like to travel next month," the server will provide a travel plan that includes "climbing Mount Fuji" and "visiting temples in Kyoto." It will also suggest an option to experience a "hanging garden" using virtual reality technology.

[0641] This system allows users to enjoy unique travel experiences that go beyond local and international travel. It also helps users easily select and implement the most suitable travel plan for their needs.

[0642] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0643] Step 1:

[0644] Users enter their travel requirements into the terminal. This includes detailed information such as budget, desired travel dates, regions they want to visit, and activities or themes of interest. This input process clearly defines the user's specific travel needs.

[0645] Step 2:

[0646] The terminal transmits the information collected from the user to the server via a communication device. At this point, the terminal processes the user information collected as raw data and formats it into a format that the server can receive.

[0647] Step 3:

[0648] The server analyzes the received user information and activates a generative AI model. The analysis classifies the data based on the user's interests and constraints, extracting necessary features. The model uses machine learning algorithms to generate personalized travel plans. The output is a travel itinerary optimized for the user's needs.

[0649] Step 4:

[0650] The server incorporates special experiences into the generated travel itinerary using virtual reality technology. Specifically, it adds virtual tourist destinations and activities to the travel plan. This determines the content of the virtual experiences that can be offered to the user.

[0651] Step 5:

[0652] The server sends the final travel plan to the terminal. The terminal uses a visual display to show the user the details of the plan. The user can compare multiple options and select the most suitable travel itinerary.

[0653] Step 6:

[0654] Based on the travel plan selected by the user, the device proceeds with the necessary booking procedures and preparations for the virtual reality experience. This process involves arranging accommodations and transportation services through integration with the booking system. Digital content for the virtual experience is also prepared as needed.

[0655] Step 7:

[0656] Users will experience both actual visits and virtual reality activities according to their selected travel plan. The server will provide virtual tourist destination-related data to the device as needed to ensure a smooth user experience.

[0657] (Application Example 1)

[0658] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0659] Modern travel planning lacks travel experiences that reflect individual user preferences, making it difficult to propose novel sightseeing experiences. Furthermore, there are few effective means of providing real-time cultural and historical guidance tailored to user interests during their trip. To address these challenges, it is necessary to provide users with more satisfying travel experiences.

[0660] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0661] In this invention, the server includes means for acquiring data such as the user's preferences, budget, and desired travel period; means for formulating a travel plan using a generative model based on the acquired data; means for generating tourist destinations that do not exist in the real world using virtual reality technology and providing an experience based on the formulated travel plan; means for presenting the generated travel plan to the user and initiating a virtual experience based on the user's selection; and means for supplying the generated virtual tourist destinations through a visual device. This enables the formulation of travel plans tailored to the individual user's preferences and the creation of novel tourist destination experiences.

[0662] "User preferences, budget, and desired travel dates" refers to information indicating a user's personal preferences, budget constraints, and preferred travel dates.

[0663] "Means of acquisition" refers to technology or devices that have the function of collecting data from users and receiving it in a system.

[0664] A "generative model" is an algorithm or program that uses AI technology to generate specific results or plans based on user data.

[0665] "Means for planning travel" refers to technology or devices that have the function of creating an optimal travel plan, taking into account the user's interests and constraints.

[0666] "Virtual reality technology" refers to digital technologies and devices that enable users to experience a virtual space different from the real world.

[0667] A "tourist destination that does not exist in the real world" refers to a virtual tourist location that does not exist in reality but is constructed through virtual reality technology and can be experienced by users.

[0668] "Means of providing an experience" refers to a technology or device that has the function of providing a user with a specific experience through digital technology.

[0669] "Means of supplying through visual devices" refers to technologies or devices that visually deliver a virtual reality experience to the user.

[0670] "Real-time cultural and historical guidance" refers to commentary that provides the cultural background and historical information necessary at that moment in relation to the virtual tourist destination the user is experiencing.

[0671] A "personalized virtual travel experience" is a virtual travel experience that is customized according to the individual interests and preferences of the user.

[0672] The system implementing this invention comprises a server and a user terminal. First, the user terminal provides an interface for inputting data regarding the user's preferences, budget, and desired travel dates. This data is sent from the terminal to the server. The server receives the data and activates an AI-based generative model. This generative model, implemented using Python and TensorFlow, generates a travel plan optimized for the user's conditions. The generated plan includes tourist destinations that do not exist in the real world, using virtual reality technology. The virtual reality experience is realized using Unity and the Oculus SDK.

[0673] For example, if a user is interested in "medieval castles," the server generates a "medieval European castle tour" and makes this tour available for VR experience. The generated travel plan is presented to the user through the device screen, and they can start the selected virtual experience in real time using their visual device.

[0674] Furthermore, the server provides users with real-time information about the culture and history associated with the generated virtual tourist destinations. This allows users to have a deeper virtual travel experience through their visual devices.

[0675] As an example, here is a sample prompt given to a generative AI model: "The user is interested in medieval castles. Generate a travel plan that will captivate them during their virtual journey, integrating information that encompasses their culture and history." This allows the system to provide the user with a personalized virtual travel experience.

[0676] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0677] Step 1:

[0678] The user enters their preferences, budget, and desired travel dates through an interface on their device. This data is acquired as input from the user's device and sent to the server. The output of this step is a dataset of the user's travel conditions.

[0679] Step 2:

[0680] The server analyzes the data received from the user. This analysis generates prompt statements that take into account the user's preferences and conditions, preparing them for input into an AI-based generative model. As a result of the data analysis, input data for the generative model is obtained. This process includes database searches and combinatorial logic.

[0681] Step 3:

[0682] The generative AI model receives prompt text on the server and generates a corresponding travel plan. The model uses a predictive algorithm to select travel destinations and experiences that are suitable for the user's interests and preferences. The output is a proposed travel plan, which includes special tourist destinations that can be experienced in virtual reality. This process is performed using a TensorFlow machine learning model.

[0683] Step 4:

[0684] The server sends the generated travel plan to the user's device. The device receives this data and displays it visually on the screen. The user can choose the most appealing option from multiple suggestions. The output of this step is the travel plan selected by the user.

[0685] Step 5:

[0686] Based on the selected travel plan, the server prepares an experience using virtual reality technology. Specifically, it uses Unity and the Oculus SDK to build a scene of a virtual tourist destination and delivers it to the user's visual device in real time. The output is a virtual reality tour experienced through the user's visual device.

[0687] Step 6:

[0688] During the tour, the server delivers real-time explanations of the culture and history related to the virtual tourist destination the user is visiting, via visual devices. This allows users to receive educational information and enrich their travel experience. The output is real-time guide information in the form of audio and text.

[0689] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0690] This invention is a system that generates travel plans tailored to the user's preferences, budget, and desired travel period, and further adjusts the plan by recognizing the user's emotions. This system uses virtual reality technology to create tourist destinations that do not exist in reality, providing the user with a special travel experience. Specific embodiments of this system are described below.

[0691] In the initial stages of the system, users input their travel preferences via a terminal. This includes desired tourist destinations, activities of interest, budget, and travel dates. The terminal sends this information, along with an emotion engine, to the server. At this time, the emotion engine analyzes the user's emotional state and provides feedback to the server based on that analysis.

[0692] Based on the received data and information from the emotion engine, the server uses an AI generative model to create a travel plan tailored to the user's preferences. The generative model takes emotional data into consideration and optimizes the suggested plan to be more appealing and comfortable for the user. For example, if the user desires a relaxing travel experience, the generative model will prioritize plans that include nature retreats and quiet tourist destinations.

[0693] Next, the server sends the generated travel plan to the terminal, which then presents it to the user. The user selects a plan from the displayed options that best matches their emotional state. During this process, the emotion engine checks the user's reaction to their selection, and if dissatisfaction is detected, the plan may be adjusted.

[0694] Once the user has decided on a plan, the device sends the result to the server, which then prepares for the virtual reality experience and the actual trip. The server provides data on the virtual tourist destination to the device, allowing the user to enjoy the new experience through their visual device. In addition, the emotion engine monitors the user's emotions during the virtual reality experience and modifies the experience as needed to ensure a more comfortable trip.

[0695] In this way, this system provides personalized travel experiences based on the user's preferences and emotions, proposing a new form of tourism that could not be achieved with existing technologies.

[0696] The following describes the processing flow.

[0697] Step 1:

[0698] Users use their devices to enter their travel preferences. Specifically, they enter detailed information such as the tourist destinations they want to visit, activities they are interested in, their budget, and their travel itinerary.

[0699] Step 2:

[0700] The terminal sends user input information to the server. At the same time, an emotion engine built into the terminal analyzes the user's emotions from their facial expressions and voice, and sends that data along with the server.

[0701] Step 3:

[0702] The server analyzes the received travel information and sentiment data, and activates an AI generation model to create a travel plan that suits the user's preferences and emotions.

[0703] Step 4:

[0704] The server uses a generative model to create an optimized travel plan based on the user's preferences and emotional state. For example, if the emotional analysis determines that the user is tired, it will prioritize a relaxing plan.

[0705] Step 5:

[0706] The server sends the created travel plans to the terminal. The terminal visually presents these to the user and explains the details.

[0707] Step 6:

[0708] Users review travel plans presented through their devices and select one that matches their preferences and current emotions. Their emotions are analyzed again during the selection process, allowing for feedback to fine-tune the plan.

[0709] Step 7:

[0710] Once the user's selected plan is confirmed, the device sends the result back to the server and begins preparing for the plan's execution.

[0711] Step 8:

[0712] The server provides the virtual reality experience data to the device based on the selected plan. The device then uses a visual device to deliver the experience to the user.

[0713] Step 9:

[0714] Throughout the experience, the emotion engine continuously monitors the user's emotions. If necessary, it dynamically adjusts the experience, for example, by suggesting new, engaging content if the user appears bored.

[0715] Through these steps, users can always enjoy optimized travel plans and virtual experiences.

[0716] (Example 2)

[0717] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0718] Traditional travel planning services only offer plans based on users' basic preferences and budgets, making it difficult to provide personalized experiences that adapt to users' emotional states. Furthermore, the limitation to real-world geography restricts the ability to offer truly unique and novel travel experiences. Additionally, the difficulty in dynamically adjusting plans based on user feedback makes it challenging to maximize travel satisfaction.

[0719] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0720] In this invention, the server includes means for collecting information such as the user's characteristics, budget, and desired travel dates; means for generating a travel plan tailored to the user's wishes using a generative AI model based on the collected information and sentiment analysis technology; and means for generating a non-existent destination using virtual technology and providing a virtual experience. This provides an attractive and dynamic travel experience based on the user's emotional state, enabling a new tourism experience that transcends the limitations of reality.

[0721] "User characteristics" refer to the individual user's preferences, behavioral patterns, emotional states, and other distinctive features.

[0722] "Budget" refers to the range of funds or spending that a user can use for travel.

[0723] "Desired travel period" refers to information indicating the specific date, time, or duration that the user wishes to travel.

[0724] "Emotional analysis technology" refers to analytical techniques that determine a user's emotional state based on text data and other input data obtained from the user.

[0725] A "generative AI model" refers to artificial intelligence technology that automatically generates an optimal travel plan tailored to the user's preferences based on collected data.

[0726] "Virtual technology" refers to technologies that digitally generate environments and landscapes that do not exist in reality, allowing users to virtually experience them.

[0727] "Travel plan" refers to a travel schedule and activity suggestions designed according to the user's preferences.

[0728] "Virtual experience" refers to the process of providing users with an experience through unrealistic environments and activities created using digital technology.

[0729] This invention is a system that generates travel plans tailored to the user's characteristics, budget, and desired travel period, and further adjusts the plan by recognizing the user's emotional state. The system uses virtual technology to generate destinations that do not exist in reality, providing the user with a special virtual experience.

[0730] The user first enters their travel preferences via a terminal. This data includes desired tourist destinations, activities of interest, budget, and travel dates. The terminal then transmits this information, along with the user's emotional state, to a server using sentiment analysis technology.

[0731] The server uses a generative AI model to generate a travel plan based on the user's preferences, using the received data and information obtained from sentiment analysis technology. The generated plan reflects the sentiment information and is optimized for the user.

[0732] For example, if a user enters a request such as "I want to relax in a quiet natural environment on the weekend," the server will use a generative AI model to suggest a plan that includes nature retreats and quiet tourist destinations. An example of a prompt message would be: "User input information: Desired destination: Undecided, Activities of interest: Nature walks, Budget: Moderate, Travel dates: 2 days. Emotional state: Desires relaxation. Based on this, please generate a relaxing travel plan."

[0733] Once a plan is generated, the server sends it to the terminal and presents it to the user. The user can review the presented plan and select the one that best matches their emotional state. If the user expresses dissatisfaction, the server uses the generation AI model again to adjust the plan and optimize it based on the user's feedback.

[0734] Once the user reviews and approves the plan, the device works with the server to utilize virtual technology and prepare a virtual experience of the selected destination. Through the visual device, the user can virtually experience the generated, unrealistic destination, and emotion analysis technology monitors the user's emotions, adjusting the experience as needed to ensure a comfortable journey.

[0735] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0736] Step 1:

[0737] Users input their travel preferences via a terminal. This includes desired tourist destinations, activities of interest, budget, and travel dates. The entered data, along with the user's emotional state, is sent to the server by the terminal using sentiment analysis technology. The input consists of user preference data and emotional information, which the terminal uses to analyze the user's preferences and emotional state.

[0738] Step 2:

[0739] The server receives user preference data and emotional information from the terminal. The server then prompts a generative AI model to generate a travel plan based on the user's preferences. For example, the input the generative AI model receives might be "User input information: Desired destination: Undecided, Activities of interest: Nature walks, Budget: Moderate, Travel duration: 2 days. Emotional state: Desired to relax." Based on this, the AI ​​model outputs the most suitable plan for the user.

[0740] Step 3:

[0741] The server sends the generated travel plan to the terminal. The terminal then presents this plan to the user, displaying it on the computer screen. The user reviews the displayed plan and provides feedback via the terminal. Here, it is crucial to present a plan that is appropriate to the user's emotional state.

[0742] Step 4:

[0743] Upon receiving user feedback, the device uses sentiment analysis technology again to confirm the user's current emotional state. If necessary, the device sends feedback data to the server for adjustment. Specifically, if the user expresses dissatisfaction, the device will use that information to request a readjustment of the plan.

[0744] Step 5:

[0745] The server finalizes the travel plan approved by the user and prepares a virtual experience of the selected destination using virtual technology. The server provides data of the virtual destination to the terminal, specifically preparing to deliver a new virtual experience to the user through visual devices. Through this virtual experience, the user virtually experiences a pre-set, unrealistic destination, and their emotional state during the experience is monitored in real time using emotion analysis technology.

[0746] (Application Example 2)

[0747] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[0748] Real-world travel plans struggle to provide personalized experiences tailored to individual user preferences and emotional states. Furthermore, the inability to experience non-existent tourist destinations limits the diversity and personalization of travel experiences.

[0749] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0750] In this invention, the server includes means for collecting information on the user's attributes and budget, means for creating an itinerary using a model based on the collected information, means for generating non-existent tourist destinations using virtual technology and providing experiences based on the created itinerary, and means for analyzing the user's emotional state and optimizing the itinerary using the model. This makes it possible to provide customized travel plans for each user and to realize a rich diversity of experiences by including virtual tourist destinations.

[0751] "User attributes" refer to the characteristics and traits associated with individual users, including information such as age, interests, and travel preferences.

[0752] "Budget information" refers to information that indicates the range of funds and expenses available to the user for their trip.

[0753] "A method for creating itineraries using models" refers to the process of automatically generating appropriate travel plans using machine learning models based on collected data.

[0754] "Virtual technology" refers to technologies that include virtual reality and augmented reality, which simulate places and experiences that do not exist in reality through computer graphics.

[0755] "Emotional state" refers to a psychological or physiological state that represents a user's feelings and mood, and influences their experience and decision-making.

[0756] "Methods for optimizing travel itineraries" refer to techniques that adjust each element of a travel plan based on user information and emotional data to create a more personalized and engaging experience.

[0757] This invention is a system that generates personalized travel plans using user attributes and budget information, and further provides a virtual tourist experience. This system mainly consists of a server, terminals, and a visual device.

[0758] The server first receives user input information via an interface. This information includes travel destination preferences, budget, and the user's emotional state. The terminal is a mobile information device such as a smartphone or tablet, where user data entry takes place. The server processes the acquired information and uses a machine learning model to generate a customized itinerary based on the user's preferences. Here, TensorFlow or similar is used for the machine learning model.

[0759] The generated itineraries are combined with virtual tourist destinations using virtual technology. The virtual technology is built using development platforms such as Unity and Unreal Engine, and users experience these virtual spaces through visual devices (such as smart glasses). The server uses IBM Watson for user emotion analysis, monitoring the user's emotions in real time and fine-tuning the experience as needed.

[0760] For example, if a user desires a relaxing trip, the server will suggest a virtual tourist destination that replicates a tranquil natural environment. Furthermore, if the user's emotions change during the trip, the server can detect this and offer a more active experience. By using a prompt such as, "Recommend some tourist spots for an energetic traveler," it's possible to understand what kind of experience the user desires and provide a more accurate and tailored experience.

[0761] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0762] Step 1:

[0763] The device receives information from the user, such as their travel destination preferences, budget, and travel itinerary. Based on this input, the device sends data to the server. The user's emotional state is also analyzed simultaneously, and feedback is provided from the device to the server. The input data consists of string and numerical formats.

[0764] Step 2:

[0765] The server stores information received from the terminal in a database and generates a travel plan using a machine learning model (e.g., TensorFlow). Based on the input data, the server predicts the plan best suited to the user's preferences. The model compares the proposed travel plan with similar past data and adjusts it accordingly, providing an optimized travel plan as output.

[0766] Step 3:

[0767] The server adds virtual tourist destinations to travel plans generated using virtual technology. In this process, virtual reality platforms such as Unity and Unreal Engine are used to generate visually engaging content for the user. This allows the virtual tourist destinations to be output as digital data, enabling a flexible and responsive experience.

[0768] Step 4:

[0769] The server returns the generated final travel plan to the device, which then presents it to the user. The user can select the plan that best suits their preferences from the available options. Feedback based on the user's selection is sent back to the server, and if there are any complaints, the plan is adjusted.

[0770] Step 5:

[0771] Once the final travel plan is determined based on the user's selections, the server prepares to begin the virtual reality experience. Digital data of the virtual tourist destination is transferred to the device, and the user can enjoy the new experience through their visual device. Throughout this process, the user's emotional state is continuously monitored, and the experience is adjusted as needed.

[0772] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0773] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0774] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[0775] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0776] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0777] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0778] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0779] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0780] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0781] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0782] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0783] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[0784] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0785] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0786] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0787] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0788] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0789] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0790] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0791] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0792] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0793] The following is further disclosed regarding the embodiments described above.

[0794] (Claim 1)

[0795] A means of collecting information such as user preferences, budget, and desired travel dates,

[0796] A means of creating a travel plan using a generative model based on collected information,

[0797] A means of generating non-existent tourist destinations using virtual reality technology and providing experiences based on the created travel plan,

[0798] A system that includes this.

[0799] (Claim 2)

[0800] The system according to claim 1, further comprising means for presenting a generated travel plan to a user and initiating an actual trip or virtual experience based on the user's selection.

[0801] (Claim 3)

[0802] The system according to claim 1, further comprising means for providing the generated virtual tourist destination through a visual device.

[0803] "Example 1"

[0804] (Claim 1)

[0805] A means of acquiring information via communication devices and analyzing information including user preferences, budget, and desired travel period,

[0806] A means for generating personalized travel itineraries using a generative AI model based on acquired information,

[0807] A means of providing users with an experience by using virtual reality technology to generate tourist destinations that do not actually exist as content for a generated travel itinerary,

[0808] A means of providing a virtual tourism experience to a user using visual devices,

[0809] A system that includes this.

[0810] (Claim 2)

[0811] The system according to claim 1, further comprising means for presenting a generated travel itinerary to a user via a communication device and for initiating an actual trip or virtual experience based on the user's decision.

[0812] (Claim 3)

[0813] The system according to claim 1, further comprising means for providing a virtual tourist destination created by virtual reality technology as an experience through visual devices.

[0814] "Application Example 1"

[0815] (Claim 1)

[0816] A means of acquiring data such as user preferences, budget, and desired travel period,

[0817] A means of formulating a travel plan using a generative model based on acquired data,

[0818] A means of creating and providing experiences of tourist destinations that do not exist in the real world using virtual reality technology, based on a planned travel itinerary.

[0819] A means of presenting a generated travel plan to the user and initiating a virtual experience based on the user's selection,

[0820] A means of supplying generated virtual tourist destinations through a visual device,

[0821] A system that includes this.

[0822] (Claim 2)

[0823] The system according to claim 1, further comprising means for providing real-time cultural and historical guidance to data generated from receiving information about the user's interests.

[0824] (Claim 3)

[0825] The system according to claim 1, further comprising means for providing a personalized virtual travel experience based on a generated travel plan.

[0826] "Example 2 of combining an emotion engine"

[0827] (Claim 1)

[0828] A means of collecting information such as user characteristics, budget, and desired travel dates,

[0829] A means of generating a travel plan tailored to the user's wishes using a generative AI model that utilizes collected information and sentiment analysis technology,

[0830] A means of presenting a generated travel plan to the user and optimizing the plan using emotional information,

[0831] A means of generating destinations that do not exist in reality using virtual technology and providing virtual experiences,

[0832] A system that includes this.

[0833] (Claim 2)

[0834] The system according to claim 1, further comprising means for presenting a generated travel plan to the user via a terminal, monitoring the user's emotional state, and modifying the plan or adjusting the content of the virtual experience as necessary.

[0835] (Claim 3)

[0836] The system according to claim 1, further comprising means for providing a virtual destination through a visual device and optimizing the experience based on user feedback.

[0837] "Application example 2 when combining with an emotional engine"

[0838] (Claim 1)

[0839] Means for collecting information on user attributes and budget,

[0840] A means of creating a travel itinerary using a model based on collected information,

[0841] A means of generating and providing experiences of tourist destinations that do not exist in reality using virtual technology, based on the created itinerary.

[0842] A means of analyzing the emotional state of users and optimizing the itinerary using a model,

[0843] A system that includes this.

[0844] (Claim 2)

[0845] The system according to claim 1, further comprising means for presenting a generated itinerary and initiating a real or virtual experience based on the user's selection.

[0846] (Claim 3)

[0847] The system according to claim 1, further comprising means for providing the generated virtual tourist destination through a visual device. [Explanation of Symbols]

[0848] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means of acquiring data such as user preferences, budget, and desired travel period, A means of formulating a travel plan using a generative model based on acquired data, A means of creating and providing experiences of tourist destinations that do not exist in the real world using virtual reality technology, based on a planned travel itinerary. A means of presenting a generated travel plan to the user and initiating a virtual experience based on the user's selection, A means of supplying generated virtual tourist destinations through a visual device, A system that includes this.

2. The system according to claim 1, further comprising means for providing real-time cultural and historical guidance to data generated from receiving information about the user's interests.

3. The system according to claim 1, further comprising means for providing a personalized virtual travel experience based on a generated travel plan.

Images