system

Abstract

A system is provided.SOLUTION: A system, comprising: means for generating a travel plan utilizing generative AI technology; means for providing virtual-reality (VR) or augmented-reality (XR) content based on the generated travel plan; means for optimizing the travel plan based on feedback from a user; and means for creating and providing promotional content for a tourist attraction in collaboration with a municipality or travel agency.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Planning a trip takes time and effort, and there are problems that make it difficult to realize a trip due to financial burdens and environmental constraints. Furthermore, the lack of promotion of tourist destinations and the problem of overtourism have made regional revitalization an issue. It is necessary to comprehensively solve these issues, provide highly convenient services for travelers, and support the promotion and sustainable development of regional tourism. [Means for solving the problem]

[0005] The present invention provides a system that includes a means for generating travel plans using generative AI technology, a means for providing virtual reality (VR) or augmented reality (XR) content based on the generated travel plans, a means for optimizing the travel plans based on user feedback, and a means for creating and providing promotional content for tourist destinations in collaboration with local governments and travel agencies. This allows users to create optimal travel plans without spending time or effort, and ensures a flawless trip by simulating the trip in advance using VR or XR. Furthermore, the system contributes to regional revitalization by efficiently promoting tourist destinations.

[0006] "Generative AI technology" refers to artificial intelligence technology for automatically constructing travel plans, generating optimal travel plans based on the user's conditions and requests.

[0007] "Travel Plan" means a plan for a traveler to undertake a trip, including details of accommodation, sightseeing spots, transportation, places to eat, etc.

[0008] "Virtual reality (VR)" is a technology that uses computer technology to provide a virtual environment in which users can experience the sensation of actually being in that place.

[0009] "Augmented reality (XR)" is a technology that displays digital information overlaid on the real world, allowing users to experience both reality and virtual reality simultaneously.

[0010] "Feedback" refers to information that conveys to the system what the user felt during the use or experience, and what changes they would like to make.

[0011] "Optimization" refers to the process of modifying an existing travel plan to make it more effective and convenient based on user feedback.

[0012] A "local government" is a public body that manages a particular area and provides administrative services to its residents and the environment.

[0013] A "travel agency" is a business that provides travel arrangements and services to travelers.

[0014] "Promotional Content" refers to promotional materials such as videos, images, and text created to promote a particular tourist destination or event and attract tourists. [Brief explanation of the drawings]

[0015] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0016] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0017] First, the terms used in the following description will be explained.

[0018] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0019] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0020] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0021] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0023] [First embodiment]

[0024] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0025] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0026] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0027] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0028] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0030] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0031] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0032] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0033] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0034] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0035] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0036] This invention is a system that uses generative AI technology to generate travel plans and provide VR or XR content based on them. This system allows users to input their travel requirements, virtually experience the generated plan in advance, and obtain an optimized travel plan based on that. It also generates promotional content for tourist destinations and supports regional revitalization in cooperation with local governments and travel agencies.

[0037] Program processing

[0038] 1. Receiving user input

[0039] 1. The user uses the device interface to input travel conditions, such as the destination, travel period, budget, and theme (e.g., hot springs, gourmet food).

[0040] 2. The terminal sends the entered data to the server. The terminal converts the entered data into the appropriate format and sends it to the server using the HTTPS protocol.

[0041] 2. Generate a travel plan

[0042] 1. The server parses the received input data and stores it in the database. The server parses the received data in JSON format and stores it in the database.

[0043] 2. The server calls a specialized AI engine to generate the optimal travel plan based on the input criteria. The AI ​​engine automatically creates the optimal travel plan for the user using tourist attractions, accommodations, transportation options, and restaurant information in the database.

[0044] 3. The server sends the generated travel plan to the terminal and presents it to the user in an easy-to-read format.

[0045] 3. Providing simulated experiences

[0046] 1. The user tries out the VR / XR content based on the generated travel plan. Specifically, the user selects playback of the VR / XR content on the device screen.

[0047] 2. The device downloads the corresponding VR / XR content from the server and displays it to the user, providing a virtual reality experience to the user through a device such as a VR headset.

[0048] 4. Optimizing travel planning

[0049] 1. If the user wishes to make changes to the travel plan, they input the revised conditions into the terminal. For example, they input a request to upgrade the rank of the accommodation.

[0050] 2. The device sends the new conditions to the server.

[0051] 3. The server runs the generation AI engine again based on the revised conditions, generates an optimized travel plan, and sends it to the device.

[0052] 4. The user reviews the revised and optimized travel plan and decides on the final plan.

[0053] 5. Creation of promotional content and regional revitalization

[0054] 1. The server creates promotional content for each tourist destination in collaboration with the AI. Specifically, it collects information from a database of tourist destinations and generates promotional videos and images using AI technology.

[0055] 2. The server provides the generated promotional content to local governments and travel agencies, sharing the content through dedicated APIs and dashboards to help promote tourist destinations.

[0056] 3. Local governments and travel agencies can use this content to efficiently promote tourism and attract tourists.

[0057] Specific examples

[0058] 1. Receiving user input

[0059] The user types into the terminal, "I would like to go to Hokkaido in July for 3 nights and 4 days, with a budget of 100,000 yen or less, and enjoy the hot springs and gourmet food."

[0060] The terminal sends these conditions to the server.

[0061] 2. Generate a travel plan

[0062] Based on the conditions received by the server, the AI ​​engine generates a travel plan that matches the conditions, such as "Hokkaido in July, 3 nights and 4 days, budget within 100,000 yen, hot springs and gourmet food."

[0063] The plan includes a stay at a hot spring inn in Sapporo, breakfast at the morning market in Hakodate, and a visit to the lavender fields in Furano.

[0064] Once the plan is generated, the server sends it to the terminal and displays it to the user.

[0065] 3. Providing simulated experiences

[0066] Users put on a VR headset on the device and virtually experience a hot spring inn in Sapporo or a morning market in Hakodate.

[0067] The device provides VR content, allowing users to experience the local atmosphere.

[0068] 4. Optimizing travel planning

[0069] If the user wishes to change the hot spring inn to one with a slightly higher rank, the user transmits the modified conditions from the terminal to the server.

[0070] The server again uses the generation AI engine to generate a new plan that includes a higher-ranked hot spring inn.

[0071] The server sends the optimized travel plan to the terminal and displays it to the user.

[0072] 5. Creation of promotional content and regional revitalization

[0073] The server generates promotional content for "Furano's lavender fields and surrounding restaurants."

[0074] Local governments will publish this content on their official websites and social media to attract tourists.

[0075] In this way, the present invention provides users with personalized travel plans and enables them to have a trouble-free trip through a virtual experience. It also enables local governments and travel agencies to promote tourist destinations efficiently, contributing to regional revitalization.

[0076] The processing flow will be explained below.

[0077] Step 1:

[0078] The user inputs travel conditions using the terminal interface, specifically, detailed conditions such as destination, travel period, budget, theme (e.g., hot springs, gourmet food), etc.

[0079] Step 2:

[0080] The terminal sends the input data to the server, which converts the input data into an appropriate format and sends it to the server via the HTTPS protocol.

[0081] Step 3:

[0082] The server parses the received input data and saves it in the database.The server parses the received data in JSON format and saves it in the database.

[0083] Step 4:

[0084] The server calls the AI ​​engine to generate the optimal travel plan based on the input conditions. The AI ​​engine uses tourist attractions, accommodations, transportation options, and restaurant information in the database to create the optimal travel plan for the user.

[0085] Step 5:

[0086] The server transmits the generated travel plan to the terminal and presents it to the user in an easy-to-view format.

[0087] Step 6:

[0088] The user checks the generated travel plan and selects to try out the VR / XR content. The user presses the play button for the VR / XR content on the device screen.

[0089] Step 7:

[0090] The device downloads the corresponding VR / XR content from the server and displays it to the user, providing a virtual reality experience to the user through a device such as a VR headset.

[0091] Step 8:

[0092] If the user wishes to modify the travel plan, he or she inputs the modified conditions into the terminal, such as a preference to upgrade the rank of accommodation.

[0093] Step 9:

[0094] The terminal sends the new conditions to the server. The terminal converts the modified conditions into the appropriate format and sends them to the server.

[0095] Step 10:

[0096] The server runs the generation AI engine again based on the revised conditions to generate an optimized travel plan. The generation AI engine analyzes the conditions again and generates a new travel plan.

[0097] Step 11:

[0098] The server sends the optimized travel plan to the terminal and presents it to the user, who then reviews the final travel plan and makes a final decision if necessary.

[0099] Step 12:

[0100] The server works with local governments and travel agencies to generate promotional content for tourist destinations. The server collects information from a database of tourist destinations and uses AI technology to create promotional videos and images.

[0101] Step 13:

[0102] The server provides the generated promotional content to local governments and travel agencies, who share the content through a dedicated API and dashboard to help promote tourist destinations.

[0103] Step 14:

[0104] Local governments and travel agencies will use the provided promotional content to promote tourism, and will post it on their official websites and social media to attract more tourists.

[0105] Example 1

[0106] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0107] Conventional travel plan generation systems have limited ability to provide users with personalized travel plans. Furthermore, they do not readily provide virtual reality (VR) or augmented reality (XR) experiences based on the generated travel plans, making it less convenient for users to consider their travel plans in advance. Furthermore, they lacked a sufficient mechanism for efficiently creating promotional content for tourist destinations and supporting regional revitalization through collaboration with local governments and travel agencies. These issues need to be resolved.

[0108] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0109] In this invention, the server includes: a means for a user to input travel requirements; a means for the terminal to convert the input data into an appropriate data format and send it to the server; a means for the server to analyze the received data and store it in a database; a means for the server to automatically generate a travel plan based on the input requirements using a generation AI engine; a means for the server to send the generated travel plan to the terminal and present it to the user in an easy-to-view format; a means for the user to try VR or XR content based on the travel plan; a means for the terminal to download corresponding VR or XR content from the server and display it to the user; a means for the user to input modifications to the travel plan and for the terminal to send the new conditions to the server; a means for the server to re-operate the generation AI engine based on the modified conditions and generate an optimized travel plan; and a means for the server to generate promotional content for tourist destinations and provide it to local governments and travel agencies. This enables the provision of personalized travel plans to users, advance travel planning through virtual experiences, and efficient tourist destination promotion through collaboration with local governments and travel agencies.

[0110] "User" refers to a person who uses the system to input travel conditions in order to create, modify, or experience a travel plan.

[0111] "Terminal" refers to the device used by a user to input travel requirements and experience virtual reality (VR) and augmented reality (XR) content.

[0112] "Server" refers to the central computing resource of the system that receives and analyzes data sent by users and automatically generates travel plans using a generative AI engine.

[0113] "Generative AI engine" refers to artificial intelligence technology for generating optimal travel plans based on input conditions.

[0114] "Database" refers to the system that structures and stores the received data and holds the information that the Generative AI Engine references when generating travel plans.

[0115] "Travel conditions" refers to detailed information such as the travel destination, duration, budget, and theme entered by the user.

[0116] "Travel plan" refers to a detailed plan including tourist attractions, accommodation, transportation, restaurant information, etc., that is automatically generated by the AI ​​engine based on the travel conditions entered by the user.

[0117] "Virtual reality (VR) content" refers to digital content that allows users to virtually experience a trip in advance based on their travel plans.

[0118] "Augmented reality (XR) content" refers to digital content that combines virtual reality with real-world scenery and objects.

[0119] "Promotional content" refers to promotional materials such as videos and images created using a generative AI engine to convey the attractions of a tourist destination.

[0120] "Local government" refers to a local public body with the autonomy to carry out tourism destination promotion activities.

[0121] "Travel agency" refers to a company that creates and sells travel plans and provides travel services to customers.

[0122] "Feedback" refers to any corrections or requests for improvements made by a user to a provided travel plan.

[0123] "Optimization" refers to the process by which the generative AI engine regenerates and improves travel plans based on user feedback and new conditions.

[0124] This invention is a system that uses generative AI technology to generate travel plans and provide virtual reality (VR) or augmented reality (XR) content based on those plans. This system allows users to input their travel requirements, virtually experience the generated plan in advance, and obtain an optimized travel plan based on that. It also generates promotional content for tourist destinations and supports regional revitalization in cooperation with local governments and travel agencies.

[0125] This system consists of a terminal that provides an interface for users to input travel conditions, a server that receives and analyzes the input data and generates and optimizes travel plans using a generative AI engine, a means to present the generated travel plans to users, and a means to play VR / XR content to provide a virtual experience.

[0126] First, the user inputs the travel conditions using the terminal interface. These include the destination, travel period, budget, theme (e.g., hot springs, gourmet food), etc. For example, the user might input "I'd like to go to Hokkaido in July for 3 nights and 4 days, with a budget of 100,000 yen or less, and enjoy hot springs and gourmet food." The terminal converts the input data into an appropriate data format (e.g., JSON format) and sends it to the server using the HTTPS protocol.

[0127] The server parses the received data in JSON format and stores it in a database as structured information. The server then calls a generative AI engine to automatically generate the optimal travel plan for the user. The generative AI engine integrates tourist spots, accommodation, transportation, and restaurant information from the database to create a travel plan that meets the user's requirements. For example, it might generate a plan such as "Stay at a hot spring inn in Sapporo, have breakfast at the morning market in Hakodate, and visit the lavender fields in Furano."

[0128] The generated travel plan is then sent to the device and displayed to the user. The user can review the plan and try out further virtual experiences. The device then downloads the corresponding VR or XR content from the server and displays it to the user. The user then puts on a VR headset and can virtually experience, for example, a hot spring inn in Sapporo or a morning market in Hakodate.

[0129] If a user wishes to modify their travel plan, for example, to choose a higher-ranking hot spring inn, they send the modified conditions from their device to the server. The server then uses the generation AI engine again to generate a new plan based on the modified conditions. The modified plan is then sent back to the device and presented to the user.

[0130] The server then generates promotional content for tourist destinations. It collects information from a database of tourist destinations and uses a generative AI engine to create promotional videos and images. For example, promotional content for "Furano's lavender fields and surrounding restaurants" is generated. This content is provided to local governments and travel agencies via APIs and dashboards, enabling efficient promotion of tourist destinations.

[0131] As described above, the present invention provides users with personalized travel plans, allows them to consider travel plans in advance through virtual experiences, and enables efficient promotion of tourist destinations through collaboration with local governments and travel agencies.

[0132] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0133] Step 1: Receiving User Input

[0134] 1. Input: The user inputs travel conditions (destination, travel period, budget, theme, etc.) into the terminal interface.

[0135] 2. Data processing: The terminal converts the input data into JSON format.

[0136] 3. Output: Send the converted JSON data to the server.

[0137] 4. Specific operation: The user enters into the device interface, "I would like to go to Hokkaido in July for 3 nights and 4 days, with a budget of 100,000 yen or less, and enjoy hot springs and gourmet food," and the device sends the JSON data "{ "destination": "Hokkaido", "duration": "3 nights and 4 days", "budget": "100,000 yen", "theme": "Hot springs, gourmet food"}" to the server.

[0138] Step 2: Generate a travel plan

[0139] 1. Input: JSON format travel condition data is sent to the server.

[0140] 2. Data analysis and storage: The server parses the received data in JSON format and stores it in a database as structured information.

[0141] 3. Data calculation: The server calls the AI ​​engine and generates the optimal travel plan based on the information in the database.

[0142] 4. Output: The generated travel plan is sent to the terminal.

[0143] 5. Specific operation: The server analyzes the data "{ "destination": "Hokkaido", "duration": "3 nights and 4 days", "budget": "100,000 yen", "theme": "hot springs, gourmet"}" and saves it in the database as "Destination: Hokkaido, Duration: 3 nights and 4 days, Budget: 100,000 yen, Theme: hot springs, gourmet." The generation AI engine then generates a travel plan such as "Stay at a hot spring inn in Sapporo, have breakfast at the morning market in Hakodate, and visit the lavender fields in Furano," and sends it to the device.

[0144] Step 3: Present your travel plans

[0145] 1. Input: The generated travel plan data is sent to the terminal.

[0146] 2. Data display: The terminal displays the travel plan received in an easy-to-read format for the user.

[0147] 3. Output: The user confirms the generated itinerary.

[0148] 4. Specific operation: The device displays a travel plan on the screen, such as "Day 1: Stay at a hot spring inn in Sapporo, Day 2: Breakfast at the morning market in Hakodate, Day 3: Visit the lavender fields in Furano," and the user confirms it.

[0149] Step 4: Providing VR / XR content

[0150] 1. Input: The user selects to play VR or XR content.

[0151] 2. Content download: The device downloads compatible VR or XR content from the server.

[0152] 3. Data display: The device displays the downloaded content to the user.

[0153] 4. Output: The user has a virtual reality experience.

[0154] 5. Specific operation: The user clicks the "Experience VR" button, and the device downloads VR content of a hot spring inn in Sapporo and a morning market in Hakodate from the server, providing the user with a virtual experience through the VR headset.

[0155] Step 5: Optimize your travel plans

[0156] 1. Input: The user inputs a modification to the travel plan (for example, upgrading the accommodation) into the terminal.

[0157] 2. Data transmission: The terminal transmits the modified conditions to the server.

[0158] 3. Data reanalysis and generation: The server calls the generation AI engine again based on the revised conditions to generate an optimized travel plan.

[0159] 4. Output: The new itinerary is sent to the device.

[0160] 5. Specific operation: The user enters into the device, "I would like to change the hot spring inn to one with a higher rank," and the device sends the modified data "{ "accommodation_rank": "luxury"}" to the server. The server then runs the generation AI engine again, generates a new plan that includes a hot spring inn with a higher rank, and sends it to the device.

[0161] Step 6: Create and deliver promotional content

[0162] 1. Input: The server obtains information from the tourist destination database.

[0163] 2. Data collection and generation: The server uses a generation AI engine to generate promotional videos and images.

[0164] 3. Data provision: Providing the generated promotional content to local governments and travel agencies.

[0165] 4. Output: Local governments and travel agencies will use the content to promote tourism.

[0166] 5. Specific operation: The server collects information about "Furano's lavender fields and surrounding restaurants" from a tourist destination database, and generates a promotional video using a generative AI engine. The generated content is provided to local governments and travel agencies via APIs and dashboards, and is then published on social media and official websites.

[0167] (Application example 1)

[0168] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0169] Modern travel planning is complex, and creating an optimal itinerary requires collecting, analyzing, and planning a large amount of information. Furthermore, there are limited ways to experience and confirm travel plans in advance, which can lead to disappointments during the actual trip. It also takes time and money for local governments and travel agencies to create content to effectively promote tourist destinations. Therefore, there is a need for a system that provides users with a quick and easy way to create and experience travel plans in advance, as well as effectively create promotional content for tourist destinations.

[0170] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0171] In this invention, the server includes means for generating a travel plan using generative AI technology, means for providing virtual reality (VR) or augmented reality (XR) content based on the generated travel plan, and means for optimizing the travel plan based on user feedback. This allows users to obtain an optimal travel plan at the planning stage, reduces disappointment in the actual trip by having a virtual experience in advance through VR / XR content, and enables local governments and travel agencies to efficiently create effective promotional content.

[0172] "Generative AI technology" is an artificial intelligence technology that automatically generates travel plans and content based on conditions specified by the user.

[0173] A "travel plan" is a plan such as an itinerary or a list of tourist attractions created based on the user's wishes and conditions.

[0174] "Virtual reality (VR) content" is digital content that uses computer technology to allow users to experience virtual spaces that do not exist in reality.

[0175] "Augmented reality (XR) content" refers to content that uses technology to overlay digital information on the real world, including virtual reality (VR) and other augmented reality technologies.

[0176] "Feedback from users" refers to information such as opinions, requests, and corrections provided by users.

[0177] "Optimization" is the process of adjusting the itinerary to suit your needs based on user feedback and additional requirements.

[0178] A "local government" is an administrative body that governs a specific region and is responsible for promoting tourist destinations, etc.

[0179] A "travel agency" is a business that provides travel-related services and information, and creates and arranges travel plans.

[0180] "Promotional content" is any digital content, such as videos, images or text, created to promote a tourist destination or a particular service.

[0181] A "smartphone" is a multi-functional mobile device that can connect to the Internet and install applications in addition to the functions of a mobile phone.

[0182] A "terminal interface" is an interface such as a graphical user interface or command input that allows a user to operate a terminal.

[0183] A "server" is a computer system connected to a network that processes requests from multiple users.

[0184] "Received data" refers to information and conditions entered by the user and is data that is analyzed by the server.

[0185] A "VR headset" is a device worn by users to experience a virtual reality space visually and aurally.

[0186] The system of the present invention generates a travel plan using generative AI technology and provides virtual reality (VR) or augmented reality (XR) content based on the generated travel plan. A specific embodiment of this system is described below.

[0187] Hardware and software used

[0188] Smartphone: Used for user input, travel plans, and VR / XR content display.

[0189] Server: Data analysis, calling the generative AI engine, generating and managing travel plans.

[0190] Generative AI engine: Artificial intelligence that creates travel plans and promotional content based on user criteria.

[0191] VR headset: A device that allows users to experience virtual reality.

[0192] System Features

[0193] 1. Receiving user input

[0194] The user inputs travel conditions using a smartphone. For example, specific information such as "destination," "travel period," "budget," and "travel theme" is set. This input information is sent from the smartphone to the server using the HTTPS protocol.

[0195] 2. Generate a travel plan

[0196] The server analyzes the received data and parses it in JSON format. It then invokes the AI ​​engine to generate an optimal travel plan based on the user's settings. The generated plan is then sent from the server to the smartphone and presented to the user.

[0197] 3. Providing simulated experiences

[0198] When a user selects VR / XR content based on the generated travel plan, the content starts playing on the device screen. When the smartphone is connected to a VR headset, the corresponding VR content is downloaded, providing the user with a virtual reality experience. This virtual reality experience enhances user interaction and reduces the risks and frustrations that may occur during real travel.

[0199] 4. Optimizing travel planning

[0200] If the user wishes to make changes to their travel plan, they can resubmit the revised conditions from their smartphone to the server. The server will then run the AI ​​engine based on the new conditions to generate an optimized travel plan. The final plan will be presented to the user for approval.

[0201] 5. Creation and provision of promotional content

[0202] The server uses a generative AI engine to generate effective promotional content (videos, images, etc.) based on a database of tourist destinations. This content is provided to local governments and travel agencies to help them attract tourists. The content is shared through a dedicated API and dashboard, allowing for efficient promotion of tourist destinations.

[0203] Specific examples

[0204] For example, if a user inputs "I want to go to Hokkaido in July for three nights and four days, with a budget of less than 100,000 yen, and enjoy hot springs and gourmet food," the server analyzes the received conditions, and the generative AI engine generates the optimal travel plan. This plan might include a hot spring inn in Sapporo, breakfast at the morning market in Hakodate, and a visit to the lavender fields in Furano. The generated plan is sent to a smartphone, and the user can wear a VR headset and virtually experience it in advance.

[0205] Prompt Sentence Examples

[0206] "Please generate a 3-night, 4-day itinerary for Hokkaido in July. I would like to enjoy hot springs and gourmet food within a budget of 100,000 yen."

[0207] In this way, the system of the present invention provides users with personalized travel plans and enables trouble-free travel through a virtual reality experience. It also enables local governments and travel agencies to promote tourist destinations efficiently, contributing to regional revitalization.

[0208] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0209] Step 1:

[0210] The user inputs travel conditions using a smartphone, specifically setting items such as the travel destination, travel period, budget, and travel theme. The input data is parsed in JSON format and sent to the server using the HTTPS protocol.

[0211] Input: Travel destination, travel period, budget, travel theme

[0212] Output: JSON format travel condition data

[0213] Step 2:

[0214] The server analyzes the received JSON-formatted travel condition data. This allows each condition to be recognized and classified as an individual parameter. The analyzed data is then converted into a format that is easy for the generative AI engine to handle.

[0215] Input: JSON format travel conditions data

[0216] Output: Analyzed travel condition parameters

[0217] Step 3:

[0218] The server calls the AI ​​engine to generate an optimal travel plan based on the analyzed travel condition parameters. The AI ​​engine then references a database of tourist spots, accommodations, restaurants, etc. to create an optimal plan that meets the conditions.

[0219] Input: Travel condition parameters

[0220] Data processing: Reference to databases of tourist attractions, accommodations, and restaurants

[0221] Output: Generated itinerary

[0222] Step 4:

[0223] The server sends the generated itinerary to the smartphone and presents it to the user, who can then check each element of the itinerary (e.g., places to visit, accommodation, places to eat, etc.).

[0224] Input: Generated itinerary

[0225] Output: The itinerary presented to the user

[0226] Step 5:

[0227] When a user wants to try out VR / XR content based on the generated travel plan, they select to play the VR content on their smartphone screen. The smartphone downloads the VR content from the server, and the user puts on a VR headset to experience the virtual reality experience.

[0228] Input: Generated travel plan, selection to play VR content

[0229] Data processing: VR content download

[0230] Output: Virtual reality experience

[0231] Step 6:

[0232] If a user wishes to make changes to their travel plan, they can enter the changes on their smartphone and send them to the server. For example, they can include specific requests such as "I want to upgrade the rank of the accommodation." The server then runs the AI ​​engine again based on the new conditions to generate an optimized travel plan.

[0233] Input: Modified conditions, New conditions

[0234] Data processing: Re-running the generative AI engine

[0235] Output: Optimized itinerary

[0236] Step 7:

[0237] The server sends the optimized travel plan to the smartphone and presents it to the user, who can then review the revised plan and make a final decision.

[0238] Input: Optimized itinerary

[0239] Output: The optimized itinerary presented to the user

[0240] Step 8:

[0241] The server uses a generation AI engine to create promotional content for tourist destinations. It collects information from a database of tourist destinations and generates promotional videos and images. This content is provided to local governments and travel agencies for use in tourism promotion activities.

[0242] Input: tourist destination data, generative AI engine

[0243] Data processing: Promoting videos and images

[0244] Output: Generated promotional content

[0245] The above are the processing steps of the system that realizes the application example of the present invention, which not only allows users to easily create travel plans and prepare for their trips through virtual reality experiences, but also enables local governments and travel agencies to efficiently promote tourist destinations.

[0246] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0247] This system combines generative AI technology with an emotion engine to provide users with personalized travel plans and virtual reality (VR) or augmented reality (XR) content based on those plans. Furthermore, it optimizes travel plans using user feedback and emotion data, and supports regional revitalization in collaboration with local governments and travel agencies through the generation of effective promotional content.

[0248] Program processing

[0249] 1. Receiving user input

[0250] First, the user uses the device interface to input travel requirements, such as the destination, travel period, budget, theme (e.g., hot springs, gourmet food), etc. The device converts this input data into an appropriate format and sends it to the server via the HTTPS protocol.

[0251] 2. Generate a travel plan

[0252] The server analyzes the received input data and saves it in a database. The server then parses the received data in JSON format and passes it to the generation AI engine. The generation AI engine generates the optimal travel plan for the user based on the tourist spots, accommodations, transportation, and restaurant information in the database. The generated travel plan is sent from the server to the device and presented to the user in an easy-to-read format.

[0253] 3. Providing simulated experiences

[0254] Next, the user selects to try out VR / XR content based on the generated travel plan. The user presses the play button for the VR / XR content on the device screen, and the device downloads the corresponding VR / XR content from the server. The device then provides the user with a virtual reality experience through a device such as a VR headset.

[0255] 4. Acquiring Emotion Data Using the Emotion Engine

[0256] During a user's VR / XR experience, the emotion engine recognizes the user's emotions in real time and collects data. The emotion engine uses facial recognition and voice analysis technology to measure the user's satisfaction, excitement, anxiety, etc.

[0257] 5. Optimize travel planning

[0258] Based on the emotion data obtained from the emotion engine, the server modifies or optimizes the travel plan in real time. For example, if it is determined that the user is particularly enjoying a certain tourist spot, the plan will be modified to extend the stay at that tourist spot. This allows the user to obtain a more satisfying travel plan.

[0259] 6. Receiving User Feedback

[0260] If a user wishes to make changes to their travel plan, they input the revised conditions into the device. For example, they input a specific request such as "raising the rank of accommodation." The device sends the new conditions to the server, which then runs the generation AI engine again to generate an optimized travel plan and send it to the device.

[0261] 7. Creation of promotional content and regional revitalization

[0262] The server works in conjunction with a generation AI to create promotional content for each tourist destination. Specifically, it collects information from a database of tourist destinations and generates promotional videos and images using AI technology. The generated promotional content is provided to local governments and travel agencies. Sharing the content through a dedicated API and dashboard effectively supports the promotion of tourist destinations. Local governments and travel agencies can use this content to promote tourism and attract more tourists.

[0263] Specific examples

[0264] 1. Receiving user input

[0265] The user types into the terminal, "I would like to go to Hokkaido in July for 3 nights and 4 days, with a budget of 100,000 yen or less, and enjoy the hot springs and gourmet food."

[0266] The terminal sends these conditions to the server.

[0267] 2. Generate a travel plan

[0268] Based on the conditions received by the server, the AI ​​engine generates a travel plan that takes into account "Hokkaido in July, 3 nights and 4 days, budget of 100,000 yen or less, hot springs and gourmet food."

[0269] The plan includes a stay at a hot spring inn in Sapporo, breakfast at the morning market in Hakodate, and a visit to the lavender fields in Furano.

[0270] Once the plan is generated, the server sends it to the terminal and displays it to the user.

[0271] 3. Providing simulated experiences

[0272] Users put on a VR headset on the device and virtually experience a hot spring inn in Sapporo or a morning market in Hakodate.

[0273] The device provides VR content, allowing users to experience the local atmosphere.

[0274] 4. Acquiring Emotion Data Using the Emotion Engine

[0275] During the user's VR experience, the emotion engine recognizes the user's emotions in real time and collects data such as joy, excitement, and anxiety.

[0276] The emotional data is sent to a server and used to adjust travel plans.

[0277] 5. Optimize travel planning

[0278] If it is determined based on the emotion data obtained from the emotion engine that the user is very satisfied with the hot spring inn, for example, the server modifies the plan to extend the stay at the hot spring inn.

[0279] The revised plan is sent to the user's terminal and presented to the user.

[0280] 6. Receiving User Feedback

[0281] If the user desires to choose a hot spring inn of a slightly higher rank, the user transmits the modified conditions from the terminal to the server.

[0282] The server again uses the generation AI engine to generate a new plan that includes a highly ranked hot spring inn.

[0283] The server sends the optimized travel plan to the terminal and displays it to the user.

[0284] 7. Creation of promotional content and regional revitalization

[0285] The server generates promotional content for "Furano's lavender fields and surrounding restaurants."

[0286] Local governments will publish this content on their official websites and social media to attract tourists.

[0287] In this way, the present invention provides users with personalized travel plans, utilizes emotional data to provide a more satisfying travel experience, and supports local governments and travel agencies in effectively promoting tourist destinations.

[0288] The processing flow will be explained below.

[0289] Step 1:

[0290] The user inputs travel conditions using the terminal interface, specifically, detailed conditions such as destination, travel period, budget, theme (e.g., hot springs, gourmet food), etc.

[0291] Step 2:

[0292] The terminal sends the entered data to the server, which converts the user's input data into an appropriate format and sends it to the server via the HTTPS protocol.

[0293] Step 3:

[0294] The server parses the received input data and saves it in the database.The server parses the received data in JSON format and saves it in the database.

[0295] Step 4:

[0296] The server calls the AI ​​engine to generate the optimal travel plan based on the input conditions. The AI ​​engine uses tourist attractions, accommodations, transportation options, and restaurant information in the database to create the optimal travel plan for the user.

[0297] Step 5:

[0298] The server sends the generated travel plan to the terminal and presents it to the user in an easy-to-read format. The terminal displays the travel plan to the user.

[0299] Step 6:

[0300] The user checks the generated travel plan and selects to try out the VR / XR content. The user presses the play button for the VR / XR content on the device screen.

[0301] Step 7:

[0302] The device downloads the corresponding VR / XR content from the server and displays it to the user, providing a virtual reality experience to the user through a device such as a VR headset.

[0303] Step 8:

[0304] As soon as a user begins their VR experience, the emotion engine collects their emotional data in real time, using facial recognition and voice analysis technology to measure their satisfaction and excitement.

[0305] Step 9:

[0306] The device transmits the acquired emotional data to a server, which is designed to update the data in real time.

[0307] Step 10:

[0308] The server analyzes the emotion data and optimizes the travel plan. For example, if it determines that the user is particularly satisfied with a particular tourist spot, it will modify the plan to extend the time spent at that spot.

[0309] Step 11:

[0310] The server sends the new optimized travel plan to the terminal and presents it to the user, and the terminal displays the new plan to the user.

[0311] Step 12:

[0312] If the user wishes to make further changes to the travel plan, they can input new conditions from the terminal and send them to the server. For example, they can add a preference such as "I want to improve the ranking of the restaurant."

[0313] Step 13:

[0314] The server runs the generation AI engine again to generate a travel plan based on the new conditions and sends it to the device, which then presents the new plan to the user.

[0315] Step 14:

[0316] The server works with local governments and travel agencies to generate promotional content for tourist destinations. The server collects information from a database of tourist destinations and uses AI technology to create promotional videos and images based on that information.

[0317] Step 15:

[0318] The server provides the generated promotional content to local governments and travel agencies, who share the content through a dedicated API and dashboard to help promote tourist destinations.

[0319] Step 16:

[0320] Local governments and travel agencies will use the provided promotional content to promote tourism, and will publish the content on their official websites and social media to attract tourists.

[0321] Example 2

[0322] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0323] Conventional travel planning systems struggle to consider users' individual preferences and real-time emotions, making it difficult to provide highly satisfying travel plans. Furthermore, they lacked the ability to utilize virtual reality and augmented reality content, leaving users with limited means to provide pre-travel experiences. Furthermore, local governments and travel agencies had limited means to generate and provide effective promotional content, preventing them from fully leveraging the appeal of tourist destinations.

[0324] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0325] In this invention, the server includes means for using generative AI technology to generate a travel plan, means for providing virtual reality or augmented reality content based on the generated travel plan, means for acquiring emotional data using an emotion engine during the user's virtual experience, means for optimizing the travel plan based on the acquired emotional data, means for modifying the travel plan based on user feedback, and means for creating and providing promotional content for tourist destinations in cooperation with local governments and travel agencies. This allows users to experience travel in advance through travel plans based on their individual preferences and virtual experiences, and further allows local governments and travel agencies to efficiently communicate the appeal of tourist destinations by utilizing effective promotional content.

[0326] "Generative AI technology" is a technology that uses artificial intelligence to automatically generate travel plans based on user input information.

[0327] "Virtual reality content" is content that allows users to experience real environments and situations in a virtual space using special headsets or devices.

[0328] "Augmented reality content" is content provided using technology that overlays digital information onto real-world images.

[0329] The "emotion engine" uses facial recognition and voice analysis technology to recognize the user's emotions in real time and analyze the data.

[0330] "Feedback" refers to information such as opinions and requests provided by users after using the system.

[0331] A "local government" is a local public body responsible for the administration of a particular area.

[0332] A "travel agency" is a business that plans and sells travel products.

[0333] "Promotional content" refers to digital content such as videos and images used to promote and publicize the attractions of tourist destinations and facilities.

[0334] "User input" refers to information such as travel requirements that a user provides to the system.

[0335] A "VR headset" is a device worn by a user to experience virtual reality.

[0336] A "server" is a computer system that receives and processes requests from users and provides the required services.

[0337] This system uses generative AI technology and an emotion engine to provide users with personalized travel plans and virtual reality (VR) or augmented reality (XR) content based on those plans. The system also uses user feedback and emotion data to optimize travel plans and collaborate with local governments and travel agencies to generate effective promotional content, thereby supporting regional revitalization.

[0338] Receiving User Input

[0339] First, the user inputs the travel conditions using the device interface. This includes detailed settings such as destination, travel period, budget, and theme (e.g., hot springs, gourmet food). For example, the user might input, "I want to go to Hokkaido in July for three nights and four days, with a budget of less than 100,000 yen, to enjoy hot springs and gourmet food." The device converts this information into JSON format and sends it to the server via the HTTPS protocol.

[0340] Generate a travel plan

[0341] The server receives the user's input data, analyzes it, and saves it in a database. The received data is parsed in JSON format and passed to the generation AI engine. The generation AI engine generates the optimal travel plan for the user based on data such as tourist attractions, accommodation, transportation, and restaurant information. For example, the generated plan might include a hot spring inn in Sapporo, breakfast at the morning market in Hakodate, and a visit to the lavender fields in Furano. The generated travel plan is sent from the server to the device and presented to the user in an easy-to-read format.

[0342] Providing simulated experiences

[0343] Users can try out VR / XR content based on the generated travel plan. When the user presses the play button for the VR / XR content on the device screen, the device downloads the corresponding VR / XR content from the server. Once the download is complete, the user puts on the VR headset and begins the virtual reality experience. This allows the user to experience the local atmosphere in a realistic way.

[0344] Acquiring emotional data using the emotion engine

[0345] During a user's VR / XR experience, the emotion engine recognizes the user's emotions in real time and collects data. The emotion engine uses facial recognition and voice analysis technology to measure the user's level of satisfaction, excitement, anxiety, etc., and sends that data to the server. For example, if a user smiles during their experience at a hot spring inn, it will be determined that they are highly satisfied.

[0346] Optimize travel planning

[0347] The server analyzes the emotion data obtained from the emotion engine and modifies or optimizes the travel plan in real time based on the results. For example, if it determines that the user particularly enjoyed a hot spring inn, the plan will be modified to extend the stay at the inn. The modified plan is sent from the server to the terminal and presented to the user.

[0348] Receiving feedback from users

[0349] If a user wishes to make changes to their travel plan, they can use their device to input new conditions. For example, they can input a specific request such as "raising the rank of the hot spring inn." The device then sends the new conditions to the server, which then runs the AI ​​engine again to generate an optimized travel plan that includes the new conditions. The generated plan is then sent back from the server to the device and displayed to the user.

[0350] Creation of promotional content and regional revitalization

[0351] The server works in conjunction with a generation AI to create promotional content for each tourist destination. Information is collected from a database of tourist destinations, and promotional videos and images are generated using the generation AI. The generated promotional content is provided to local governments and travel agencies. Sharing the content through a dedicated API and dashboard effectively supports the promotion of tourist destinations. Local governments and travel agencies use this content to promote tourism and attract more tourists. As a specific example, a promotional video with the theme of "Furano's lavender fields and surrounding restaurants" is created and posted on the local government's official website.

[0352] The system provides users with personalized travel plans, utilizes emotional data to provide a more satisfying travel experience, and supports local governments and travel agencies in effectively promoting tourist destinations.

[0353] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0354] Step 1:

[0355] Receiving User Input

[0356] The user inputs travel conditions using the device interface. Specifically, this includes detailed settings such as destination, travel period, budget, and theme (e.g., hot springs, gourmet food). For example, the user might input, "I would like to travel to Hokkaido in July for 3 nights and 4 days, with a budget of 100,000 yen or less, to enjoy hot springs and gourmet food." The device converts this information into JSON format and sends it to the server via the HTTPS protocol. The input data are travel conditions such as destination, period, and budget, which are converted into JSON format. The output data are travel conditions in JSON format.

[0357] Step 2:

[0358] Generate a travel plan

[0359] The server receives the user's input data, analyzes it, and saves it in a database. The server parses the received data in JSON format and passes it to the generative AI engine. The generative AI engine generates the optimal travel plan for the user based on the tourist spot, accommodation, transportation, and restaurant information in the database. The generative AI engine analyzes the input data and combines information about tourist spots and accommodation to create a personalized travel plan. For example, it might include a hot spring inn in Sapporo, breakfast at the morning market in Hakodate, and a visit to the lavender fields in Furano. The output data is the generated travel plan.

[0360] Step 3:

[0361] Presenting the generated travel plan

[0362] The server sends the generated itinerary to the terminal and presents it to the user in an easy-to-read format. Specifically, the itinerary is displayed on the terminal's display, allowing the user to check the contents of the plan. The input data is the generated itinerary, and the output data is the itinerary displayed in a format that the user can view.

[0363] Step 4:

[0364] Providing simulated experiences

[0365] Users can try out VR / XR content based on the generated travel plan. When the user presses the play button for the VR / XR content on the device screen, the device downloads the corresponding VR / XR content from the server. Once the download is complete, the user puts on the VR headset and begins the virtual reality experience. The input data is a request for VR / XR content based on the travel plan, and the output data is the downloaded VR / XR content.

[0366] Step 5:

[0367] Acquiring emotional data using the emotion engine

[0368] During a user's VR / XR experience, the emotion engine recognizes the user's emotions in real time and collects data. The emotion engine uses facial recognition and voice analysis technology to measure the user's level of satisfaction, excitement, anxiety, etc., and sends this data to the server. For example, if a user smiles while experiencing a hot spring inn, it is determined that the user is highly satisfied. The input data is the user's emotional expression (facial expression and tone of voice), and the output data is the analyzed emotional data.

[0369] Step 6:

[0370] Optimize your travel plans

[0371] The server analyzes the emotion data obtained from the emotion engine and modifies or optimizes the travel plan in real time based on the results. For example, if it determines that the user particularly enjoyed a hot spring inn, the plan is modified to extend the stay at the inn. The modified plan is sent from the server to the terminal and presented to the user. The input data are the emotion data and the original travel plan, and the output data is the optimized travel plan.

[0372] Step 7:

[0373] Receiving feedback from users

[0374] If a user wishes to make changes to their travel plan, they use their device to input new conditions. For example, they can input a specific request such as "raising the rank of the hot spring inn." The device then sends the new conditions to the server, which then runs the generation AI engine again to generate an optimized travel plan that includes the new conditions. The generated plan is then sent back from the server to the device and displayed to the user. The input data is the user's feedback, and the output data is the revised travel plan.

[0375] Step 8:

[0376] Creation of promotional content and regional revitalization

[0377] The server works with a generation AI to create promotional content for each tourist destination. Information is collected from a database of tourist destinations, and promotional videos and images are generated using the generation AI. The generated promotional content is provided to local governments and travel agencies. Sharing the content through a dedicated API and dashboard effectively supports the promotion of tourist destinations. Local governments and travel agencies use this content to promote tourism and attract more tourists. As a specific example, a promotional video with the theme of "Furano's lavender fields and surrounding restaurants" is created and posted on the local government's official website. The input data is information about the tourist destinations, and the output data is the generated promotional content.

[0378] (Application example 2)

[0379] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0380] Conventional travel plan creation systems have the problem of being unable to provide highly customized travel plans that reflect the individual needs and preferences of users. They also lack a means to optimize travel plans by incorporating users' feelings and feedback on the generated travel plans in real time. Furthermore, promotion of tourist destinations remains limited to standard methods, limiting their effectiveness in promoting regional revitalization. A new system is needed to resolve these issues, provide users with a more satisfying travel experience, and support tourism promotion by local governments and travel agencies.

[0381] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0382] In this invention, the server includes: a means for generating travel plans using generative AI technology; a means for providing virtual reality (VR) or augmented reality (XR) content based on the generated travel plans; a means for optimizing the travel plans based on user feedback; a means for acquiring user emotion data and further optimizing the travel plans based on the emotion data; a means for delivering personalized travel content to users via their smartphones; and a means for creating and providing promotional content for tourist destinations in collaboration with local governments and travel agencies. This enables the provision of highly customized travel plans tailored to individual needs and preferences, and enables the optimization of travel plans that reflect user emotion and feedback in real time. It also effectively supports promotional activities for tourist destinations, promoting regional revitalization.

[0383] "Generative AI technology" is a technology that uses artificial intelligence to automatically generate optimal travel plans based on user input data.

[0384] A "travel plan" is a plan that is generated based on the user's travel conditions and includes information on tourist spots, accommodations, transportation, restaurants, and the like.

[0385] "Virtual reality (VR) content" refers to visual and auditory content that allows users to experience destinations in a virtual space based on a generated travel plan.

[0386] "Augmented Reality (XR) Content" refers to content that provides an experience that blends physical reality and digital content based on a generated travel plan.

[0387] "User feedback" refers to opinions and corrections users provide regarding travel plans and VR / XR experiences.

[0388] "Emotional data" is data collected using facial recognition and voice analysis technology to capture the emotions users express during their travel plans and VR / XR experiences.

[0389] An "emotion engine" is a software or hardware system that recognizes a user's emotions in real time and acquires emotion data.

[0390] "Personalized travel content" refers to travel information and experience content that is optimized to suit a user's individual conditions and preferences.

[0391] "Local governments" are local governments that are responsible for local administration in each region and are the entities that carry out promotional activities for tourist destinations.

[0392] A "travel agency" is a company that creates travel plans, makes arrangements, and makes reservations.

[0393] "Promotional content" refers to media materials such as videos, images, and texts used to promote tourist destinations and travel plans.

[0394] The system embodying this invention includes means for generative AI technology, an emotion engine, a VR / XR content generation tool, receiving and processing user input, acquiring and analyzing emotion data, optimizing travel plans, and generating and distributing promotional content.

[0395] Example of running the system program:

[0396] Receiving User Input

[0397] The user inputs travel conditions (destination, travel period, budget, theme, etc.) using a smartphone application. This input data is converted into JSON format by the device and sent to the server via the HTTPS protocol.

[0398] Generate a travel plan

[0399] The server receives input data sent by the user and passes it to the generative AI engine. The generative AI engine uses this data and information on tourist spots and accommodations stored in the database to generate an optimal travel plan. This travel plan is then converted back to JSON format and sent to the device.

[0400] Providing virtual reality (VR) / augmented reality (XR) experiences

[0401] The device will download the VR / XR content from the server if the user checks the travel plan and selects a VR / XR experience. The user can then wear a smartphone or a compatible VR headset and enjoy the virtual experience.

[0402] Acquiring and analyzing emotion data

[0403] While the user is experiencing VR / XR, the device uses a camera and microphone to recognize the user's face and perform voice analysis, which allows the emotion engine to collect and analyze the user's emotional data (such as satisfaction, excitement, and anxiety) in real time. This data is then sent to the server.

[0404] Optimize your travel plans

[0405] The server receives the emotion data and uses a generative AI engine to optimize the travel plan. For example, if the user is enjoying a particular tourist spot, the plan will be revised to extend the time spent there.

[0406] Receiving and incorporating user feedback

[0407] If a user wants to modify their travel plan, they enter new conditions into the app. This data is also sent to the server, and the AI ​​engine regenerates the optimal plan. This new plan is sent to the device and displayed to the user.

[0408] Promotional content creation and distribution

[0409] The server works in conjunction with the generative AI to create promotional content for tourist destinations, which is then published on the websites and social media of local governments and travel agencies to be used in tourist attraction activities.

[0410] Specific examples

[0411] Receiving User Input

[0412] The user enters into the application, "I would like to spend 4 days and 3 nights in Tokyo in August, with a budget of 200,000 yen or less, enjoying museums and shopping," and sends this information to the server.

[0413] Generate a travel plan

[0414] Based on the data received by the server, the generative AI engine generates a travel plan that includes "visiting an art museum in Ueno, shopping in Ginza, and staying at a luxury hotel in Shinjuku."

[0415] Providing virtual reality (VR) / augmented reality (XR) experiences

[0416] Users can use the device to virtually experience Ueno Museum and Ginza Shopping Street, checking out the local atmosphere in advance.

[0417] Acquiring and analyzing emotion data

[0418] The device performs facial recognition and voice analysis of the user and transmits emotional data to the server.

[0419] Optimize your travel plans

[0420] Based on the emotion data, the server modifies the plan and presents the new plan to the user.

[0421] Prompt Sentence Examples

[0422] An example prompt for a generative AI model is:

[0423] Please provide data that will be helpful when generating your Tokyo travel plans. Please include information that meets the following tourist criteria:

[0424] Trip duration: 3 nights, 4 days

[0425] Destination: Tokyo

[0426] Budget: Under 200,000 yen

[0427] Main themes: Museums, Shopping

[0428] Recommended tourist spots, accommodations, and restaurant information

[0429] In this way, it becomes possible to provide travel plans tailored to the individual conditions and preferences of users, optimize travel plans in real time using emotional data, and effectively support tourism promotion by local governments.

[0430] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0431] Step 1:

[0432] The user uses a smartphone application to input travel requirements, including the destination, travel period, budget, and theme. This data is converted into JSON format by the device and sent to the server via the HTTPS protocol. Specifically, the user enters "3 nights and 4 days in Tokyo in August, budget of 200,000 yen or less, wanting to enjoy museums and shopping" into the app's form and presses the submit button.

[0433] Input: The travel requirements entered by the user into the app

[0434] Output: Trip conditions data converted to JSON format

[0435] Step 2:

[0436] The server receives travel requirement data in JSON format sent by the user. It analyzes the received data and passes it on to the generation AI engine. Based on this data, the generation AI engine generates the optimal travel plan by referencing tourist destinations, accommodations, transportation options, and restaurant information in the database.

[0437] Input: JSON format travel conditions data

[0438] Output: A travel plan generated by the generative AI engine

[0439] Step 3:

[0440] The server converts the generated itinerary into JSON format and sends it to the device via HTTPS. The device receives the itinerary and displays it in a user-friendly format. The user can then review the itinerary and choose the option for a virtual reality (VR) or augmented reality (XR) experience.

[0441] Input: Generated itinerary

[0442] Output: The itinerary displayed on the user's device

[0443] Step 4:

[0444] When a user selects a VR / XR experience on their device, the device downloads the corresponding VR / XR content from the server, and the device provides the user with a virtual reality experience through a smartphone app or a compatible VR headset. For example, a user can virtually experience the Ueno Museum or the Ginza Shopping District to get a feel for the local atmosphere.

[0445] Input: User-selected VR / XR experience options

[0446] Output: Download VR / XR content and provide a virtual reality experience to the user

[0447] Step 5:

[0448] The device uses a camera and microphone to recognize the user's face and perform voice analysis during the user's VR / XR experience. The emotion engine analyzes the user's emotional data (satisfaction, excitement, anxiety, etc.) based on the collected data and obtains emotional data in real time. This data is then sent from the device to the server.

[0449] Input: User's facial recognition data and voice data

[0450] Output: Analyzed user emotion data

[0451] Step 6:

[0452] The server analyzes the acquired emotion data and optimizes the travel plan using a generative AI engine. For example, if it determines that the user is having a great time at a particular tourist spot, it will modify the plan to extend the stay at that tourist spot. This modified plan is then converted back into JSON format and sent to the device.

[0453] Input: Parsed user emotion data

[0454] Output: Optimized itinerary

[0455] Step 7:

[0456] If a user wants to modify their travel plan (for example, "I want more luxurious accommodation"), they enter the new conditions into the app. The device sends this data to the server, which uses its generative AI engine to regenerate the optimal plan. This new plan is sent to the device and displayed to the user.

[0457] Input: New criteria re-entered by the user

[0458] Output: Regenerated itinerary

[0459] Step 8:

[0460] The server works in conjunction with AI technology to create promotional content for tourist destinations. The generated promotional content is provided to local governments and travel agencies. For example, the server generates a promotional video for the "Ueno Museum and its surrounding cafes," which the local government then publishes on its official website and social media.

[0461] Input: Tourist destination database information

[0462] Output: Generated promotional content

[0463] In this way, users can receive travel plans tailored to their individual requirements and preferences, and their travel plans can be optimized by acquiring real-time emotional data. This also effectively supports promotional activities for tourist destinations.

[0464] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0465] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0466] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0467] [Second embodiment]

[0468] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0469] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0470] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0471] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0472] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0473] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0474] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0475] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0476] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0477] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0478] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0479] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0480] This invention is a system that uses generative AI technology to generate travel plans and provide VR or XR content based on them. This system allows users to input their travel requirements, virtually experience the generated plan in advance, and obtain an optimized travel plan based on that. It also generates promotional content for tourist destinations and supports regional revitalization in cooperation with local governments and travel agencies.

[0481] Program processing

[0482] 1. Receiving user input

[0483] 1. The user uses the device interface to input travel conditions, such as the destination, travel period, budget, and theme (e.g., hot springs, gourmet food).

[0484] 2. The terminal sends the entered data to the server. The terminal converts the entered data into the appropriate format and sends it to the server using the HTTPS protocol.

[0485] 2. Generate a travel plan

[0486] 1. The server parses the received input data and stores it in the database. The server parses the received data in JSON format and stores it in the database.

[0487] 2. The server calls a specialized AI engine to generate the optimal travel plan based on the input criteria. The AI ​​engine automatically creates the optimal travel plan for the user using tourist attractions, accommodations, transportation options, and restaurant information in the database.

[0488] 3. The server sends the generated travel plan to the terminal and presents it to the user in an easy-to-read format.

[0489] 3. Providing simulated experiences

[0490] 1. The user tries out the VR / XR content based on the generated travel plan. Specifically, the user selects playback of the VR / XR content on the device screen.

[0491] 2. The device downloads the corresponding VR / XR content from the server and displays it to the user, providing a virtual reality experience to the user through a device such as a VR headset.

[0492] 4. Optimizing travel planning

[0493] 1. If the user wishes to make changes to the travel plan, they input the revised conditions into the terminal. For example, they input a request to upgrade the rank of the accommodation.

[0494] 2. The device sends the new conditions to the server.

[0495] 3. The server runs the generation AI engine again based on the revised conditions, generates an optimized travel plan, and sends it to the device.

[0496] 4. The user reviews the revised and optimized travel plan and decides on the final plan.

[0497] 5. Creation of promotional content and regional revitalization

[0498] 1. The server creates promotional content for each tourist destination in collaboration with the AI. Specifically, it collects information from a database of tourist destinations and generates promotional videos and images using AI technology.

[0499] 2. The server provides the generated promotional content to local governments and travel agencies, sharing the content through dedicated APIs and dashboards to help promote tourist destinations.

[0500] 3. Local governments and travel agencies can use this content to efficiently promote tourism and attract tourists.

[0501] Specific examples

[0502] 1. Receiving user input

[0503] The user types into the terminal, "I would like to go to Hokkaido in July for 3 nights and 4 days, with a budget of 100,000 yen or less, and enjoy the hot springs and gourmet food."

[0504] The terminal sends these conditions to the server.

[0505] 2. Generate a travel plan

[0506] Based on the conditions received by the server, the AI ​​engine generates a travel plan that matches the conditions, such as "Hokkaido in July, 3 nights and 4 days, budget within 100,000 yen, hot springs and gourmet food."

[0507] The plan includes a stay at a hot spring inn in Sapporo, breakfast at the morning market in Hakodate, and a visit to the lavender fields in Furano.

[0508] Once the plan is generated, the server sends it to the terminal and displays it to the user.

[0509] 3. Providing simulated experiences

[0510] Users put on a VR headset on the device and virtually experience a hot spring inn in Sapporo or a morning market in Hakodate.

[0511] The device provides VR content, allowing users to experience the local atmosphere.

[0512] 4. Optimizing travel planning

[0513] If the user wishes to change the hot spring inn to one with a slightly higher rank, the user transmits the modified conditions from the terminal to the server.

[0514] The server again uses the generation AI engine to generate a new plan that includes a higher-ranked hot spring inn.

[0515] The server sends the optimized travel plan to the terminal and displays it to the user.

[0516] 5. Creation of promotional content and regional revitalization

[0517] The server generates promotional content for "Furano's lavender fields and surrounding restaurants."

[0518] Local governments will publish this content on their official websites and social media to attract tourists.

[0519] In this way, the present invention provides users with personalized travel plans and enables them to have a trouble-free trip through a virtual experience. It also enables local governments and travel agencies to promote tourist destinations efficiently, contributing to regional revitalization.

[0520] The processing flow will be explained below.

[0521] Step 1:

[0522] The user inputs travel conditions using the terminal interface, specifically, detailed conditions such as destination, travel period, budget, theme (e.g., hot springs, gourmet food), etc.

[0523] Step 2:

[0524] The terminal sends the input data to the server, which converts the input data into an appropriate format and sends it to the server via the HTTPS protocol.

[0525] Step 3:

[0526] The server parses the received input data and saves it in the database.The server parses the received data in JSON format and saves it in the database.

[0527] Step 4:

[0528] The server calls the AI ​​engine to generate the optimal travel plan based on the input conditions. The AI ​​engine uses tourist attractions, accommodations, transportation options, and restaurant information in the database to create the optimal travel plan for the user.

[0529] Step 5:

[0530] The server transmits the generated travel plan to the terminal and presents it to the user in an easy-to-view format.

[0531] Step 6:

[0532] The user checks the generated travel plan and selects to try out the VR / XR content. The user presses the play button for the VR / XR content on the device screen.

[0533] Step 7:

[0534] The device downloads the corresponding VR / XR content from the server and displays it to the user, providing a virtual reality experience to the user through a device such as a VR headset.

[0535] Step 8:

[0536] If the user wishes to modify the travel plan, he or she inputs the modified conditions into the terminal, such as a preference to upgrade the rank of accommodation.

[0537] Step 9:

[0538] The terminal sends the new conditions to the server. The terminal converts the modified conditions into the appropriate format and sends them to the server.

[0539] Step 10:

[0540] The server runs the generation AI engine again based on the revised conditions to generate an optimized travel plan. The generation AI engine analyzes the conditions again and generates a new travel plan.

[0541] Step 11:

[0542] The server sends the optimized travel plan to the terminal and presents it to the user, who then reviews the final travel plan and makes a final decision if necessary.

[0543] Step 12:

[0544] The server works with local governments and travel agencies to generate promotional content for tourist destinations. The server collects information from a database of tourist destinations and uses AI technology to create promotional videos and images.

[0545] Step 13:

[0546] The server provides the generated promotional content to local governments and travel agencies, who share the content through a dedicated API and dashboard to help promote tourist destinations.

[0547] Step 14:

[0548] Local governments and travel agencies will use the provided promotional content to promote tourism, and will post it on their official websites and social media to attract more tourists.

[0549] Example 1

[0550] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0551] Conventional travel plan generation systems have limited ability to provide users with personalized travel plans. Furthermore, they do not readily provide virtual reality (VR) or augmented reality (XR) experiences based on the generated travel plans, making it less convenient for users to consider their travel plans in advance. Furthermore, they lacked a sufficient mechanism for efficiently creating promotional content for tourist destinations and supporting regional revitalization through collaboration with local governments and travel agencies. These issues need to be resolved.

[0552] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0553] In this invention, the server includes: a means for a user to input travel requirements; a means for the terminal to convert the input data into an appropriate data format and send it to the server; a means for the server to analyze the received data and store it in a database; a means for the server to automatically generate a travel plan based on the input requirements using a generation AI engine; a means for the server to send the generated travel plan to the terminal and present it to the user in an easy-to-view format; a means for the user to try VR or XR content based on the travel plan; a means for the terminal to download corresponding VR or XR content from the server and display it to the user; a means for the user to input modifications to the travel plan and for the terminal to send the new conditions to the server; a means for the server to re-operate the generation AI engine based on the modified conditions and generate an optimized travel plan; and a means for the server to generate promotional content for tourist destinations and provide it to local governments and travel agencies. This enables the provision of personalized travel plans to users, advance travel planning through virtual experiences, and efficient tourist destination promotion through collaboration with local governments and travel agencies.

[0554] "User" refers to a person who uses the system to input travel conditions in order to create, modify, or experience a travel plan.

[0555] "Terminal" refers to the device used by a user to input travel requirements and experience virtual reality (VR) and augmented reality (XR) content.

[0556] "Server" refers to the central computing resource of the system that receives and analyzes data sent by users and automatically generates travel plans using a generative AI engine.

[0557] "Generative AI engine" refers to artificial intelligence technology for generating optimal travel plans based on input conditions.

[0558] "Database" refers to the system that structures and stores the received data and holds the information that the Generative AI Engine references when generating travel plans.

[0559] "Travel conditions" refers to detailed information such as the travel destination, duration, budget, and theme entered by the user.

[0560] "Travel plan" refers to a detailed plan including tourist attractions, accommodation, transportation, restaurant information, etc., that is automatically generated by the AI ​​engine based on the travel conditions entered by the user.

[0561] "Virtual reality (VR) content" refers to digital content that allows users to virtually experience a trip in advance based on their travel plans.

[0562] "Augmented reality (XR) content" refers to digital content that combines virtual reality with real-world scenery and objects.

[0563] "Promotional content" refers to promotional materials such as videos and images created using a generative AI engine to convey the attractions of a tourist destination.

[0564] "Local government" refers to a local public body with the autonomy to carry out tourism destination promotion activities.

[0565] "Travel agency" refers to a company that creates and sells travel plans and provides travel services to customers.

[0566] "Feedback" refers to any corrections or requests for improvements made by a user to a provided travel plan.

[0567] "Optimization" refers to the process by which the generative AI engine regenerates and improves travel plans based on user feedback and new conditions.

[0568] This invention is a system that uses generative AI technology to generate travel plans and provide virtual reality (VR) or augmented reality (XR) content based on those plans. This system allows users to input their travel requirements, virtually experience the generated plan in advance, and obtain an optimized travel plan based on that. It also generates promotional content for tourist destinations and supports regional revitalization in cooperation with local governments and travel agencies.

[0569] This system consists of a terminal that provides an interface for users to input travel conditions, a server that receives and analyzes the input data and generates and optimizes travel plans using a generative AI engine, a means to present the generated travel plans to users, and a means to play VR / XR content to provide a virtual experience.

[0570] First, the user inputs the travel conditions using the terminal interface. These include the destination, travel period, budget, theme (e.g., hot springs, gourmet food), etc. For example, the user might input "I'd like to go to Hokkaido in July for 3 nights and 4 days, with a budget of 100,000 yen or less, and enjoy hot springs and gourmet food." The terminal converts the input data into an appropriate data format (e.g., JSON format) and sends it to the server using the HTTPS protocol.

[0571] The server parses the received data in JSON format and stores it in a database as structured information. The server then calls a generative AI engine to automatically generate the optimal travel plan for the user. The generative AI engine integrates tourist spots, accommodation, transportation, and restaurant information from the database to create a travel plan that meets the user's requirements. For example, it might generate a plan such as "Stay at a hot spring inn in Sapporo, have breakfast at the morning market in Hakodate, and visit the lavender fields in Furano."

[0572] The generated travel plan is then sent to the device and displayed to the user. The user can review the plan and try out further virtual experiences. The device then downloads the corresponding VR or XR content from the server and displays it to the user. The user then puts on a VR headset and can virtually experience, for example, a hot spring inn in Sapporo or a morning market in Hakodate.

[0573] If a user wishes to modify their travel plan, for example, to choose a higher-ranking hot spring inn, they send the modified conditions from their device to the server. The server then uses the generation AI engine again to generate a new plan based on the modified conditions. The modified plan is then sent back to the device and presented to the user.

[0574] The server then generates promotional content for tourist destinations. It collects information from a database of tourist destinations and uses a generative AI engine to create promotional videos and images. For example, promotional content for "Furano's lavender fields and surrounding restaurants" is generated. This content is provided to local governments and travel agencies via APIs and dashboards, enabling efficient promotion of tourist destinations.

[0575] As described above, the present invention provides users with personalized travel plans, allows them to consider travel plans in advance through virtual experiences, and enables efficient promotion of tourist destinations through collaboration with local governments and travel agencies.

[0576] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0577] Step 1: Receiving User Input

[0578] 1. Input: The user inputs travel conditions (destination, travel period, budget, theme, etc.) into the terminal interface.

[0579] 2. Data processing: The terminal converts the input data into JSON format.

[0580] 3. Output: Send the converted JSON data to the server.

[0581] 4. Specific operation: The user enters into the device interface, "I would like to go to Hokkaido in July for 3 nights and 4 days, with a budget of 100,000 yen or less, and enjoy hot springs and gourmet food," and the device sends the JSON data "{ "destination": "Hokkaido", "duration": "3 nights and 4 days", "budget": "100,000 yen", "theme": "Hot springs, gourmet food"}" to the server.

[0582] Step 2: Generate a travel plan

[0583] 1. Input: JSON format travel condition data is sent to the server.

[0584] 2. Data analysis and storage: The server parses the received data in JSON format and stores it in a database as structured information.

[0585] 3. Data calculation: The server calls the AI ​​engine and generates the optimal travel plan based on the information in the database.

[0586] 4. Output: The generated travel plan is sent to the terminal.

[0587] 5. Specific operation: The server analyzes the data "{ "destination": "Hokkaido", "duration": "3 nights and 4 days", "budget": "100,000 yen", "theme": "hot springs, gourmet"}" and saves it in the database as "Destination: Hokkaido, Duration: 3 nights and 4 days, Budget: 100,000 yen, Theme: hot springs, gourmet." The generation AI engine then generates a travel plan such as "Stay at a hot spring inn in Sapporo, have breakfast at the morning market in Hakodate, and visit the lavender fields in Furano," and sends it to the device.

[0588] Step 3: Present your travel plans

[0589] 1. Input: The generated travel plan data is sent to the terminal.

[0590] 2. Data display: The terminal displays the travel plan received in an easy-to-read format for the user.

[0591] 3. Output: The user confirms the generated itinerary.

[0592] 4. Specific operation: The device displays a travel plan on the screen, such as "Day 1: Stay at a hot spring inn in Sapporo, Day 2: Breakfast at the morning market in Hakodate, Day 3: Visit the lavender fields in Furano," and the user confirms it.

[0593] Step 4: Providing VR / XR content

[0594] 1. Input: The user selects to play VR or XR content.

[0595] 2. Content download: The device downloads compatible VR or XR content from the server.

[0596] 3. Data display: The device displays the downloaded content to the user.

[0597] 4. Output: The user has a virtual reality experience.

[0598] 5. Specific operation: The user clicks the "Experience VR" button, and the device downloads VR content of a hot spring inn in Sapporo and a morning market in Hakodate from the server, providing the user with a virtual experience through the VR headset.

[0599] Step 5: Optimize your travel plans

[0600] 1. Input: The user inputs a modification to the travel plan (for example, upgrading the accommodation) into the terminal.

[0601] 2. Data transmission: The terminal transmits the modified conditions to the server.

[0602] 3. Data reanalysis and generation: The server calls the generation AI engine again based on the revised conditions to generate an optimized travel plan.

[0603] 4. Output: The new itinerary is sent to the device.

[0604] 5. Specific operation: The user enters into the device, "I would like to change the hot spring inn to one with a higher rank," and the device sends the modified data "{ "accommodation_rank": "luxury"}" to the server. The server then runs the generation AI engine again, generates a new plan that includes a hot spring inn with a higher rank, and sends it to the device.

[0605] Step 6: Create and deliver promotional content

[0606] 1. Input: The server obtains information from the tourist destination database.

[0607] 2. Data collection and generation: The server uses a generation AI engine to generate promotional videos and images.

[0608] 3. Data provision: Providing the generated promotional content to local governments and travel agencies.

[0609] 4. Output: Local governments and travel agencies will use the content to promote tourism.

[0610] 5. Specific operation: The server collects information about "Furano's lavender fields and surrounding restaurants" from a tourist destination database, and generates a promotional video using a generative AI engine. The generated content is provided to local governments and travel agencies via APIs and dashboards, and is then published on social media and official websites.

[0611] (Application example 1)

[0612] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0613] Modern travel planning is complex, and creating an optimal itinerary requires collecting, analyzing, and planning a large amount of information. Furthermore, there are limited ways to experience and confirm travel plans in advance, which can lead to disappointments during the actual trip. It also takes time and money for local governments and travel agencies to create content to effectively promote tourist destinations. Therefore, there is a need for a system that provides users with a quick and easy way to create and experience travel plans in advance, as well as effectively create promotional content for tourist destinations.

[0614] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0615] In this invention, the server includes means for generating a travel plan using generative AI technology, means for providing virtual reality (VR) or augmented reality (XR) content based on the generated travel plan, and means for optimizing the travel plan based on user feedback. This allows users to obtain an optimal travel plan at the planning stage, reduces disappointment in the actual trip by having a virtual experience in advance through VR / XR content, and enables local governments and travel agencies to efficiently create effective promotional content.

[0616] "Generative AI technology" is an artificial intelligence technology that automatically generates travel plans and content based on conditions specified by the user.

[0617] A "travel plan" is a plan such as an itinerary or a list of tourist attractions created based on the user's wishes and conditions.

[0618] "Virtual reality (VR) content" is digital content that uses computer technology to allow users to experience virtual spaces that do not exist in reality.

[0619] "Augmented reality (XR) content" refers to content that uses technology to overlay digital information on the real world, including virtual reality (VR) and other augmented reality technologies.

[0620] "Feedback from users" refers to information such as opinions, requests, and corrections provided by users.

[0621] "Optimization" is the process of adjusting the itinerary to suit your needs based on user feedback and additional requirements.

[0622] A "local government" is an administrative body that governs a specific region and is responsible for promoting tourist destinations, etc.

[0623] A "travel agency" is a business that provides travel-related services and information, and creates and arranges travel plans.

[0624] "Promotional content" is any digital content, such as videos, images or text, created to promote a tourist destination or a particular service.

[0625] A "smartphone" is a multi-functional mobile device that can connect to the Internet and install applications in addition to the functions of a mobile phone.

[0626] A "terminal interface" is an interface such as a graphical user interface or command input that allows a user to operate a terminal.

[0627] A "server" is a computer system connected to a network that processes requests from multiple users.

[0628] "Received data" refers to information and conditions entered by the user and is data that is analyzed by the server.

[0629] A "VR headset" is a device worn by users to experience a virtual reality space visually and aurally.

[0630] The system of the present invention generates a travel plan using generative AI technology and provides virtual reality (VR) or augmented reality (XR) content based on the generated travel plan. A specific embodiment of this system is described below.

[0631] Hardware and software used

[0632] Smartphone: Used for user input, travel plans, and VR / XR content display.

[0633] Server: Data analysis, calling the generative AI engine, generating and managing travel plans.

[0634] Generative AI engine: Artificial intelligence that creates travel plans and promotional content based on user criteria.

[0635] VR headset: A device that allows users to experience virtual reality.

[0636] System Features

[0637] 1. Receiving user input

[0638] The user inputs travel conditions using a smartphone. For example, specific information such as "destination," "travel period," "budget," and "travel theme" is set. This input information is sent from the smartphone to the server using the HTTPS protocol.

[0639] 2. Generate a travel plan

[0640] The server analyzes the received data and parses it in JSON format. It then invokes the AI ​​engine to generate an optimal travel plan based on the user's settings. The generated plan is then sent from the server to the smartphone and presented to the user.

[0641] 3. Providing simulated experiences

[0642] When a user selects VR / XR content based on the generated travel plan, the content starts playing on the device screen. When the smartphone is connected to a VR headset, the corresponding VR content is downloaded, providing the user with a virtual reality experience. This virtual reality experience enhances user interaction and reduces the risks and frustrations that may occur during real travel.

[0643] 4. Optimizing travel planning

[0644] If the user wishes to make changes to their travel plan, they can resubmit the revised conditions from their smartphone to the server. The server will then run the AI ​​engine based on the new conditions to generate an optimized travel plan. The final plan will be presented to the user for approval.

[0645] 5. Creation and provision of promotional content

[0646] The server uses a generative AI engine to generate effective promotional content (videos, images, etc.) based on a database of tourist destinations. This content is provided to local governments and travel agencies to help them attract tourists. The content is shared through a dedicated API and dashboard, allowing for efficient promotion of tourist destinations.

[0647] Specific examples

[0648] For example, if a user inputs "I want to go to Hokkaido in July for three nights and four days, with a budget of less than 100,000 yen, and enjoy hot springs and gourmet food," the server analyzes the received conditions, and the generative AI engine generates the optimal travel plan. This plan might include a hot spring inn in Sapporo, breakfast at the morning market in Hakodate, and a visit to the lavender fields in Furano. The generated plan is sent to a smartphone, and the user can wear a VR headset and virtually experience it in advance.

[0649] Prompt Sentence Examples

[0650] "Please generate a 3-night, 4-day itinerary for Hokkaido in July. I would like to enjoy hot springs and gourmet food within a budget of 100,000 yen."

[0651] In this way, the system of the present invention provides users with personalized travel plans and enables trouble-free travel through a virtual reality experience. It also enables local governments and travel agencies to promote tourist destinations efficiently, contributing to regional revitalization.

[0652] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0653] Step 1:

[0654] The user inputs travel conditions using a smartphone, specifically setting items such as the travel destination, travel period, budget, and travel theme. The input data is parsed in JSON format and sent to the server using the HTTPS protocol.

[0655] Input: Travel destination, travel period, budget, travel theme

[0656] Output: JSON format travel condition data

[0657] Step 2:

[0658] The server analyzes the received JSON-formatted travel condition data. This allows each condition to be recognized and classified as an individual parameter. The analyzed data is then converted into a format that is easy for the generative AI engine to handle.

[0659] Input: JSON format travel conditions data

[0660] Output: Analyzed travel condition parameters

[0661] Step 3:

[0662] The server calls the AI ​​engine to generate an optimal travel plan based on the analyzed travel condition parameters. The AI ​​engine then references a database of tourist spots, accommodations, restaurants, etc. to create an optimal plan that meets the conditions.

[0663] Input: Travel condition parameters

[0664] Data processing: Reference to databases of tourist attractions, accommodations, and restaurants

[0665] Output: Generated itinerary

[0666] Step 4:

[0667] The server sends the generated itinerary to the smartphone and presents it to the user, who can then check each element of the itinerary (e.g., places to visit, accommodation, places to eat, etc.).

[0668] Input: Generated itinerary

[0669] Output: The itinerary presented to the user

[0670] Step 5:

[0671] When a user wants to try out VR / XR content based on the generated travel plan, they select to play the VR content on their smartphone screen. The smartphone downloads the VR content from the server, and the user puts on a VR headset to experience the virtual reality experience.

[0672] Input: Generated travel plan, selection to play VR content

[0673] Data processing: VR content download

[0674] Output: Virtual reality experience

[0675] Step 6:

[0676] If a user wishes to make changes to their travel plan, they can enter the changes on their smartphone and send them to the server. For example, they can include specific requests such as "I want to upgrade the rank of the accommodation." The server then runs the AI ​​engine again based on the new conditions to generate an optimized travel plan.

[0677] Input: Modified conditions, New conditions

[0678] Data processing: Re-running the generative AI engine

[0679] Output: Optimized itinerary

[0680] Step 7:

[0681] The server sends the optimized travel plan to the smartphone and presents it to the user, who can then review the revised plan and make a final decision.

[0682] Input: Optimized itinerary

[0683] Output: The optimized itinerary presented to the user

[0684] Step 8:

[0685] The server uses a generation AI engine to create promotional content for tourist destinations. It collects information from a database of tourist destinations and generates promotional videos and images. This content is provided to local governments and travel agencies for use in tourism promotion activities.

[0686] Input: tourist destination data, generative AI engine

[0687] Data processing: Promoting videos and images

[0688] Output: Generated promotional content

[0689] The above are the processing steps of the system that realizes the application example of the present invention, which not only allows users to easily create travel plans and prepare for their trips through virtual reality experiences, but also enables local governments and travel agencies to efficiently promote tourist destinations.

[0690] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0691] This system combines generative AI technology with an emotion engine to provide users with personalized travel plans and virtual reality (VR) or augmented reality (XR) content based on those plans. Furthermore, it optimizes travel plans using user feedback and emotion data, and supports regional revitalization in collaboration with local governments and travel agencies through the generation of effective promotional content.

[0692] Program processing

[0693] 1. Receiving user input

[0694] First, the user uses the device interface to input travel requirements, such as the destination, travel period, budget, theme (e.g., hot springs, gourmet food), etc. The device converts this input data into an appropriate format and sends it to the server via the HTTPS protocol.

[0695] 2. Generate a travel plan

[0696] The server analyzes the received input data and saves it in a database. The server then parses the received data in JSON format and passes it to the generation AI engine. The generation AI engine generates the optimal travel plan for the user based on the tourist spots, accommodations, transportation, and restaurant information in the database. The generated travel plan is sent from the server to the device and presented to the user in an easy-to-read format.

[0697] 3. Providing simulated experiences

[0698] Next, the user selects to try out VR / XR content based on the generated travel plan. The user presses the play button for the VR / XR content on the device screen, and the device downloads the corresponding VR / XR content from the server. The device then provides the user with a virtual reality experience through a device such as a VR headset.

[0699] 4. Acquiring Emotion Data Using the Emotion Engine

[0700] During a user's VR / XR experience, the emotion engine recognizes the user's emotions in real time and collects data. The emotion engine uses facial recognition and voice analysis technology to measure the user's satisfaction, excitement, anxiety, etc.

[0701] 5. Optimize travel planning

[0702] Based on the emotion data obtained from the emotion engine, the server modifies or optimizes the travel plan in real time. For example, if it is determined that the user is particularly enjoying a certain tourist spot, the plan will be modified to extend the stay at that tourist spot. This allows the user to obtain a more satisfying travel plan.

[0703] 6. Receiving User Feedback

[0704] If a user wishes to make changes to their travel plan, they input the revised conditions into the device. For example, they input a specific request such as "raising the rank of accommodation." The device sends the new conditions to the server, which then runs the generation AI engine again to generate an optimized travel plan and send it to the device.

[0705] 7. Creation of promotional content and regional revitalization

[0706] The server works in conjunction with a generation AI to create promotional content for each tourist destination. Specifically, it collects information from a database of tourist destinations and generates promotional videos and images using AI technology. The generated promotional content is provided to local governments and travel agencies. Sharing the content through a dedicated API and dashboard effectively supports the promotion of tourist destinations. Local governments and travel agencies can use this content to promote tourism and attract more tourists.

[0707] Specific examples

[0708] 1. Receiving user input

[0709] The user types into the terminal, "I would like to go to Hokkaido in July for 3 nights and 4 days, with a budget of 100,000 yen or less, and enjoy the hot springs and gourmet food."

[0710] The terminal sends these conditions to the server.

[0711] 2. Generate a travel plan

[0712] Based on the conditions received by the server, the AI ​​engine generates a travel plan that takes into account "Hokkaido in July, 3 nights and 4 days, budget of 100,000 yen or less, hot springs and gourmet food."

[0713] The plan includes a stay at a hot spring inn in Sapporo, breakfast at the morning market in Hakodate, and a visit to the lavender fields in Furano.

[0714] Once the plan is generated, the server sends it to the terminal and displays it to the user.

[0715] 3. Providing simulated experiences

[0716] Users put on a VR headset on the device and virtually experience a hot spring inn in Sapporo or a morning market in Hakodate.

[0717] The device provides VR content, allowing users to experience the local atmosphere.

[0718] 4. Acquiring Emotion Data Using the Emotion Engine

[0719] During the user's VR experience, the emotion engine recognizes the user's emotions in real time and collects data such as joy, excitement, and anxiety.

[0720] The emotional data is sent to a server and used to adjust travel plans.

[0721] 5. Optimize travel planning

[0722] If it is determined based on the emotion data obtained from the emotion engine that the user is very satisfied with the hot spring inn, for example, the server modifies the plan to extend the stay at the hot spring inn.

[0723] The revised plan is sent to the user's terminal and presented to the user.

[0724] 6. Receiving User Feedback

[0725] If the user desires to choose a hot spring inn of a slightly higher rank, the user transmits the modified conditions from the terminal to the server.

[0726] The server again uses the generation AI engine to generate a new plan that includes a highly ranked hot spring inn.

[0727] The server sends the optimized travel plan to the terminal and displays it to the user.

[0728] 7. Creation of promotional content and regional revitalization

[0729] The server generates promotional content for "Furano's lavender fields and surrounding restaurants."

[0730] Local governments will publish this content on their official websites and social media to attract tourists.

[0731] In this way, the present invention provides users with personalized travel plans, utilizes emotional data to provide a more satisfying travel experience, and supports local governments and travel agencies in effectively promoting tourist destinations.

[0732] The processing flow will be explained below.

[0733] Step 1:

[0734] The user inputs travel conditions using the terminal interface, specifically, detailed conditions such as destination, travel period, budget, theme (e.g., hot springs, gourmet food), etc.

[0735] Step 2:

[0736] The terminal sends the entered data to the server, which converts the user's input data into an appropriate format and sends it to the server via the HTTPS protocol.

[0737] Step 3:

[0738] The server parses the received input data and saves it in the database.The server parses the received data in JSON format and saves it in the database.

[0739] Step 4:

[0740] The server calls the AI ​​engine to generate the optimal travel plan based on the input conditions. The AI ​​engine uses tourist attractions, accommodations, transportation options, and restaurant information in the database to create the optimal travel plan for the user.

[0741] Step 5:

[0742] The server sends the generated travel plan to the terminal and presents it to the user in an easy-to-read format. The terminal displays the travel plan to the user.

[0743] Step 6:

[0744] The user checks the generated travel plan and selects to try out the VR / XR content. The user presses the play button for the VR / XR content on the device screen.

[0745] Step 7:

[0746] The device downloads the corresponding VR / XR content from the server and displays it to the user, providing a virtual reality experience to the user through a device such as a VR headset.

[0747] Step 8:

[0748] As soon as a user begins their VR experience, the emotion engine collects their emotional data in real time, using facial recognition and voice analysis technology to measure their satisfaction and excitement.

[0749] Step 9:

[0750] The device transmits the acquired emotional data to a server, which is designed to update the data in real time.

[0751] Step 10:

[0752] The server analyzes the emotion data and optimizes the travel plan. For example, if it determines that the user is particularly satisfied with a particular tourist spot, it will modify the plan to extend the time spent at that spot.

[0753] Step 11:

[0754] The server sends the new optimized travel plan to the terminal and presents it to the user, and the terminal displays the new plan to the user.

[0755] Step 12:

[0756] If the user wishes to make further changes to the travel plan, they can input new conditions from the terminal and send them to the server. For example, they can add a preference such as "I want to improve the ranking of the restaurant."

[0757] Step 13:

[0758] The server runs the generation AI engine again to generate a travel plan based on the new conditions and sends it to the device, which then presents the new plan to the user.

[0759] Step 14:

[0760] The server works with local governments and travel agencies to generate promotional content for tourist destinations. The server collects information from a database of tourist destinations and uses AI technology to create promotional videos and images based on that information.

[0761] Step 15:

[0762] The server provides the generated promotional content to local governments and travel agencies, who share the content through a dedicated API and dashboard to help promote tourist destinations.

[0763] Step 16:

[0764] Local governments and travel agencies will use the provided promotional content to promote tourism, and will publish the content on their official websites and social media to attract tourists.

[0765] Example 2

[0766] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0767] Conventional travel planning systems struggle to consider users' individual preferences and real-time emotions, making it difficult to provide highly satisfying travel plans. Furthermore, they lacked the ability to utilize virtual reality and augmented reality content, leaving users with limited means to provide pre-travel experiences. Furthermore, local governments and travel agencies had limited means to generate and provide effective promotional content, preventing them from fully leveraging the appeal of tourist destinations.

[0768] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0769] In this invention, the server includes means for using generative AI technology to generate a travel plan, means for providing virtual reality or augmented reality content based on the generated travel plan, means for acquiring emotional data using an emotion engine during the user's virtual experience, means for optimizing the travel plan based on the acquired emotional data, means for modifying the travel plan based on user feedback, and means for creating and providing promotional content for tourist destinations in cooperation with local governments and travel agencies. This allows users to experience travel in advance through travel plans based on their individual preferences and virtual experiences, and further allows local governments and travel agencies to efficiently communicate the appeal of tourist destinations by utilizing effective promotional content.

[0770] "Generative AI technology" is a technology that uses artificial intelligence to automatically generate travel plans based on user input information.

[0771] "Virtual reality content" is content that allows users to experience real environments and situations in a virtual space using special headsets or devices.

[0772] "Augmented reality content" is content provided using technology that overlays digital information onto real-world images.

[0773] The "emotion engine" uses facial recognition and voice analysis technology to recognize the user's emotions in real time and analyze the data.

[0774] "Feedback" refers to information such as opinions and requests provided by users after using the system.

[0775] A "local government" is a local public body responsible for the administration of a particular area.

[0776] A "travel agency" is a business that plans and sells travel products.

[0777] "Promotional content" refers to digital content such as videos and images used to promote and publicize the attractions of tourist destinations and facilities.

[0778] "User input" refers to information such as travel requirements that a user provides to the system.

[0779] A "VR headset" is a device worn by a user to experience virtual reality.

[0780] A "server" is a computer system that receives and processes requests from users and provides the required services.

[0781] This system uses generative AI technology and an emotion engine to provide users with personalized travel plans and virtual reality (VR) or augmented reality (XR) content based on those plans. The system also uses user feedback and emotion data to optimize travel plans and collaborate with local governments and travel agencies to generate effective promotional content, thereby supporting regional revitalization.

[0782] Receiving User Input

[0783] First, the user inputs the travel conditions using the device interface. This includes detailed settings such as destination, travel period, budget, and theme (e.g., hot springs, gourmet food). For example, the user might input, "I want to go to Hokkaido in July for three nights and four days, with a budget of less than 100,000 yen, to enjoy hot springs and gourmet food." The device converts this information into JSON format and sends it to the server via the HTTPS protocol.

[0784] Generate a travel plan

[0785] The server receives the user's input data, analyzes it, and saves it in a database. The received data is parsed in JSON format and passed to the generation AI engine. The generation AI engine generates the optimal travel plan for the user based on data such as tourist attractions, accommodation, transportation, and restaurant information. For example, the generated plan might include a hot spring inn in Sapporo, breakfast at the morning market in Hakodate, and a visit to the lavender fields in Furano. The generated travel plan is sent from the server to the device and presented to the user in an easy-to-read format.

[0786] Providing simulated experiences

[0787] Users can try out VR / XR content based on the generated travel plan. When the user presses the play button for the VR / XR content on the device screen, the device downloads the corresponding VR / XR content from the server. Once the download is complete, the user puts on the VR headset and begins the virtual reality experience. This allows the user to experience the local atmosphere in a realistic way.

[0788] Acquiring emotional data using the emotion engine

[0789] During a user's VR / XR experience, the emotion engine recognizes the user's emotions in real time and collects data. The emotion engine uses facial recognition and voice analysis technology to measure the user's level of satisfaction, excitement, anxiety, etc., and sends that data to the server. For example, if a user smiles during their experience at a hot spring inn, it will be determined that they are highly satisfied.

[0790] Optimize travel planning

[0791] The server analyzes the emotion data obtained from the emotion engine and modifies or optimizes the travel plan in real time based on the results. For example, if it determines that the user particularly enjoyed a hot spring inn, the plan will be modified to extend the stay at the inn. The modified plan is sent from the server to the terminal and presented to the user.

[0792] Receiving feedback from users

[0793] If a user wishes to make changes to their travel plan, they can use their device to input new conditions. For example, they can input a specific request such as "raising the rank of the hot spring inn." The device then sends the new conditions to the server, which then runs the AI ​​engine again to generate an optimized travel plan that includes the new conditions. The generated plan is then sent back from the server to the device and displayed to the user.

[0794] Creation of promotional content and regional revitalization

[0795] The server works in conjunction with a generation AI to create promotional content for each tourist destination. Information is collected from a database of tourist destinations, and promotional videos and images are generated using the generation AI. The generated promotional content is provided to local governments and travel agencies. Sharing the content through a dedicated API and dashboard effectively supports the promotion of tourist destinations. Local governments and travel agencies use this content to promote tourism and attract more tourists. As a specific example, a promotional video with the theme of "Furano's lavender fields and surrounding restaurants" is created and posted on the local government's official website.

[0796] The system provides users with personalized travel plans, utilizes emotional data to provide a more satisfying travel experience, and supports local governments and travel agencies in effectively promoting tourist destinations.

[0797] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0798] Step 1:

[0799] Receiving User Input

[0800] The user inputs travel conditions using the device interface. Specifically, this includes detailed settings such as destination, travel period, budget, and theme (e.g., hot springs, gourmet food). For example, the user might input, "I would like to travel to Hokkaido in July for 3 nights and 4 days, with a budget of 100,000 yen or less, to enjoy hot springs and gourmet food." The device converts this information into JSON format and sends it to the server via the HTTPS protocol. The input data are travel conditions such as destination, period, and budget, which are converted into JSON format. The output data are travel conditions in JSON format.

[0801] Step 2:

[0802] Generate a travel plan

[0803] The server receives the user's input data, analyzes it, and saves it in a database. The server parses the received data in JSON format and passes it to the generative AI engine. The generative AI engine generates the optimal travel plan for the user based on the tourist spot, accommodation, transportation, and restaurant information in the database. The generative AI engine analyzes the input data and combines information about tourist spots and accommodation to create a personalized travel plan. For example, it might include a hot spring inn in Sapporo, breakfast at the morning market in Hakodate, and a visit to the lavender fields in Furano. The output data is the generated travel plan.

[0804] Step 3:

[0805] Presenting the generated travel plan

[0806] The server sends the generated itinerary to the terminal and presents it to the user in an easy-to-read format. Specifically, the itinerary is displayed on the terminal's display, allowing the user to check the contents of the plan. The input data is the generated itinerary, and the output data is the itinerary displayed in a format that the user can view.

[0807] Step 4:

[0808] Providing simulated experiences

[0809] Users can try out VR / XR content based on the generated travel plan. When the user presses the play button for the VR / XR content on the device screen, the device downloads the corresponding VR / XR content from the server. Once the download is complete, the user puts on the VR headset and begins the virtual reality experience. The input data is a request for VR / XR content based on the travel plan, and the output data is the downloaded VR / XR content.

[0810] Step 5:

[0811] Acquiring emotional data using the emotion engine

[0812] During a user's VR / XR experience, the emotion engine recognizes the user's emotions in real time and collects data. The emotion engine uses facial recognition and voice analysis technology to measure the user's level of satisfaction, excitement, anxiety, etc., and sends this data to the server. For example, if a user smiles while experiencing a hot spring inn, it is determined that the user is highly satisfied. The input data is the user's emotional expression (facial expression and tone of voice), and the output data is the analyzed emotional data.

[0813] Step 6:

[0814] Optimize your travel plans

[0815] The server analyzes the emotion data obtained from the emotion engine and modifies or optimizes the travel plan in real time based on the results. For example, if it determines that the user particularly enjoyed a hot spring inn, the plan is modified to extend the stay at the inn. The modified plan is sent from the server to the terminal and presented to the user. The input data are the emotion data and the original travel plan, and the output data is the optimized travel plan.

[0816] Step 7:

[0817] Receiving feedback from users

[0818] If a user wishes to make changes to their travel plan, they use their device to input new conditions. For example, they can input a specific request such as "raising the rank of the hot spring inn." The device then sends the new conditions to the server, which then runs the generation AI engine again to generate an optimized travel plan that includes the new conditions. The generated plan is then sent back from the server to the device and displayed to the user. The input data is the user's feedback, and the output data is the revised travel plan.

[0819] Step 8:

[0820] Creation of promotional content and regional revitalization

[0821] The server works with a generation AI to create promotional content for each tourist destination. Information is collected from a database of tourist destinations, and promotional videos and images are generated using the generation AI. The generated promotional content is provided to local governments and travel agencies. Sharing the content through a dedicated API and dashboard effectively supports the promotion of tourist destinations. Local governments and travel agencies use this content to promote tourism and attract more tourists. As a specific example, a promotional video with the theme of "Furano's lavender fields and surrounding restaurants" is created and posted on the local government's official website. The input data is information about the tourist destinations, and the output data is the generated promotional content.

[0822] (Application example 2)

[0823] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0824] Conventional travel plan creation systems have the problem of being unable to provide highly customized travel plans that reflect the individual needs and preferences of users. They also lack a means to optimize travel plans by incorporating users' feelings and feedback on the generated travel plans in real time. Furthermore, promotion of tourist destinations remains limited to standard methods, limiting their effectiveness in promoting regional revitalization. A new system is needed to resolve these issues, provide users with a more satisfying travel experience, and support tourism promotion by local governments and travel agencies.

[0825] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0826] In this invention, the server includes: a means for generating travel plans using generative AI technology; a means for providing virtual reality (VR) or augmented reality (XR) content based on the generated travel plans; a means for optimizing the travel plans based on user feedback; a means for acquiring user emotion data and further optimizing the travel plans based on the emotion data; a means for delivering personalized travel content to users via their smartphones; and a means for creating and providing promotional content for tourist destinations in collaboration with local governments and travel agencies. This enables the provision of highly customized travel plans tailored to individual needs and preferences, and enables the optimization of travel plans that reflect user emotion and feedback in real time. It also effectively supports promotional activities for tourist destinations, promoting regional revitalization.

[0827] "Generative AI technology" is a technology that uses artificial intelligence to automatically generate optimal travel plans based on user input data.

[0828] A "travel plan" is a plan that is generated based on the user's travel conditions and includes information on tourist spots, accommodations, transportation, restaurants, and the like.

[0829] "Virtual reality (VR) content" refers to visual and auditory content that allows users to experience destinations in a virtual space based on a generated travel plan.

[0830] "Augmented Reality (XR) Content" refers to content that provides an experience that blends physical reality and digital content based on a generated travel plan.

[0831] "User feedback" refers to opinions and corrections users provide regarding travel plans and VR / XR experiences.

[0832] "Emotional data" is data collected using facial recognition and voice analysis technology to capture the emotions users express during their travel plans and VR / XR experiences.

[0833] An "emotion engine" is a software or hardware system that recognizes a user's emotions in real time and acquires emotion data.

[0834] "Personalized travel content" refers to travel information and experience content that is optimized to suit a user's individual conditions and preferences.

[0835] "Local governments" are local governments that are responsible for local administration in each region and are the entities that carry out promotional activities for tourist destinations.

[0836] A "travel agency" is a company that creates travel plans, makes arrangements, and makes reservations.

[0837] "Promotional content" refers to media materials such as videos, images, and texts used to promote tourist destinations and travel plans.

[0838] The system embodying this invention includes means for generative AI technology, an emotion engine, a VR / XR content generation tool, receiving and processing user input, acquiring and analyzing emotion data, optimizing travel plans, and generating and distributing promotional content.

[0839] Example of running the system program:

[0840] Receiving User Input

[0841] The user inputs travel conditions (destination, travel period, budget, theme, etc.) using a smartphone application. This input data is converted into JSON format by the device and sent to the server via the HTTPS protocol.

[0842] Generate a travel plan

[0843] The server receives input data sent by the user and passes it to the generative AI engine. The generative AI engine uses this data and information on tourist spots and accommodations stored in the database to generate an optimal travel plan. This travel plan is then converted back to JSON format and sent to the device.

[0844] Providing virtual reality (VR) / augmented reality (XR) experiences

[0845] The device will download the VR / XR content from the server if the user checks the travel plan and selects a VR / XR experience. The user can then wear a smartphone or a compatible VR headset and enjoy the virtual experience.

[0846] Acquiring and analyzing emotion data

[0847] While the user is experiencing VR / XR, the device uses a camera and microphone to recognize the user's face and perform voice analysis, which allows the emotion engine to collect and analyze the user's emotional data (such as satisfaction, excitement, and anxiety) in real time. This data is then sent to the server.

[0848] Optimize your travel plans

[0849] The server receives the emotion data and uses a generative AI engine to optimize the travel plan. For example, if the user is enjoying a particular tourist spot, the plan will be revised to extend the time spent there.

[0850] Receiving and incorporating user feedback

[0851] If a user wants to modify their travel plan, they enter new conditions into the app. This data is also sent to the server, and the AI ​​engine regenerates the optimal plan. This new plan is sent to the device and displayed to the user.

[0852] Promotional content creation and distribution

[0853] The server works in conjunction with the generative AI to create promotional content for tourist destinations, which is then published on the websites and social media of local governments and travel agencies to be used in tourist attraction activities.

[0854] Specific examples

[0855] Receiving User Input

[0856] The user enters into the application, "I would like to spend 4 days and 3 nights in Tokyo in August, with a budget of 200,000 yen or less, enjoying museums and shopping," and sends this information to the server.

[0857] Generate a travel plan

[0858] Based on the data received by the server, the generative AI engine generates a travel plan that includes "visiting an art museum in Ueno, shopping in Ginza, and staying at a luxury hotel in Shinjuku."

[0859] Providing virtual reality (VR) / augmented reality (XR) experiences

[0860] Users can use the device to virtually experience Ueno Museum and Ginza Shopping Street, checking out the local atmosphere in advance.

[0861] Acquiring and analyzing emotion data

[0862] The device performs facial recognition and voice analysis of the user and transmits emotional data to the server.

[0863] Optimize your travel plans

[0864] Based on the emotion data, the server modifies the plan and presents the new plan to the user.

[0865] Prompt Sentence Examples

[0866] An example prompt for a generative AI model is:

[0867] Please provide data that will be helpful when generating your Tokyo travel plans. Please include information that meets the following tourist criteria:

[0868] Trip duration: 3 nights, 4 days

[0869] Destination: Tokyo

[0870] Budget: Under 200,000 yen

[0871] Main themes: Museums, Shopping

[0872] Recommended tourist spots, accommodations, and restaurant information

[0873] In this way, it becomes possible to provide travel plans tailored to the individual conditions and preferences of users, optimize travel plans in real time using emotional data, and effectively support tourism promotion by local governments.

[0874] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0875] Step 1:

[0876] The user uses a smartphone application to input travel requirements, including the destination, travel period, budget, and theme. This data is converted into JSON format by the device and sent to the server via the HTTPS protocol. Specifically, the user enters "3 nights and 4 days in Tokyo in August, budget of 200,000 yen or less, wanting to enjoy museums and shopping" into the app's form and presses the submit button.

[0877] Input: The travel requirements entered by the user into the app

[0878] Output: Trip conditions data converted to JSON format

[0879] Step 2:

[0880] The server receives travel requirement data in JSON format sent by the user. It analyzes the received data and passes it on to the generation AI engine. Based on this data, the generation AI engine generates the optimal travel plan by referencing tourist destinations, accommodations, transportation options, and restaurant information in the database.

[0881] Input: JSON format travel conditions data

[0882] Output: A travel plan generated by the generative AI engine

[0883] Step 3:

[0884] The server converts the generated itinerary into JSON format and sends it to the device via HTTPS. The device receives the itinerary and displays it in a user-friendly format. The user can then review the itinerary and choose the option for a virtual reality (VR) or augmented reality (XR) experience.

[0885] Input: Generated itinerary

[0886] Output: The itinerary displayed on the user's device

[0887] Step 4:

[0888] When a user selects a VR / XR experience on their device, the device downloads the corresponding VR / XR content from the server, and the device provides the user with a virtual reality experience through a smartphone app or a compatible VR headset. For example, a user can virtually experience the Ueno Museum or the Ginza Shopping District to get a feel for the local atmosphere.

[0889] Input: User-selected VR / XR experience options

[0890] Output: Download VR / XR content and provide a virtual reality experience to the user

[0891] Step 5:

[0892] The device uses a camera and microphone to recognize the user's face and perform voice analysis during the user's VR / XR experience. The emotion engine analyzes the user's emotional data (satisfaction, excitement, anxiety, etc.) based on the collected data and obtains emotional data in real time. This data is then sent from the device to the server.

[0893] Input: User's facial recognition data and voice data

[0894] Output: Analyzed user emotion data

[0895] Step 6:

[0896] The server analyzes the acquired emotion data and optimizes the travel plan using a generative AI engine. For example, if it determines that the user is having a great time at a particular tourist spot, it will modify the plan to extend the stay at that tourist spot. This modified plan is then converted back into JSON format and sent to the device.

[0897] Input: Parsed user emotion data

[0898] Output: Optimized itinerary

[0899] Step 7:

[0900] If a user wants to modify their travel plan (for example, "I want more luxurious accommodation"), they enter the new conditions into the app. The device sends this data to the server, which uses its generative AI engine to regenerate the optimal plan. This new plan is sent to the device and displayed to the user.

[0901] Input: New criteria re-entered by the user

[0902] Output: Regenerated itinerary

[0903] Step 8:

[0904] The server works in conjunction with AI technology to create promotional content for tourist destinations. The generated promotional content is provided to local governments and travel agencies. For example, the server generates a promotional video for the "Ueno Museum and its surrounding cafes," which the local government then publishes on its official website and social media.

[0905] Input: Tourist destination database information

[0906] Output: Generated promotional content

[0907] In this way, users can receive travel plans tailored to their individual requirements and preferences, and their travel plans can be optimized by acquiring real-time emotional data. This also effectively supports promotional activities for tourist destinations.

[0908] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0909] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0910] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0911] [Third embodiment]

[0912] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0913] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0914] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0915] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0916] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0917] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0918] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0919] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0920] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0921] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0922] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0923] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0924] This invention is a system that uses generative AI technology to generate travel plans and provide VR or XR content based on them. This system allows users to input their travel requirements, virtually experience the generated plan in advance, and obtain an optimized travel plan based on that. It also generates promotional content for tourist destinations and supports regional revitalization in cooperation with local governments and travel agencies.

[0925] Program processing

[0926] 1. Receiving user input

[0927] 1. The user uses the device interface to input travel conditions, such as the destination, travel period, budget, and theme (e.g., hot springs, gourmet food).

[0928] 2. The terminal sends the entered data to the server. The terminal converts the entered data into the appropriate format and sends it to the server using the HTTPS protocol.

[0929] 2. Generate a travel plan

[0930] 1. The server parses the received input data and stores it in the database. The server parses the received data in JSON format and stores it in the database.

[0931] 2. The server calls a specialized AI engine to generate the optimal travel plan based on the input criteria. The AI ​​engine automatically creates the optimal travel plan for the user using tourist attractions, accommodations, transportation options, and restaurant information in the database.

[0932] 3. The server sends the generated travel plan to the terminal and presents it to the user in an easy-to-read format.

[0933] 3. Providing simulated experiences

[0934] 1. The user tries out the VR / XR content based on the generated travel plan. Specifically, the user selects playback of the VR / XR content on the device screen.

[0935] 2. The device downloads the corresponding VR / XR content from the server and displays it to the user, providing a virtual reality experience to the user through a device such as a VR headset.

[0936] 4. Optimizing travel planning

[0937] 1. If the user wishes to make changes to the travel plan, they input the revised conditions into the terminal. For example, they input a request to upgrade the rank of the accommodation.

[0938] 2. The device sends the new conditions to the server.

[0939] 3. The server runs the generation AI engine again based on the revised conditions, generates an optimized travel plan, and sends it to the device.

[0940] 4. The user reviews the revised and optimized travel plan and decides on the final plan.

[0941] 5. Creation of promotional content and regional revitalization

[0942] 1. The server creates promotional content for each tourist destination in collaboration with the AI. Specifically, it collects information from a database of tourist destinations and generates promotional videos and images using AI technology.

[0943] 2. The server provides the generated promotional content to local governments and travel agencies, sharing the content through dedicated APIs and dashboards to help promote tourist destinations.

[0944] 3. Local governments and travel agencies can use this content to efficiently promote tourism and attract tourists.

[0945] Specific examples

[0946] 1. Receiving user input

[0947] The user types into the terminal, "I would like to go to Hokkaido in July for 3 nights and 4 days, with a budget of 100,000 yen or less, and enjoy the hot springs and gourmet food."

[0948] The terminal sends these conditions to the server.

[0949] 2. Generate a travel plan

[0950] Based on the conditions received by the server, the AI ​​engine generates a travel plan that matches the conditions, such as "Hokkaido in July, 3 nights and 4 days, budget within 100,000 yen, hot springs and gourmet food."

[0951] The plan includes a stay at a hot spring inn in Sapporo, breakfast at the morning market in Hakodate, and a visit to the lavender fields in Furano.

[0952] Once the plan is generated, the server sends it to the terminal and displays it to the user.

[0953] 3. Providing simulated experiences

[0954] Users put on a VR headset on the device and virtually experience a hot spring inn in Sapporo or a morning market in Hakodate.

[0955] The device provides VR content, allowing users to experience the local atmosphere.

[0956] 4. Optimizing travel planning

[0957] If the user wishes to change the hot spring inn to one with a slightly higher rank, the user transmits the modified conditions from the terminal to the server.

[0958] The server again uses the generation AI engine to generate a new plan that includes a higher-ranked hot spring inn.

[0959] The server sends the optimized travel plan to the terminal and displays it to the user.

[0960] 5. Creation of promotional content and regional revitalization

[0961] The server generates promotional content for "Furano's lavender fields and surrounding restaurants."

[0962] Local governments will publish this content on their official websites and social media to attract tourists.

[0963] In this way, the present invention provides users with personalized travel plans and enables them to have a trouble-free trip through a virtual experience. It also enables local governments and travel agencies to promote tourist destinations efficiently, contributing to regional revitalization.

[0964] The processing flow will be explained below.

[0965] Step 1:

[0966] The user inputs travel conditions using the terminal interface, specifically, detailed conditions such as destination, travel period, budget, theme (e.g., hot springs, gourmet food), etc.

[0967] Step 2:

[0968] The terminal sends the input data to the server, which converts the input data into an appropriate format and sends it to the server via the HTTPS protocol.

[0969] Step 3:

[0970] The server parses the received input data and saves it in the database.The server parses the received data in JSON format and saves it in the database.

[0971] Step 4:

[0972] The server calls the AI ​​engine to generate the optimal travel plan based on the input conditions. The AI ​​engine uses tourist attractions, accommodations, transportation options, and restaurant information in the database to create the optimal travel plan for the user.

[0973] Step 5:

[0974] The server transmits the generated travel plan to the terminal and presents it to the user in an easy-to-view format.

[0975] Step 6:

[0976] The user checks the generated travel plan and selects to try out the VR / XR content. The user presses the play button for the VR / XR content on the device screen.

[0977] Step 7:

[0978] The device downloads the corresponding VR / XR content from the server and displays it to the user, providing a virtual reality experience to the user through a device such as a VR headset.

[0979] Step 8:

[0980] If the user wishes to modify the travel plan, he or she inputs the modified conditions into the terminal, such as a preference to upgrade the rank of accommodation.

[0981] Step 9:

[0982] The terminal sends the new conditions to the server. The terminal converts the modified conditions into the appropriate format and sends them to the server.

[0983] Step 10:

[0984] The server runs the generation AI engine again based on the revised conditions to generate an optimized travel plan. The generation AI engine analyzes the conditions again and generates a new travel plan.

[0985] Step 11:

[0986] The server sends the optimized travel plan to the terminal and presents it to the user, who then reviews the final travel plan and makes a final decision if necessary.

[0987] Step 12:

[0988] The server works with local governments and travel agencies to generate promotional content for tourist destinations. The server collects information from a database of tourist destinations and uses AI technology to create promotional videos and images.

[0989] Step 13:

[0990] The server provides the generated promotional content to local governments and travel agencies, who share the content through a dedicated API and dashboard to help promote tourist destinations.

[0991] Step 14:

[0992] Local governments and travel agencies will use the provided promotional content to promote tourism, and will post it on their official websites and social media to attract more tourists.

[0993] Example 1

[0994] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0995] Conventional travel plan generation systems have limited ability to provide users with personalized travel plans. Furthermore, they do not readily provide virtual reality (VR) or augmented reality (XR) experiences based on the generated travel plans, making it less convenient for users to consider their travel plans in advance. Furthermore, they lacked a sufficient mechanism for efficiently creating promotional content for tourist destinations and supporting regional revitalization through collaboration with local governments and travel agencies. These issues need to be resolved.

[0996] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0997] In this invention, the server includes: a means for a user to input travel requirements; a means for the terminal to convert the input data into an appropriate data format and send it to the server; a means for the server to analyze the received data and store it in a database; a means for the server to automatically generate a travel plan based on the input requirements using a generation AI engine; a means for the server to send the generated travel plan to the terminal and present it to the user in an easy-to-view format; a means for the user to try VR or XR content based on the travel plan; a means for the terminal to download corresponding VR or XR content from the server and display it to the user; a means for the user to input modifications to the travel plan and for the terminal to send the new conditions to the server; a means for the server to re-operate the generation AI engine based on the modified conditions and generate an optimized travel plan; and a means for the server to generate promotional content for tourist destinations and provide it to local governments and travel agencies. This enables the provision of personalized travel plans to users, advance travel planning through virtual experiences, and efficient tourist destination promotion through collaboration with local governments and travel agencies.

[0998] "User" refers to a person who uses the system to input travel conditions in order to create, modify, or experience a travel plan.

[0999] "Terminal" refers to the device used by a user to input travel requirements and experience virtual reality (VR) and augmented reality (XR) content.

[1000] "Server" refers to the central computing resource of the system that receives and analyzes data sent by users and automatically generates travel plans using a generative AI engine.

[1001] "Generative AI engine" refers to artificial intelligence technology for generating optimal travel plans based on input conditions.

[1002] "Database" refers to the system that structures and stores the received data and holds the information that the Generative AI Engine references when generating travel plans.

[1003] "Travel conditions" refers to detailed information such as the travel destination, duration, budget, and theme entered by the user.

[1004] "Travel plan" refers to a detailed plan including tourist attractions, accommodation, transportation, restaurant information, etc., that is automatically generated by the AI ​​engine based on the travel conditions entered by the user.

[1005] "Virtual reality (VR) content" refers to digital content that allows users to virtually experience a trip in advance based on their travel plans.

[1006] "Augmented reality (XR) content" refers to digital content that combines virtual reality with real-world scenery and objects.

[1007] "Promotional content" refers to promotional materials such as videos and images created using a generative AI engine to convey the attractions of a tourist destination.

[1008] "Local government" refers to a local public body with the autonomy to carry out tourism destination promotion activities.

[1009] "Travel agency" refers to a company that creates and sells travel plans and provides travel services to customers.

[1010] "Feedback" refers to any corrections or requests for improvements made by a user to a provided travel plan.

[1011] "Optimization" refers to the process by which the generative AI engine regenerates and improves travel plans based on user feedback and new conditions.

[1012] This invention is a system that uses generative AI technology to generate travel plans and provide virtual reality (VR) or augmented reality (XR) content based on those plans. This system allows users to input their travel requirements, virtually experience the generated plan in advance, and obtain an optimized travel plan based on that. It also generates promotional content for tourist destinations and supports regional revitalization in cooperation with local governments and travel agencies.

[1013] This system consists of a terminal that provides an interface for users to input travel conditions, a server that receives and analyzes the input data and generates and optimizes travel plans using a generative AI engine, a means to present the generated travel plans to users, and a means to play VR / XR content to provide a virtual experience.

[1014] First, the user inputs the travel conditions using the terminal interface. These include the destination, travel period, budget, theme (e.g., hot springs, gourmet food), etc. For example, the user might input "I'd like to go to Hokkaido in July for 3 nights and 4 days, with a budget of 100,000 yen or less, and enjoy hot springs and gourmet food." The terminal converts the input data into an appropriate data format (e.g., JSON format) and sends it to the server using the HTTPS protocol.

[1015] The server parses the received data in JSON format and stores it in a database as structured information. The server then calls a generative AI engine to automatically generate the optimal travel plan for the user. The generative AI engine integrates tourist spots, accommodation, transportation, and restaurant information from the database to create a travel plan that meets the user's requirements. For example, it might generate a plan such as "Stay at a hot spring inn in Sapporo, have breakfast at the morning market in Hakodate, and visit the lavender fields in Furano."

[1016] The generated travel plan is then sent to the device and displayed to the user. The user can review the plan and try out further virtual experiences. The device then downloads the corresponding VR or XR content from the server and displays it to the user. The user then puts on a VR headset and can virtually experience, for example, a hot spring inn in Sapporo or a morning market in Hakodate.

[1017] If a user wishes to modify their travel plan, for example, to choose a higher-ranking hot spring inn, they send the modified conditions from their device to the server. The server then uses the generation AI engine again to generate a new plan based on the modified conditions. The modified plan is then sent back to the device and presented to the user.

[1018] The server then generates promotional content for tourist destinations. It collects information from a database of tourist destinations and uses a generative AI engine to create promotional videos and images. For example, promotional content for "Furano's lavender fields and surrounding restaurants" is generated. This content is provided to local governments and travel agencies via APIs and dashboards, enabling efficient promotion of tourist destinations.

[1019] As described above, the present invention provides users with personalized travel plans, allows them to consider travel plans in advance through virtual experiences, and enables efficient promotion of tourist destinations through collaboration with local governments and travel agencies.

[1020] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1021] Step 1: Receiving User Input

[1022] 1. Input: The user inputs travel conditions (destination, travel period, budget, theme, etc.) into the terminal interface.

[1023] 2. Data processing: The terminal converts the input data into JSON format.

[1024] 3. Output: Send the converted JSON data to the server.

[1025] 4. Specific operation: The user enters into the device interface, "I would like to go to Hokkaido in July for 3 nights and 4 days, with a budget of 100,000 yen or less, and enjoy hot springs and gourmet food," and the device sends the JSON data "{ "destination": "Hokkaido", "duration": "3 nights and 4 days", "budget": "100,000 yen", "theme": "Hot springs, gourmet food"}" to the server.

[1026] Step 2: Generate a travel plan

[1027] 1. Input: JSON format travel condition data is sent to the server.

[1028] 2. Data analysis and storage: The server parses the received data in JSON format and stores it in a database as structured information.

[1029] 3. Data calculation: The server calls the AI ​​engine and generates the optimal travel plan based on the information in the database.

[1030] 4. Output: The generated travel plan is sent to the terminal.

[1031] 5. Specific operation: The server analyzes the data "{ "destination": "Hokkaido", "duration": "3 nights and 4 days", "budget": "100,000 yen", "theme": "hot springs, gourmet"}" and saves it in the database as "Destination: Hokkaido, Duration: 3 nights and 4 days, Budget: 100,000 yen, Theme: hot springs, gourmet." The generation AI engine then generates a travel plan such as "Stay at a hot spring inn in Sapporo, have breakfast at the morning market in Hakodate, and visit the lavender fields in Furano," and sends it to the device.

[1032] Step 3: Present your travel plans

[1033] 1. Input: The generated travel plan data is sent to the terminal.

[1034] 2. Data display: The terminal displays the travel plan received in an easy-to-read format for the user.

[1035] 3. Output: The user confirms the generated itinerary.

[1036] 4. Specific operation: The device displays a travel plan on the screen, such as "Day 1: Stay at a hot spring inn in Sapporo, Day 2: Breakfast at the morning market in Hakodate, Day 3: Visit the lavender fields in Furano," and the user confirms it.

[1037] Step 4: Providing VR / XR content

[1038] 1. Input: The user selects to play VR or XR content.

[1039] 2. Content download: The device downloads compatible VR or XR content from the server.

[1040] 3. Data display: The device displays the downloaded content to the user.

[1041] 4. Output: The user has a virtual reality experience.

[1042] 5. Specific operation: The user clicks the "Experience VR" button, and the device downloads VR content of a hot spring inn in Sapporo and a morning market in Hakodate from the server, providing the user with a virtual experience through the VR headset.

[1043] Step 5: Optimize your travel plans

[1044] 1. Input: The user inputs a modification to the travel plan (for example, upgrading the accommodation) into the terminal.

[1045] 2. Data transmission: The terminal transmits the modified conditions to the server.

[1046] 3. Data reanalysis and generation: The server calls the generation AI engine again based on the revised conditions to generate an optimized travel plan.

[1047] 4. Output: The new itinerary is sent to the device.

[1048] 5. Specific operation: The user enters into the device, "I would like to change the hot spring inn to one with a higher rank," and the device sends the modified data "{ "accommodation_rank": "luxury"}" to the server. The server then runs the generation AI engine again, generates a new plan that includes a hot spring inn with a higher rank, and sends it to the device.

[1049] Step 6: Create and deliver promotional content

[1050] 1. Input: The server obtains information from the tourist destination database.

[1051] 2. Data collection and generation: The server uses a generation AI engine to generate promotional videos and images.

[1052] 3. Data provision: Providing the generated promotional content to local governments and travel agencies.

[1053] 4. Output: Local governments and travel agencies will use the content to promote tourism.

[1054] 5. Specific operation: The server collects information about "Furano's lavender fields and surrounding restaurants" from a tourist destination database, and generates a promotional video using a generative AI engine. The generated content is provided to local governments and travel agencies via APIs and dashboards, and is then published on social media and official websites.

[1055] (Application example 1)

[1056] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1057] Modern travel planning is complex, and creating an optimal itinerary requires collecting, analyzing, and planning a large amount of information. Furthermore, there are limited ways to experience and confirm travel plans in advance, which can lead to disappointments during the actual trip. It also takes time and money for local governments and travel agencies to create content to effectively promote tourist destinations. Therefore, there is a need for a system that provides users with a quick and easy way to create and experience travel plans in advance, as well as effectively create promotional content for tourist destinations.

[1058] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1059] In this invention, the server includes means for generating a travel plan using generative AI technology, means for providing virtual reality (VR) or augmented reality (XR) content based on the generated travel plan, and means for optimizing the travel plan based on user feedback. This allows users to obtain an optimal travel plan at the planning stage, reduces disappointment in the actual trip by having a virtual experience in advance through VR / XR content, and enables local governments and travel agencies to efficiently create effective promotional content.

[1060] "Generative AI technology" is an artificial intelligence technology that automatically generates travel plans and content based on conditions specified by the user.

[1061] A "travel plan" is a plan such as an itinerary or a list of tourist attractions created based on the user's wishes and conditions.

[1062] "Virtual reality (VR) content" is digital content that uses computer technology to allow users to experience virtual spaces that do not exist in reality.

[1063] "Augmented reality (XR) content" refers to content that uses technology to overlay digital information on the real world, including virtual reality (VR) and other augmented reality technologies.

[1064] "Feedback from users" refers to information such as opinions, requests, and corrections provided by users.

[1065] "Optimization" is the process of adjusting the itinerary to suit your needs based on user feedback and additional requirements.

[1066] A "local government" is an administrative body that governs a specific region and is responsible for promoting tourist destinations, etc.

[1067] A "travel agency" is a business that provides travel-related services and information, and creates and arranges travel plans.

[1068] "Promotional content" is any digital content, such as videos, images or text, created to promote a tourist destination or a particular service.

[1069] A "smartphone" is a multi-functional mobile device that can connect to the Internet and install applications in addition to the functions of a mobile phone.

[1070] A "terminal interface" is an interface such as a graphical user interface or command input that allows a user to operate a terminal.

[1071] A "server" is a computer system connected to a network that processes requests from multiple users.

[1072] "Received data" refers to information and conditions entered by the user and is data that is analyzed by the server.

[1073] A "VR headset" is a device worn by users to experience a virtual reality space visually and aurally.

[1074] The system of the present invention generates a travel plan using generative AI technology and provides virtual reality (VR) or augmented reality (XR) content based on the generated travel plan. A specific embodiment of this system is described below.

[1075] Hardware and software used

[1076] Smartphone: Used for user input, travel plans, and VR / XR content display.

[1077] Server: Data analysis, calling the generative AI engine, generating and managing travel plans.

[1078] Generative AI engine: Artificial intelligence that creates travel plans and promotional content based on user criteria.

[1079] VR headset: A device that allows users to experience virtual reality.

[1080] System Features

[1081] 1. Receiving user input

[1082] The user inputs travel conditions using a smartphone. For example, specific information such as "destination," "travel period," "budget," and "travel theme" is set. This input information is sent from the smartphone to the server using the HTTPS protocol.

[1083] 2. Generate a travel plan

[1084] The server analyzes the received data and parses it in JSON format. It then invokes the AI ​​engine to generate an optimal travel plan based on the user's settings. The generated plan is then sent from the server to the smartphone and presented to the user.

[1085] 3. Providing simulated experiences

[1086] When a user selects VR / XR content based on the generated travel plan, the content starts playing on the device screen. When the smartphone is connected to a VR headset, the corresponding VR content is downloaded, providing the user with a virtual reality experience. This virtual reality experience enhances user interaction and reduces the risks and frustrations that may occur during real travel.

[1087] 4. Optimizing travel planning

[1088] If the user wishes to make changes to their travel plan, they can resubmit the revised conditions from their smartphone to the server. The server will then run the AI ​​engine based on the new conditions to generate an optimized travel plan. The final plan will be presented to the user for approval.

[1089] 5. Creation and provision of promotional content

[1090] The server uses a generative AI engine to generate effective promotional content (videos, images, etc.) based on a database of tourist destinations. This content is provided to local governments and travel agencies to help them attract tourists. The content is shared through a dedicated API and dashboard, allowing for efficient promotion of tourist destinations.

[1091] Specific examples

[1092] For example, if a user inputs "I want to go to Hokkaido in July for three nights and four days, with a budget of less than 100,000 yen, and enjoy hot springs and gourmet food," the server analyzes the received conditions, and the generative AI engine generates the optimal travel plan. This plan might include a hot spring inn in Sapporo, breakfast at the morning market in Hakodate, and a visit to the lavender fields in Furano. The generated plan is sent to a smartphone, and the user can wear a VR headset and virtually experience it in advance.

[1093] Prompt Sentence Examples

[1094] "Please generate a 3-night, 4-day itinerary for Hokkaido in July. I would like to enjoy hot springs and gourmet food within a budget of 100,000 yen."

[1095] In this way, the system of the present invention provides users with personalized travel plans and enables trouble-free travel through a virtual reality experience. It also enables local governments and travel agencies to promote tourist destinations efficiently, contributing to regional revitalization.

[1096] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1097] Step 1:

[1098] The user inputs travel conditions using a smartphone, specifically setting items such as the travel destination, travel period, budget, and travel theme. The input data is parsed in JSON format and sent to the server using the HTTPS protocol.

[1099] Input: Travel destination, travel period, budget, travel theme

[1100] Output: JSON format travel condition data

[1101] Step 2:

[1102] The server analyzes the received JSON-formatted travel condition data. This allows each condition to be recognized and classified as an individual parameter. The analyzed data is then converted into a format that is easy for the generative AI engine to handle.

[1103] Input: JSON format travel conditions data

[1104] Output: Analyzed travel condition parameters

[1105] Step 3:

[1106] The server calls the AI ​​engine to generate an optimal travel plan based on the analyzed travel condition parameters. The AI ​​engine then references a database of tourist spots, accommodations, restaurants, etc. to create an optimal plan that meets the conditions.

[1107] Input: Travel condition parameters

[1108] Data processing: Reference to databases of tourist attractions, accommodations, and restaurants

[1109] Output: Generated itinerary

[1110] Step 4:

[1111] The server sends the generated itinerary to the smartphone and presents it to the user, who can then check each element of the itinerary (e.g., places to visit, accommodation, places to eat, etc.).

[1112] Input: Generated itinerary

[1113] Output: The itinerary presented to the user

[1114] Step 5:

[1115] When a user wants to try out VR / XR content based on the generated travel plan, they select to play the VR content on their smartphone screen. The smartphone downloads the VR content from the server, and the user puts on a VR headset to experience the virtual reality experience.

[1116] Input: Generated travel plan, selection to play VR content

[1117] Data processing: VR content download

[1118] Output: Virtual reality experience

[1119] Step 6:

[1120] If a user wishes to make changes to their travel plan, they can enter the changes on their smartphone and send them to the server. For example, they can include specific requests such as "I want to upgrade the rank of the accommodation." The server then runs the AI ​​engine again based on the new conditions to generate an optimized travel plan.

[1121] Input: Modified conditions, New conditions

[1122] Data processing: Re-running the generative AI engine

[1123] Output: Optimized itinerary

[1124] Step 7:

[1125] The server sends the optimized travel plan to the smartphone and presents it to the user, who can then review the revised plan and make a final decision.

[1126] Input: Optimized itinerary

[1127] Output: The optimized itinerary presented to the user

[1128] Step 8:

[1129] The server uses a generation AI engine to create promotional content for tourist destinations. It collects information from a database of tourist destinations and generates promotional videos and images. This content is provided to local governments and travel agencies for use in tourism promotion activities.

[1130] Input: tourist destination data, generative AI engine

[1131] Data processing: Promoting videos and images

[1132] Output: Generated promotional content

[1133] The above are the processing steps of the system that realizes the application example of the present invention, which not only allows users to easily create travel plans and prepare for their trips through virtual reality experiences, but also enables local governments and travel agencies to efficiently promote tourist destinations.

[1134] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1135] This system combines generative AI technology with an emotion engine to provide users with personalized travel plans and virtual reality (VR) or augmented reality (XR) content based on those plans. Furthermore, it optimizes travel plans using user feedback and emotion data, and supports regional revitalization in collaboration with local governments and travel agencies through the generation of effective promotional content.

[1136] Program processing

[1137] 1. Receiving user input

[1138] First, the user uses the device interface to input travel requirements, such as the destination, travel period, budget, theme (e.g., hot springs, gourmet food), etc. The device converts this input data into an appropriate format and sends it to the server via the HTTPS protocol.

[1139] 2. Generate a travel plan

[1140] The server analyzes the received input data and saves it in a database. The server then parses the received data in JSON format and passes it to the generation AI engine. The generation AI engine generates the optimal travel plan for the user based on the tourist spots, accommodations, transportation, and restaurant information in the database. The generated travel plan is sent from the server to the device and presented to the user in an easy-to-read format.

[1141] 3. Providing simulated experiences

[1142] Next, the user selects to try out VR / XR content based on the generated travel plan. The user presses the play button for the VR / XR content on the device screen, and the device downloads the corresponding VR / XR content from the server. The device then provides the user with a virtual reality experience through a device such as a VR headset.

[1143] 4. Acquiring Emotion Data Using the Emotion Engine

[1144] During a user's VR / XR experience, the emotion engine recognizes the user's emotions in real time and collects data. The emotion engine uses facial recognition and voice analysis technology to measure the user's satisfaction, excitement, anxiety, etc.

[1145] 5. Optimize travel planning

[1146] Based on the emotion data obtained from the emotion engine, the server modifies or optimizes the travel plan in real time. For example, if it is determined that the user is particularly enjoying a certain tourist spot, the plan will be modified to extend the stay at that tourist spot. This allows the user to obtain a more satisfying travel plan.

[1147] 6. Receiving User Feedback

[1148] If a user wishes to make changes to their travel plan, they input the revised conditions into the device. For example, they input a specific request such as "raising the rank of accommodation." The device sends the new conditions to the server, which then runs the generation AI engine again to generate an optimized travel plan and send it to the device.

[1149] 7. Creation of promotional content and regional revitalization

[1150] The server works in conjunction with a generation AI to create promotional content for each tourist destination. Specifically, it collects information from a database of tourist destinations and generates promotional videos and images using AI technology. The generated promotional content is provided to local governments and travel agencies. Sharing the content through a dedicated API and dashboard effectively supports the promotion of tourist destinations. Local governments and travel agencies can use this content to promote tourism and attract more tourists.

[1151] Specific examples

[1152] 1. Receiving user input

[1153] The user types into the terminal, "I would like to go to Hokkaido in July for 3 nights and 4 days, with a budget of 100,000 yen or less, and enjoy the hot springs and gourmet food."

[1154] The terminal sends these conditions to the server.

[1155] 2. Generate a travel plan

[1156] Based on the conditions received by the server, the AI ​​engine generates a travel plan that takes into account "Hokkaido in July, 3 nights and 4 days, budget of 100,000 yen or less, hot springs and gourmet food."

[1157] The plan includes a stay at a hot spring inn in Sapporo, breakfast at the morning market in Hakodate, and a visit to the lavender fields in Furano.

[1158] Once the plan is generated, the server sends it to the terminal and displays it to the user.

[1159] 3. Providing simulated experiences

[1160] Users put on a VR headset on the device and virtually experience a hot spring inn in Sapporo or a morning market in Hakodate.

[1161] The device provides VR content, allowing users to experience the local atmosphere.

[1162] 4. Acquiring Emotion Data Using the Emotion Engine

[1163] During the user's VR experience, the emotion engine recognizes the user's emotions in real time and collects data such as joy, excitement, and anxiety.

[1164] The emotional data is sent to a server and used to adjust travel plans.

[1165] 5. Optimize travel planning

[1166] If it is determined based on the emotion data obtained from the emotion engine that the user is very satisfied with the hot spring inn, for example, the server modifies the plan to extend the stay at the hot spring inn.

[1167] The revised plan is sent to the user's terminal and presented to the user.

[1168] 6. Receiving User Feedback

[1169] If the user desires to choose a hot spring inn of a slightly higher rank, the user transmits the modified conditions from the terminal to the server.

[1170] The server again uses the generation AI engine to generate a new plan that includes a highly ranked hot spring inn.

[1171] The server sends the optimized travel plan to the terminal and displays it to the user.

[1172] 7. Creation of promotional content and regional revitalization

[1173] The server generates promotional content for "Furano's lavender fields and surrounding restaurants."

[1174] Local governments will publish this content on their official websites and social media to attract tourists.

[1175] In this way, the present invention provides users with personalized travel plans, utilizes emotional data to provide a more satisfying travel experience, and supports local governments and travel agencies in effectively promoting tourist destinations.

[1176] The processing flow will be explained below.

[1177] Step 1:

[1178] The user inputs travel conditions using the terminal interface, specifically, detailed conditions such as destination, travel period, budget, theme (e.g., hot springs, gourmet food), etc.

[1179] Step 2:

[1180] The terminal sends the entered data to the server, which converts the user's input data into an appropriate format and sends it to the server via the HTTPS protocol.

[1181] Step 3:

[1182] The server parses the received input data and saves it in the database.The server parses the received data in JSON format and saves it in the database.

[1183] Step 4:

[1184] The server calls the AI ​​engine to generate the optimal travel plan based on the input conditions. The AI ​​engine uses tourist attractions, accommodations, transportation options, and restaurant information in the database to create the optimal travel plan for the user.

[1185] Step 5:

[1186] The server sends the generated travel plan to the terminal and presents it to the user in an easy-to-read format. The terminal displays the travel plan to the user.

[1187] Step 6:

[1188] The user checks the generated travel plan and selects to try out the VR / XR content. The user presses the play button for the VR / XR content on the device screen.

[1189] Step 7:

[1190] The device downloads the corresponding VR / XR content from the server and displays it to the user, providing a virtual reality experience to the user through a device such as a VR headset.

[1191] Step 8:

[1192] As soon as a user begins their VR experience, the emotion engine collects their emotional data in real time, using facial recognition and voice analysis technology to measure their satisfaction and excitement.

[1193] Step 9:

[1194] The device transmits the acquired emotional data to a server, which is designed to update the data in real time.

[1195] Step 10:

[1196] The server analyzes the emotion data and optimizes the travel plan. For example, if it determines that the user is particularly satisfied with a particular tourist spot, it will modify the plan to extend the time spent at that spot.

[1197] Step 11:

[1198] The server sends the new optimized travel plan to the terminal and presents it to the user, and the terminal displays the new plan to the user.

[1199] Step 12:

[1200] If the user wishes to make further changes to the travel plan, they can input new conditions from the terminal and send them to the server. For example, they can add a preference such as "I want to improve the ranking of the restaurant."

[1201] Step 13:

[1202] The server runs the generation AI engine again to generate a travel plan based on the new conditions and sends it to the device, which then presents the new plan to the user.

[1203] Step 14:

[1204] The server works with local governments and travel agencies to generate promotional content for tourist destinations. The server collects information from a database of tourist destinations and uses AI technology to create promotional videos and images based on that information.

[1205] Step 15:

[1206] The server provides the generated promotional content to local governments and travel agencies, who share the content through a dedicated API and dashboard to help promote tourist destinations.

[1207] Step 16:

[1208] Local governments and travel agencies will use the provided promotional content to promote tourism, and will publish the content on their official websites and social media to attract tourists.

[1209] Example 2

[1210] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1211] Conventional travel planning systems struggle to consider users' individual preferences and real-time emotions, making it difficult to provide highly satisfying travel plans. Furthermore, they lacked the ability to utilize virtual reality and augmented reality content, leaving users with limited means to provide pre-travel experiences. Furthermore, local governments and travel agencies had limited means to generate and provide effective promotional content, preventing them from fully leveraging the appeal of tourist destinations.

[1212] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1213] In this invention, the server includes means for using generative AI technology to generate a travel plan, means for providing virtual reality or augmented reality content based on the generated travel plan, means for acquiring emotional data using an emotion engine during the user's virtual experience, means for optimizing the travel plan based on the acquired emotional data, means for modifying the travel plan based on user feedback, and means for creating and providing promotional content for tourist destinations in cooperation with local governments and travel agencies. This allows users to experience travel in advance through travel plans based on their individual preferences and virtual experiences, and further allows local governments and travel agencies to efficiently communicate the appeal of tourist destinations by utilizing effective promotional content.

[1214] "Generative AI technology" is a technology that uses artificial intelligence to automatically generate travel plans based on user input information.

[1215] "Virtual reality content" is content that allows users to experience real environments and situations in a virtual space using special headsets or devices.

[1216] "Augmented reality content" is content provided using technology that overlays digital information onto real-world images.

[1217] The "emotion engine" uses facial recognition and voice analysis technology to recognize the user's emotions in real time and analyze the data.

[1218] "Feedback" refers to information such as opinions and requests provided by users after using the system.

[1219] A "local government" is a local public body responsible for the administration of a particular area.

[1220] A "travel agency" is a business that plans and sells travel products.

[1221] "Promotional content" refers to digital content such as videos and images used to promote and publicize the attractions of tourist destinations and facilities.

[1222] "User input" refers to information such as travel requirements that a user provides to the system.

[1223] A "VR headset" is a device worn by a user to experience virtual reality.

[1224] A "server" is a computer system that receives and processes requests from users and provides the required services.

[1225] This system uses generative AI technology and an emotion engine to provide users with personalized travel plans and virtual reality (VR) or augmented reality (XR) content based on those plans. The system also uses user feedback and emotion data to optimize travel plans and collaborate with local governments and travel agencies to generate effective promotional content, thereby supporting regional revitalization.

[1226] Receiving User Input

[1227] First, the user inputs the travel conditions using the device interface. This includes detailed settings such as destination, travel period, budget, and theme (e.g., hot springs, gourmet food). For example, the user might input, "I want to go to Hokkaido in July for three nights and four days, with a budget of less than 100,000 yen, to enjoy hot springs and gourmet food." The device converts this information into JSON format and sends it to the server via the HTTPS protocol.

[1228] Generate a travel plan

[1229] The server receives the user's input data, analyzes it, and saves it in a database. The received data is parsed in JSON format and passed to the generation AI engine. The generation AI engine generates the optimal travel plan for the user based on data such as tourist attractions, accommodation, transportation, and restaurant information. For example, the generated plan might include a hot spring inn in Sapporo, breakfast at the morning market in Hakodate, and a visit to the lavender fields in Furano. The generated travel plan is sent from the server to the device and presented to the user in an easy-to-read format.

[1230] Providing simulated experiences

[1231] Users can try out VR / XR content based on the generated travel plan. When the user presses the play button for the VR / XR content on the device screen, the device downloads the corresponding VR / XR content from the server. Once the download is complete, the user puts on the VR headset and begins the virtual reality experience. This allows the user to experience the local atmosphere in a realistic way.

[1232] Acquiring emotional data using the emotion engine

[1233] During a user's VR / XR experience, the emotion engine recognizes the user's emotions in real time and collects data. The emotion engine uses facial recognition and voice analysis technology to measure the user's level of satisfaction, excitement, anxiety, etc., and sends that data to the server. For example, if a user smiles during their experience at a hot spring inn, it will be determined that they are highly satisfied.

[1234] Optimize travel planning

[1235] The server analyzes the emotion data obtained from the emotion engine and modifies or optimizes the travel plan in real time based on the results. For example, if it determines that the user particularly enjoyed a hot spring inn, the plan will be modified to extend the stay at the inn. The modified plan is sent from the server to the terminal and presented to the user.

[1236] Receiving feedback from users

[1237] If a user wishes to make changes to their travel plan, they can use their device to input new conditions. For example, they can input a specific request such as "raising the rank of the hot spring inn." The device then sends the new conditions to the server, which then runs the AI ​​engine again to generate an optimized travel plan that includes the new conditions. The generated plan is then sent back from the server to the device and displayed to the user.

[1238] Creation of promotional content and regional revitalization

[1239] The server works in conjunction with a generation AI to create promotional content for each tourist destination. Information is collected from a database of tourist destinations, and promotional videos and images are generated using the generation AI. The generated promotional content is provided to local governments and travel agencies. Sharing the content through a dedicated API and dashboard effectively supports the promotion of tourist destinations. Local governments and travel agencies use this content to promote tourism and attract more tourists. As a specific example, a promotional video with the theme of "Furano's lavender fields and surrounding restaurants" is created and posted on the local government's official website.

[1240] The system provides users with personalized travel plans, utilizes emotional data to provide a more satisfying travel experience, and supports local governments and travel agencies in effectively promoting tourist destinations.

[1241] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1242] Step 1:

[1243] Receiving User Input

[1244] The user inputs travel conditions using the device interface. Specifically, this includes detailed settings such as destination, travel period, budget, and theme (e.g., hot springs, gourmet food). For example, the user might input, "I would like to travel to Hokkaido in July for 3 nights and 4 days, with a budget of 100,000 yen or less, to enjoy hot springs and gourmet food." The device converts this information into JSON format and sends it to the server via the HTTPS protocol. The input data are travel conditions such as destination, period, and budget, which are converted into JSON format. The output data are travel conditions in JSON format.

[1245] Step 2:

[1246] Generate a travel plan

[1247] The server receives the user's input data, analyzes it, and saves it in a database. The server parses the received data in JSON format and passes it to the generative AI engine. The generative AI engine generates the optimal travel plan for the user based on the tourist spot, accommodation, transportation, and restaurant information in the database. The generative AI engine analyzes the input data and combines information about tourist spots and accommodation to create a personalized travel plan. For example, it might include a hot spring inn in Sapporo, breakfast at the morning market in Hakodate, and a visit to the lavender fields in Furano. The output data is the generated travel plan.

[1248] Step 3:

[1249] Presenting the generated travel plan

[1250] The server sends the generated itinerary to the terminal and presents it to the user in an easy-to-read format. Specifically, the itinerary is displayed on the terminal's display, allowing the user to check the contents of the plan. The input data is the generated itinerary, and the output data is the itinerary displayed in a format that the user can view.

[1251] Step 4:

[1252] Providing simulated experiences

[1253] Users can try out VR / XR content based on the generated travel plan. When the user presses the play button for the VR / XR content on the device screen, the device downloads the corresponding VR / XR content from the server. Once the download is complete, the user puts on the VR headset and begins the virtual reality experience. The input data is a request for VR / XR content based on the travel plan, and the output data is the downloaded VR / XR content.

[1254] Step 5:

[1255] Acquiring emotional data using the emotion engine

[1256] During a user's VR / XR experience, the emotion engine recognizes the user's emotions in real time and collects data. The emotion engine uses facial recognition and voice analysis technology to measure the user's level of satisfaction, excitement, anxiety, etc., and sends this data to the server. For example, if a user smiles while experiencing a hot spring inn, it is determined that the user is highly satisfied. The input data is the user's emotional expression (facial expression and tone of voice), and the output data is the analyzed emotional data.

[1257] Step 6:

[1258] Optimize your travel plans

[1259] The server analyzes the emotion data obtained from the emotion engine and modifies or optimizes the travel plan in real time based on the results. For example, if it determines that the user particularly enjoyed a hot spring inn, the plan is modified to extend the stay at the inn. The modified plan is sent from the server to the terminal and presented to the user. The input data are the emotion data and the original travel plan, and the output data is the optimized travel plan.

[1260] Step 7:

[1261] Receiving feedback from users

[1262] If a user wishes to make changes to their travel plan, they use their device to input new conditions. For example, they can input a specific request such as "raising the rank of the hot spring inn." The device then sends the new conditions to the server, which then runs the generation AI engine again to generate an optimized travel plan that includes the new conditions. The generated plan is then sent back from the server to the device and displayed to the user. The input data is the user's feedback, and the output data is the revised travel plan.

[1263] Step 8:

[1264] Creation of promotional content and regional revitalization

[1265] The server works with a generation AI to create promotional content for each tourist destination. Information is collected from a database of tourist destinations, and promotional videos and images are generated using the generation AI. The generated promotional content is provided to local governments and travel agencies. Sharing the content through a dedicated API and dashboard effectively supports the promotion of tourist destinations. Local governments and travel agencies use this content to promote tourism and attract more tourists. As a specific example, a promotional video with the theme of "Furano's lavender fields and surrounding restaurants" is created and posted on the local government's official website. The input data is information about the tourist destinations, and the output data is the generated promotional content.

[1266] (Application example 2)

[1267] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1268] Conventional travel plan creation systems have the problem of being unable to provide highly customized travel plans that reflect the individual needs and preferences of users. They also lack a means to optimize travel plans by incorporating users' feelings and feedback on the generated travel plans in real time. Furthermore, promotion of tourist destinations remains limited to standard methods, limiting their effectiveness in promoting regional revitalization. A new system is needed to resolve these issues, provide users with a more satisfying travel experience, and support tourism promotion by local governments and travel agencies.

[1269] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1270] In this invention, the server includes: a means for generating travel plans using generative AI technology; a means for providing virtual reality (VR) or augmented reality (XR) content based on the generated travel plans; a means for optimizing the travel plans based on user feedback; a means for acquiring user emotion data and further optimizing the travel plans based on the emotion data; a means for delivering personalized travel content to users via their smartphones; and a means for creating and providing promotional content for tourist destinations in collaboration with local governments and travel agencies. This enables the provision of highly customized travel plans tailored to individual needs and preferences, and enables the optimization of travel plans that reflect user emotion and feedback in real time. It also effectively supports promotional activities for tourist destinations, promoting regional revitalization.

[1271] "Generative AI technology" is a technology that uses artificial intelligence to automatically generate optimal travel plans based on user input data.

[1272] A "travel plan" is a plan that is generated based on the user's travel conditions and includes information on tourist spots, accommodations, transportation, restaurants, and the like.

[1273] "Virtual reality (VR) content" refers to visual and auditory content that allows users to experience destinations in a virtual space based on a generated travel plan.

[1274] "Augmented Reality (XR) Content" refers to content that provides an experience that blends physical reality and digital content based on a generated travel plan.

[1275] "User feedback" refers to opinions and corrections users provide regarding travel plans and VR / XR experiences.

[1276] "Emotional data" is data collected using facial recognition and voice analysis technology to capture the emotions users express during their travel plans and VR / XR experiences.

[1277] An "emotion engine" is a software or hardware system that recognizes a user's emotions in real time and acquires emotion data.

[1278] "Personalized travel content" refers to travel information and experience content that is optimized to suit a user's individual conditions and preferences.

[1279] "Local governments" are local governments that are responsible for local administration in each region and are the entities that carry out promotional activities for tourist destinations.

[1280] A "travel agency" is a company that creates travel plans, makes arrangements, and makes reservations.

[1281] "Promotional content" refers to media materials such as videos, images, and texts used to promote tourist destinations and travel plans.

[1282] The system embodying this invention includes means for generative AI technology, an emotion engine, a VR / XR content generation tool, receiving and processing user input, acquiring and analyzing emotion data, optimizing travel plans, and generating and distributing promotional content.

[1283] Example of running the system program:

[1284] Receiving User Input

[1285] The user inputs travel conditions (destination, travel period, budget, theme, etc.) using a smartphone application. This input data is converted into JSON format by the device and sent to the server via the HTTPS protocol.

[1286] Generate a travel plan

[1287] The server receives input data sent by the user and passes it to the generative AI engine. The generative AI engine uses this data and information on tourist spots and accommodations stored in the database to generate an optimal travel plan. This travel plan is then converted back to JSON format and sent to the device.

[1288] Providing virtual reality (VR) / augmented reality (XR) experiences

[1289] The device will download the VR / XR content from the server if the user checks the travel plan and selects a VR / XR experience. The user can then wear a smartphone or a compatible VR headset and enjoy the virtual experience.

[1290] Acquiring and analyzing emotion data

[1291] While the user is experiencing VR / XR, the device uses a camera and microphone to recognize the user's face and perform voice analysis, which allows the emotion engine to collect and analyze the user's emotional data (such as satisfaction, excitement, and anxiety) in real time. This data is then sent to the server.

[1292] Optimize your travel plans

[1293] The server receives the emotion data and uses a generative AI engine to optimize the travel plan. For example, if the user is enjoying a particular tourist spot, the plan will be revised to extend the time spent there.

[1294] Receiving and incorporating user feedback

[1295] If a user wants to modify their travel plan, they enter new conditions into the app. This data is also sent to the server, and the AI ​​engine regenerates the optimal plan. This new plan is sent to the device and displayed to the user.

[1296] Promotional content creation and distribution

[1297] The server works in conjunction with the generative AI to create promotional content for tourist destinations, which is then published on the websites and social media of local governments and travel agencies to be used in tourist attraction activities.

[1298] Specific examples

[1299] Receiving User Input

[1300] The user enters into the application, "I would like to spend 4 days and 3 nights in Tokyo in August, with a budget of 200,000 yen or less, enjoying museums and shopping," and sends this information to the server.

[1301] Generate a travel plan

[1302] Based on the data received by the server, the generative AI engine generates a travel plan that includes "visiting an art museum in Ueno, shopping in Ginza, and staying at a luxury hotel in Shinjuku."

[1303] Providing virtual reality (VR) / augmented reality (XR) experiences

[1304] Users can use the device to virtually experience Ueno Museum and Ginza Shopping Street, checking out the local atmosphere in advance.

[1305] Acquiring and analyzing emotion data

[1306] The device performs facial recognition and voice analysis of the user and transmits emotional data to the server.

[1307] Optimize your travel plans

[1308] Based on the emotion data, the server modifies the plan and presents the new plan to the user.

[1309] Prompt Sentence Examples

[1310] An example prompt for a generative AI model is:

[1311] Please provide data that will be helpful when generating your Tokyo travel plans. Please include information that meets the following tourist criteria:

[1312] Trip duration: 3 nights, 4 days

[1313] Destination: Tokyo

[1314] Budget: Under 200,000 yen

[1315] Main themes: Museums, Shopping

[1316] Recommended tourist spots, accommodations, and restaurant information

[1317] In this way, it becomes possible to provide travel plans tailored to the individual conditions and preferences of users, optimize travel plans in real time using emotional data, and effectively support tourism promotion by local governments.

[1318] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1319] Step 1:

[1320] The user uses a smartphone application to input travel requirements, including the destination, travel period, budget, and theme. This data is converted into JSON format by the device and sent to the server via the HTTPS protocol. Specifically, the user enters "3 nights and 4 days in Tokyo in August, budget of 200,000 yen or less, wanting to enjoy museums and shopping" into the app's form and presses the submit button.

[1321] Input: The travel requirements entered by the user into the app

[1322] Output: Trip conditions data converted to JSON format

[1323] Step 2:

[1324] The server receives travel requirement data in JSON format sent by the user. It analyzes the received data and passes it on to the generation AI engine. Based on this data, the generation AI engine generates the optimal travel plan by referencing tourist destinations, accommodations, transportation options, and restaurant information in the database.

[1325] Input: JSON format travel conditions data

[1326] Output: A travel plan generated by the generative AI engine

[1327] Step 3:

[1328] The server converts the generated itinerary into JSON format and sends it to the device via HTTPS. The device receives the itinerary and displays it in a user-friendly format. The user can then review the itinerary and choose the option for a virtual reality (VR) or augmented reality (XR) experience.

[1329] Input: Generated itinerary

[1330] Output: The itinerary displayed on the user's device

[1331] Step 4:

[1332] When a user selects a VR / XR experience on their device, the device downloads the corresponding VR / XR content from the server, and the device provides the user with a virtual reality experience through a smartphone app or a compatible VR headset. For example, a user can virtually experience the Ueno Museum or the Ginza Shopping District to get a feel for the local atmosphere.

[1333] Input: User-selected VR / XR experience options

[1334] Output: Download VR / XR content and provide a virtual reality experience to the user

[1335] Step 5:

[1336] The device uses a camera and microphone to recognize the user's face and perform voice analysis during the user's VR / XR experience. The emotion engine analyzes the user's emotional data (satisfaction, excitement, anxiety, etc.) based on the collected data and obtains emotional data in real time. This data is then sent from the device to the server.

[1337] Input: User's facial recognition data and voice data

[1338] Output: Analyzed user emotion data

[1339] Step 6:

[1340] The server analyzes the acquired emotion data and optimizes the travel plan using a generative AI engine. For example, if it determines that the user is having a great time at a particular tourist spot, it will modify the plan to extend the stay at that tourist spot. This modified plan is then converted back into JSON format and sent to the device.

[1341] Input: Parsed user emotion data

[1342] Output: Optimized itinerary

[1343] Step 7:

[1344] If a user wants to modify their travel plan (for example, "I want more luxurious accommodation"), they enter the new conditions into the app. The device sends this data to the server, which uses its generative AI engine to regenerate the optimal plan. This new plan is sent to the device and displayed to the user.

[1345] Input: New criteria re-entered by the user

[1346] Output: Regenerated itinerary

[1347] Step 8:

[1348] The server works in conjunction with AI technology to create promotional content for tourist destinations. The generated promotional content is provided to local governments and travel agencies. For example, the server generates a promotional video for the "Ueno Museum and its surrounding cafes," which the local government then publishes on its official website and social media.

[1349] Input: Tourist destination database information

[1350] Output: Generated promotional content

[1351] In this way, users can receive travel plans tailored to their individual requirements and preferences, and their travel plans can be optimized by acquiring real-time emotional data. This also effectively supports promotional activities for tourist destinations.

[1352] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1353] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1354] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1355] [Fourth embodiment]

[1356] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1357] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1358] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1359] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1360] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1361] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1362] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1363] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1364] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1365] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1366] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1367] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1368] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1369] This invention is a system that uses generative AI technology to generate travel plans and provide VR or XR content based on them. This system allows users to input their travel requirements, virtually experience the generated plan in advance, and obtain an optimized travel plan based on that. It also generates promotional content for tourist destinations and supports regional revitalization in cooperation with local governments and travel agencies.

[1370] Program processing

[1371] 1. Receiving user input

[1372] 1. The user uses the device interface to input travel conditions, such as the destination, travel period, budget, and theme (e.g., hot springs, gourmet food).

[1373] 2. The terminal sends the entered data to the server. The terminal converts the entered data into the appropriate format and sends it to the server using the HTTPS protocol.

[1374] 2. Generate a travel plan

[1375] 1. The server parses the received input data and stores it in the database. The server parses the received data in JSON format and stores it in the database.

[1376] 2. The server calls a specialized AI engine to generate the optimal travel plan based on the input criteria. The AI ​​engine automatically creates the optimal travel plan for the user using tourist attractions, accommodations, transportation options, and restaurant information in the database.

[1377] 3. The server sends the generated travel plan to the terminal and presents it to the user in an easy-to-read format.

[1378] 3. Providing simulated experiences

[1379] 1. The user tries out the VR / XR content based on the generated travel plan. Specifically, the user selects playback of the VR / XR content on the device screen.

[1380] 2. The device downloads the corresponding VR / XR content from the server and displays it to the user, providing a virtual reality experience to the user through a device such as a VR headset.

[1381] 4. Optimizing travel planning

[1382] 1. If the user wishes to make changes to the travel plan, they input the revised conditions into the terminal. For example, they input a request to upgrade the rank of the accommodation.

[1383] 2. The device sends the new conditions to the server.

[1384] 3. The server runs the generation AI engine again based on the revised conditions, generates an optimized travel plan, and sends it to the device.

[1385] 4. The user reviews the revised and optimized travel plan and decides on the final plan.

[1386] 5. Creation of promotional content and regional revitalization

[1387] 1. The server creates promotional content for each tourist destination in collaboration with the AI. Specifically, it collects information from a database of tourist destinations and generates promotional videos and images using AI technology.

[1388] 2. The server provides the generated promotional content to local governments and travel agencies, sharing the content through dedicated APIs and dashboards to help promote tourist destinations.

[1389] 3. Local governments and travel agencies can use this content to efficiently promote tourism and attract tourists.

[1390] Specific examples

[1391] 1. Receiving user input

[1392] The user types into the terminal, "I would like to go to Hokkaido in July for 3 nights and 4 days, with a budget of 100,000 yen or less, and enjoy the hot springs and gourmet food."

[1393] The terminal sends these conditions to the server.

[1394] 2. Generate a travel plan

[1395] Based on the conditions received by the server, the AI ​​engine generates a travel plan that matches the conditions, such as "Hokkaido in July, 3 nights and 4 days, budget within 100,000 yen, hot springs and gourmet food."

[1396] The plan includes a stay at a hot spring inn in Sapporo, breakfast at the morning market in Hakodate, and a visit to the lavender fields in Furano.

[1397] Once the plan is generated, the server sends it to the terminal and displays it to the user.

[1398] 3. Providing simulated experiences

[1399] Users put on a VR headset on the device and virtually experience a hot spring inn in Sapporo or a morning market in Hakodate.

[1400] The device provides VR content, allowing users to experience the local atmosphere.

[1401] 4. Optimizing travel planning

[1402] If the user wishes to change the hot spring inn to one with a slightly higher rank, the user transmits the modified conditions from the terminal to the server.

[1403] The server again uses the generation AI engine to generate a new plan that includes a higher-ranked hot spring inn.

[1404] The server sends the optimized travel plan to the terminal and displays it to the user.

[1405] 5. Creation of promotional content and regional revitalization

[1406] The server generates promotional content for "Furano's lavender fields and surrounding restaurants."

[1407] Local governments will publish this content on their official websites and social media to attract tourists.

[1408] In this way, the present invention provides users with personalized travel plans and enables them to have a trouble-free trip through a virtual experience. It also enables local governments and travel agencies to promote tourist destinations efficiently, contributing to regional revitalization.

[1409] The processing flow will be explained below.

[1410] Step 1:

[1411] The user inputs travel conditions using the terminal interface, specifically, detailed conditions such as destination, travel period, budget, theme (e.g., hot springs, gourmet food), etc.

[1412] Step 2:

[1413] The terminal sends the input data to the server, which converts the input data into an appropriate format and sends it to the server via the HTTPS protocol.

[1414] Step 3:

[1415] The server parses the received input data and saves it in the database.The server parses the received data in JSON format and saves it in the database.

[1416] Step 4:

[1417] The server calls the AI ​​engine to generate the optimal travel plan based on the input conditions. The AI ​​engine uses tourist attractions, accommodations, transportation options, and restaurant information in the database to create the optimal travel plan for the user.

[1418] Step 5:

[1419] The server transmits the generated travel plan to the terminal and presents it to the user in an easy-to-view format.

[1420] Step 6:

[1421] The user checks the generated travel plan and selects to try out the VR / XR content. The user presses the play button for the VR / XR content on the device screen.

[1422] Step 7:

[1423] The device downloads the corresponding VR / XR content from the server and displays it to the user, providing a virtual reality experience to the user through a device such as a VR headset.

[1424] Step 8:

[1425] If the user wishes to modify the travel plan, he or she inputs the modified conditions into the terminal, such as a preference to upgrade the rank of accommodation.

[1426] Step 9:

[1427] The terminal sends the new conditions to the server. The terminal converts the modified conditions into the appropriate format and sends them to the server.

[1428] Step 10:

[1429] The server runs the generation AI engine again based on the revised conditions to generate an optimized travel plan. The generation AI engine analyzes the conditions again and generates a new travel plan.

[1430] Step 11:

[1431] The server sends the optimized travel plan to the terminal and presents it to the user, who then reviews the final travel plan and makes a final decision if necessary.

[1432] Step 12:

[1433] The server works with local governments and travel agencies to generate promotional content for tourist destinations. The server collects information from a database of tourist destinations and uses AI technology to create promotional videos and images.

[1434] Step 13:

[1435] The server provides the generated promotional content to local governments and travel agencies, who share the content through a dedicated API and dashboard to help promote tourist destinations.

[1436] Step 14:

[1437] Local governments and travel agencies will use the provided promotional content to promote tourism, and will post it on their official websites and social media to attract more tourists.

[1438] Example 1

[1439] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1440] Conventional travel plan generation systems have limited ability to provide users with personalized travel plans. Furthermore, they do not readily provide virtual reality (VR) or augmented reality (XR) experiences based on the generated travel plans, making it less convenient for users to consider their travel plans in advance. Furthermore, they lacked a sufficient mechanism for efficiently creating promotional content for tourist destinations and supporting regional revitalization through collaboration with local governments and travel agencies. These issues need to be resolved.

[1441] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1442] In this invention, the server includes: a means for a user to input travel requirements; a means for the terminal to convert the input data into an appropriate data format and send it to the server; a means for the server to analyze the received data and store it in a database; a means for the server to automatically generate a travel plan based on the input requirements using a generation AI engine; a means for the server to send the generated travel plan to the terminal and present it to the user in an easy-to-view format; a means for the user to try VR or XR content based on the travel plan; a means for the terminal to download corresponding VR or XR content from the server and display it to the user; a means for the user to input modifications to the travel plan and for the terminal to send the new conditions to the server; a means for the server to re-operate the generation AI engine based on the modified conditions and generate an optimized travel plan; and a means for the server to generate promotional content for tourist destinations and provide it to local governments and travel agencies. This enables the provision of personalized travel plans to users, advance travel planning through virtual experiences, and efficient tourist destination promotion through collaboration with local governments and travel agencies.

[1443] "User" refers to a person who uses the system to input travel conditions in order to create, modify, or experience a travel plan.

[1444] "Terminal" refers to the device used by a user to input travel requirements and experience virtual reality (VR) and augmented reality (XR) content.

[1445] "Server" refers to the central computing resource of the system that receives and analyzes data sent by users and automatically generates travel plans using a generative AI engine.

[1446] "Generative AI engine" refers to artificial intelligence technology for generating optimal travel plans based on input conditions.

[1447] "Database" refers to the system that structures and stores the received data and holds the information that the Generative AI Engine references when generating travel plans.

[1448] "Travel conditions" refers to detailed information such as the travel destination, duration, budget, and theme entered by the user.

[1449] "Travel plan" refers to a detailed plan including tourist attractions, accommodation, transportation, restaurant information, etc., that is automatically generated by the AI ​​engine based on the travel conditions entered by the user.

[1450] "Virtual reality (VR) content" refers to digital content that allows users to virtually experience a trip in advance based on their travel plans.

[1451] "Augmented reality (XR) content" refers to digital content that combines virtual reality with real-world scenery and objects.

[1452] "Promotional content" refers to promotional materials such as videos and images created using a generative AI engine to convey the attractions of a tourist destination.

[1453] "Local government" refers to a local public body with the autonomy to carry out tourism destination promotion activities.

[1454] "Travel agency" refers to a company that creates and sells travel plans and provides travel services to customers.

[1455] "Feedback" refers to any corrections or requests for improvements made by a user to a provided travel plan.

[1456] "Optimization" refers to the process by which the generative AI engine regenerates and improves travel plans based on user feedback and new conditions.

[1457] This invention is a system that uses generative AI technology to generate travel plans and provide virtual reality (VR) or augmented reality (XR) content based on those plans. This system allows users to input their travel requirements, virtually experience the generated plan in advance, and obtain an optimized travel plan based on that. It also generates promotional content for tourist destinations and supports regional revitalization in cooperation with local governments and travel agencies.

[1458] This system consists of a terminal that provides an interface for users to input travel conditions, a server that receives and analyzes the input data and generates and optimizes travel plans using a generative AI engine, a means to present the generated travel plans to users, and a means to play VR / XR content to provide a virtual experience.

[1459] First, the user inputs the travel conditions using the terminal interface. These include the destination, travel period, budget, theme (e.g., hot springs, gourmet food), etc. For example, the user might input "I'd like to go to Hokkaido in July for 3 nights and 4 days, with a budget of 100,000 yen or less, and enjoy hot springs and gourmet food." The terminal converts the input data into an appropriate data format (e.g., JSON format) and sends it to the server using the HTTPS protocol.

[1460] The server parses the received data in JSON format and stores it in a database as structured information. The server then calls a generative AI engine to automatically generate the optimal travel plan for the user. The generative AI engine integrates tourist spots, accommodation, transportation, and restaurant information from the database to create a travel plan that meets the user's requirements. For example, it might generate a plan such as "Stay at a hot spring inn in Sapporo, have breakfast at the morning market in Hakodate, and visit the lavender fields in Furano."

[1461] The generated travel plan is then sent to the device and displayed to the user. The user can review the plan and try out further virtual experiences. The device then downloads the corresponding VR or XR content from the server and displays it to the user. The user then puts on a VR headset and can virtually experience, for example, a hot spring inn in Sapporo or a morning market in Hakodate.

[1462] If a user wishes to modify their travel plan, for example, to choose a higher-ranking hot spring inn, they send the modified conditions from their device to the server. The server then uses the generation AI engine again to generate a new plan based on the modified conditions. The modified plan is then sent back to the device and presented to the user.

[1463] The server then generates promotional content for tourist destinations. It collects information from a database of tourist destinations and uses a generative AI engine to create promotional videos and images. For example, promotional content for "Furano's lavender fields and surrounding restaurants" is generated. This content is provided to local governments and travel agencies via APIs and dashboards, enabling efficient promotion of tourist destinations.

[1464] As described above, the present invention provides users with personalized travel plans, allows them to consider travel plans in advance through virtual experiences, and enables efficient promotion of tourist destinations through collaboration with local governments and travel agencies.

[1465] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1466] Step 1: Receiving User Input

[1467] 1. Input: The user inputs travel conditions (destination, travel period, budget, theme, etc.) into the terminal interface.

[1468] 2. Data processing: The terminal converts the input data into JSON format.

[1469] 3. Output: Send the converted JSON data to the server.

[1470] 4. Specific operation: The user enters into the device interface, "I would like to go to Hokkaido in July for 3 nights and 4 days, with a budget of 100,000 yen or less, and enjoy hot springs and gourmet food," and the device sends the JSON data "{ "destination": "Hokkaido", "duration": "3 nights and 4 days", "budget": "100,000 yen", "theme": "Hot springs, gourmet food"}" to the server.

[1471] Step 2: Generate a travel plan

[1472] 1. Input: JSON format travel condition data is sent to the server.

[1473] 2. Data analysis and storage: The server parses the received data in JSON format and stores it in a database as structured information.

[1474] 3. Data calculation: The server calls the AI ​​engine and generates the optimal travel plan based on the information in the database.

[1475] 4. Output: The generated travel plan is sent to the terminal.

[1476] 5. Specific operation: The server analyzes the data "{ "destination": "Hokkaido", "duration": "3 nights and 4 days", "budget": "100,000 yen", "theme": "hot springs, gourmet"}" and saves it in the database as "Destination: Hokkaido, Duration: 3 nights and 4 days, Budget: 100,000 yen, Theme: hot springs, gourmet." The generation AI engine then generates a travel plan such as "Stay at a hot spring inn in Sapporo, have breakfast at the morning market in Hakodate, and visit the lavender fields in Furano," and sends it to the device.

[1477] Step 3: Present your travel plans

[1478] 1. Input: The generated travel plan data is sent to the terminal.

[1479] 2. Data display: The terminal displays the travel plan received in an easy-to-read format for the user.

[1480] 3. Output: The user confirms the generated itinerary.

[1481] 4. Specific operation: The device displays a travel plan on the screen, such as "Day 1: Stay at a hot spring inn in Sapporo, Day 2: Breakfast at the morning market in Hakodate, Day 3: Visit the lavender fields in Furano," and the user confirms it.

[1482] Step 4: Providing VR / XR content

[1483] 1. Input: The user selects to play VR or XR content.

[1484] 2. Content download: The device downloads compatible VR or XR content from the server.

[1485] 3. Data display: The device displays the downloaded content to the user.

[1486] 4. Output: The user has a virtual reality experience.

[1487] 5. Specific operation: The user clicks the "Experience VR" button, and the device downloads VR content of a hot spring inn in Sapporo and a morning market in Hakodate from the server, providing the user with a virtual experience through the VR headset.

[1488] Step 5: Optimize your travel plans

[1489] 1. Input: The user inputs a modification to the travel plan (for example, upgrading the accommodation) into the terminal.

[1490] 2. Data transmission: The terminal transmits the modified conditions to the server.

[1491] 3. Data reanalysis and generation: The server calls the generation AI engine again based on the revised conditions to generate an optimized travel plan.

[1492] 4. Output: The new itinerary is sent to the device.

[1493] 5. Specific operation: The user enters into the device, "I would like to change the hot spring inn to one with a higher rank," and the device sends the modified data "{ "accommodation_rank": "luxury"}" to the server. The server then runs the generation AI engine again, generates a new plan that includes a hot spring inn with a higher rank, and sends it to the device.

[1494] Step 6: Create and deliver promotional content

[1495] 1. Input: The server obtains information from the tourist destination database.

[1496] 2. Data collection and generation: The server uses a generation AI engine to generate promotional videos and images.

[1497] 3. Data provision: Providing the generated promotional content to local governments and travel agencies.

[1498] 4. Output: Local governments and travel agencies will use the content to promote tourism.

[1499] 5. Specific operation: The server collects information about "Furano's lavender fields and surrounding restaurants" from a tourist destination database, and generates a promotional video using a generative AI engine. The generated content is provided to local governments and travel agencies via APIs and dashboards, and is then published on social media and official websites.

[1500] (Application example 1)

[1501] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1502] Modern travel planning is complex, and creating an optimal itinerary requires collecting, analyzing, and planning a large amount of information. Furthermore, there are limited ways to experience and confirm travel plans in advance, which can lead to disappointments during the actual trip. It also takes time and money for local governments and travel agencies to create content to effectively promote tourist destinations. Therefore, there is a need for a system that provides users with a quick and easy way to create and experience travel plans in advance, as well as effectively create promotional content for tourist destinations.

[1503] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1504] In this invention, the server includes means for generating a travel plan using generative AI technology, means for providing virtual reality (VR) or augmented reality (XR) content based on the generated travel plan, and means for optimizing the travel plan based on user feedback. This allows users to obtain an optimal travel plan at the planning stage, reduces disappointment in the actual trip by having a virtual experience in advance through VR / XR content, and enables local governments and travel agencies to efficiently create effective promotional content.

[1505] "Generative AI technology" is an artificial intelligence technology that automatically generates travel plans and content based on conditions specified by the user.

[1506] A "travel plan" is a plan such as an itinerary or a list of tourist attractions created based on the user's wishes and conditions.

[1507] "Virtual reality (VR) content" is digital content that uses computer technology to allow users to experience virtual spaces that do not exist in reality.

[1508] "Augmented reality (XR) content" refers to content that uses technology to overlay digital information on the real world, including virtual reality (VR) and other augmented reality technologies.

[1509] "Feedback from users" refers to information such as opinions, requests, and corrections provided by users.

[1510] "Optimization" is the process of adjusting the itinerary to suit your needs based on user feedback and additional requirements.

[1511] A "local government" is an administrative body that governs a specific region and is responsible for promoting tourist destinations, etc.

[1512] A "travel agency" is a business that provides travel-related services and information, and creates and arranges travel plans.

[1513] "Promotional content" is any digital content, such as videos, images or text, created to promote a tourist destination or a particular service.

[1514] A "smartphone" is a multi-functional mobile device that can connect to the Internet and install applications in addition to the functions of a mobile phone.

[1515] A "terminal interface" is an interface such as a graphical user interface or command input that allows a user to operate a terminal.

[1516] A "server" is a computer system connected to a network that processes requests from multiple users.

[1517] "Received data" refers to information and conditions entered by the user and is data that is analyzed by the server.

[1518] A "VR headset" is a device worn by users to experience a virtual reality space visually and aurally.

[1519] The system of the present invention generates a travel plan using generative AI technology and provides virtual reality (VR) or augmented reality (XR) content based on the generated travel plan. A specific embodiment of this system is described below.

[1520] Hardware and software used

[1521] Smartphone: Used for user input, travel plans, and VR / XR content display.

[1522] Server: Data analysis, calling the generative AI engine, generating and managing travel plans.

[1523] Generative AI engine: Artificial intelligence that creates travel plans and promotional content based on user criteria.

[1524] VR headset: A device that allows users to experience virtual reality.

[1525] System Features

[1526] 1. Receiving user input

[1527] The user inputs travel conditions using a smartphone. For example, specific information such as "destination," "travel period," "budget," and "travel theme" is set. This input information is sent from the smartphone to the server using the HTTPS protocol.

[1528] 2. Generate a travel plan

[1529] The server analyzes the received data and parses it in JSON format. It then invokes the AI ​​engine to generate an optimal travel plan based on the user's settings. The generated plan is then sent from the server to the smartphone and presented to the user.

[1530] 3. Providing simulated experiences

[1531] When a user selects VR / XR content based on the generated travel plan, the content starts playing on the device screen. When the smartphone is connected to a VR headset, the corresponding VR content is downloaded, providing the user with a virtual reality experience. This virtual reality experience enhances user interaction and reduces the risks and frustrations that may occur during real travel.

[1532] 4. Optimizing travel planning

[1533] If the user wishes to make changes to their travel plan, they can resubmit the revised conditions from their smartphone to the server. The server will then run the AI ​​engine based on the new conditions to generate an optimized travel plan. The final plan will be presented to the user for approval.

[1534] 5. Creation and provision of promotional content

[1535] The server uses a generative AI engine to generate effective promotional content (videos, images, etc.) based on a database of tourist destinations. This content is provided to local governments and travel agencies to help them attract tourists. The content is shared through a dedicated API and dashboard, allowing for efficient promotion of tourist destinations.

[1536] Specific examples

[1537] For example, if a user inputs "I want to go to Hokkaido in July for three nights and four days, with a budget of less than 100,000 yen, and enjoy hot springs and gourmet food," the server analyzes the received conditions, and the generative AI engine generates the optimal travel plan. This plan might include a hot spring inn in Sapporo, breakfast at the morning market in Hakodate, and a visit to the lavender fields in Furano. The generated plan is sent to a smartphone, and the user can wear a VR headset and virtually experience it in advance.

[1538] Prompt Sentence Examples

[1539] "Please generate a 3-night, 4-day itinerary for Hokkaido in July. I would like to enjoy hot springs and gourmet food within a budget of 100,000 yen."

[1540] In this way, the system of the present invention provides users with personalized travel plans and enables trouble-free travel through a virtual reality experience. It also enables local governments and travel agencies to promote tourist destinations efficiently, contributing to regional revitalization.

[1541] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1542] Step 1:

[1543] The user inputs travel conditions using a smartphone, specifically setting items such as the travel destination, travel period, budget, and travel theme. The input data is parsed in JSON format and sent to the server using the HTTPS protocol.

[1544] Input: Travel destination, travel period, budget, travel theme

[1545] Output: JSON format travel condition data

[1546] Step 2:

[1547] The server analyzes the received JSON-formatted travel condition data. This allows each condition to be recognized and classified as an individual parameter. The analyzed data is then converted into a format that is easy for the generative AI engine to handle.

[1548] Input: JSON format travel conditions data

[1549] Output: Analyzed travel condition parameters

[1550] Step 3:

[1551] The server calls the AI ​​engine to generate an optimal travel plan based on the analyzed travel condition parameters. The AI ​​engine then references a database of tourist spots, accommodations, restaurants, etc. to create an optimal plan that meets the conditions.

[1552] Input: Travel condition parameters

[1553] Data processing: Reference to databases of tourist attractions, accommodations, and restaurants

[1554] Output: Generated itinerary

[1555] Step 4:

[1556] The server sends the generated itinerary to the smartphone and presents it to the user, who can then check each element of the itinerary (e.g., places to visit, accommodation, places to eat, etc.).

[1557] Input: Generated itinerary

[1558] Output: The itinerary presented to the user

[1559] Step 5:

[1560] When a user wants to try out VR / XR content based on the generated travel plan, they select to play the VR content on their smartphone screen. The smartphone downloads the VR content from the server, and the user puts on a VR headset to experience the virtual reality experience.

[1561] Input: Generated travel plan, selection to play VR content

[1562] Data processing: VR content download

[1563] Output: Virtual reality experience

[1564] Step 6:

[1565] If a user wishes to make changes to their travel plan, they can enter the changes on their smartphone and send them to the server. For example, they can include specific requests such as "I want to upgrade the rank of the accommodation." The server then runs the AI ​​engine again based on the new conditions to generate an optimized travel plan.

[1566] Input: Modified conditions, New conditions

[1567] Data processing: Re-running the generative AI engine

[1568] Output: Optimized itinerary

[1569] Step 7:

[1570] The server sends the optimized travel plan to the smartphone and presents it to the user, who can then review the revised plan and make a final decision.

[1571] Input: Optimized itinerary

[1572] Output: The optimized itinerary presented to the user

[1573] Step 8:

[1574] The server uses a generation AI engine to create promotional content for tourist destinations. It collects information from a database of tourist destinations and generates promotional videos and images. This content is provided to local governments and travel agencies for use in tourism promotion activities.

[1575] Input: tourist destination data, generative AI engine

[1576] Data processing: Promoting videos and images

[1577] Output: Generated promotional content

[1578] The above are the processing steps of the system that realizes the application example of the present invention, which not only allows users to easily create travel plans and prepare for their trips through virtual reality experiences, but also enables local governments and travel agencies to efficiently promote tourist destinations.

[1579] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1580] This system combines generative AI technology with an emotion engine to provide users with personalized travel plans and virtual reality (VR) or augmented reality (XR) content based on those plans. Furthermore, it optimizes travel plans using user feedback and emotion data, and supports regional revitalization in collaboration with local governments and travel agencies through the generation of effective promotional content.

[1581] Program processing

[1582] 1. Receiving user input

[1583] First, the user uses the device interface to input travel requirements, such as the destination, travel period, budget, theme (e.g., hot springs, gourmet food), etc. The device converts this input data into an appropriate format and sends it to the server via the HTTPS protocol.

[1584] 2. Generate a travel plan

[1585] The server analyzes the received input data and saves it in a database. The server then parses the received data in JSON format and passes it to the generation AI engine. The generation AI engine generates the optimal travel plan for the user based on the tourist spots, accommodations, transportation, and restaurant information in the database. The generated travel plan is sent from the server to the device and presented to the user in an easy-to-read format.

[1586] 3. Providing simulated experiences

[1587] Next, the user selects to try out VR / XR content based on the generated travel plan. The user presses the play button for the VR / XR content on the device screen, and the device downloads the corresponding VR / XR content from the server. The device then provides the user with a virtual reality experience through a device such as a VR headset.

[1588] 4. Acquiring Emotion Data Using the Emotion Engine

[1589] During a user's VR / XR experience, the emotion engine recognizes the user's emotions in real time and collects data. The emotion engine uses facial recognition and voice analysis technology to measure the user's satisfaction, excitement, anxiety, etc.

[1590] 5. Optimize travel planning

[1591] Based on the emotion data obtained from the emotion engine, the server modifies or optimizes the travel plan in real time. For example, if it is determined that the user is particularly enjoying a certain tourist spot, the plan will be modified to extend the stay at that tourist spot. This allows the user to obtain a more satisfying travel plan.

[1592] 6. Receiving User Feedback

[1593] If a user wishes to make changes to their travel plan, they input the revised conditions into the device. For example, they input a specific request such as "raising the rank of accommodation." The device sends the new conditions to the server, which then runs the generation AI engine again to generate an optimized travel plan and send it to the device.

[1594] 7. Creation of promotional content and regional revitalization

[1595] The server works in conjunction with a generation AI to create promotional content for each tourist destination. Specifically, it collects information from a database of tourist destinations and generates promotional videos and images using AI technology. The generated promotional content is provided to local governments and travel agencies. Sharing the content through a dedicated API and dashboard effectively supports the promotion of tourist destinations. Local governments and travel agencies can use this content to promote tourism and attract more tourists.

[1596] Specific examples

[1597] 1. Receiving user input

[1598] The user types into the terminal, "I would like to go to Hokkaido in July for 3 nights and 4 days, with a budget of 100,000 yen or less, and enjoy the hot springs and gourmet food."

[1599] The terminal sends these conditions to the server.

[1600] 2. Generate a travel plan

[1601] Based on the conditions received by the server, the AI ​​engine generates a travel plan that takes into account "Hokkaido in July, 3 nights and 4 days, budget of 100,000 yen or less, hot springs and gourmet food."

[1602] The plan includes a stay at a hot spring inn in Sapporo, breakfast at the morning market in Hakodate, and a visit to the lavender fields in Furano.

[1603] Once the plan is generated, the server sends it to the terminal and displays it to the user.

[1604] 3. Providing simulated experiences

[1605] Users put on a VR headset on the device and virtually experience a hot spring inn in Sapporo or a morning market in Hakodate.

[1606] The device provides VR content, allowing users to experience the local atmosphere.

[1607] 4. Acquiring Emotion Data Using the Emotion Engine

[1608] During the user's VR experience, the emotion engine recognizes the user's emotions in real time and collects data such as joy, excitement, and anxiety.

[1609] The emotional data is sent to a server and used to adjust travel plans.

[1610] 5. Optimize travel planning

[1611] If it is determined based on the emotion data obtained from the emotion engine that the user is very satisfied with the hot spring inn, for example, the server modifies the plan to extend the stay at the hot spring inn.

[1612] The revised plan is sent to the user's terminal and presented to the user.

[1613] 6. Receiving User Feedback

[1614] If the user desires to choose a hot spring inn of a slightly higher rank, the user transmits the modified conditions from the terminal to the server.

[1615] The server again uses the generation AI engine to generate a new plan that includes a highly ranked hot spring inn.

[1616] The server sends the optimized travel plan to the terminal and displays it to the user.

[1617] 7. Creation of promotional content and regional revitalization

[1618] The server generates promotional content for "Furano's lavender fields and surrounding restaurants."

[1619] Local governments will publish this content on their official websites and social media to attract tourists.

[1620] In this way, the present invention provides users with personalized travel plans, utilizes emotional data to provide a more satisfying travel experience, and supports local governments and travel agencies in effectively promoting tourist destinations.

[1621] The processing flow will be explained below.

[1622] Step 1:

[1623] The user inputs travel conditions using the terminal interface, specifically, detailed conditions such as destination, travel period, budget, theme (e.g., hot springs, gourmet food), etc.

[1624] Step 2:

[1625] The terminal sends the entered data to the server, which converts the user's input data into an appropriate format and sends it to the server via the HTTPS protocol.

[1626] Step 3:

[1627] The server parses the received input data and saves it in the database.The server parses the received data in JSON format and saves it in the database.

[1628] Step 4:

[1629] The server calls the AI ​​engine to generate the optimal travel plan based on the input conditions. The AI ​​engine uses tourist attractions, accommodations, transportation options, and restaurant information in the database to create the optimal travel plan for the user.

[1630] Step 5:

[1631] The server sends the generated travel plan to the terminal and presents it to the user in an easy-to-read format. The terminal displays the travel plan to the user.

[1632] Step 6:

[1633] The user checks the generated travel plan and selects to try out the VR / XR content. The user presses the play button for the VR / XR content on the device screen.

[1634] Step 7:

[1635] The device downloads the corresponding VR / XR content from the server and displays it to the user, providing a virtual reality experience to the user through a device such as a VR headset.

[1636] Step 8:

[1637] As soon as a user begins their VR experience, the emotion engine collects their emotional data in real time, using facial recognition and voice analysis technology to measure their satisfaction and excitement.

[1638] Step 9:

[1639] The device transmits the acquired emotional data to a server, which is designed to update the data in real time.

[1640] Step 10:

[1641] The server analyzes the emotion data and optimizes the travel plan. For example, if it determines that the user is particularly satisfied with a particular tourist spot, it will modify the plan to extend the time spent at that spot.

[1642] Step 11:

[1643] The server sends the new optimized travel plan to the terminal and presents it to the user, and the terminal displays the new plan to the user.

[1644] Step 12:

[1645] If the user wishes to make further changes to the travel plan, they can input new conditions from the terminal and send them to the server. For example, they can add a preference such as "I want to improve the ranking of the restaurant."

[1646] Step 13:

[1647] The server runs the generation AI engine again to generate a travel plan based on the new conditions and sends it to the device, which then presents the new plan to the user.

[1648] Step 14:

[1649] The server works with local governments and travel agencies to generate promotional content for tourist destinations. The server collects information from a database of tourist destinations and uses AI technology to create promotional videos and images based on that information.

[1650] Step 15:

[1651] The server provides the generated promotional content to local governments and travel agencies, who share the content through a dedicated API and dashboard to help promote tourist destinations.

[1652] Step 16:

[1653] Local governments and travel agencies will use the provided promotional content to promote tourism, and will publish the content on their official websites and social media to attract tourists.

[1654] Example 2

[1655] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1656] Conventional travel planning systems struggle to consider users' individual preferences and real-time emotions, making it difficult to provide highly satisfying travel plans. Furthermore, they lacked the ability to utilize virtual reality and augmented reality content, leaving users with limited means to provide pre-travel experiences. Furthermore, local governments and travel agencies had limited means to generate and provide effective promotional content, preventing them from fully leveraging the appeal of tourist destinations.

[1657] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1658] In this invention, the server includes means for using generative AI technology to generate a travel plan, means for providing virtual reality or augmented reality content based on the generated travel plan, means for acquiring emotional data using an emotion engine during the user's virtual experience, means for optimizing the travel plan based on the acquired emotional data, means for modifying the travel plan based on user feedback, and means for creating and providing promotional content for tourist destinations in cooperation with local governments and travel agencies. This allows users to experience travel in advance through travel plans based on their individual preferences and virtual experiences, and further allows local governments and travel agencies to efficiently communicate the appeal of tourist destinations by utilizing effective promotional content.

[1659] "Generative AI technology" is a technology that uses artificial intelligence to automatically generate travel plans based on user input information.

[1660] "Virtual reality content" is content that allows users to experience real environments and situations in a virtual space using special headsets or devices.

[1661] "Augmented reality content" is content provided using technology that overlays digital information onto real-world images.

[1662] The "emotion engine" uses facial recognition and voice analysis technology to recognize the user's emotions in real time and analyze the data.

[1663] "Feedback" refers to information such as opinions and requests provided by users after using the system.

[1664] A "local government" is a local public body responsible for the administration of a particular area.

[1665] A "travel agency" is a business that plans and sells travel products.

[1666] "Promotional content" refers to digital content such as videos and images used to promote and publicize the attractions of tourist destinations and facilities.

[1667] "User input" refers to information such as travel requirements that a user provides to the system.

[1668] A "VR headset" is a device worn by a user to experience virtual reality.

[1669] A "server" is a computer system that receives and processes requests from users and provides the required services.

[1670] This system uses generative AI technology and an emotion engine to provide users with personalized travel plans and virtual reality (VR) or augmented reality (XR) content based on those plans. The system also uses user feedback and emotion data to optimize travel plans and collaborate with local governments and travel agencies to generate effective promotional content, thereby supporting regional revitalization.

[1671] Receiving User Input

[1672] First, the user inputs the travel conditions using the device interface. This includes detailed settings such as destination, travel period, budget, and theme (e.g., hot springs, gourmet food). For example, the user might input, "I want to go to Hokkaido in July for three nights and four days, with a budget of less than 100,000 yen, to enjoy hot springs and gourmet food." The device converts this information into JSON format and sends it to the server via the HTTPS protocol.

[1673] Generate a travel plan

[1674] The server receives the user's input data, analyzes it, and saves it in a database. The received data is parsed in JSON format and passed to the generation AI engine. The generation AI engine generates the optimal travel plan for the user based on data such as tourist attractions, accommodation, transportation, and restaurant information. For example, the generated plan might include a hot spring inn in Sapporo, breakfast at the morning market in Hakodate, and a visit to the lavender fields in Furano. The generated travel plan is sent from the server to the device and presented to the user in an easy-to-read format.

[1675] Providing simulated experiences

[1676] Users can try out VR / XR content based on the generated travel plan. When the user presses the play button for the VR / XR content on the device screen, the device downloads the corresponding VR / XR content from the server. Once the download is complete, the user puts on the VR headset and begins the virtual reality experience. This allows the user to experience the local atmosphere in a realistic way.

[1677] Acquiring emotional data using the emotion engine

[1678] During a user's VR / XR experience, the emotion engine recognizes the user's emotions in real time and collects data. The emotion engine uses facial recognition and voice analysis technology to measure the user's level of satisfaction, excitement, anxiety, etc., and sends that data to the server. For example, if a user smiles during their experience at a hot spring inn, it will be determined that they are highly satisfied.

[1679] Optimize travel planning

[1680] The server analyzes the emotion data obtained from the emotion engine and modifies or optimizes the travel plan in real time based on the results. For example, if it determines that the user particularly enjoyed a hot spring inn, the plan will be modified to extend the stay at the inn. The modified plan is sent from the server to the terminal and presented to the user.

[1681] Receiving feedback from users

[1682] If a user wishes to make changes to their travel plan, they can use their device to input new conditions. For example, they can input a specific request such as "raising the rank of the hot spring inn." The device then sends the new conditions to the server, which then runs the AI ​​engine again to generate an optimized travel plan that includes the new conditions. The generated plan is then sent back from the server to the device and displayed to the user.

[1683] Creation of promotional content and regional revitalization

[1684] The server works in conjunction with a generation AI to create promotional content for each tourist destination. Information is collected from a database of tourist destinations, and promotional videos and images are generated using the generation AI. The generated promotional content is provided to local governments and travel agencies. Sharing the content through a dedicated API and dashboard effectively supports the promotion of tourist destinations. Local governments and travel agencies use this content to promote tourism and attract more tourists. As a specific example, a promotional video with the theme of "Furano's lavender fields and surrounding restaurants" is created and posted on the local government's official website.

[1685] The system provides users with personalized travel plans, utilizes emotional data to provide a more satisfying travel experience, and supports local governments and travel agencies in effectively promoting tourist destinations.

[1686] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1687] Step 1:

[1688] Receiving User Input

[1689] The user inputs travel conditions using the device interface. Specifically, this includes detailed settings such as destination, travel period, budget, and theme (e.g., hot springs, gourmet food). For example, the user might input, "I would like to travel to Hokkaido in July for 3 nights and 4 days, with a budget of 100,000 yen or less, to enjoy hot springs and gourmet food." The device converts this information into JSON format and sends it to the server via the HTTPS protocol. The input data are travel conditions such as destination, period, and budget, which are converted into JSON format. The output data are travel conditions in JSON format.

[1690] Step 2:

[1691] Generate a travel plan

[1692] The server receives the user's input data, analyzes it, and saves it in a database. The server parses the received data in JSON format and passes it to the generative AI engine. The generative AI engine generates the optimal travel plan for the user based on the tourist spot, accommodation, transportation, and restaurant information in the database. The generative AI engine analyzes the input data and combines information about tourist spots and accommodation to create a personalized travel plan. For example, it might include a hot spring inn in Sapporo, breakfast at the morning market in Hakodate, and a visit to the lavender fields in Furano. The output data is the generated travel plan.

[1693] Step 3:

[1694] Presenting the generated travel plan

[1695] The server sends the generated itinerary to the terminal and presents it to the user in an easy-to-read format. Specifically, the itinerary is displayed on the terminal's display, allowing the user to check the contents of the plan. The input data is the generated itinerary, and the output data is the itinerary displayed in a format that the user can view.

[1696] Step 4:

[1697] Providing simulated experiences

[1698] Users can try out VR / XR content based on the generated travel plan. When the user presses the play button for the VR / XR content on the device screen, the device downloads the corresponding VR / XR content from the server. Once the download is complete, the user puts on the VR headset and begins the virtual reality experience. The input data is a request for VR / XR content based on the travel plan, and the output data is the downloaded VR / XR content.

[1699] Step 5:

[1700] Acquiring emotional data using the emotion engine

[1701] During a user's VR / XR experience, the emotion engine recognizes the user's emotions in real time and collects data. The emotion engine uses facial recognition and voice analysis technology to measure the user's level of satisfaction, excitement, anxiety, etc., and sends this data to the server. For example, if a user smiles while experiencing a hot spring inn, it is determined that the user is highly satisfied. The input data is the user's emotional expression (facial expression and tone of voice), and the output data is the analyzed emotional data.

[1702] Step 6:

[1703] Optimize your travel plans

[1704] The server analyzes the emotion data obtained from the emotion engine and modifies or optimizes the travel plan in real time based on the results. For example, if it determines that the user particularly enjoyed a hot spring inn, the plan is modified to extend the stay at the inn. The modified plan is sent from the server to the terminal and presented to the user. The input data are the emotion data and the original travel plan, and the output data is the optimized travel plan.

[1705] Step 7:

[1706] Receiving feedback from users

[1707] If a user wishes to make changes to their travel plan, they use their device to input new conditions. For example, they can input a specific request such as "raising the rank of the hot spring inn." The device then sends the new conditions to the server, which then runs the generation AI engine again to generate an optimized travel plan that includes the new conditions. The generated plan is then sent back from the server to the device and displayed to the user. The input data is the user's feedback, and the output data is the revised travel plan.

[1708] Step 8:

[1709] Creation of promotional content and regional revitalization

[1710] The server works with a generation AI to create promotional content for each tourist destination. Information is collected from a database of tourist destinations, and promotional videos and images are generated using the generation AI. The generated promotional content is provided to local governments and travel agencies. Sharing the content through a dedicated API and dashboard effectively supports the promotion of tourist destinations. Local governments and travel agencies use this content to promote tourism and attract more tourists. As a specific example, a promotional video with the theme of "Furano's lavender fields and surrounding restaurants" is created and posted on the local government's official website. The input data is information about the tourist destinations, and the output data is the generated promotional content.

[1711] (Application example 2)

[1712] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1713] Conventional travel plan creation systems have the problem of being unable to provide highly customized travel plans that reflect the individual needs and preferences of users. They also lack a means to optimize travel plans by incorporating users' feelings and feedback on the generated travel plans in real time. Furthermore, promotion of tourist destinations remains limited to standard methods, limiting their effectiveness in promoting regional revitalization. A new system is needed to resolve these issues, provide users with a more satisfying travel experience, and support tourism promotion by local governments and travel agencies.

[1714] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1715] In this invention, the server includes: a means for generating travel plans using generative AI technology; a means for providing virtual reality (VR) or augmented reality (XR) content based on the generated travel plans; a means for optimizing the travel plans based on user feedback; a means for acquiring user emotion data and further optimizing the travel plans based on the emotion data; a means for delivering personalized travel content to users via their smartphones; and a means for creating and providing promotional content for tourist destinations in collaboration with local governments and travel agencies. This enables the provision of highly customized travel plans tailored to individual needs and preferences, and enables the optimization of travel plans that reflect user emotion and feedback in real time. It also effectively supports promotional activities for tourist destinations, promoting regional revitalization.

[1716] "Generative AI technology" is a technology that uses artificial intelligence to automatically generate optimal travel plans based on user input data.

[1717] A "travel plan" is a plan that is generated based on the user's travel conditions and includes information on tourist spots, accommodations, transportation, restaurants, and the like.

[1718] "Virtual reality (VR) content" refers to visual and auditory content that allows users to experience destinations in a virtual space based on a generated travel plan.

[1719] "Augmented Reality (XR) Content" refers to content that provides an experience that blends physical reality and digital content based on a generated travel plan. ...

Claims

1. A means for generating a travel plan using generative AI technology; means for providing virtual reality (VR) or extended reality (XR) content based on the generated itinerary; means for optimizing the travel plan based on user feedback; A means of creating and providing promotional content for tourist destinations in collaboration with local governments and travel agencies; A system including:

2. The system according to claim 1, further comprising means for receiving travel conditions input by a user and automatically generating a travel plan based on the conditions using AI generation technology.

3. The system of claim 1 further comprising means for presenting the generated travel plan to the user and then optimizing the travel plan again using the generative AI technology based on the user's feedback.

Images