System

Abstract

A system is provided.SOLUTION: A system comprising: means for inputting a travel destination, a budget, a stay period, and a desired travel style by a user; means for searching for a related tourist spot or activity information from a database based on the input information; means for generating a specific travel plan according to the stay period of the user based on a search result; and means for presenting the generated travel plan to the user.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] One challenge for travelers is deciding where to go and in what order to visit them when they are in a new place. Another problem is that planning a trip takes a lot of time and effort. In addition, there is currently a lack of easy ways to obtain plans that suit the individual needs and preferences of travelers. Another problem is that these travel plans are not improved after the trip and end up being a one-time, disposable item. [Means for solving the problem]

[0005] To solve the above problems, the present invention provides the following means: First, a means for a user to input their travel destination, budget, length of stay, and desired travel style is provided. Next, a means is provided for searching a database for related tourist destination and activity information based on the input information. Then, a means is provided for generating a specific travel plan tailored to the user's length of stay based on the search results. Furthermore, a means is provided for presenting the generated travel plan to the user. These means allow travelers to easily plan their trips and obtain plans that meet their individual needs and preferences. Furthermore, by providing a means for collecting feedback from users and improving the travel plan based on that feedback, the quality of the plan can be continuously improved after the trip.

[0006] "User input means" refers to a means that provides an interface for a traveler to input their travel destination, budget, length of stay, and desired travel style.

[0007] The "database search means" is a means for searching the database for related tourist destination and activity information based on the information entered by the user.

[0008] The "travel plan generation means" is a means for generating a specific travel plan tailored to the user's length of stay based on the search results.

[0009] The "travel plan presentation means" is a means for presenting the generated travel plan to the user.

[0010] "Feedback collection means" refers to a means for collecting feedback from users about travel plans and improving the plans based on that feedback. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2]1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0012] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0013] First, the terms used in the following description will be explained.

[0014] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0015] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0016] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0017] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0018] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0019] [First embodiment]

[0020] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0021] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0022] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0023] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0024] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0025] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0026] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0027] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0028] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0029] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0030] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0031] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0032] The following system is conceivable as a mode for implementing the present invention. This system allows a traveler to input their travel destination, budget, length of stay, and desired travel style, and then proposes the optimal travel plan. A specific embodiment of this system is described below.

[0033] User Input Method

[0034] Device:

[0035] Users are presented with an interface, which can be in the form of a web page or a mobile application, for inputting their travel destination, budget, length of stay, and travel style.

[0036] Examples:

[0037] The user enters their travel destination "Kyoto," their budget "50,000 yen," their length of stay "2 days," and their travel style "food tour."

[0038] Database search methods

[0039] server:

[0040] The server receives the information sent by the user and searches the database for information on related tourist spots, restaurants, and activities, including queries to extract information on "Kyoto" and "food tours."

[0041] Examples:

[0042] If the travel destination is "Kyoto" and the travel style is "food-hopping," the server retrieves information such as "Nishiki Market" and "Japanese confectionery shops" from the database.

[0043] Travel plan generation method

[0044] server:

[0045] Based on the information retrieved from the database, the server generates a specific itinerary tailored to the user's length of stay, including places to visit and activities tailored to the user's preferences and needs.

[0046] Examples:

[0047] The itinerary generated for the first day includes "eating around Nishiki Market" in the morning, "visiting a Japanese sweets shop" in the afternoon, and "strolling around the Gion district" in the evening. The itinerary also includes "visiting a historical temple" in the morning of the second day and "lunch at a local cafe" in the afternoon.

[0048] Travel plan presentation method

[0049] Device:

[0050] The server generates a travel plan and presents it to the user through the chatbot, who can then check the plan on their smartphone or PC.

[0051] Examples:

[0052] The chatbot sends users messages like, "Here's a recommended itinerary: Day 1: Eat your way through Nishiki Market, then explore the Gion district. Day 2: Visit a historic temple and have lunch at a local cafe."

[0053] Feedback collection methods

[0054] Device:

[0055] Provide an interface for collecting user feedback after the trip is completed.

[0056] Examples:

[0057] After the chatbot sends a message such as "Please tell us your thoughts about the travel plan," the user enters feedback such as "Nishiki Market was crowded, so please suggest a different time next time."

[0058] server:

[0059] The server receives the feedback from the user and stores it in a database, which is then taken into account when generating the next plan.

[0060] This allows travelers to efficiently plan their trips, and since the plans are continually improved based on feedback after the trip, future trip plans will be more accurate and satisfying. This system allows travelers to easily obtain the best travel plans that suit their needs.

[0061] The processing flow will be explained below.

[0062] Step 1: Displaying a user input form

[0063] Device:

[0064] Provide an interface for travelers to input their travel destination, budget, length of stay, and preferred travel style, displayed using text boxes and drop-down lists in the form of a web page or mobile application.

[0065] Specific behavior:

[0066] Displays input fields for destination, budget, length of stay, and travel style.

[0067] A "Submit" button will be provided so that users can submit their input as soon as it is complete.

[0068] Step 2: Sending User Input

[0069] User:

[0070] Enter the required information about your destination, budget, length of stay, and travel style into each field and press the submit button.

[0071] Specific behavior:

[0072] Enter information such as travel destination "Kyoto," budget "50,000 yen," length of stay "2 days," and travel style "food tour."

[0073] By pressing the send button, the information is sent to the server.

[0074] Step 3: Receiving input information

[0075] server:

[0076] Receives and analyzes user-submitted travel information for use in generating database queries.

[0077] Specific behavior:

[0078] Analyze the received form data and store the travel destination, budget, length of stay, and travel style in variables.

[0079] Step 4: Generate and execute database queries

[0080] server:

[0081] Generate database queries based on analyzed user input information to search for tourist destinations and activity information.

[0082] Specific behavior:

[0083] If the travel destination is "Kyoto" and the travel style is "food tour," a query is generated to search for related tourist spots and restaurants.

[0084] Execute a query against the database and retrieve the results.

[0085] Step 5: Parse the search results

[0086] server:

[0087] The search results obtained from the database are analyzed and used as material for generating travel plans.

[0088] Specific behavior:

[0089] Get a list of tourist attractions and restaurants from your search results and prioritize them based on length of stay and budget.

[0090] Step 6: Generate your travel plan

[0091] server:

[0092] Based on the analysis results, a specific travel plan is generated that matches the user's length of stay.

[0093] Specific behavior:

[0094] A schedule is generated for the first day, such as "eating around Nishiki Market" in the morning, "strolling around the Gion district" in the afternoon, and "visiting a Japanese confectionery shop" in the evening.

[0095] Generate a schedule such as "visit a historical temple" in the morning of the second day and "have lunch at a local cafe" in the afternoon.

[0096] Step 7: Submit your travel plans

[0097] server:

[0098] The generated itinerary is passed to the chatbot in a structured format.

[0099] Specific behavior:

[0100] The generated travel plan is converted into JSON format etc. and sent to the chatbot.

[0101] Step 8: Present your travel plans

[0102] Device:

[0103] The chatbot presents users with the best travel plans.

[0104] Specific behavior:

[0105] The chatbot will message the user saying, "Here's a recommended itinerary: Day 1, eat your way through Nishiki Market, then explore the Gion district; Day 2, visit a historic temple and have lunch at a local cafe."

[0106] Step 9: Request feedback

[0107] Chatbots:

[0108] Send a message after the trip to ask for user feedback.

[0109] Specific behavior:

[0110] The chatbot sends a message requesting feedback: "Please tell us what you think about our travel plans."

[0111] Step 10: Receive and store feedback

[0112] User:

[0113] Enter and submit feedback on your travel plans.

[0114] Specific behavior:

[0115] Enter comments such as "Nishiki Market was crowded, so please suggest a different time next time" into the feedback form.

[0116] Click the submit button to send your feedback.

[0117] server:

[0118] Receive user feedback and store it in a database.

[0119] Specific behavior:

[0120] Analyze the feedback received and store it in the relevant travel plan record.

[0121] The saved feedback is used to improve the plan generation algorithm for the next iteration.

[0122] This will create a system that provides optimal travel plans for each individual traveler and improves the quality of the plans based on feedback.

[0123] Example 1

[0124] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0125] Today's travelers need an easy way to find the best travel plan that suits their destination, budget, length of stay, and preferred travel style. However, manually creating plans tailored to individual needs takes time and effort. In addition, there is a lack of a way to incorporate past experiences and feedback into future travel plans, making it difficult to further improve travel satisfaction.

[0126] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0127] In this invention, the server includes: means for the user to input their travel destination, budget, length of stay, and desired travel style; computer server means for receiving the input information and searching a database for related tourist destination and activity information; means for generating a specific travel plan tailored to the user's length of stay using a generative AI model based on the search results; and terminal means for presenting the generated travel plan to the user and providing an interactive interface for the user to check the plan. This allows the user to efficiently and precisely obtain a travel plan that meets their needs, and further enables them to reflect their post-trip feedback in future plans, resulting in a more satisfying trip.

[0128] "User input means" refers to a means by which a user inputs information about a travel destination, budget, length of stay, and desired travel style.

[0129] The "computer server" is a server that searches the database based on the information received from the user and obtains information on appropriate tourist spots and activities.

[0130] A "generative AI model" is an artificial intelligence model that generates travel plans that reflect the user's preferences and needs based on acquired data.

[0131] An "interactive interface" is a means of presenting the generated travel plan to the user and allowing the user to review the plan, and is typically used via a smartphone or PC.

[0132] The "feedback collection means" is a means for collecting feedback from users after their trip, and is used to reflect this feedback when generating the next plan.

[0133] A "database" is an information storage system for storing information about tourist attractions and activities.

[0134] The "travel plan generation means" is a means for generating a specific travel plan tailored to the user's length of stay based on information obtained from the database.

[0135] A "terminal" is a device that allows a user to use an interface to provide input information and check the generated travel plan, and includes a smartphone or personal computer.

[0136] The following system is conceivable as an embodiment of the present invention. This system allows a traveler to input their travel destination, budget, length of stay, and desired travel style, and then proposes an optimal travel plan. This system includes a user input means, a computer server, a generative AI model, an interactive interface, and a feedback collection means.

[0137] User Input Method

[0138] Device:

[0139] Users input information such as their travel destination, budget, length of stay, and travel style through a device. The device is provided in the form of a web page or mobile application. Specifically, users input their travel destination "Kyoto," their budget "50,000 yen," their length of stay "2 days," and their travel style "food-hopping."

[0140] Data reception and search methods

[0141] server:

[0142] The computer server receives the information sent by the user and searches the database for information on related tourist spots and activities. This search includes queries to extract information on "Kyoto" and "food tours," for example. Specifically, the server retrieves information on "Nishiki Market" and "Japanese confectionery shops" from the database based on the information on "food tours" in "Kyoto."

[0143] Travel plan generation method

[0144] server:

[0145] Based on the acquired data, the server uses a generative AI model to generate a specific itinerary tailored to the user's length of stay. The itinerary includes visits and activities tailored to the user's preferences and needs. Specifically, the itinerary generated on the first day includes a "food tour of Nishiki Market" in the morning, a "visit to a Japanese confectionery shop" in the afternoon, and a "stroll through the Gion district" in the evening. The itinerary on the second day also includes a "visit to a historic temple" and "lunch at a local cafe."

[0146] Travel plan presentation method

[0147] Device:

[0148] The generated itinerary is presented to the user through the chatbot. The user can check the itinerary using their smartphone or PC. Specifically, the chatbot sends a message saying, "Here's a recommended itinerary: On day one, enjoy a bite to eat at Nishiki Market, then stroll through the Gion district. On day two, visit a historic temple and have lunch at a local cafe."

[0149] Feedback collection methods

[0150] Device:

[0151] After the trip, an interface is provided to collect feedback from the user. Specifically, the chatbot sends a message saying, "Please tell us your thoughts about the trip plan," and the user enters feedback such as, "Nishiki Market was crowded, so please suggest a different time next time."

[0152] server:

[0153] The server receives the user's feedback and stores it in a database. This allows the server to take this feedback into account when generating the next plan. Specifically, the server will change the time slot for visiting Nishiki Market based on the feedback.

[0154] Prompt Sentence Examples

[0155] An example of a prompt sentence to be input to the generative AI model in this system is as follows:

[0156] Examples:

[0157] "I'd like to travel to Kyoto for two days. My budget is 50,000 yen, and my travel style is to eat my way around. What plan do you recommend?"

[0158] As a result, the system provides users with the best travel plans and is continuously improved based on their feedback, allowing users to easily obtain travel plans that suit their needs and achieve a highly satisfying travel experience.

[0159] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0160] Step 1:

[0161] User enters travel information

[0162] Terminal: The user enters the travel destination, budget, length of stay, and desired travel style and submits.

[0163] What happens: A user launches a web page or mobile application, fills in a form displayed in the interface, and clicks the "Submit" button.

[0164] Input: User entered travel destination "Kyoto", budget "50,000 yen", length of stay "2 days", travel style "food tour".

[0165] Output: The input information is sent to the server.

[0166] Step 2:

[0167] Receive information and search the database

[0168] Server: The server searches the database based on the received information and retrieves information on related tourist spots and activities.

[0169] What it does: The server receives the HTTP request and generates an SQL query based on the travel destination and style to extract information from the database.

[0170] Input: Input information submitted by the user.

[0171] Output: Information about related tourist attractions and activities (e.g., "Nishiki Market," "Japanese sweets shop").

[0172] Step 3:

[0173] Generate a travel plan

[0174] Server: Based on the acquired data, the server uses a generative AI model to generate a specific travel plan tailored to the user's length of stay.

[0175] How it works: The server passes the data to a plan generation algorithm, and the generative AI model creates a visit schedule for each day. The generated plan is saved in JSON format.

[0176] Input: Information about tourist attractions and activities retrieved from a database.

[0177] Output: A specific travel plan (e.g., on the first day, "Eat your way around Nishiki Market" in the morning, "Visit a Japanese sweets shop" in the afternoon, and "Walk around the Gion district" in the evening).

[0178] Step 4:

[0179] Present the generated itinerary to the user

[0180] Terminal: The generated travel plan is presented to the user through the chatbot.

[0181] Specific operation: The server sends the generated travel plan to the chatbot, which then sends a message to the user. The user then checks the plan on their smartphone or PC.

[0182] Input: The generated itinerary.

[0183] Output: The message shown to the user (e.g., "Here's a suggested itinerary: Day 1: Eat your way through Nishiki Market, then explore the Gion district. Day 2: Visit a historic temple and have lunch at a local cafe.").

[0184] Step 5:

[0185] Collect user feedback

[0186] Terminal: An interface is provided to collect feedback from users after the trip is completed.

[0187] What happens: The chatbot sends a message saying, "Please tell us what you think about our travel plans," and the user enters their feedback.

[0188] Input: User feedback (e.g., "Nishiki Market was crowded, please suggest a different time next time.").

[0189] Output: The entered feedback is sent to the server.

[0190] Step 6:

[0191] Receive feedback and store it in a database

[0192] Server: The server receives the feedback from the user and stores it in a database. The next time a plan is generated, this feedback will be taken into account.

[0193] Specific operation: The server receives the feedback data, inserts the feedback data into the database, and, if necessary, configures the saved feedback so that it is used for the next plan generation.

[0194] Input: User feedback.

[0195] Output: Feedback stored in a database that will be used to improve the next itinerary generation.

[0196] Through these steps, the system can provide users with efficient, precise, and personalized travel plans, and continuously improve those plans.

[0197] (Application example 1)

[0198] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0199] In recent years, there has been a growing demand for the rapid provision of personalized travel plans that meet the diverse needs of travelers. However, conventional systems lack the means to simulate specific experiences before travelers actually visit a destination when proposing travel plans. This has led to challenges in improving traveler satisfaction and low accuracy of plans. It is also difficult to effectively collect feedback from travelers and reflect it in future plans.

[0200] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0201] In this invention, the server includes: a means for a user to input their travel destination, budget, length of stay, and desired travel style; a means for searching a database for related tourist spots and activity information based on the input information; a means for generating a specific travel plan tailored to the user's length of stay based on the search results; a means for presenting the generated travel plan to the user; and a means for the user to experience the generated travel plan in a virtual reality environment. This allows travelers to experience specific tourist experiences in advance in a virtual space, and allows them to provide more accurate feedback based on that experience, which can be reflected in future travel plans.

[0202] "User" refers to a person who uses the System to generate and experience travel plans.

[0203] "Destination" means a geographic location that a User wishes to visit.

[0204] "Budget" refers to the financial constraints a user has when traveling.

[0205] "Length of Stay" refers to the length of time a user plans to stay at a travel destination.

[0206] "Desired travel style" refers to the types of activities and experiences users seek while traveling.

[0207] "Input means" refers to an interface through which a user provides information about travel destination, budget, length of stay, and travel style to the system.

[0208] "Database" refers to a system that stores travel-related data such as tourist destination and activity information.

[0209] "Searching means" refers to the process of extracting relevant information from a database based on input information.

[0210] "Means of generation" refers to the process of creating a specific travel plan based on the search results.

[0211] "Presentation means" refers to an interface for providing the generated travel plan to the user.

[0212] "Virtual reality environment" refers to an environment in which users can use virtual reality technology to simulate a travel plan as if it were a real experience.

[0213] "Feedback" refers to ratings and opinions about travel plans provided by users.

[0214] "Measures to improve" refers to the process of improving the accuracy and satisfaction of future travel plans based on collected feedback.

[0215] This invention provides a system that allows users to input their travel destination, budget, length of stay, and desired travel style, generate an optimal travel plan based on the input, and then experience the plan in a virtual reality environment. Specific embodiments for implementing the invention are described below.

[0216] User Input Method

[0217] Users input their travel destination, budget, length of stay, and travel style via devices such as smartphones or PCs, using interfaces provided on web pages or mobile applications.

[0218] Database search methods

[0219] The server has a means for receiving the information sent by the user and searching the database for information on related tourist spots, restaurants, and activities. For example, if the travel destination is "Kyoto" and the travel style is "eating around," information on "markets" and "restaurants" is retrieved from the database.

[0220] Travel plan generation method

[0221] The server generates a specific itinerary based on the information retrieved from the database, tailored to the user's length of stay. For example, a possible itinerary on the first day could be "eating around the marketplace" in the morning, "exploring the historic area" in the afternoon, and "cafe-hopping" in the evening.

[0222] Travel plan presentation method

[0223] The server uses chatbots and notification functions to present the generated travel plans to users, who can then check the plans on their smartphones or PCs.

[0224] Virtual experience means

[0225] One of the features of this system is that users can experience the travel plan generated in a virtual reality environment by wearing smart glasses or a head-mounted display and simulating the travel plan in a virtual space.

[0226] Feedback collection methods

[0227] After the trip, feedback is collected through the device and the travel plan is improved based on that feedback. For example, specific feedback such as "The market was crowded, so please suggest a different time."

[0228] Hardware and software used

[0229] Server: Executes programs, performs database searches, and generates plans. For example, we use a cloud server (AWS, GCP).

[0230] Database: Use a database management system such as SQLite or MySQL.

[0231] Chatbots: Use natural language processing solutions such as Dialogflow (Google).

[0232] Virtual reality system: A VR environment developed with Unity or Unreal Engine.

[0233] Specific examples

[0234] The user inputs their travel destination "Kyoto," their budget "50,000 yen," their stay length "2 days," and their travel style "food-hopping." The system extracts tourist spots related to "food-hopping" in "Kyoto" from a database and generates a plan that includes, for example, "food-hopping at markets," "strolling around historical areas," and "cafe-hopping." The user puts on a VR headset and experiences these spots in virtual reality. After the trip, feedback is collected from the user and reflected in future plans.

[0235] Prompt Sentence Examples

[0236] "My next trip is to Kyoto, my budget is 50,000 yen, I'll be there for two days, and my travel style will be food-hopping. What's your recommended plan?"

[0237] "The market was crowded, so please suggest a different time."

[0238] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0239] Step 1:

[0240] The user inputs their travel destination, budget, length of stay, and desired travel style through the device interface. The input data is sent to the server in JSON format. The input data specifically includes information such as "Destination: Kyoto," "Budget: 50,000 yen," "Length of stay: 2 days," and "Travel style: Eating around."

[0241] Step 2:

[0242] The server analyzes the received user data and stores it in variables. The variables store the travel destination, budget, length of stay, and travel style. This defines the parameters required for database searches. For example, the variable destination might store "Kyoto," budget "50,000 yen," duration "2 days," and style "food tour."

[0243] Step 3:

[0244] The server generates a query to search for related tourist spots and activity information from the database. The generated query is constructed in the form of an SQL statement based on variables. For example, the SQL query "SELECT FROM activities WHERE location="Kyoto" AND style="food-hopping"" is generated. This extracts related tourist spots and activity information from the database.

[0245] Step 4:

[0246] The server generates a specific travel plan tailored to the user's length of stay based on the extracted tourist destination and activity information. The plan generation algorithm allocates the extracted data to appropriate time slots to create a schedule that best suits the user's needs. For example, an itinerary such as "eating around the market" in the morning of the first day, "strolling around the historical area" in the afternoon, and "cafe hopping" in the evening could be automatically generated.

[0247] Step 5:

[0248] The generated travel plan is converted into JSON format and presented to the user. The server then sends the generated plan to the user in the form of a chatbot. The user can then check the plan on their smartphone or PC. For example, a specific schedule such as "Day 1: Eat your way around the market, stroll through the historical area, and visit cafes. Day 2: Visit a famous local temple and have lunch at a cafe" is presented.

[0249] Step 6:

[0250] Users use smart glasses or a head-mounted display to experience the generated travel plan in a virtual reality environment. The virtual reality application is developed using Unity or Unreal Engine and simulates tourist spots and activities with the feeling of visiting them in real life. Users can visit specific spots in VR and check the experience.

[0251] Step 7:

[0252] After completing the trip, the user enters feedback through the device. The device interface includes a simple evaluation form and a free response section, where the user provides their evaluation and opinion on the travel plan. For example, specific feedback such as "The market was crowded, so please suggest a different time next time" can be included.

[0253] Step 8:

[0254] The server analyzes the feedback collected from users and stores it in a database. The stored feedback is taken into consideration when generating future travel plans and is used to improve user satisfaction. The feedback analysis algorithm extracts areas for improvement based on the collected data and reflects them in the parameters for generating new plans.

[0255] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0256] The following describes an embodiment of the present invention. The present invention allows travelers to input their travel destination, budget, length of stay, and desired travel style, and proposes the optimal travel plan. Furthermore, it combines an emotion engine that recognizes the user's emotions to provide a more personalized travel experience.

[0257] User Input Method

[0258] Device:

[0259] Users are presented with an interface, which can be in the form of a web page or a mobile application, for inputting their travel destination, budget, length of stay, and travel style.

[0260] Examples:

[0261] The user enters their travel destination "Kyoto," their budget "50,000 yen," their length of stay "2 days," and their travel style "food tour."

[0262] Emotion Engine

[0263] Device:

[0264] As users type, emotions are recognized and analyzed by an emotion engine that uses facial recognition software and voice analysis algorithms to identify the user's emotions.

[0265] Examples:

[0266] If the user is excited while typing, a positive emotion is perceived.

[0267] Database search methods

[0268] server:

[0269] The server receives the information and recognized emotions sent by the user and searches the database for information on related tourist spots, restaurants, and activities, including queries to extract information on "Kyoto" and "food tours."

[0270] Examples:

[0271] If the travel destination is "Kyoto" and the travel style is "food-hopping," the server retrieves information such as "Nishiki Market" and "Japanese confectionery shops" from the database.

[0272] Emotion-Based Adjustments

[0273] server:

[0274] Based on the information obtained, the travel plan can be adjusted taking into account the user's emotions: if positive emotions are recognized, more adventurous activities can be included in the plan.

[0275] Examples:

[0276] If the user is excited, the destinations will include things like "visiting cafes in the Gion district at night."

[0277] Travel plan generation method

[0278] server:

[0279] Based on the information retrieved from the database, the server generates a specific itinerary tailored to the user's length of stay, incorporating the results of the emotion engine. The itinerary includes places to visit and activities tailored to the user's preferences and needs.

[0280] Examples:

[0281] The generated schedule includes "eating around Nishiki Market" in the morning of the first day, "strolling around the Gion district" in the afternoon, and "visiting a Japanese sweets shop" in the evening. The schedule also includes "visiting a historical temple" in the morning of the second day, and "lunch at a local cafe" in the afternoon.

[0282] Travel plan presentation method

[0283] Device:

[0284] The server generates a travel plan and presents it to the user through the chatbot, who can then check the plan on their smartphone or PC.

[0285] Examples:

[0286] The chatbot sends users messages like, "Here's a recommended itinerary: Day 1: Eat your way through Nishiki Market, then explore the Gion district. Day 2: Visit a historic temple and have lunch at a local cafe."

[0287] Feedback collection methods

[0288] Device:

[0289] Provide an interface for collecting user feedback after the trip is completed.

[0290] Examples:

[0291] After the chatbot sends a message such as "Please tell us your thoughts about the travel plan," the user enters feedback such as "Nishiki Market was crowded, so please suggest a different time next time."

[0292] server:

[0293] The server receives the feedback from the user and stores it in a database, which is then taken into account when generating the next plan.

[0294] Utilizing Emotional Data

[0295] server:

[0296] The company will analyze sentiment data collected from users and use it to improve its travel plan generation algorithm, enabling even more advanced personalization in the future.

[0297] Examples:

[0298] Record activities that excited users on past trips and include similar activities in your next travel plans.

[0299] This allows travelers to efficiently plan their trips, and since the plans are continually improved based on post-trip feedback and emotional data, future trip plans will be more accurate and satisfying. This system allows travelers to easily obtain the optimal travel plan that suits their needs and emotions.

[0300] The processing flow will be explained below.

[0301] Step 1: Displaying a user input form

[0302] Device:

[0303] Present an interface for travelers to input their travel destination, budget, length of stay, and preferred travel style. This can be done using text boxes and drop-down lists in the form of a web page or mobile application.

[0304] Specific behavior:

[0305] Displays input fields for destination, budget, length of stay, and travel style.

[0306] Provide a "Submit" button so users can submit their information as soon as it is entered.

[0307] Step 2: Sending User Input

[0308] User:

[0309] Enter information about your destination, budget, length of stay, and travel style into the fields and press the submit button.

[0310] Specific behavior:

[0311] Enter information such as travel destination "Kyoto," budget "50,000 yen," length of stay "2 days," and travel style "food tour."

[0312] Press the send button and the information will be sent to the server.

[0313] Step 3: Receiving and parsing input information

[0314] server:

[0315] It receives user-submitted travel information, parses it for use in generating database queries, and passes the information to the emotion engine.

[0316] Specific behavior:

[0317] Analyze the received form data and store the travel destination, budget, length of stay, and travel style in variables.

[0318] Pass user input information to the emotion engine to obtain emotion data.

[0319] Step 4: Recognize user emotions

[0320] Device:

[0321] The emotion engine analyzes the user's facial expressions and voice in real time as they type, recognizing their emotional state.

[0322] Specific behavior:

[0323] It uses facial recognition software and voice analysis algorithms to recognize emotions (e.g., joy or excitement) that users express while typing.

[0324] The recognized emotion data is sent to the server.

[0325] Step 5: Generate and execute database queries

[0326] server:

[0327] Based on the analyzed user input information and emotion data, a database query is generated to search for tourist destinations and activity information.

[0328] Specific behavior:

[0329] If the travel destination is "Kyoto" and the travel style is "food-hopping," generate a query to search for related tourist spots and restaurants.

[0330] Execute the query and retrieve the results from the database.

[0331] Step 6: Parse the search results

[0332] server:

[0333] The search results obtained from the database are analyzed and used to generate travel plans.

[0334] Specific behavior:

[0335] Get a list of tourist attractions and restaurants from your search results and prioritize them based on length of stay and budget.

[0336] Step 7: Generate your travel plan

[0337] server:

[0338] A specific travel plan is generated based on the information acquired by the server and the user's emotional data.

[0339] Specific behavior:

[0340] A schedule is generated for the first day, such as "eating around Nishiki Market" in the morning, "strolling around the Gion district" in the afternoon, and "visiting a Japanese confectionery shop" in the evening.

[0341] Generate a schedule such as "visit a historical temple" in the morning of the second day and "have lunch at a local cafe" in the afternoon.

[0342] If the user's sentiment is positive, make adjustments, such as including evening activities.

[0343] Step 8: Present your travel plans

[0344] Device:

[0345] The server generates a travel plan and presents it to the user through the chatbot.

[0346] Specific behavior:

[0347] The chatbot will message the user saying, "Here's a suggested itinerary: Day 1: Eat your way through Nishiki Market, then explore the Gion district. Day 2: Visit a historic temple and have lunch at a local cafe."

[0348] Step 9: Request feedback

[0349] Chatbots:

[0350] Send a message after the trip to ask for user feedback.

[0351] Specific behavior:

[0352] Send a message asking for feedback: "Tell us what you think about our travel plans."

[0353] Step 10: Receive and store feedback

[0354] User:

[0355] Enter and submit feedback on your travel plans.

[0356] Specific behavior:

[0357] Enter comments such as "Nishiki Market was crowded, so please suggest a different time next time" into the feedback form.

[0358] Click the submit button to send your feedback.

[0359] server:

[0360] Receive user feedback and store it in a database.

[0361] Specific behavior:

[0362] Analyze the feedback received and store it in the relevant travel plan record.

[0363] The saved feedback is used to improve the plan generation algorithm for the next iteration.

[0364] Step 11: Analyze and use sentiment data

[0365] server:

[0366] The collected emotional data is analyzed and used to generate future plans.

[0367] Specific behavior:

[0368] Analyze the positive emotional data users have shown on past trips and reflect it in their next travel plans.

[0369] For example, if a user expresses high satisfaction with a particular activity, we will take that into account and include a similar activity in our next plan.

[0370] Example 2

[0371] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0372] Conventional travel plan generation systems propose travel plans without considering the user's feelings, making it difficult to provide plans that satisfy the user. Furthermore, they do not fully utilize feedback and are unable to provide continuously improved plans. This leads to a decrease in user satisfaction.

[0373] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for the user to input the travel destination, budget, length of stay, and desired travel style, means for recognizing and analyzing the user's emotions based on the input information, means for searching for related tourist destination and activity information from a database based on the analyzed emotion data and the input information, means for adjusting the travel plan taking the user's emotions into consideration based on the acquired information, means for generating a specific travel plan tailored to the user's length of stay using the adjusted information, and means for presenting the generated travel plan to the user. This makes it possible to provide an optimal travel plan based on the user's emotions and needs, thereby improving user satisfaction.

[0374] "User" means an individual who utilizes the System and inputs information to generate a travel plan.

[0375] "Travel Destination" means a destination that a User wishes to visit.

[0376] "Budget" means the range of funds available to User for Travel.

[0377] "Length of Stay" means the period of time that a User intends to stay at a particular travel destination.

[0378] "Travel style" refers to the type or theme of travel based on the user's preferences.

[0379] "Input means" refers to the interface that allows users to provide information such as travel destination, budget, length of stay, and travel style to the system.

[0380] "Means for recognizing and analyzing emotions" refers to the function of capturing the user's facial expressions and voice and analyzing them using an emotion engine.

[0381] "Database" refers to a collection of information that stores information about travel destinations, tourist attractions, restaurants, and activities.

[0382] "Searching means" refers to the function of extracting relevant information from a database based on user input and emotional data.

[0383] "Adjustment" refers to the ability to optimize travel plans to meet the user's needs based on the information obtained and the user's emotional data.

[0384] "Means for generating" refers to the function of using the adjusted information to create a specific travel plan tailored to the user's length of stay.

[0385] "Presentation means" refers to the function for displaying and providing the generated travel plan to the user.

[0386] "Feedback" refers to the evaluations and opinions about the plan provided by the user after the trip is completed.

[0387] The present invention is a system that allows travelers to input their travel destination, budget, length of stay, and desired travel style, and then proposes an optimal travel plan taking the user's emotions into consideration. This system acquires the user's input information and emotion data, performs a database search based on this, and generates and presents an appropriate travel plan. Specific methods for implementing this system are described below.

[0388] Hardware and Software Configuration

[0389] Device: The device that provides the interface for the user to enter input. This can be a smartphone, tablet, or PC. The interface can be implemented in the form of a web page or mobile application.

[0390] Emotion Engine: Analyzes user emotions using facial expression recognition software and voice analysis algorithms, such as OpenCV for facial expression recognition and Google Cloud Speech-to-Text API for voice analysis.

[0391] Server: The central server performs database searches, information retrieval, and plan generation, coordination, and presentation. The database contains detailed information about tourist spots, restaurants, and activities.

[0392] Chatbots: Used to interact with users, for example, by providing travel itineraries and collecting feedback in a natural conversational format using Dialogflow or the Microsoft Bot Framework.

[0393] System Overview

[0394] User Input Method

[0395] Users input their travel destination, budget, length of stay, and travel style using a device. The interface is designed to be intuitive and easy to use. For example, a user inputs their travel destination "Kyoto," their budget "50,000 yen," their stay length "2 days," and their travel style "food-hopping."

[0396] Emotion Engine

[0397] When a user enters this information, the device's camera and microphone are used to capture the user's facial expressions and voice, which are then analyzed by the emotion engine. The emotion engine uses facial recognition software and voice analysis algorithms to identify the user's emotional state (e.g., excitement, joy, etc.). For example, if the user is excited while entering information, a positive emotion is recognized.

[0398] Database search methods

[0399] The server receives the information sent by the user and analyzed emotion data, and searches the database for information on related tourist spots, restaurants, and activities. For example, if the travel destination is "Kyoto" and the travel style is "eating around," the server will retrieve information such as "Nishiki Market" and "Japanese confectionery shops" from the database.

[0400] Emotion-Based Adjustments

[0401] The server then uses the information it has acquired to adjust the itinerary, taking into account the user's emotions. If a positive emotion is detected, it can include more adventurous activities in the itinerary. For example, if the user is excited, it can add a trip to the Gion district at night to the itinerary.

[0402] Travel plan generation method

[0403] Based on the information retrieved from the database, the server generates a specific itinerary tailored to the user's length of stay, while also incorporating the results of the emotion engine. The itinerary includes visits and activities tailored to the user's preferences and needs. For example, a schedule may be generated such as "eating around Nishiki Market" in the morning of the first day, "strolling around the Gion district" in the afternoon, and "visiting a Japanese confectionery shop" in the evening. Another schedule may include "visiting a historical temple" in the morning of the second day, and "lunch at a local cafe" in the afternoon.

[0404] Travel plan presentation method

[0405] The server generates a travel plan and presents it to the user via the device. The user can then view the plan on their smartphone or PC, checking detailed schedules and location information. For example, the chatbot could send a message to the user saying, "Here's a recommended travel plan: On day one, enjoy a bite to eat at Nishiki Market, then stroll through the Gion district. On day two, visit a historic temple and have lunch at a local cafe."

[0406] Feedback collection methods

[0407] After the trip, an interface is provided to collect feedback from the user. For example, after the chatbot sends a message such as "Please tell us your thoughts about the trip plan," the user can enter feedback such as "Nishiki Market was crowded, so please suggest a different time next time."

[0408] Utilizing Emotional Data

[0409] The server receives user feedback and sentiment data, analyzes it, and uses it to improve the itinerary generation algorithm, enabling greater personalization in the future. For example, it can record activities that excited users on past trips and include similar activities in the next itinerary.

[0410] Examples of prompt statements

[0411] 1. "Enter your travel destination as 'Kyoto,' your budget as '50,000 yen,' your stay period as '2 days,' and your travel style as 'eating around.' Then, if the emotion engine detects an excited state, add positive activities to your plan."

[0412] 2. "The system uses facial recognition software and voice analysis algorithms to identify the user's emotions. Based on the information and emotional data entered by the user, the server then searches for relevant information from a database and generates a travel plan, which includes activities tailored based on the emotions."

[0413] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0414] Step 1: Receiving User Input

[0415] Terminal: Provides an interface where users can input their travel destination, budget, length of stay, and desired travel style. The input information is sent to the server. For example, a user might input "Travel destination: Kyoto, Budget: 50,000 yen, Length of stay: 2 days, Travel style: Eating around" into a smartphone app.

[0416] Input: Travel destination, budget, length of stay, travel style

[0417] Output: User input data (travel destination "Kyoto", budget "50,000 yen", length of stay "2 days", travel style "food-hopping")

[0418] Step 2: Emotion analysis using the emotion engine

[0419] Device: When a user provides input, the device's camera and microphone are used to capture facial expressions and voice, and the emotion engine analyzes the data. Using facial recognition software and voice analysis algorithms, the user's emotions are identified. For example, if a user says "eating out" in an excited voice, the emotion engine recognizes a positive emotion.

[0420] Input: Real-time facial expression data, voice data

[0421] Output: Parsed emotion data (positive, excited)

[0422] Step 3: Database search

[0423] Server: Based on the acquired user input data and emotion data, the server searches the database for information on related tourist spots, restaurants, and activities. For example, if the travel destination is "Kyoto" and the travel style is "eating around," the server will search and extract information such as "Nishiki Market" and "Japanese confectionery shops."

[0424] Input: User input data, emotion data

[0425] Output: Related information (tourist information, restaurant information, activity information)

[0426] Step 4: Emotionally Based Adjustment

[0427] Server: Based on the acquired tourist destination and activity information, the plan contents are adjusted taking into account the user's emotional state. If a positive emotion is recognized, more adventurous activities are added. For example, if the user is excited, "Café hopping in the Gion district at night" is added to the plan.

[0428] Input: related information, emotion data

[0429] Output: Adjusted itinerary information

[0430] Step 5: Generate your travel plan

[0431] Server: Using the adjusted information, the server generates a specific itinerary tailored to the user's length of stay. The itinerary includes visits and activities tailored to the user's preferences and needs. For example, the server generates a schedule such as "eating around Nishiki Market" in the morning of the first day, "strolling around the Gion district" in the afternoon, and "visiting a Japanese confectionery shop" in the evening, and "visiting a historical temple" in the morning of the second day, and "lunch at a local cafe" in the afternoon.

[0432] Input: Adjusted travel plan information, length of stay data

[0433] Output: Final itinerary

[0434] Step 6: Present your travel plans

[0435] Device: Presents the generated itinerary to the user. The user can then view the itinerary on their smartphone or PC, along with detailed schedules and location information. For example, the chatbot could send a message such as, "Here's a recommended itinerary: Day 1, eat your way through Nishiki Market, then explore the Gion district. Day 2, visit a historic temple and have lunch at a local cafe."

[0436] Input: Final travel plan

[0437] Output: Plan data to be presented to the user

[0438] Step 7: Gather feedback

[0439] Terminal: Provides an interface for collecting feedback from users after the trip. For example, the chatbot sends a message saying, "Please tell us what you thought about the trip plan," and the user enters feedback such as, "Nishiki Market was crowded, so please suggest a different time next time."

[0440] Input: User feedback

[0441] Output: Feedback data

[0442] Step 8: Leverage feedback data

[0443] Server: Receives user feedback and sentiment data, analyzes it, and uses it to improve the itinerary generation algorithm. For example, it records activities that excited users on past trips and includes similar activities in the next itinerary.

[0444] Input: Feedback data, emotion data

[0445] Output: Improved algorithms and database updates

[0446] (Application example 2)

[0447] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0448] Conventional travel plan generation systems create travel plans without considering user emotions, making it difficult to provide a fully optimized travel experience for each individual user. Even if feedback is collected, there is a lack of effective ways to utilize it, making it difficult to reflect it in future travel plans. Furthermore, there are limited ways to visually check the travel plan, making it difficult to meet user expectations.

[0449] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for the user to input their travel destination, budget, length of stay, and desired travel style; means for recognizing and analyzing emotions; means for searching a database for related tourist destination and activity information based on the input information and the recognized emotions; means for generating a travel plan taking into account the search results and the user's emotions; and means for presenting the generated travel plan to the user in a virtual reality space. This makes it possible to generate and present a travel plan optimized for each individual user, taking into account the user's emotions, thereby improving the user's experience and satisfaction.

[0450] "User" means an individual or group who wishes to use the system to generate a travel plan.

[0451] A "destination" is a specific geographic location that a user wishes to visit.

[0452] "Budget" is the amount of money the user plans to spend during the trip.

[0453] "Length of Stay" means the length of time a user intends to stay at a particular travel destination.

[0454] "Travel style" refers to the user's preferred travel method or theme (e.g., food tours, sightseeing, activities).

[0455] The "means for inputting" is an interface that allows a user to input travel destination, budget, length of stay, and travel style into the system.

[0456] "Means for recognizing and analyzing emotions" refers to software or hardware that identifies and analyzes emotions from a user's facial expressions and voice.

[0457] The "database search means" is a function for searching for related tourist destination and activity information based on the input information and recognized emotions.

[0458] The "means for generating a travel plan" refers to algorithms and software for creating a specific travel plan taking into account the searched information and the user's emotions.

[0459] The "means for presenting in virtual reality space" is an interface for visually presenting the generated travel plan to the user through a virtual reality device.

[0460] "Means for collecting feedback" refers to an interface for receiving opinions and impressions from users after the trip is completed.

[0461] The "means for improving travel plans based on feedback" refers to algorithms and software that analyze collected user feedback and incorporate it into future travel plans.

[0462] The present invention is a system that generates and presents optimal travel plans while recognizing emotions, based on the traveler's input of destination, budget, length of stay, and desired travel style. This system is configured as follows:

[0463] First, users use an interface to input their travel destination, budget, length of stay, and desired travel style. This interface is provided through devices such as smartphones or head-mounted displays (HMDs). For example, a user inputs information such as "Kyoto," "50,000 yen," "2 days," and "food tour" through the device.

[0464] Next, an emotion engine is activated to recognize and analyze emotions. This emotion engine uses facial recognition software and voice analysis algorithms to identify the user's emotions. For example, if the user is excited while typing, a positive emotion is recognized.

[0465] The server searches the database for information on related tourist spots and activities based on the information sent by the user and the recognized emotions. Specifically, it searches for information on "Kyoto" and "food tours" and extracts tourist spots such as Nishiki Market and Japanese confectionery shops.

[0466] The server then generates an itinerary based on the search results and the user's emotions, potentially including more adventurous activities if positive emotions are recognized. For example, an excited user might be suggested an activity like "cafe-hopping in the Gion district at night."

[0467] The generated travel plan is presented to the user in a virtual reality space. Specifically, when the user is wearing an HMD, the generated plan is displayed visually and the user can check the plan details in the virtual environment. For example, the presented plan might include a schedule of "Day 1: Eat your way around Nishiki Market and stroll around the Gion district."

[0468] After the trip is over, the server collects feedback from the user. The collected feedback is stored in a database and used as a reference when generating the next travel plan. For example, if a user provides feedback such as "Nishiki Market was crowded, so please suggest a different time next time," that information will be reflected in generating the next plan.

[0469] Examples and prompts

[0470] If a user uses the device to input data such as "Kyoto," "50,000 yen," "2 days," "food tour," and "excitement," the generated itinerary will include things like "food tour at Nishiki Market" and "stroll around the Gion district," thus providing the user with the optimal travel plan.

[0471] An example of a prompt for the generative AI model is as follows:

[0472] Generate the best itinerary based on the following data:

[0473] Travel destination: Kyoto

[0474] Budget: 50,000 yen

[0475] Length of stay: 2 days

[0476] Travel Style: Eating out

[0477] User Sentiment: Excitement

[0478] Necessary information: Nishiki Market, Japanese sweets shops, Gion area cafes, etc.

[0479] In this way, the present invention takes into account the user's emotions, generates an individually optimized travel plan, and makes it possible to visually present it in a virtual environment.

[0480] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0481] Step 1:

[0482] Users input their destination, budget, length of stay, and desired travel style.

[0483] Input: Information entered by the user via the device (destination, budget, length of stay, travel style).

[0484] Output: User's travel planning information provided to the system.

[0485] How it works: The user uses a smartphone or head-mounted display (HMD) to input textual information into the application's interface.

[0486] Step 2:

[0487] The device uses an emotion engine to recognize and analyze the user's emotions.

[0488] Input: The facial expressions and voice of the user when typing.

[0489] Output: The user's emotional state (e.g., excitement, joy).

[0490] How it works: Using facial recognition software and voice recognition algorithms to analyze your facial expressions and tone of voice to determine your current emotional state, for example, whether your face is smiling or your tone of voice is excited.

[0491] Step 3:

[0492] The server searches the database based on the input information and the recognized emotion.

[0493] Input: Travel destination, travel style, and user emotional state.

[0494] Output: A list of related tourist attractions and activities.

[0495] How it works: The database search engine queries information that matches the input travel destination and style, and extracts information on related tourist spots and activities. For example, based on "Kyoto" and "food tour," it retrieves information on "Nishiki Market" and "famous Japanese confectionery shops."

[0496] Step 4:

[0497] The server generates a travel plan taking into account the search results and the user's emotions.

[0498] Input: A list of search results and the user's emotional state.

[0499] Output: A customized itinerary.

[0500] How it works: The itinerary generation algorithm combines search results with the perceived emotions to generate a specific itinerary. If positive emotions are detected, it will adjust the itinerary to include more adventurous activities. For example, for "excited users," it will add options such as "nighttime cafe hopping in the Gion district."

[0501] Step 5:

[0502] The server presents the generated travel plan to the user in a virtual reality space.

[0503] Input: The generated itinerary.

[0504] Output: A visual presentation of the itinerary in virtual reality space.

[0505] How it works: Through a virtual reality interface, users can visually experience the generated itinerary using a head-mounted display. For example, the itinerary might say, "Day 1: Eat your way through Nishiki Market, Day 2: Visit a historic temple."

[0506] Step 6:

[0507] After the trip is over, the server collects feedback from the user and uses it as a reference when generating the next travel plan.

[0508] Input: User feedback (e.g., "How crowded is Nishiki Market?").

[0509] Output: Feedback data stored in a database.

[0510] How it works: Through a feedback collection interface, users submit their thoughts and opinions after completing their trip. The collected feedback is stored in a database and used to generate future travel plans.

[0511] Step 7:

[0512] The server improves its itinerary generation algorithm based on the collected feedback and sentiment data.

[0513] Input: User feedback and sentiment data.

[0514] Output: An improved trip plan generation algorithm.

[0515] How it works: The algorithm for generating itineraries is improved based on the analysis of sentiment data and feedback. This allows future itineraries to be more personalized. For example, it might take into account the crowding of Nishiki Market and suggest different times of day.

[0516] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0517] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0518] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0519] [Second embodiment]

[0520] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0521] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0522] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0523] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0524] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0525] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0526] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0527] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0528] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0529] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0530] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0531] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0532] The following system is conceivable as a mode for implementing the present invention. This system allows a traveler to input their travel destination, budget, length of stay, and desired travel style, and then proposes the optimal travel plan. A specific embodiment of this system is described below.

[0533] User Input Method

[0534] Device:

[0535] Users are presented with an interface, which can be in the form of a web page or a mobile application, for inputting their travel destination, budget, length of stay, and travel style.

[0536] Examples:

[0537] The user enters their travel destination "Kyoto," their budget "50,000 yen," their length of stay "2 days," and their travel style "food tour."

[0538] Database search methods

[0539] server:

[0540] The server receives the information sent by the user and searches the database for information on related tourist spots, restaurants, and activities, including queries to extract information on "Kyoto" and "food tours."

[0541] Examples:

[0542] If the travel destination is "Kyoto" and the travel style is "food-hopping," the server retrieves information such as "Nishiki Market" and "Japanese confectionery shops" from the database.

[0543] Travel plan generation method

[0544] server:

[0545] Based on the information retrieved from the database, the server generates a specific itinerary tailored to the user's length of stay, including places to visit and activities tailored to the user's preferences and needs.

[0546] Examples:

[0547] The itinerary generated for the first day includes "eating around Nishiki Market" in the morning, "visiting a Japanese sweets shop" in the afternoon, and "strolling around the Gion district" in the evening. The itinerary also includes "visiting a historical temple" in the morning of the second day and "lunch at a local cafe" in the afternoon.

[0548] Travel plan presentation method

[0549] Device:

[0550] The server generates a travel plan and presents it to the user through the chatbot, who can then check the plan on their smartphone or PC.

[0551] Examples:

[0552] The chatbot sends users messages like, "Here's a recommended itinerary: Day 1: Eat your way through Nishiki Market, then explore the Gion district. Day 2: Visit a historic temple and have lunch at a local cafe."

[0553] Feedback collection methods

[0554] Device:

[0555] Provide an interface for collecting user feedback after the trip is completed.

[0556] Examples:

[0557] After the chatbot sends a message such as "Please tell us your thoughts about the travel plan," the user enters feedback such as "Nishiki Market was crowded, so please suggest a different time next time."

[0558] server:

[0559] The server receives the feedback from the user and stores it in a database, which is then taken into account when generating the next plan.

[0560] This allows travelers to efficiently plan their trips, and since the plans are continually improved based on feedback after the trip, future trip plans will be more accurate and satisfying. This system allows travelers to easily obtain the best travel plans that suit their needs.

[0561] The processing flow will be explained below.

[0562] Step 1: Displaying a user input form

[0563] Device:

[0564] Provide an interface for travelers to input their travel destination, budget, length of stay, and preferred travel style, displayed using text boxes and drop-down lists in the form of a web page or mobile application.

[0565] Specific behavior:

[0566] Displays input fields for destination, budget, length of stay, and travel style.

[0567] A "Submit" button will be provided so that users can submit their input as soon as it is complete.

[0568] Step 2: Sending User Input

[0569] User:

[0570] Enter the required information about your destination, budget, length of stay, and travel style into each field and press the submit button.

[0571] Specific behavior:

[0572] Enter information such as travel destination "Kyoto," budget "50,000 yen," length of stay "2 days," and travel style "food tour."

[0573] By pressing the send button, the information is sent to the server.

[0574] Step 3: Receiving input information

[0575] server:

[0576] Receives and analyzes user-submitted travel information for use in generating database queries.

[0577] Specific behavior:

[0578] Analyze the received form data and store the travel destination, budget, length of stay, and travel style in variables.

[0579] Step 4: Generate and execute database queries

[0580] server:

[0581] Generate database queries based on analyzed user input information to search for tourist destinations and activity information.

[0582] Specific behavior:

[0583] If the travel destination is "Kyoto" and the travel style is "food tour," a query is generated to search for related tourist spots and restaurants.

[0584] Execute a query against the database and retrieve the results.

[0585] Step 5: Parse the search results

[0586] server:

[0587] The search results obtained from the database are analyzed and used as material for generating travel plans.

[0588] Specific behavior:

[0589] Get a list of tourist attractions and restaurants from your search results and prioritize them based on length of stay and budget.

[0590] Step 6: Generate your travel plan

[0591] server:

[0592] Based on the analysis results, a specific travel plan is generated that matches the user's length of stay.

[0593] Specific behavior:

[0594] A schedule is generated for the first day, such as "eating around Nishiki Market" in the morning, "strolling around the Gion district" in the afternoon, and "visiting a Japanese confectionery shop" in the evening.

[0595] Generate a schedule such as "visit a historical temple" in the morning of the second day and "have lunch at a local cafe" in the afternoon.

[0596] Step 7: Submit your travel plans

[0597] server:

[0598] The generated itinerary is passed to the chatbot in a structured format.

[0599] Specific behavior:

[0600] The generated travel plan is converted into JSON format etc. and sent to the chatbot.

[0601] Step 8: Present your travel plans

[0602] Device:

[0603] The chatbot presents users with the best travel plans.

[0604] Specific behavior:

[0605] The chatbot will message the user saying, "Here's a recommended itinerary: Day 1, eat your way through Nishiki Market, then explore the Gion district; Day 2, visit a historic temple and have lunch at a local cafe."

[0606] Step 9: Request feedback

[0607] Chatbots:

[0608] Send a message after the trip to ask for user feedback.

[0609] Specific behavior:

[0610] The chatbot sends a message requesting feedback: "Please tell us what you think about our travel plans."

[0611] Step 10: Receive and store feedback

[0612] User:

[0613] Enter and submit feedback on your travel plans.

[0614] Specific behavior:

[0615] Enter comments such as "Nishiki Market was crowded, so please suggest a different time next time" into the feedback form.

[0616] Click the submit button to send your feedback.

[0617] server:

[0618] Receive user feedback and store it in a database.

[0619] Specific behavior:

[0620] Analyze the feedback received and store it in the relevant travel plan record.

[0621] The saved feedback is used to improve the plan generation algorithm for the next iteration.

[0622] This will create a system that provides optimal travel plans for each individual traveler and improves the quality of the plans based on feedback.

[0623] Example 1

[0624] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0625] Today's travelers need an easy way to find the best travel plan that suits their destination, budget, length of stay, and preferred travel style. However, manually creating plans tailored to individual needs takes time and effort. In addition, there is a lack of a way to incorporate past experiences and feedback into future travel plans, making it difficult to further improve travel satisfaction.

[0626] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0627] In this invention, the server includes: means for the user to input their travel destination, budget, length of stay, and desired travel style; computer server means for receiving the input information and searching a database for related tourist destination and activity information; means for generating a specific travel plan tailored to the user's length of stay using a generative AI model based on the search results; and terminal means for presenting the generated travel plan to the user and providing an interactive interface for the user to check the plan. This allows the user to efficiently and precisely obtain a travel plan that meets their needs, and further enables them to reflect their post-trip feedback in future plans, resulting in a more satisfying trip.

[0628] "User input means" refers to a means by which a user inputs information about a travel destination, budget, length of stay, and desired travel style.

[0629] The "computer server" is a server that searches the database based on the information received from the user and obtains information on appropriate tourist spots and activities.

[0630] A "generative AI model" is an artificial intelligence model that generates travel plans that reflect the user's preferences and needs based on acquired data.

[0631] An "interactive interface" is a means of presenting the generated travel plan to the user and allowing the user to review the plan, and is typically used via a smartphone or PC.

[0632] The "feedback collection means" is a means for collecting feedback from users after their trip, and is used to reflect this feedback when generating the next plan.

[0633] A "database" is an information storage system for storing information about tourist attractions and activities.

[0634] The "travel plan generation means" is a means for generating a specific travel plan tailored to the user's length of stay based on information obtained from the database.

[0635] A "terminal" is a device that allows a user to use an interface to provide input information and check the generated travel plan, and includes a smartphone or personal computer.

[0636] The following system is conceivable as an embodiment of the present invention. This system allows a traveler to input their travel destination, budget, length of stay, and desired travel style, and then proposes an optimal travel plan. This system includes a user input means, a computer server, a generative AI model, an interactive interface, and a feedback collection means.

[0637] User Input Method

[0638] Device:

[0639] Users input information such as their travel destination, budget, length of stay, and travel style through a device. The device is provided in the form of a web page or mobile application. Specifically, users input their travel destination "Kyoto," their budget "50,000 yen," their length of stay "2 days," and their travel style "food-hopping."

[0640] Data reception and search methods

[0641] server:

[0642] The computer server receives the information sent by the user and searches the database for information on related tourist spots and activities. This search includes queries to extract information on "Kyoto" and "food tours," for example. Specifically, the server retrieves information on "Nishiki Market" and "Japanese confectionery shops" from the database based on the information on "food tours" in "Kyoto."

[0643] Travel plan generation method

[0644] server:

[0645] Based on the acquired data, the server uses a generative AI model to generate a specific itinerary tailored to the user's length of stay. The itinerary includes visits and activities tailored to the user's preferences and needs. Specifically, the itinerary generated on the first day includes a "food tour of Nishiki Market" in the morning, a "visit to a Japanese confectionery shop" in the afternoon, and a "stroll through the Gion district" in the evening. The itinerary on the second day also includes a "visit to a historic temple" and "lunch at a local cafe."

[0646] Travel plan presentation method

[0647] Device:

[0648] The generated itinerary is presented to the user through the chatbot. The user can check the itinerary using their smartphone or PC. Specifically, the chatbot sends a message saying, "Here's a recommended itinerary: On day one, enjoy a bite to eat at Nishiki Market, then stroll through the Gion district. On day two, visit a historic temple and have lunch at a local cafe."

[0649] Feedback collection methods

[0650] Device:

[0651] After the trip, an interface is provided to collect feedback from the user. Specifically, the chatbot sends a message saying, "Please tell us your thoughts about the trip plan," and the user enters feedback such as, "Nishiki Market was crowded, so please suggest a different time next time."

[0652] server:

[0653] The server receives the user's feedback and stores it in a database. This allows the server to take this feedback into account when generating the next plan. Specifically, the server will change the time slot for visiting Nishiki Market based on the feedback.

[0654] Prompt Sentence Examples

[0655] An example of a prompt sentence to be input to the generative AI model in this system is as follows:

[0656] Examples:

[0657] "I'd like to travel to Kyoto for two days. My budget is 50,000 yen, and my travel style is to eat my way around. What plan do you recommend?"

[0658] As a result, the system provides users with the best travel plans and is continuously improved based on their feedback, allowing users to easily obtain travel plans that suit their needs and achieve a highly satisfying travel experience.

[0659] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0660] Step 1:

[0661] User enters travel information

[0662] Terminal: The user enters the travel destination, budget, length of stay, and desired travel style and submits.

[0663] What happens: A user launches a web page or mobile application, fills in a form displayed in the interface, and clicks the "Submit" button.

[0664] Input: User entered travel destination "Kyoto", budget "50,000 yen", length of stay "2 days", travel style "food tour".

[0665] Output: The input information is sent to the server.

[0666] Step 2:

[0667] Receive information and search the database

[0668] Server: The server searches the database based on the received information and retrieves information on related tourist spots and activities.

[0669] What it does: The server receives the HTTP request and generates an SQL query based on the travel destination and style to extract information from the database.

[0670] Input: Input information submitted by the user.

[0671] Output: Information about related tourist attractions and activities (e.g., "Nishiki Market," "Japanese sweets shop").

[0672] Step 3:

[0673] Generate a travel plan

[0674] Server: Based on the acquired data, the server uses a generative AI model to generate a specific travel plan tailored to the user's length of stay.

[0675] How it works: The server passes the data to a plan generation algorithm, and the generative AI model creates a visit schedule for each day. The generated plan is saved in JSON format.

[0676] Input: Information about tourist attractions and activities retrieved from a database.

[0677] Output: A specific travel plan (e.g., on the first day, "Eat your way around Nishiki Market" in the morning, "Visit a Japanese sweets shop" in the afternoon, and "Walk around the Gion district" in the evening).

[0678] Step 4:

[0679] Present the generated itinerary to the user

[0680] Terminal: The generated travel plan is presented to the user through the chatbot.

[0681] Specific operation: The server sends the generated travel plan to the chatbot, which then sends a message to the user. The user then checks the plan on their smartphone or PC.

[0682] Input: The generated itinerary.

[0683] Output: The message shown to the user (e.g., "Here's a suggested itinerary: Day 1: Eat your way through Nishiki Market, then explore the Gion district. Day 2: Visit a historic temple and have lunch at a local cafe.").

[0684] Step 5:

[0685] Collect user feedback

[0686] Terminal: An interface is provided to collect feedback from users after the trip is completed.

[0687] What happens: The chatbot sends a message saying, "Please tell us what you think about our travel plans," and the user enters their feedback.

[0688] Input: User feedback (e.g., "Nishiki Market was crowded, please suggest a different time next time.").

[0689] Output: The entered feedback is sent to the server.

[0690] Step 6:

[0691] Receive feedback and store it in a database

[0692] Server: The server receives the feedback from the user and stores it in a database. The next time a plan is generated, this feedback will be taken into account.

[0693] Specific operation: The server receives the feedback data, inserts the feedback data into the database, and, if necessary, configures the saved feedback so that it is used for the next plan generation.

[0694] Input: User feedback.

[0695] Output: Feedback stored in a database that will be used to improve the next itinerary generation.

[0696] Through these steps, the system can provide users with efficient, precise, and personalized travel plans, and continuously improve those plans.

[0697] (Application example 1)

[0698] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0699] In recent years, there has been a growing demand for the rapid provision of personalized travel plans that meet the diverse needs of travelers. However, conventional systems lack the means to simulate specific experiences before travelers actually visit a destination when proposing travel plans. This has led to challenges in improving traveler satisfaction and low accuracy of plans. It is also difficult to effectively collect feedback from travelers and reflect it in future plans.

[0700] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0701] In this invention, the server includes: a means for a user to input their travel destination, budget, length of stay, and desired travel style; a means for searching a database for related tourist spots and activity information based on the input information; a means for generating a specific travel plan tailored to the user's length of stay based on the search results; a means for presenting the generated travel plan to the user; and a means for the user to experience the generated travel plan in a virtual reality environment. This allows travelers to experience specific tourist experiences in advance in a virtual space, and allows them to provide more accurate feedback based on that experience, which can be reflected in future travel plans.

[0702] "User" refers to a person who uses the System to generate and experience travel plans.

[0703] "Destination" means a geographic location that a User wishes to visit.

[0704] "Budget" refers to the financial constraints a user has when traveling.

[0705] "Length of Stay" refers to the length of time a user plans to stay at a travel destination.

[0706] "Desired travel style" refers to the types of activities and experiences users seek while traveling.

[0707] "Input means" refers to an interface through which a user provides information about travel destination, budget, length of stay, and travel style to the system.

[0708] "Database" refers to a system that stores travel-related data such as tourist destination and activity information.

[0709] "Searching means" refers to the process of extracting relevant information from a database based on input information.

[0710] "Means of generation" refers to the process of creating a specific travel plan based on the search results.

[0711] "Presentation means" refers to an interface for providing the generated travel plan to the user.

[0712] "Virtual reality environment" refers to an environment in which users can use virtual reality technology to simulate a travel plan as if it were a real experience.

[0713] "Feedback" refers to ratings and opinions about travel plans provided by users.

[0714] "Measures to improve" refers to the process of improving the accuracy and satisfaction of future travel plans based on collected feedback.

[0715] This invention provides a system that allows users to input their travel destination, budget, length of stay, and desired travel style, generate an optimal travel plan based on the input, and then experience the plan in a virtual reality environment. Specific embodiments for implementing the invention are described below.

[0716] User Input Method

[0717] Users input their travel destination, budget, length of stay, and travel style via devices such as smartphones or PCs, using interfaces provided on web pages or mobile applications.

[0718] Database search methods

[0719] The server has a means for receiving the information sent by the user and searching the database for information on related tourist spots, restaurants, and activities. For example, if the travel destination is "Kyoto" and the travel style is "eating around," information on "markets" and "restaurants" is retrieved from the database.

[0720] Travel plan generation method

[0721] The server generates a specific itinerary based on the information retrieved from the database, tailored to the user's length of stay. For example, a possible itinerary on the first day could be "eating around the marketplace" in the morning, "exploring the historic area" in the afternoon, and "cafe-hopping" in the evening.

[0722] Travel plan presentation method

[0723] The server uses chatbots and notification functions to present the generated travel plans to users, who can then check the plans on their smartphones or PCs.

[0724] Virtual experience means

[0725] One of the features of this system is that users can experience the travel plan generated in a virtual reality environment by wearing smart glasses or a head-mounted display and simulating the travel plan in a virtual space.

[0726] Feedback collection methods

[0727] After the trip, feedback is collected through the device and the travel plan is improved based on that feedback. For example, specific feedback such as "The market was crowded, so please suggest a different time."

[0728] Hardware and software used

[0729] Server: Executes programs, performs database searches, and generates plans. For example, we use a cloud server (AWS, GCP).

[0730] Database: Use a database management system such as SQLite or MySQL.

[0731] Chatbots: Use natural language processing solutions such as Dialogflow (Google).

[0732] Virtual reality system: A VR environment developed with Unity or Unreal Engine.

[0733] Specific examples

[0734] The user inputs their travel destination "Kyoto," their budget "50,000 yen," their stay length "2 days," and their travel style "food-hopping." The system extracts tourist spots related to "food-hopping" in "Kyoto" from a database and generates a plan that includes, for example, "food-hopping at markets," "strolling around historical areas," and "cafe-hopping." The user puts on a VR headset and experiences these spots in virtual reality. After the trip, feedback is collected from the user and reflected in future plans.

[0735] Prompt Sentence Examples

[0736] "My next trip is to Kyoto, my budget is 50,000 yen, I'll be there for two days, and my travel style will be food-hopping. What's your recommended plan?"

[0737] "The market was crowded, so please suggest a different time."

[0738] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0739] Step 1:

[0740] The user inputs their travel destination, budget, length of stay, and desired travel style through the device interface. The input data is sent to the server in JSON format. The input data specifically includes information such as "Destination: Kyoto," "Budget: 50,000 yen," "Length of stay: 2 days," and "Travel style: Eating around."

[0741] Step 2:

[0742] The server analyzes the received user data and stores it in variables. The variables store the travel destination, budget, length of stay, and travel style. This defines the parameters required for database searches. For example, the variable destination might store "Kyoto," budget "50,000 yen," duration "2 days," and style "food tour."

[0743] Step 3:

[0744] The server generates a query to search for related tourist spots and activity information from the database. The generated query is constructed in the form of an SQL statement based on variables. For example, the SQL query "SELECT FROM activities WHERE location="Kyoto" AND style="food-hopping"" is generated. This extracts related tourist spots and activity information from the database.

[0745] Step 4:

[0746] The server generates a specific travel plan tailored to the user's length of stay based on the extracted tourist destination and activity information. The plan generation algorithm allocates the extracted data to appropriate time slots to create a schedule that best suits the user's needs. For example, an itinerary such as "eating around the market" in the morning of the first day, "strolling around the historical area" in the afternoon, and "cafe hopping" in the evening could be automatically generated.

[0747] Step 5:

[0748] The generated travel plan is converted into JSON format and presented to the user. The server then sends the generated plan to the user in the form of a chatbot. The user can then check the plan on their smartphone or PC. For example, a specific schedule such as "Day 1: Eat your way around the market, stroll through the historical area, and visit cafes. Day 2: Visit a famous local temple and have lunch at a cafe" is presented.

[0749] Step 6:

[0750] Users use smart glasses or a head-mounted display to experience the generated travel plan in a virtual reality environment. The virtual reality application is developed using Unity or Unreal Engine and simulates tourist spots and activities with the feeling of visiting them in real life. Users can visit specific spots in VR and check the experience.

[0751] Step 7:

[0752] After completing the trip, the user enters feedback through the device. The device interface includes a simple evaluation form and a free response section, where the user provides their evaluation and opinion on the travel plan. For example, specific feedback such as "The market was crowded, so please suggest a different time next time" can be included.

[0753] Step 8:

[0754] The server analyzes the feedback collected from users and stores it in a database. The stored feedback is taken into consideration when generating future travel plans and is used to improve user satisfaction. The feedback analysis algorithm extracts areas for improvement based on the collected data and reflects them in the parameters for generating new plans.

[0755] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0756] The following describes an embodiment of the present invention. The present invention allows travelers to input their travel destination, budget, length of stay, and desired travel style, and proposes the optimal travel plan. Furthermore, it combines an emotion engine that recognizes the user's emotions to provide a more personalized travel experience.

[0757] User Input Method

[0758] Device:

[0759] Users are presented with an interface, which can be in the form of a web page or a mobile application, for inputting their travel destination, budget, length of stay, and travel style.

[0760] Examples:

[0761] The user enters their travel destination "Kyoto," their budget "50,000 yen," their length of stay "2 days," and their travel style "food tour."

[0762] Emotion Engine

[0763] Device:

[0764] As users type, emotions are recognized and analyzed by an emotion engine that uses facial recognition software and voice analysis algorithms to identify the user's emotions.

[0765] Examples:

[0766] If the user is excited while typing, a positive emotion is perceived.

[0767] Database search methods

[0768] server:

[0769] The server receives the information and recognized emotions sent by the user and searches the database for information on related tourist spots, restaurants, and activities, including queries to extract information on "Kyoto" and "food tours."

[0770] Examples:

[0771] If the travel destination is "Kyoto" and the travel style is "food-hopping," the server retrieves information such as "Nishiki Market" and "Japanese confectionery shops" from the database.

[0772] Emotion-Based Adjustments

[0773] server:

[0774] Based on the information obtained, the travel plan can be adjusted taking into account the user's emotions: if positive emotions are recognized, more adventurous activities can be included in the plan.

[0775] Examples:

[0776] If the user is excited, the destinations will include things like "visiting cafes in the Gion district at night."

[0777] Travel plan generation method

[0778] server:

[0779] Based on the information retrieved from the database, the server generates a specific itinerary tailored to the user's length of stay, incorporating the results of the emotion engine. The itinerary includes places to visit and activities tailored to the user's preferences and needs.

[0780] Examples:

[0781] The generated schedule includes "eating around Nishiki Market" in the morning of the first day, "strolling around the Gion district" in the afternoon, and "visiting a Japanese sweets shop" in the evening. The schedule also includes "visiting a historical temple" in the morning of the second day, and "lunch at a local cafe" in the afternoon.

[0782] Travel plan presentation method

[0783] Device:

[0784] The server generates a travel plan and presents it to the user through the chatbot, who can then check the plan on their smartphone or PC.

[0785] Examples:

[0786] The chatbot sends users messages like, "Here's a recommended itinerary: Day 1: Eat your way through Nishiki Market, then explore the Gion district. Day 2: Visit a historic temple and have lunch at a local cafe."

[0787] Feedback collection methods

[0788] Device:

[0789] Provide an interface for collecting user feedback after the trip is completed.

[0790] Examples:

[0791] After the chatbot sends a message such as "Please tell us your thoughts about the travel plan," the user enters feedback such as "Nishiki Market was crowded, so please suggest a different time next time."

[0792] server:

[0793] The server receives the feedback from the user and stores it in a database, which is then taken into account when generating the next plan.

[0794] Utilizing Emotional Data

[0795] server:

[0796] The company will analyze sentiment data collected from users and use it to improve its travel plan generation algorithm, enabling even more advanced personalization in the future.

[0797] Examples:

[0798] Record activities that excited users on past trips and include similar activities in your next travel plans.

[0799] This allows travelers to efficiently plan their trips, and since the plans are continually improved based on post-trip feedback and emotional data, future trip plans will be more accurate and satisfying. This system allows travelers to easily obtain the optimal travel plan that suits their needs and emotions.

[0800] The processing flow will be explained below.

[0801] Step 1: Displaying a user input form

[0802] Device:

[0803] Present an interface for travelers to input their travel destination, budget, length of stay, and preferred travel style. This can be done using text boxes and drop-down lists in the form of a web page or mobile application.

[0804] Specific behavior:

[0805] Displays input fields for destination, budget, length of stay, and travel style.

[0806] Provide a "Submit" button so users can submit their information as soon as it is entered.

[0807] Step 2: Sending User Input

[0808] User:

[0809] Enter information about your destination, budget, length of stay, and travel style into the fields and press the submit button.

[0810] Specific behavior:

[0811] Enter information such as travel destination "Kyoto," budget "50,000 yen," length of stay "2 days," and travel style "food tour."

[0812] Press the send button and the information will be sent to the server.

[0813] Step 3: Receiving and parsing input information

[0814] server:

[0815] It receives user-submitted travel information, parses it for use in generating database queries, and passes the information to the emotion engine.

[0816] Specific behavior:

[0817] Analyze the received form data and store the travel destination, budget, length of stay, and travel style in variables.

[0818] Pass user input information to the emotion engine to obtain emotion data.

[0819] Step 4: Recognize user emotions

[0820] Device:

[0821] The emotion engine analyzes the user's facial expressions and voice in real time as they type, recognizing their emotional state.

[0822] Specific behavior:

[0823] It uses facial recognition software and voice analysis algorithms to recognize emotions (e.g., joy or excitement) that users express while typing.

[0824] The recognized emotion data is sent to the server.

[0825] Step 5: Generate and execute database queries

[0826] server:

[0827] Based on the analyzed user input information and emotion data, a database query is generated to search for tourist destinations and activity information.

[0828] Specific behavior:

[0829] If the travel destination is "Kyoto" and the travel style is "food-hopping," generate a query to search for related tourist spots and restaurants.

[0830] Execute the query and retrieve the results from the database.

[0831] Step 6: Parse the search results

[0832] server:

[0833] The search results obtained from the database are analyzed and used to generate travel plans.

[0834] Specific behavior:

[0835] Get a list of tourist attractions and restaurants from your search results and prioritize them based on length of stay and budget.

[0836] Step 7: Generate your travel plan

[0837] server:

[0838] A specific travel plan is generated based on the information acquired by the server and the user's emotional data.

[0839] Specific behavior:

[0840] A schedule is generated for the first day, such as "eating around Nishiki Market" in the morning, "strolling around the Gion district" in the afternoon, and "visiting a Japanese confectionery shop" in the evening.

[0841] Generate a schedule such as "visit a historical temple" in the morning of the second day and "have lunch at a local cafe" in the afternoon.

[0842] If the user's sentiment is positive, make adjustments, such as including evening activities.

[0843] Step 8: Present your travel plans

[0844] Device:

[0845] The server generates a travel plan and presents it to the user through the chatbot.

[0846] Specific behavior:

[0847] The chatbot will message the user saying, "Here's a suggested itinerary: Day 1: Eat your way through Nishiki Market, then explore the Gion district. Day 2: Visit a historic temple and have lunch at a local cafe."

[0848] Step 9: Request feedback

[0849] Chatbots:

[0850] Send a message after the trip to ask for user feedback.

[0851] Specific behavior:

[0852] Send a message asking for feedback: "Tell us what you think about our travel plans."

[0853] Step 10: Receive and store feedback

[0854] User:

[0855] Enter and submit feedback on your travel plans.

[0856] Specific behavior:

[0857] Enter comments such as "Nishiki Market was crowded, so please suggest a different time next time" into the feedback form.

[0858] Click the submit button to send your feedback.

[0859] server:

[0860] Receive user feedback and store it in a database.

[0861] Specific behavior:

[0862] Analyze the feedback received and store it in the relevant travel plan record.

[0863] The saved feedback is used to improve the plan generation algorithm for the next iteration.

[0864] Step 11: Analyze and use sentiment data

[0865] server:

[0866] The collected emotional data is analyzed and used to generate future plans.

[0867] Specific behavior:

[0868] Analyze the positive emotional data users have shown on past trips and reflect it in their next travel plans.

[0869] For example, if a user expresses high satisfaction with a particular activity, we will take that into account and include a similar activity in our next plan.

[0870] Example 2

[0871] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0872] Conventional travel plan generation systems propose travel plans without considering the user's feelings, making it difficult to provide plans that satisfy the user. Furthermore, they do not fully utilize feedback and are unable to provide continuously improved plans. This leads to a decrease in user satisfaction.

[0873] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for the user to input the travel destination, budget, length of stay, and desired travel style, means for recognizing and analyzing the user's emotions based on the input information, means for searching for related tourist destination and activity information from a database based on the analyzed emotion data and the input information, means for adjusting the travel plan taking the user's emotions into consideration based on the acquired information, means for generating a specific travel plan tailored to the user's length of stay using the adjusted information, and means for presenting the generated travel plan to the user. This makes it possible to provide an optimal travel plan based on the user's emotions and needs, thereby improving user satisfaction.

[0874] "User" means an individual who utilizes the System and inputs information to generate a travel plan.

[0875] "Travel Destination" means a destination that a User wishes to visit.

[0876] "Budget" means the range of funds available to User for Travel.

[0877] "Length of Stay" means the period of time that a User intends to stay at a particular travel destination.

[0878] "Travel style" refers to the type or theme of travel based on the user's preferences.

[0879] "Input means" refers to the interface that allows users to provide information such as travel destination, budget, length of stay, and travel style to the system.

[0880] "Means for recognizing and analyzing emotions" refers to the function of capturing the user's facial expressions and voice and analyzing them using an emotion engine.

[0881] "Database" refers to a collection of information that stores information about travel destinations, tourist attractions, restaurants, and activities.

[0882] "Searching means" refers to the function of extracting relevant information from a database based on user input and emotional data.

[0883] "Adjustment" refers to the ability to optimize travel plans to meet the user's needs based on the information obtained and the user's emotional data.

[0884] "Means for generating" refers to the function of using the adjusted information to create a specific travel plan tailored to the user's length of stay.

[0885] "Presentation means" refers to the function for displaying and providing the generated travel plan to the user.

[0886] "Feedback" refers to the evaluations and opinions about the plan provided by the user after the trip is completed.

[0887] The present invention is a system that allows travelers to input their travel destination, budget, length of stay, and desired travel style, and then proposes an optimal travel plan taking the user's emotions into consideration. This system acquires the user's input information and emotion data, performs a database search based on this, and generates and presents an appropriate travel plan. Specific methods for implementing this system are described below.

[0888] Hardware and Software Configuration

[0889] Device: The device that provides the interface for the user to enter input. This can be a smartphone, tablet, or PC. The interface can be implemented in the form of a web page or mobile application.

[0890] Emotion Engine: Analyzes user emotions using facial expression recognition software and voice analysis algorithms, such as OpenCV for facial expression recognition and Google Cloud Speech-to-Text API for voice analysis.

[0891] Server: The central server performs database searches, information retrieval, and plan generation, coordination, and presentation. The database contains detailed information about tourist spots, restaurants, and activities.

[0892] Chatbots: Used to interact with users, for example, by providing travel itineraries and collecting feedback in a natural conversational format using Dialogflow or the Microsoft Bot Framework.

[0893] System Overview

[0894] User Input Method

[0895] Users input their travel destination, budget, length of stay, and travel style using a device. The interface is designed to be intuitive and easy to use. For example, a user inputs their travel destination "Kyoto," their budget "50,000 yen," their stay length "2 days," and their travel style "food-hopping."

[0896] Emotion Engine

[0897] When a user enters this information, the device's camera and microphone are used to capture the user's facial expressions and voice, which are then analyzed by the emotion engine. The emotion engine uses facial recognition software and voice analysis algorithms to identify the user's emotional state (e.g., excitement, joy, etc.). For example, if the user is excited while entering information, a positive emotion is recognized.

[0898] Database search methods

[0899] The server receives the information sent by the user and analyzed emotion data, and searches the database for information on related tourist spots, restaurants, and activities. For example, if the travel destination is "Kyoto" and the travel style is "eating around," the server will retrieve information such as "Nishiki Market" and "Japanese confectionery shops" from the database.

[0900] Emotion-Based Adjustments

[0901] The server then uses the information it has acquired to adjust the itinerary, taking into account the user's emotions. If a positive emotion is detected, it can include more adventurous activities in the itinerary. For example, if the user is excited, it can add a trip to the Gion district at night to the itinerary.

[0902] Travel plan generation method

[0903] Based on the information retrieved from the database, the server generates a specific itinerary tailored to the user's length of stay, while also incorporating the results of the emotion engine. The itinerary includes visits and activities tailored to the user's preferences and needs. For example, a schedule may be generated such as "eating around Nishiki Market" in the morning of the first day, "strolling around the Gion district" in the afternoon, and "visiting a Japanese confectionery shop" in the evening. Another schedule may include "visiting a historical temple" in the morning of the second day, and "lunch at a local cafe" in the afternoon.

[0904] Travel plan presentation method

[0905] The server generates a travel plan and presents it to the user via the device. The user can then view the plan on their smartphone or PC, checking detailed schedules and location information. For example, the chatbot could send a message to the user saying, "Here's a recommended travel plan: On day one, enjoy a bite to eat at Nishiki Market, then stroll through the Gion district. On day two, visit a historic temple and have lunch at a local cafe."

[0906] Feedback collection methods

[0907] After the trip, an interface is provided to collect feedback from the user. For example, after the chatbot sends a message such as "Please tell us your thoughts about the trip plan," the user can enter feedback such as "Nishiki Market was crowded, so please suggest a different time next time."

[0908] Utilizing Emotional Data

[0909] The server receives user feedback and sentiment data, analyzes it, and uses it to improve the itinerary generation algorithm, enabling greater personalization in the future. For example, it can record activities that excited users on past trips and include similar activities in the next itinerary.

[0910] Examples of prompt statements

[0911] 1. "Enter your travel destination as 'Kyoto,' your budget as '50,000 yen,' your stay period as '2 days,' and your travel style as 'eating around.' Then, if the emotion engine detects an excited state, add positive activities to your plan."

[0912] 2. "The system uses facial recognition software and voice analysis algorithms to identify the user's emotions. Based on the information and emotional data entered by the user, the server then searches for relevant information from a database and generates a travel plan, which includes activities tailored based on the emotions."

[0913] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0914] Step 1: Receiving User Input

[0915] Terminal: Provides an interface where users can input their travel destination, budget, length of stay, and desired travel style. The input information is sent to the server. For example, a user might input "Travel destination: Kyoto, Budget: 50,000 yen, Length of stay: 2 days, Travel style: Eating around" into a smartphone app.

[0916] Input: Travel destination, budget, length of stay, travel style

[0917] Output: User input data (travel destination "Kyoto", budget "50,000 yen", length of stay "2 days", travel style "food-hopping")

[0918] Step 2: Emotion analysis using the emotion engine

[0919] Device: When a user provides input, the device's camera and microphone are used to capture facial expressions and voice, and the emotion engine analyzes the data. Using facial recognition software and voice analysis algorithms, the user's emotions are identified. For example, if a user says "eating out" in an excited voice, the emotion engine recognizes a positive emotion.

[0920] Input: Real-time facial expression data, voice data

[0921] Output: Parsed emotion data (positive, excited)

[0922] Step 3: Database search

[0923] Server: Based on the acquired user input data and emotion data, the server searches the database for information on related tourist spots, restaurants, and activities. For example, if the travel destination is "Kyoto" and the travel style is "eating around," the server will search and extract information such as "Nishiki Market" and "Japanese confectionery shops."

[0924] Input: User input data, emotion data

[0925] Output: Related information (tourist information, restaurant information, activity information)

[0926] Step 4: Emotionally Based Adjustment

[0927] Server: Based on the acquired tourist destination and activity information, the plan contents are adjusted taking into account the user's emotional state. If a positive emotion is recognized, more adventurous activities are added. For example, if the user is excited, "Café hopping in the Gion district at night" is added to the plan.

[0928] Input: related information, emotion data

[0929] Output: Adjusted itinerary information

[0930] Step 5: Generate your travel plan

[0931] Server: Using the adjusted information, the server generates a specific itinerary tailored to the user's length of stay. The itinerary includes visits and activities tailored to the user's preferences and needs. For example, the server generates a schedule such as "eating around Nishiki Market" in the morning of the first day, "strolling around the Gion district" in the afternoon, and "visiting a Japanese confectionery shop" in the evening, and "visiting a historical temple" in the morning of the second day, and "lunch at a local cafe" in the afternoon.

[0932] Input: Adjusted travel plan information, length of stay data

[0933] Output: Final itinerary

[0934] Step 6: Present your travel plans

[0935] Device: Presents the generated itinerary to the user. The user can then view the itinerary on their smartphone or PC, along with detailed schedules and location information. For example, the chatbot could send a message such as, "Here's a recommended itinerary: Day 1, eat your way through Nishiki Market, then explore the Gion district. Day 2, visit a historic temple and have lunch at a local cafe."

[0936] Input: Final travel plan

[0937] Output: Plan data to be presented to the user

[0938] Step 7: Gather feedback

[0939] Terminal: Provides an interface for collecting feedback from users after the trip. For example, the chatbot sends a message saying, "Please tell us what you thought about the trip plan," and the user enters feedback such as, "Nishiki Market was crowded, so please suggest a different time next time."

[0940] Input: User feedback

[0941] Output: Feedback data

[0942] Step 8: Leverage feedback data

[0943] Server: Receives user feedback and sentiment data, analyzes it, and uses it to improve the itinerary generation algorithm. For example, it records activities that excited users on past trips and includes similar activities in the next itinerary.

[0944] Input: Feedback data, emotion data

[0945] Output: Improved algorithms and database updates

[0946] (Application example 2)

[0947] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0948] Conventional travel plan generation systems create travel plans without considering user emotions, making it difficult to provide a fully optimized travel experience for each individual user. Even if feedback is collected, there is a lack of effective ways to utilize it, making it difficult to reflect it in future travel plans. Furthermore, there are limited ways to visually check the travel plan, making it difficult to meet user expectations.

[0949] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for the user to input their travel destination, budget, length of stay, and desired travel style; means for recognizing and analyzing emotions; means for searching a database for related tourist destination and activity information based on the input information and the recognized emotions; means for generating a travel plan taking into account the search results and the user's emotions; and means for presenting the generated travel plan to the user in a virtual reality space. This makes it possible to generate and present a travel plan optimized for each individual user, taking into account the user's emotions, thereby improving the user's experience and satisfaction.

[0950] "User" means an individual or group who wishes to use the system to generate a travel plan.

[0951] A "destination" is a specific geographic location that a user wishes to visit.

[0952] "Budget" is the amount of money the user plans to spend during the trip.

[0953] "Length of Stay" means the length of time a user intends to stay at a particular travel destination.

[0954] "Travel style" refers to the user's preferred travel method or theme (e.g., food tours, sightseeing, activities).

[0955] The "means for inputting" is an interface that allows a user to input travel destination, budget, length of stay, and travel style into the system.

[0956] "Means for recognizing and analyzing emotions" refers to software or hardware that identifies and analyzes emotions from a user's facial expressions and voice.

[0957] The "database search means" is a function for searching for related tourist destination and activity information based on the input information and recognized emotions.

[0958] The "means for generating a travel plan" refers to algorithms and software for creating a specific travel plan taking into account the searched information and the user's emotions.

[0959] The "means for presenting in virtual reality space" is an interface for visually presenting the generated travel plan to the user through a virtual reality device.

[0960] "Means for collecting feedback" refers to an interface for receiving opinions and impressions from users after the trip is completed.

[0961] The "means for improving travel plans based on feedback" refers to algorithms and software that analyze collected user feedback and incorporate it into future travel plans.

[0962] The present invention is a system that generates and presents optimal travel plans while recognizing emotions, based on the traveler's input of destination, budget, length of stay, and desired travel style. This system is configured as follows:

[0963] First, users use an interface to input their travel destination, budget, length of stay, and desired travel style. This interface is provided through devices such as smartphones or head-mounted displays (HMDs). For example, a user inputs information such as "Kyoto," "50,000 yen," "2 days," and "food tour" through the device.

[0964] Next, an emotion engine is activated to recognize and analyze emotions. This emotion engine uses facial recognition software and voice analysis algorithms to identify the user's emotions. For example, if the user is excited while typing, a positive emotion is recognized.

[0965] The server searches the database for information on related tourist spots and activities based on the information sent by the user and the recognized emotions. Specifically, it searches for information on "Kyoto" and "food tours" and extracts tourist spots such as Nishiki Market and Japanese confectionery shops.

[0966] The server then generates an itinerary based on the search results and the user's emotions, potentially including more adventurous activities if positive emotions are recognized. For example, an excited user might be suggested an activity like "cafe-hopping in the Gion district at night."

[0967] The generated travel plan is presented to the user in a virtual reality space. Specifically, when the user is wearing an HMD, the generated plan is displayed visually and the user can check the plan details in the virtual environment. For example, the presented plan might include a schedule of "Day 1: Eat your way around Nishiki Market and stroll around the Gion district."

[0968] After the trip is over, the server collects feedback from the user. The collected feedback is stored in a database and used as a reference when generating the next travel plan. For example, if a user provides feedback such as "Nishiki Market was crowded, so please suggest a different time next time," that information will be reflected in generating the next plan.

[0969] Examples and prompts

[0970] If a user uses the device to input data such as "Kyoto," "50,000 yen," "2 days," "food tour," and "excitement," the generated itinerary will include things like "food tour at Nishiki Market" and "stroll around the Gion district," thus providing the user with the optimal travel plan.

[0971] An example of a prompt for the generative AI model is as follows:

[0972] Generate the best itinerary based on the following data:

[0973] Travel destination: Kyoto

[0974] Budget: 50,000 yen

[0975] Length of stay: 2 days

[0976] Travel Style: Eating out

[0977] User Sentiment: Excitement

[0978] Necessary information: Nishiki Market, Japanese sweets shops, Gion area cafes, etc.

[0979] In this way, the present invention takes into account the user's emotions, generates an individually optimized travel plan, and makes it possible to visually present it in a virtual environment.

[0980] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0981] Step 1:

[0982] Users input their destination, budget, length of stay, and desired travel style.

[0983] Input: Information entered by the user via the device (destination, budget, length of stay, travel style).

[0984] Output: User's travel planning information provided to the system.

[0985] How it works: The user uses a smartphone or head-mounted display (HMD) to input textual information into the application's interface.

[0986] Step 2:

[0987] The device uses an emotion engine to recognize and analyze the user's emotions.

[0988] Input: The facial expressions and voice of the user when typing.

[0989] Output: The user's emotional state (e.g., excitement, joy).

[0990] How it works: Using facial recognition software and voice recognition algorithms to analyze your facial expressions and tone of voice to determine your current emotional state, for example, whether your face is smiling or your tone of voice is excited.

[0991] Step 3:

[0992] The server searches the database based on the input information and the recognized emotion.

[0993] Input: Travel destination, travel style, and user emotional state.

[0994] Output: A list of related tourist attractions and activities.

[0995] How it works: The database search engine queries information that matches the input travel destination and style, and extracts information on related tourist spots and activities. For example, based on "Kyoto" and "food tour," it retrieves information on "Nishiki Market" and "famous Japanese confectionery shops."

[0996] Step 4:

[0997] The server generates a travel plan taking into account the search results and the user's emotions.

[0998] Input: A list of search results and the user's emotional state.

[0999] Output: A customized itinerary.

[1000] How it works: The itinerary generation algorithm combines search results with the perceived emotions to generate a specific itinerary. If positive emotions are detected, it will adjust the itinerary to include more adventurous activities. For example, for "excited users," it will add options such as "nighttime cafe hopping in the Gion district."

[1001] Step 5:

[1002] The server presents the generated travel plan to the user in a virtual reality space.

[1003] Input: The generated itinerary.

[1004] Output: A visual presentation of the itinerary in virtual reality space.

[1005] How it works: Through a virtual reality interface, users can visually experience the generated itinerary using a head-mounted display. For example, the itinerary might say, "Day 1: Eat your way through Nishiki Market, Day 2: Visit a historic temple."

[1006] Step 6:

[1007] After the trip is over, the server collects feedback from the user and uses it as a reference when generating the next travel plan.

[1008] Input: User feedback (e.g., "How crowded is Nishiki Market?").

[1009] Output: Feedback data stored in a database.

[1010] How it works: Through a feedback collection interface, users submit their thoughts and opinions after completing their trip. The collected feedback is stored in a database and used to generate future travel plans.

[1011] Step 7:

[1012] The server improves its itinerary generation algorithm based on the collected feedback and sentiment data.

[1013] Input: User feedback and sentiment data.

[1014] Output: An improved trip plan generation algorithm.

[1015] How it works: The algorithm for generating itineraries is improved based on the analysis of sentiment data and feedback. This allows future itineraries to be more personalized. For example, it might take into account the crowding of Nishiki Market and suggest different times of day.

[1016] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1017] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1018] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1019] [Third embodiment]

[1020] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1021] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1022] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1023] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1024] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1025] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1026] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1027] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1028] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1029] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1030] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1031] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1032] The following system is conceivable as a mode for implementing the present invention. This system allows a traveler to input their travel destination, budget, length of stay, and desired travel style, and then proposes the optimal travel plan. A specific embodiment of this system is described below.

[1033] User Input Method

[1034] Device:

[1035] Users are presented with an interface, which can be in the form of a web page or a mobile application, for inputting their travel destination, budget, length of stay, and travel style.

[1036] Examples:

[1037] The user enters their travel destination "Kyoto," their budget "50,000 yen," their length of stay "2 days," and their travel style "food tour."

[1038] Database search methods

[1039] server:

[1040] The server receives the information sent by the user and searches the database for information on related tourist spots, restaurants, and activities, including queries to extract information on "Kyoto" and "food tours."

[1041] Examples:

[1042] If the travel destination is "Kyoto" and the travel style is "food-hopping," the server retrieves information such as "Nishiki Market" and "Japanese confectionery shops" from the database.

[1043] Travel plan generation method

[1044] server:

[1045] Based on the information retrieved from the database, the server generates a specific itinerary tailored to the user's length of stay, including places to visit and activities tailored to the user's preferences and needs.

[1046] Examples:

[1047] The itinerary generated for the first day includes "eating around Nishiki Market" in the morning, "visiting a Japanese sweets shop" in the afternoon, and "strolling around the Gion district" in the evening. The itinerary also includes "visiting a historical temple" in the morning of the second day and "lunch at a local cafe" in the afternoon.

[1048] Travel plan presentation method

[1049] Device:

[1050] The server generates a travel plan and presents it to the user through the chatbot, who can then check the plan on their smartphone or PC.

[1051] Examples:

[1052] The chatbot sends users messages like, "Here's a recommended itinerary: Day 1: Eat your way through Nishiki Market, then explore the Gion district. Day 2: Visit a historic temple and have lunch at a local cafe."

[1053] Feedback collection methods

[1054] Device:

[1055] Provide an interface for collecting user feedback after the trip is completed.

[1056] Examples:

[1057] After the chatbot sends a message such as "Please tell us your thoughts about the travel plan," the user enters feedback such as "Nishiki Market was crowded, so please suggest a different time next time."

[1058] server:

[1059] The server receives the feedback from the user and stores it in a database, which is then taken into account when generating the next plan.

[1060] This allows travelers to efficiently plan their trips, and since the plans are continually improved based on feedback after the trip, future trip plans will be more accurate and satisfying. This system allows travelers to easily obtain the best travel plans that suit their needs.

[1061] The processing flow will be explained below.

[1062] Step 1: Displaying a user input form

[1063] Device:

[1064] Provide an interface for travelers to input their travel destination, budget, length of stay, and preferred travel style, displayed using text boxes and drop-down lists in the form of a web page or mobile application.

[1065] Specific behavior:

[1066] Displays input fields for destination, budget, length of stay, and travel style.

[1067] A "Submit" button will be provided so that users can submit their input as soon as it is complete.

[1068] Step 2: Sending User Input

[1069] User:

[1070] Enter the required information about your destination, budget, length of stay, and travel style into each field and press the submit button.

[1071] Specific behavior:

[1072] Enter information such as travel destination "Kyoto," budget "50,000 yen," length of stay "2 days," and travel style "food tour."

[1073] By pressing the send button, the information is sent to the server.

[1074] Step 3: Receiving input information

[1075] server:

[1076] Receives and analyzes user-submitted travel information for use in generating database queries.

[1077] Specific behavior:

[1078] Analyze the received form data and store the travel destination, budget, length of stay, and travel style in variables.

[1079] Step 4: Generate and execute database queries

[1080] server:

[1081] Generate database queries based on analyzed user input information to search for tourist destinations and activity information.

[1082] Specific behavior:

[1083] If the travel destination is "Kyoto" and the travel style is "food tour," a query is generated to search for related tourist spots and restaurants.

[1084] Execute a query against the database and retrieve the results.

[1085] Step 5: Parse the search results

[1086] server:

[1087] The search results obtained from the database are analyzed and used as material for generating travel plans.

[1088] Specific behavior:

[1089] Get a list of tourist attractions and restaurants from your search results and prioritize them based on length of stay and budget.

[1090] Step 6: Generate your travel plan

[1091] server:

[1092] Based on the analysis results, a specific travel plan is generated that matches the user's length of stay.

[1093] Specific behavior:

[1094] A schedule is generated for the first day, such as "eating around Nishiki Market" in the morning, "strolling around the Gion district" in the afternoon, and "visiting a Japanese confectionery shop" in the evening.

[1095] Generate a schedule such as "visit a historical temple" in the morning of the second day and "have lunch at a local cafe" in the afternoon.

[1096] Step 7: Submit your travel plans

[1097] server:

[1098] The generated itinerary is passed to the chatbot in a structured format.

[1099] Specific behavior:

[1100] The generated travel plan is converted into JSON format etc. and sent to the chatbot.

[1101] Step 8: Present your travel plans

[1102] Device:

[1103] The chatbot presents users with the best travel plans.

[1104] Specific behavior:

[1105] The chatbot will message the user saying, "Here's a recommended itinerary: Day 1, eat your way through Nishiki Market, then explore the Gion district; Day 2, visit a historic temple and have lunch at a local cafe."

[1106] Step 9: Request feedback

[1107] Chatbots:

[1108] Send a message after the trip to ask for user feedback.

[1109] Specific behavior:

[1110] The chatbot sends a message requesting feedback: "Please tell us what you think about our travel plans."

[1111] Step 10: Receive and store feedback

[1112] User:

[1113] Enter and submit feedback on your travel plans.

[1114] Specific behavior:

[1115] Enter comments such as "Nishiki Market was crowded, so please suggest a different time next time" into the feedback form.

[1116] Click the submit button to send your feedback.

[1117] server:

[1118] Receive user feedback and store it in a database.

[1119] Specific behavior:

[1120] Analyze the feedback received and store it in the relevant travel plan record.

[1121] The saved feedback is used to improve the plan generation algorithm for the next iteration.

[1122] This will create a system that provides optimal travel plans for each individual traveler and improves the quality of the plans based on feedback.

[1123] Example 1

[1124] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1125] Today's travelers need an easy way to find the best travel plan that suits their destination, budget, length of stay, and preferred travel style. However, manually creating plans tailored to individual needs takes time and effort. In addition, there is a lack of a way to incorporate past experiences and feedback into future travel plans, making it difficult to further improve travel satisfaction.

[1126] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1127] In this invention, the server includes: means for the user to input their travel destination, budget, length of stay, and desired travel style; computer server means for receiving the input information and searching a database for related tourist destination and activity information; means for generating a specific travel plan tailored to the user's length of stay using a generative AI model based on the search results; and terminal means for presenting the generated travel plan to the user and providing an interactive interface for the user to check the plan. This allows the user to efficiently and precisely obtain a travel plan that meets their needs, and further enables them to reflect their post-trip feedback in future plans, resulting in a more satisfying trip.

[1128] "User input means" refers to a means by which a user inputs information about a travel destination, budget, length of stay, and desired travel style.

[1129] The "computer server" is a server that searches the database based on the information received from the user and obtains information on appropriate tourist spots and activities.

[1130] A "generative AI model" is an artificial intelligence model that generates travel plans that reflect the user's preferences and needs based on acquired data.

[1131] An "interactive interface" is a means of presenting the generated travel plan to the user and allowing the user to review the plan, and is typically used via a smartphone or PC.

[1132] The "feedback collection means" is a means for collecting feedback from users after their trip, and is used to reflect this feedback when generating the next plan.

[1133] A "database" is an information storage system for storing information about tourist attractions and activities.

[1134] The "travel plan generation means" is a means for generating a specific travel plan tailored to the user's length of stay based on information obtained from the database.

[1135] A "terminal" is a device that allows a user to use an interface to provide input information and check the generated travel plan, and includes a smartphone or personal computer.

[1136] The following system is conceivable as an embodiment of the present invention. This system allows a traveler to input their travel destination, budget, length of stay, and desired travel style, and then proposes an optimal travel plan. This system includes a user input means, a computer server, a generative AI model, an interactive interface, and a feedback collection means.

[1137] User Input Method

[1138] Device:

[1139] Users input information such as their travel destination, budget, length of stay, and travel style through a device. The device is provided in the form of a web page or mobile application. Specifically, users input their travel destination "Kyoto," their budget "50,000 yen," their length of stay "2 days," and their travel style "food-hopping."

[1140] Data reception and search methods

[1141] server:

[1142] The computer server receives the information sent by the user and searches the database for information on related tourist spots and activities. This search includes queries to extract information on "Kyoto" and "food tours," for example. Specifically, the server retrieves information on "Nishiki Market" and "Japanese confectionery shops" from the database based on the information on "food tours" in "Kyoto."

[1143] Travel plan generation method

[1144] server:

[1145] Based on the acquired data, the server uses a generative AI model to generate a specific itinerary tailored to the user's length of stay. The itinerary includes visits and activities tailored to the user's preferences and needs. Specifically, the itinerary generated on the first day includes a "food tour of Nishiki Market" in the morning, a "visit to a Japanese confectionery shop" in the afternoon, and a "stroll through the Gion district" in the evening. The itinerary on the second day also includes a "visit to a historic temple" and "lunch at a local cafe."

[1146] Travel plan presentation method

[1147] Device:

[1148] The generated itinerary is presented to the user through the chatbot. The user can check the itinerary using their smartphone or PC. Specifically, the chatbot sends a message saying, "Here's a recommended itinerary: On day one, enjoy a bite to eat at Nishiki Market, then stroll through the Gion district. On day two, visit a historic temple and have lunch at a local cafe."

[1149] Feedback collection methods

[1150] Device:

[1151] After the trip, an interface is provided to collect feedback from the user. Specifically, the chatbot sends a message saying, "Please tell us your thoughts about the trip plan," and the user enters feedback such as, "Nishiki Market was crowded, so please suggest a different time next time."

[1152] server:

[1153] The server receives the user's feedback and stores it in a database. This allows the server to take this feedback into account when generating the next plan. Specifically, the server will change the time slot for visiting Nishiki Market based on the feedback.

[1154] Prompt Sentence Examples

[1155] An example of a prompt sentence to be input to the generative AI model in this system is as follows:

[1156] Examples:

[1157] "I'd like to travel to Kyoto for two days. My budget is 50,000 yen, and my travel style is to eat my way around. What plan do you recommend?"

[1158] As a result, the system provides users with the best travel plans and is continuously improved based on their feedback, allowing users to easily obtain travel plans that suit their needs and achieve a highly satisfying travel experience.

[1159] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1160] Step 1:

[1161] User enters travel information

[1162] Terminal: The user enters the travel destination, budget, length of stay, and desired travel style and submits.

[1163] What happens: A user launches a web page or mobile application, fills in a form displayed in the interface, and clicks the "Submit" button.

[1164] Input: User entered travel destination "Kyoto", budget "50,000 yen", length of stay "2 days", travel style "food tour".

[1165] Output: The input information is sent to the server.

[1166] Step 2:

[1167] Receive information and search the database

[1168] Server: The server searches the database based on the received information and retrieves information on related tourist spots and activities.

[1169] What it does: The server receives the HTTP request and generates an SQL query based on the travel destination and style to extract information from the database.

[1170] Input: Input information submitted by the user.

[1171] Output: Information about related tourist attractions and activities (e.g., "Nishiki Market," "Japanese sweets shop").

[1172] Step 3:

[1173] Generate a travel plan

[1174] Server: Based on the acquired data, the server uses a generative AI model to generate a specific travel plan tailored to the user's length of stay.

[1175] How it works: The server passes the data to a plan generation algorithm, and the generative AI model creates a visit schedule for each day. The generated plan is saved in JSON format.

[1176] Input: Information about tourist attractions and activities retrieved from a database.

[1177] Output: A specific travel plan (e.g., on the first day, "Eat your way around Nishiki Market" in the morning, "Visit a Japanese sweets shop" in the afternoon, and "Walk around the Gion district" in the evening).

[1178] Step 4:

[1179] Present the generated itinerary to the user

[1180] Terminal: The generated travel plan is presented to the user through the chatbot.

[1181] Specific operation: The server sends the generated travel plan to the chatbot, which then sends a message to the user. The user then checks the plan on their smartphone or PC.

[1182] Input: The generated itinerary.

[1183] Output: The message shown to the user (e.g., "Here's a suggested itinerary: Day 1: Eat your way through Nishiki Market, then explore the Gion district. Day 2: Visit a historic temple and have lunch at a local cafe.").

[1184] Step 5:

[1185] Collect user feedback

[1186] Terminal: An interface is provided to collect feedback from users after the trip is completed.

[1187] What happens: The chatbot sends a message saying, "Please tell us what you think about our travel plans," and the user enters their feedback.

[1188] Input: User feedback (e.g., "Nishiki Market was crowded, please suggest a different time next time.").

[1189] Output: The entered feedback is sent to the server.

[1190] Step 6:

[1191] Receive feedback and store it in a database

[1192] Server: The server receives the feedback from the user and stores it in a database. The next time a plan is generated, this feedback will be taken into account.

[1193] Specific operation: The server receives the feedback data, inserts the feedback data into the database, and, if necessary, configures the saved feedback so that it is used for the next plan generation.

[1194] Input: User feedback.

[1195] Output: Feedback stored in a database that will be used to improve the next itinerary generation.

[1196] Through these steps, the system can provide users with efficient, precise, and personalized travel plans, and continuously improve those plans.

[1197] (Application example 1)

[1198] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1199] In recent years, there has been a growing demand for the rapid provision of personalized travel plans that meet the diverse needs of travelers. However, conventional systems lack the means to simulate specific experiences before travelers actually visit a destination when proposing travel plans. This has led to challenges in improving traveler satisfaction and low accuracy of plans. It is also difficult to effectively collect feedback from travelers and reflect it in future plans.

[1200] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1201] In this invention, the server includes: a means for a user to input their travel destination, budget, length of stay, and desired travel style; a means for searching a database for related tourist spots and activity information based on the input information; a means for generating a specific travel plan tailored to the user's length of stay based on the search results; a means for presenting the generated travel plan to the user; and a means for the user to experience the generated travel plan in a virtual reality environment. This allows travelers to experience specific tourist experiences in advance in a virtual space, and allows them to provide more accurate feedback based on that experience, which can be reflected in future travel plans.

[1202] "User" refers to a person who uses the System to generate and experience travel plans.

[1203] "Destination" means a geographic location that a User wishes to visit.

[1204] "Budget" refers to the financial constraints a user has when traveling.

[1205] "Length of Stay" refers to the length of time a user plans to stay at a travel destination.

[1206] "Desired travel style" refers to the types of activities and experiences users seek while traveling.

[1207] "Input means" refers to an interface through which a user provides information about travel destination, budget, length of stay, and travel style to the system.

[1208] "Database" refers to a system that stores travel-related data such as tourist destination and activity information.

[1209] "Searching means" refers to the process of extracting relevant information from a database based on input information.

[1210] "Means of generation" refers to the process of creating a specific travel plan based on the search results.

[1211] "Presentation means" refers to an interface for providing the generated travel plan to the user.

[1212] "Virtual reality environment" refers to an environment in which users can use virtual reality technology to simulate a travel plan as if it were a real experience.

[1213] "Feedback" refers to ratings and opinions about travel plans provided by users.

[1214] "Measures to improve" refers to the process of improving the accuracy and satisfaction of future travel plans based on collected feedback.

[1215] This invention provides a system that allows users to input their travel destination, budget, length of stay, and desired travel style, generate an optimal travel plan based on the input, and then experience the plan in a virtual reality environment. Specific embodiments for implementing the invention are described below.

[1216] User Input Method

[1217] Users input their travel destination, budget, length of stay, and travel style via devices such as smartphones or PCs, using interfaces provided on web pages or mobile applications.

[1218] Database search methods

[1219] The server has a means for receiving the information sent by the user and searching the database for information on related tourist spots, restaurants, and activities. For example, if the travel destination is "Kyoto" and the travel style is "eating around," information on "markets" and "restaurants" is retrieved from the database.

[1220] Travel plan generation method

[1221] The server generates a specific itinerary based on the information retrieved from the database, tailored to the user's length of stay. For example, a possible itinerary on the first day could be "eating around the marketplace" in the morning, "exploring the historic area" in the afternoon, and "cafe-hopping" in the evening.

[1222] Travel plan presentation method

[1223] The server uses chatbots and notification functions to present the generated travel plans to users, who can then check the plans on their smartphones or PCs.

[1224] Virtual experience means

[1225] One of the features of this system is that users can experience the travel plan generated in a virtual reality environment by wearing smart glasses or a head-mounted display and simulating the travel plan in a virtual space.

[1226] Feedback collection methods

[1227] After the trip, feedback is collected through the device and the travel plan is improved based on that feedback. For example, specific feedback such as "The market was crowded, so please suggest a different time."

[1228] Hardware and software used

[1229] Server: Executes programs, performs database searches, and generates plans. For example, we use a cloud server (AWS, GCP).

[1230] Database: Use a database management system such as SQLite or MySQL.

[1231] Chatbots: Use natural language processing solutions such as Dialogflow (Google).

[1232] Virtual reality system: A VR environment developed with Unity or Unreal Engine.

[1233] Specific examples

[1234] The user inputs their travel destination "Kyoto," their budget "50,000 yen," their stay length "2 days," and their travel style "food-hopping." The system extracts tourist spots related to "food-hopping" in "Kyoto" from a database and generates a plan that includes, for example, "food-hopping at markets," "strolling around historical areas," and "cafe-hopping." The user puts on a VR headset and experiences these spots in virtual reality. After the trip, feedback is collected from the user and reflected in future plans.

[1235] Prompt Sentence Examples

[1236] "My next trip is to Kyoto, my budget is 50,000 yen, I'll be there for two days, and my travel style will be food-hopping. What's your recommended plan?"

[1237] "The market was crowded, so please suggest a different time."

[1238] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1239] Step 1:

[1240] The user inputs their travel destination, budget, length of stay, and desired travel style through the device interface. The input data is sent to the server in JSON format. The input data specifically includes information such as "Destination: Kyoto," "Budget: 50,000 yen," "Length of stay: 2 days," and "Travel style: Eating around."

[1241] Step 2:

[1242] The server analyzes the received user data and stores it in variables. The variables store the travel destination, budget, length of stay, and travel style. This defines the parameters required for database searches. For example, the variable destination might store "Kyoto," budget "50,000 yen," duration "2 days," and style "food tour."

[1243] Step 3:

[1244] The server generates a query to search for related tourist spots and activity information from the database. The generated query is constructed in the form of an SQL statement based on variables. For example, the SQL query "SELECT FROM activities WHERE location="Kyoto" AND style="food-hopping"" is generated. This extracts related tourist spots and activity information from the database.

[1245] Step 4:

[1246] The server generates a specific travel plan tailored to the user's length of stay based on the extracted tourist destination and activity information. The plan generation algorithm allocates the extracted data to appropriate time slots to create a schedule that best suits the user's needs. For example, an itinerary such as "eating around the market" in the morning of the first day, "strolling around the historical area" in the afternoon, and "cafe hopping" in the evening could be automatically generated.

[1247] Step 5:

[1248] The generated travel plan is converted into JSON format and presented to the user. The server then sends the generated plan to the user in the form of a chatbot. The user can then check the plan on their smartphone or PC. For example, a specific schedule such as "Day 1: Eat your way around the market, stroll through the historical area, and visit cafes. Day 2: Visit a famous local temple and have lunch at a cafe" is presented.

[1249] Step 6:

[1250] Users use smart glasses or a head-mounted display to experience the generated travel plan in a virtual reality environment. The virtual reality application is developed using Unity or Unreal Engine and simulates tourist spots and activities with the feeling of visiting them in real life. Users can visit specific spots in VR and check the experience.

[1251] Step 7:

[1252] After completing the trip, the user enters feedback through the device. The device interface includes a simple evaluation form and a free response section, where the user provides their evaluation and opinion on the travel plan. For example, specific feedback such as "The market was crowded, so please suggest a different time next time" can be included.

[1253] Step 8:

[1254] The server analyzes the feedback collected from users and stores it in a database. The stored feedback is taken into consideration when generating future travel plans and is used to improve user satisfaction. The feedback analysis algorithm extracts areas for improvement based on the collected data and reflects them in the parameters for generating new plans.

[1255] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1256] The following describes an embodiment of the present invention. The present invention allows travelers to input their travel destination, budget, length of stay, and desired travel style, and proposes the optimal travel plan. Furthermore, it combines an emotion engine that recognizes the user's emotions to provide a more personalized travel experience.

[1257] User Input Method

[1258] Device:

[1259] Users are presented with an interface, which can be in the form of a web page or a mobile application, for inputting their travel destination, budget, length of stay, and travel style.

[1260] Examples:

[1261] The user enters their travel destination "Kyoto," their budget "50,000 yen," their length of stay "2 days," and their travel style "food tour."

[1262] Emotion Engine

[1263] Device:

[1264] As users type, emotions are recognized and analyzed by an emotion engine that uses facial recognition software and voice analysis algorithms to identify the user's emotions.

[1265] Examples:

[1266] If the user is excited while typing, a positive emotion is perceived.

[1267] Database search methods

[1268] server:

[1269] The server receives the information and recognized emotions sent by the user and searches the database for information on related tourist spots, restaurants, and activities, including queries to extract information on "Kyoto" and "food tours."

[1270] Examples:

[1271] If the travel destination is "Kyoto" and the travel style is "food-hopping," the server retrieves information such as "Nishiki Market" and "Japanese confectionery shops" from the database.

[1272] Emotion-Based Adjustments

[1273] server:

[1274] Based on the information obtained, the travel plan can be adjusted taking into account the user's emotions: if positive emotions are recognized, more adventurous activities can be included in the plan.

[1275] Examples:

[1276] If the user is excited, the destinations will include things like "visiting cafes in the Gion district at night."

[1277] Travel plan generation method

[1278] server:

[1279] Based on the information retrieved from the database, the server generates a specific itinerary tailored to the user's length of stay, incorporating the results of the emotion engine. The itinerary includes places to visit and activities tailored to the user's preferences and needs.

[1280] Examples:

[1281] The generated schedule includes "eating around Nishiki Market" in the morning of the first day, "strolling around the Gion district" in the afternoon, and "visiting a Japanese sweets shop" in the evening. The schedule also includes "visiting a historical temple" in the morning of the second day, and "lunch at a local cafe" in the afternoon.

[1282] Travel plan presentation method

[1283] Device:

[1284] The server generates a travel plan and presents it to the user through the chatbot, who can then check the plan on their smartphone or PC.

[1285] Examples:

[1286] The chatbot sends users messages like, "Here's a recommended itinerary: Day 1: Eat your way through Nishiki Market, then explore the Gion district. Day 2: Visit a historic temple and have lunch at a local cafe."

[1287] Feedback collection methods

[1288] Device:

[1289] Provide an interface for collecting user feedback after the trip is completed.

[1290] Examples:

[1291] After the chatbot sends a message such as "Please tell us your thoughts about the travel plan," the user enters feedback such as "Nishiki Market was crowded, so please suggest a different time next time."

[1292] server:

[1293] The server receives the feedback from the user and stores it in a database, which is then taken into account when generating the next plan.

[1294] Utilizing Emotional Data

[1295] server:

[1296] The company will analyze sentiment data collected from users and use it to improve its travel plan generation algorithm, enabling even more advanced personalization in the future.

[1297] Examples:

[1298] Record activities that excited users on past trips and include similar activities in your next travel plans.

[1299] This allows travelers to efficiently plan their trips, and since the plans are continually improved based on post-trip feedback and emotional data, future trip plans will be more accurate and satisfying. This system allows travelers to easily obtain the optimal travel plan that suits their needs and emotions.

[1300] The processing flow will be explained below.

[1301] Step 1: Displaying a user input form

[1302] Device:

[1303] Present an interface for travelers to input their travel destination, budget, length of stay, and preferred travel style. This can be done using text boxes and drop-down lists in the form of a web page or mobile application.

[1304] Specific behavior:

[1305] Displays input fields for destination, budget, length of stay, and travel style.

[1306] Provide a "Submit" button so users can submit their information as soon as it is entered.

[1307] Step 2: Sending User Input

[1308] User:

[1309] Enter information about your destination, budget, length of stay, and travel style into the fields and press the submit button.

[1310] Specific behavior:

[1311] Enter information such as travel destination "Kyoto," budget "50,000 yen," length of stay "2 days," and travel style "food tour."

[1312] Press the send button and the information will be sent to the server.

[1313] Step 3: Receiving and parsing input information

[1314] server:

[1315] It receives user-submitted travel information, parses it for use in generating database queries, and passes the information to the emotion engine.

[1316] Specific behavior:

[1317] Analyze the received form data and store the travel destination, budget, length of stay, and travel style in variables.

[1318] Pass user input information to the emotion engine to obtain emotion data.

[1319] Step 4: Recognize user emotions

[1320] Device:

[1321] The emotion engine analyzes the user's facial expressions and voice in real time as they type, recognizing their emotional state.

[1322] Specific behavior:

[1323] It uses facial recognition software and voice analysis algorithms to recognize emotions (e.g., joy or excitement) that users express while typing.

[1324] The recognized emotion data is sent to the server.

[1325] Step 5: Generate and execute database queries

[1326] server:

[1327] Based on the analyzed user input information and emotion data, a database query is generated to search for tourist destinations and activity information.

[1328] Specific behavior:

[1329] If the travel destination is "Kyoto" and the travel style is "food-hopping," generate a query to search for related tourist spots and restaurants.

[1330] Execute the query and retrieve the results from the database.

[1331] Step 6: Parse the search results

[1332] server:

[1333] The search results obtained from the database are analyzed and used to generate travel plans.

[1334] Specific behavior:

[1335] Get a list of tourist attractions and restaurants from your search results and prioritize them based on length of stay and budget.

[1336] Step 7: Generate your travel plan

[1337] server:

[1338] A specific travel plan is generated based on the information acquired by the server and the user's emotional data.

[1339] Specific behavior:

[1340] A schedule is generated for the first day, such as "eating around Nishiki Market" in the morning, "strolling around the Gion district" in the afternoon, and "visiting a Japanese confectionery shop" in the evening.

[1341] Generate a schedule such as "visit a historical temple" in the morning of the second day and "have lunch at a local cafe" in the afternoon.

[1342] If the user's sentiment is positive, make adjustments, such as including evening activities.

[1343] Step 8: Present your travel plans

[1344] Device:

[1345] The server generates a travel plan and presents it to the user through the chatbot.

[1346] Specific behavior:

[1347] The chatbot will message the user saying, "Here's a suggested itinerary: Day 1: Eat your way through Nishiki Market, then explore the Gion district. Day 2: Visit a historic temple and have lunch at a local cafe."

[1348] Step 9: Request feedback

[1349] Chatbots:

[1350] Send a message after the trip to ask for user feedback.

[1351] Specific behavior:

[1352] Send a message asking for feedback: "Tell us what you think about our travel plans."

[1353] Step 10: Receive and store feedback

[1354] User:

[1355] Enter and submit feedback on your travel plans.

[1356] Specific behavior:

[1357] Enter comments such as "Nishiki Market was crowded, so please suggest a different time next time" into the feedback form.

[1358] Click the submit button to send your feedback.

[1359] server:

[1360] Receive user feedback and store it in a database.

[1361] Specific behavior:

[1362] Analyze the feedback received and store it in the relevant travel plan record.

[1363] The saved feedback is used to improve the plan generation algorithm for the next iteration.

[1364] Step 11: Analyze and use sentiment data

[1365] server:

[1366] The collected emotional data is analyzed and used to generate future plans.

[1367] Specific behavior:

[1368] Analyze the positive emotional data users have shown on past trips and reflect it in their next travel plans.

[1369] For example, if a user expresses high satisfaction with a particular activity, we will take that into account and include a similar activity in our next plan.

[1370] Example 2

[1371] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1372] Conventional travel plan generation systems propose travel plans without considering the user's feelings, making it difficult to provide plans that satisfy the user. Furthermore, they do not fully utilize feedback and are unable to provide continuously improved plans. This leads to a decrease in user satisfaction.

[1373] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for the user to input the travel destination, budget, length of stay, and desired travel style, means for recognizing and analyzing the user's emotions based on the input information, means for searching for related tourist destination and activity information from a database based on the analyzed emotion data and the input information, means for adjusting the travel plan taking the user's emotions into consideration based on the acquired information, means for generating a specific travel plan tailored to the user's length of stay using the adjusted information, and means for presenting the generated travel plan to the user. This makes it possible to provide an optimal travel plan based on the user's emotions and needs, thereby improving user satisfaction.

[1374] "User" means an individual who utilizes the System and inputs information to generate a travel plan.

[1375] "Travel Destination" means a destination that a User wishes to visit.

[1376] "Budget" means the range of funds available to User for Travel.

[1377] "Length of Stay" means the period of time that a User intends to stay at a particular travel destination.

[1378] "Travel style" refers to the type or theme of travel based on the user's preferences.

[1379] "Input means" refers to the interface that allows users to provide information such as travel destination, budget, length of stay, and travel style to the system.

[1380] "Means for recognizing and analyzing emotions" refers to the function of capturing the user's facial expressions and voice and analyzing them using an emotion engine.

[1381] "Database" refers to a collection of information that stores information about travel destinations, tourist attractions, restaurants, and activities.

[1382] "Searching means" refers to the function of extracting relevant information from a database based on user input and emotional data.

[1383] "Adjustment" refers to the ability to optimize travel plans to meet the user's needs based on the information obtained and the user's emotional data.

[1384] "Means for generating" refers to the function of using the adjusted information to create a specific travel plan tailored to the user's length of stay.

[1385] "Presentation means" refers to the function for displaying and providing the generated travel plan to the user.

[1386] "Feedback" refers to the evaluations and opinions about the plan provided by the user after the trip is completed.

[1387] The present invention is a system that allows travelers to input their travel destination, budget, length of stay, and desired travel style, and then proposes an optimal travel plan taking the user's emotions into consideration. This system acquires the user's input information and emotion data, performs a database search based on this, and generates and presents an appropriate travel plan. Specific methods for implementing this system are described below.

[1388] Hardware and Software Configuration

[1389] Device: The device that provides the interface for the user to enter input. This can be a smartphone, tablet, or PC. The interface can be implemented in the form of a web page or mobile application.

[1390] Emotion Engine: Analyzes user emotions using facial expression recognition software and voice analysis algorithms, such as OpenCV for facial expression recognition and Google Cloud Speech-to-Text API for voice analysis.

[1391] Server: The central server performs database searches, information retrieval, and plan generation, coordination, and presentation. The database contains detailed information about tourist spots, restaurants, and activities.

[1392] Chatbots: Used to interact with users, for example, by providing travel itineraries and collecting feedback in a natural conversational format using Dialogflow or the Microsoft Bot Framework.

[1393] System Overview

[1394] User Input Method

[1395] Users input their travel destination, budget, length of stay, and travel style using a device. The interface is designed to be intuitive and easy to use. For example, a user inputs their travel destination "Kyoto," their budget "50,000 yen," their stay length "2 days," and their travel style "food-hopping."

[1396] Emotion Engine

[1397] When a user enters this information, the device's camera and microphone are used to capture the user's facial expressions and voice, which are then analyzed by the emotion engine. The emotion engine uses facial recognition software and voice analysis algorithms to identify the user's emotional state (e.g., excitement, joy, etc.). For example, if the user is excited while entering information, a positive emotion is recognized.

[1398] Database search methods

[1399] The server receives the information sent by the user and analyzed emotion data, and searches the database for information on related tourist spots, restaurants, and activities. For example, if the travel destination is "Kyoto" and the travel style is "eating around," the server will retrieve information such as "Nishiki Market" and "Japanese confectionery shops" from the database.

[1400] Emotion-Based Adjustments

[1401] The server then uses the information it has acquired to adjust the itinerary, taking into account the user's emotions. If a positive emotion is detected, it can include more adventurous activities in the itinerary. For example, if the user is excited, it can add a trip to the Gion district at night to the itinerary.

[1402] Travel plan generation method

[1403] Based on the information retrieved from the database, the server generates a specific itinerary tailored to the user's length of stay, while also incorporating the results of the emotion engine. The itinerary includes visits and activities tailored to the user's preferences and needs. For example, a schedule may be generated such as "eating around Nishiki Market" in the morning of the first day, "strolling around the Gion district" in the afternoon, and "visiting a Japanese confectionery shop" in the evening. Another schedule may include "visiting a historical temple" in the morning of the second day, and "lunch at a local cafe" in the afternoon.

[1404] Travel plan presentation method

[1405] The server generates a travel plan and presents it to the user via the device. The user can then view the plan on their smartphone or PC, checking detailed schedules and location information. For example, the chatbot could send a message to the user saying, "Here's a recommended travel plan: On day one, enjoy a bite to eat at Nishiki Market, then stroll through the Gion district. On day two, visit a historic temple and have lunch at a local cafe."

[1406] Feedback collection methods

[1407] After the trip, an interface is provided to collect feedback from the user. For example, after the chatbot sends a message such as "Please tell us your thoughts about the trip plan," the user can enter feedback such as "Nishiki Market was crowded, so please suggest a different time next time."

[1408] Utilizing Emotional Data

[1409] The server receives user feedback and sentiment data, analyzes it, and uses it to improve the itinerary generation algorithm, enabling greater personalization in the future. For example, it can record activities that excited users on past trips and include similar activities in the next itinerary.

[1410] Examples of prompt statements

[1411] 1. "Enter your travel destination as 'Kyoto,' your budget as '50,000 yen,' your stay period as '2 days,' and your travel style as 'eating around.' Then, if the emotion engine detects an excited state, add positive activities to your plan."

[1412] 2. "The system uses facial recognition software and voice analysis algorithms to identify the user's emotions. Based on the information and emotional data entered by the user, the server then searches for relevant information from a database and generates a travel plan, which includes activities tailored based on the emotions."

[1413] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1414] Step 1: Receiving User Input

[1415] Terminal: Provides an interface where users can input their travel destination, budget, length of stay, and desired travel style. The input information is sent to the server. For example, a user might input "Travel destination: Kyoto, Budget: 50,000 yen, Length of stay: 2 days, Travel style: Eating around" into a smartphone app.

[1416] Input: Travel destination, budget, length of stay, travel style

[1417] Output: User input data (travel destination "Kyoto", budget "50,000 yen", length of stay "2 days", travel style "food-hopping")

[1418] Step 2: Emotion analysis using the emotion engine

[1419] Device: When a user provides input, the device's camera and microphone are used to capture facial expressions and voice, and the emotion engine analyzes the data. Using facial recognition software and voice analysis algorithms, the user's emotions are identified. For example, if a user says "eating out" in an excited voice, the emotion engine recognizes a positive emotion.

[1420] Input: Real-time facial expression data, voice data

[1421] Output: Parsed emotion data (positive, excited)

[1422] Step 3: Database search

[1423] Server: Based on the acquired user input data and emotion data, the server searches the database for information on related tourist spots, restaurants, and activities. For example, if the travel destination is "Kyoto" and the travel style is "eating around," the server will search and extract information such as "Nishiki Market" and "Japanese confectionery shops."

[1424] Input: User input data, emotion data

[1425] Output: Related information (tourist information, restaurant information, activity information)

[1426] Step 4: Emotionally Based Adjustment

[1427] Server: Based on the acquired tourist destination and activity information, the plan contents are adjusted taking into account the user's emotional state. If a positive emotion is recognized, more adventurous activities are added. For example, if the user is excited, "Café hopping in the Gion district at night" is added to the plan.

[1428] Input: related information, emotion data

[1429] Output: Adjusted itinerary information

[1430] Step 5: Generate your travel plan

[1431] Server: Using the adjusted information, the server generates a specific itinerary tailored to the user's length of stay. The itinerary includes visits and activities tailored to the user's preferences and needs. For example, the server generates a schedule such as "eating around Nishiki Market" in the morning of the first day, "strolling around the Gion district" in the afternoon, and "visiting a Japanese confectionery shop" in the evening, and "visiting a historical temple" in the morning of the second day, and "lunch at a local cafe" in the afternoon.

[1432] Input: Adjusted travel plan information, length of stay data

[1433] Output: Final itinerary

[1434] Step 6: Present your travel plans

[1435] Device: Presents the generated itinerary to the user. The user can then view the itinerary on their smartphone or PC, along with detailed schedules and location information. For example, the chatbot could send a message such as, "Here's a recommended itinerary: Day 1, eat your way through Nishiki Market, then explore the Gion district. Day 2, visit a historic temple and have lunch at a local cafe."

[1436] Input: Final travel plan

[1437] Output: Plan data to be presented to the user

[1438] Step 7: Gather feedback

[1439] Terminal: Provides an interface for collecting feedback from users after the trip. For example, the chatbot sends a message saying, "Please tell us what you thought about the trip plan," and the user enters feedback such as, "Nishiki Market was crowded, so please suggest a different time next time."

[1440] Input: User feedback

[1441] Output: Feedback data

[1442] Step 8: Leverage feedback data

[1443] Server: Receives user feedback and sentiment data, analyzes it, and uses it to improve the itinerary generation algorithm. For example, it records activities that excited users on past trips and includes similar activities in the next itinerary.

[1444] Input: Feedback data, emotion data

[1445] Output: Improved algorithms and database updates

[1446] (Application example 2)

[1447] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1448] Conventional travel plan generation systems create travel plans without considering user emotions, making it difficult to provide a fully optimized travel experience for each individual user. Even if feedback is collected, there is a lack of effective ways to utilize it, making it difficult to reflect it in future travel plans. Furthermore, there are limited ways to visually check the travel plan, making it difficult to meet user expectations.

[1449] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for the user to input their travel destination, budget, length of stay, and desired travel style; means for recognizing and analyzing emotions; means for searching a database for related tourist destination and activity information based on the input information and the recognized emotions; means for generating a travel plan taking into account the search results and the user's emotions; and means for presenting the generated travel plan to the user in a virtual reality space. This makes it possible to generate and present a travel plan optimized for each individual user, taking into account the user's emotions, thereby improving the user's experience and satisfaction.

[1450] "User" means an individual or group who wishes to use the system to generate a travel plan.

[1451] A "destination" is a specific geographic location that a user wishes to visit.

[1452] "Budget" is the amount of money the user plans to spend during the trip.

[1453] "Length of Stay" means the length of time a user intends to stay at a particular travel destination.

[1454] "Travel style" refers to the user's preferred travel method or theme (e.g., food tours, sightseeing, activities).

[1455] The "means for inputting" is an interface that allows a user to input travel destination, budget, length of stay, and travel style into the system.

[1456] "Means for recognizing and analyzing emotions" refers to software or hardware that identifies and analyzes emotions from a user's facial expressions and voice.

[1457] The "database search means" is a function for searching for related tourist destination and activity information based on the input information and recognized emotions.

[1458] The "means for generating a travel plan" refers to algorithms and software for creating a specific travel plan taking into account the searched information and the user's emotions.

[1459] The "means for presenting in virtual reality space" is an interface for visually presenting the generated travel plan to the user through a virtual reality device.

[1460] "Means for collecting feedback" refers to an interface for receiving opinions and impressions from users after the trip is completed.

[1461] The "means for improving travel plans based on feedback" refers to algorithms and software that analyze collected user feedback and incorporate it into future travel plans.

[1462] The present invention is a system that generates and presents optimal travel plans while recognizing emotions, based on the traveler's input of destination, budget, length of stay, and desired travel style. This system is configured as follows:

[1463] First, users use an interface to input their travel destination, budget, length of stay, and desired travel style. This interface is provided through devices such as smartphones or head-mounted displays (HMDs). For example, a user inputs information such as "Kyoto," "50,000 yen," "2 days," and "food tour" through the device.

[1464] Next, an emotion engine is activated to recognize and analyze emotions. This emotion engine uses facial recognition software and voice analysis algorithms to identify the user's emotions. For example, if the user is excited while typing, a positive emotion is recognized.

[1465] The server searches the database for information on related tourist spots and activities based on the information sent by the user and the recognized emotions. Specifically, it searches for information on "Kyoto" and "food tours" and extracts tourist spots such as Nishiki Market and Japanese confectionery shops.

[1466] The server then generates an itinerary based on the search results and the user's emotions, potentially including more adventurous activities if positive emotions are recognized. For example, an excited user might be suggested an activity like "cafe-hopping in the Gion district at night."

[1467] The generated travel plan is presented to the user in a virtual reality space. Specifically, when the user is wearing an HMD, the generated plan is displayed visually and the user can check the plan details in the virtual environment. For example, the presented plan might include a schedule of "Day 1: Eat your way around Nishiki Market and stroll around the Gion district."

[1468] After the trip is over, the server collects feedback from the user. The collected feedback is stored in a database and used as a reference when generating the next travel plan. For example, if a user provides feedback such as "Nishiki Market was crowded, so please suggest a different time next time," that information will be reflected in generating the next plan.

[1469] Examples and prompts

[1470] If a user uses the device to input data such as "Kyoto," "50,000 yen," "2 days," "food tour," and "excitement," the generated itinerary will include things like "food tour at Nishiki Market" and "stroll around the Gion district," thus providing the user with the optimal travel plan.

[1471] An example of a prompt for the generative AI model is as follows:

[1472] Generate the best itinerary based on the following data:

[1473] Travel destination: Kyoto

[1474] Budget: 50,000 yen

[1475] Length of stay: 2 days

[1476] Travel Style: Eating out

[1477] User Sentiment: Excitement

[1478] Necessary information: Nishiki Market, Japanese sweets shops, Gion area cafes, etc.

[1479] In this way, the present invention takes into account the user's emotions, generates an individually optimized travel plan, and makes it possible to visually present it in a virtual environment.

[1480] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1481] Step 1:

[1482] Users input their destination, budget, length of stay, and desired travel style.

[1483] Input: Information entered by the user via the device (destination, budget, length of stay, travel style).

[1484] Output: User's travel planning information provided to the system.

[1485] How it works: The user uses a smartphone or head-mounted display (HMD) to input textual information into the application's interface.

[1486] Step 2:

[1487] The device uses an emotion engine to recognize and analyze the user's emotions.

[1488] Input: The facial expressions and voice of the user when typing.

[1489] Output: The user's emotional state (e.g., excitement, joy).

[1490] How it works: Using facial recognition software and voice recognition algorithms to analyze your facial expressions and tone of voice to determine your current emotional state, for example, whether your face is smiling or your tone of voice is excited.

[1491] Step 3:

[1492] The server searches the database based on the input information and the recognized emotion.

[1493] Input: Travel destination, travel style, and user emotional state.

[1494] Output: A list of related tourist attractions and activities.

[1495] How it works: The database search engine queries information that matches the input travel destination and style, and extracts information on related tourist spots and activities. For example, based on "Kyoto" and "food tour," it retrieves information on "Nishiki Market" and "famous Japanese confectionery shops."

[1496] Step 4:

[1497] The server generates a travel plan taking into account the search results and the user's emotions.

[1498] Input: A list of search results and the user's emotional state.

[1499] Output: A customized itinerary.

[1500] How it works: The itinerary generation algorithm combines search results with the perceived emotions to generate a specific itinerary. If positive emotions are detected, it will adjust the itinerary to include more adventurous activities. For example, for "excited users," it will add options such as "nighttime cafe hopping in the Gion district."

[1501] Step 5:

[1502] The server presents the generated travel plan to the user in a virtual reality space.

[1503] Input: The generated itinerary.

[1504] Output: A visual presentation of the itinerary in virtual reality space.

[1505] How it works: Through a virtual reality interface, users can visually experience the generated itinerary using a head-mounted display. For example, the itinerary might say, "Day 1: Eat your way through Nishiki Market, Day 2: Visit a historic temple."

[1506] Step 6:

[1507] After the trip is over, the server collects feedback from the user and uses it as a reference when generating the next travel plan.

[1508] Input: User feedback (e.g., "How crowded is Nishiki Market?").

[1509] Output: Feedback data stored in a database.

[1510] How it works: Through a feedback collection interface, users submit their thoughts and opinions after completing their trip. The collected feedback is stored in a database and used to generate future travel plans.

[1511] Step 7:

[1512] The server improves its itinerary generation algorithm based on the collected feedback and sentiment data.

[1513] Input: User feedback and sentiment data.

[1514] Output: An improved trip plan generation algorithm.

[1515] How it works: The algorithm for generating itineraries is improved based on the analysis of sentiment data and feedback. This allows future itineraries to be more personalized. For example, it might take into account the crowding of Nishiki Market and suggest different times of day.

[1516] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1517] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1518] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1519] [Fourth embodiment]

[1520] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1521] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1522] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1523] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1524] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1525] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1526] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1527] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1528] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1529] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1530] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1531] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1532] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1533] The following system is conceivable as a mode for implementing the present invention. This system allows a traveler to input their travel destination, budget, length of stay, and desired travel style, and then proposes the optimal travel plan. A specific embodiment of this system is described below.

[1534] User Input Method

[1535] Device:

[1536] Users are presented with an interface, which can be in the form of a web page or a mobile application, for inputting their travel destination, budget, length of stay, and travel style.

[1537] Examples:

[1538] The user enters their travel destination "Kyoto," their budget "50,000 yen," their length of stay "2 days," and their travel style "food tour."

[1539] Database search methods

[1540] server:

[1541] The server receives the information sent by the user and searches the database for information on related tourist spots, restaurants, and activities, including queries to extract information on "Kyoto" and "food tours."

[1542] Examples:

[1543] If the travel destination is "Kyoto" and the travel style is "food-hopping," the server retrieves information such as "Nishiki Market" and "Japanese confectionery shops" from the database.

[1544] Travel plan generation method

[1545] server:

[1546] Based on the information retrieved from the database, the server generates a specific itinerary tailored to the user's length of stay, including places to visit and activities tailored to the user's preferences and needs.

[1547] Examples:

[1548] The itinerary generated for the first day includes "eating around Nishiki Market" in the morning, "visiting a Japanese sweets shop" in the afternoon, and "strolling around the Gion district" in the evening. The itinerary also includes "visiting a historical temple" in the morning of the second day and "lunch at a local cafe" in the afternoon.

[1549] Travel plan presentation method

[1550] Device:

[1551] The server generates a travel plan and presents it to the user through the chatbot, who can then check the plan on their smartphone or PC.

[1552] Examples:

[1553] The chatbot sends users messages like, "Here's a recommended itinerary: Day 1: Eat your way through Nishiki Market, then explore the Gion district. Day 2: Visit a historic temple and have lunch at a local cafe."

[1554] Feedback collection methods

[1555] Device:

[1556] Provide an interface for collecting user feedback after the trip is completed.

[1557] Examples:

[1558] After the chatbot sends a message such as "Please tell us your thoughts about the travel plan," the user enters feedback such as "Nishiki Market was crowded, so please suggest a different time next time."

[1559] server:

[1560] The server receives the feedback from the user and stores it in a database, which is then taken into account when generating the next plan.

[1561] This allows travelers to efficiently plan their trips, and since the plans are continually improved based on feedback after the trip, future trip plans will be more accurate and satisfying. This system allows travelers to easily obtain the best travel plans that suit their needs.

[1562] The processing flow will be explained below.

[1563] Step 1: Displaying a user input form

[1564] Device:

[1565] Provide an interface for travelers to input their travel destination, budget, length of stay, and preferred travel style, displayed using text boxes and drop-down lists in the form of a web page or mobile application.

[1566] Specific behavior:

[1567] Displays input fields for destination, budget, length of stay, and travel style.

[1568] A "Submit" button will be provided so that users can submit their input as soon as it is complete.

[1569] Step 2: Sending User Input

[1570] User:

[1571] Enter the required information about your destination, budget, length of stay, and travel style into each field and press the submit button.

[1572] Specific behavior:

[1573] Enter information such as travel destination "Kyoto," budget "50,000 yen," length of stay "2 days," and travel style "food tour."

[1574] By pressing the send button, the information is sent to the server.

[1575] Step 3: Receiving input information

[1576] server:

[1577] Receives and analyzes user-submitted travel information for use in generating database queries.

[1578] Specific behavior:

[1579] Analyze the received form data and store the travel destination, budget, length of stay, and travel style in variables.

[1580] Step 4: Generate and execute database queries

[1581] server:

[1582] Generate database queries based on analyzed user input information to search for tourist destinations and activity information.

[1583] Specific behavior:

[1584] If the travel destination is "Kyoto" and the travel style is "food tour," a query is generated to search for related tourist spots and restaurants.

[1585] Execute a query against the database and retrieve the results.

[1586] Step 5: Parse the search results

[1587] server:

[1588] The search results obtained from the database are analyzed and used as material for generating travel plans.

[1589] Specific behavior:

[1590] Get a list of tourist attractions and restaurants from your search results and prioritize them based on length of stay and budget.

[1591] Step 6: Generate your travel plan

[1592] server:

[1593] Based on the analysis results, a specific travel plan is generated that matches the user's length of stay.

[1594] Specific behavior:

[1595] A schedule is generated for the first day, such as "eating around Nishiki Market" in the morning, "strolling around the Gion district" in the afternoon, and "visiting a Japanese confectionery shop" in the evening.

[1596] Generate a schedule such as "visit a historical temple" in the morning of the second day and "have lunch at a local cafe" in the afternoon.

[1597] Step 7: Submit your travel plans

[1598] server:

[1599] The generated itinerary is passed to the chatbot in a structured format.

[1600] Specific behavior:

[1601] The generated travel plan is converted into JSON format etc. and sent to the chatbot.

[1602] Step 8: Present your travel plans

[1603] Device:

[1604] The chatbot presents users with the best travel plans.

[1605] Specific behavior:

[1606] The chatbot will message the user saying, "Here's a recommended itinerary: Day 1, eat your way through Nishiki Market, then explore the Gion district; Day 2, visit a historic temple and have lunch at a local cafe."

[1607] Step 9: Request feedback

[1608] Chatbots:

[1609] Send a message after the trip to ask for user feedback.

[1610] Specific behavior:

[1611] The chatbot sends a message requesting feedback: "Please tell us what you think about our travel plans."

[1612] Step 10: Receive and store feedback

[1613] User:

[1614] Enter and submit feedback on your travel plans.

[1615] Specific behavior:

[1616] Enter comments such as "Nishiki Market was crowded, so please suggest a different time next time" into the feedback form.

[1617] Click the submit button to send your feedback.

[1618] server:

[1619] Receive user feedback and store it in a database.

[1620] Specific behavior:

[1621] Analyze the feedback received and store it in the relevant travel plan record.

[1622] The saved feedback is used to improve the plan generation algorithm for the next iteration.

[1623] This will create a system that provides optimal travel plans for each individual traveler and improves the quality of the plans based on feedback.

[1624] Example 1

[1625] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1626] Today's travelers need an easy way to find the best travel plan that suits their destination, budget, length of stay, and preferred travel style. However, manually creating plans tailored to individual needs takes time and effort. In addition, there is a lack of a way to incorporate past experiences and feedback into future travel plans, making it difficult to further improve travel satisfaction.

[1627] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1628] In this invention, the server includes: means for the user to input their travel destination, budget, length of stay, and desired travel style; computer server means for receiving the input information and searching a database for related tourist destination and activity information; means for generating a specific travel plan tailored to the user's length of stay using a generative AI model based on the search results; and terminal means for presenting the generated travel plan to the user and providing an interactive interface for the user to check the plan. This allows the user to efficiently and precisely obtain a travel plan that meets their needs, and further enables them to reflect their post-trip feedback in future plans, resulting in a more satisfying trip.

[1629] "User input means" refers to a means by which a user inputs information about a travel destination, budget, length of stay, and desired travel style.

[1630] The "computer server" is a server that searches the database based on the information received from the user and obtains information on appropriate tourist spots and activities.

[1631] A "generative AI model" is an artificial intelligence model that generates travel plans that reflect the user's preferences and needs based on acquired data.

[1632] An "interactive interface" is a means of presenting the generated travel plan to the user and allowing the user to review the plan, and is typically used via a smartphone or PC.

[1633] The "feedback collection means" is a means for collecting feedback from users after their trip, and is used to reflect this feedback when generating the next plan.

[1634] A "database" is an information storage system for storing information about tourist attractions and activities.

[1635] The "travel plan generation means" is a means for generating a specific travel plan tailored to the user's length of stay based on information obtained from the database.

[1636] A "terminal" is a device that allows a user to use an interface to provide input information and check the generated travel plan, and includes a smartphone or personal computer.

[1637] The following system is conceivable as an embodiment of the present invention. This system allows a traveler to input their travel destination, budget, length of stay, and desired travel style, and then proposes an optimal travel plan. This system includes a user input means, a computer server, a generative AI model, an interactive interface, and a feedback collection means.

[1638] User Input Method

[1639] Device:

[1640] Users input information such as their travel destination, budget, length of stay, and travel style through a device. The device is provided in the form of a web page or mobile application. Specifically, users input their travel destination "Kyoto," their budget "50,000 yen," their length of stay "2 days," and their travel style "food-hopping."

[1641] Data reception and search methods

[1642] server:

[1643] The computer server receives the information sent by the user and searches the database for information on related tourist spots and activities. This search includes queries to extract information on "Kyoto" and "food tours," for example. Specifically, the server retrieves information on "Nishiki Market" and "Japanese confectionery shops" from the database based on the information on "food tours" in "Kyoto."

[1644] Travel plan generation method

[1645] server:

[1646] Based on the acquired data, the server uses a generative AI model to generate a specific itinerary tailored to the user's length of stay. The itinerary includes visits and activities tailored to the user's preferences and needs. Specifically, the itinerary generated on the first day includes a "food tour of Nishiki Market" in the morning, a "visit to a Japanese confectionery shop" in the afternoon, and a "stroll through the Gion district" in the evening. The itinerary on the second day also includes a "visit to a historic temple" and "lunch at a local cafe."

[1647] Travel plan presentation method

[1648] Device:

[1649] The generated itinerary is presented to the user through the chatbot. The user can check the itinerary using their smartphone or PC. Specifically, the chatbot sends a message saying, "Here's a recommended itinerary: On day one, enjoy a bite to eat at Nishiki Market, then stroll through the Gion district. On day two, visit a historic temple and have lunch at a local cafe."

[1650] Feedback collection methods

[1651] Device:

[1652] After the trip, an interface is provided to collect feedback from the user. Specifically, the chatbot sends a message saying, "Please tell us your thoughts about the trip plan," and the user enters feedback such as, "Nishiki Market was crowded, so please suggest a different time next time."

[1653] server:

[1654] The server receives the user's feedback and stores it in a database. This allows the server to take this feedback into account when generating the next plan. Specifically, the server will change the time slot for visiting Nishiki Market based on the feedback.

[1655] Prompt Sentence Examples

[1656] An example of a prompt sentence to be input to the generative AI model in this system is as follows:

[1657] Examples:

[1658] "I'd like to travel to Kyoto for two days. My budget is 50,000 yen, and my travel style is to eat my way around. What plan do you recommend?"

[1659] As a result, the system provides users with the best travel plans and is continuously improved based on their feedback, allowing users to easily obtain travel plans that suit their needs and achieve a highly satisfying travel experience.

[1660] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1661] Step 1:

[1662] User enters travel information

[1663] Terminal: The user enters the travel destination, budget, length of stay, and desired travel style and submits.

[1664] What happens: A user launches a web page or mobile application, fills in a form displayed in the interface, and clicks the "Submit" button.

[1665] Input: User entered travel destination "Kyoto", budget "50,000 yen", length of stay "2 days", travel style "food tour".

[1666] Output: The input information is sent to the server.

[1667] Step 2:

[1668] Receive information and search the database

[1669] Server: The server searches the database based on the received information and retrieves information on related tourist spots and activities.

[1670] What it does: The server receives the HTTP request and generates an SQL query based on the travel destination and style to extract information from the database.

[1671] Input: Input information submitted by the user.

[1672] Output: Information about related tourist attractions and activities (e.g., "Nishiki Market," "Japanese sweets shop").

[1673] Step 3:

[1674] Generate a travel plan

[1675] Server: Based on the acquired data, the server uses a generative AI model to generate a specific travel plan tailored to the user's length of stay.

[1676] How it works: The server passes the data to a plan generation algorithm, and the generative AI model creates a visit schedule for each day. The generated plan is saved in JSON format.

[1677] Input: Information about tourist attractions and activities retrieved from a database.

[1678] Output: A specific travel plan (e.g., on the first day, "Eat your way around Nishiki Market" in the morning, "Visit a Japanese sweets shop" in the afternoon, and "Walk around the Gion district" in the evening).

[1679] Step 4:

[1680] Present the generated itinerary to the user

[1681] Terminal: The generated travel plan is presented to the user through the chatbot.

[1682] Specific operation: The server sends the generated travel plan to the chatbot, which then sends a message to the user. The user then checks the plan on their smartphone or PC.

[1683] Input: The generated itinerary.

[1684] Output: The message shown to the user (e.g., "Here's a suggested itinerary: Day 1: Eat your way through Nishiki Market, then explore the Gion district. Day 2: Visit a historic temple and have lunch at a local cafe.").

[1685] Step 5:

[1686] Collect user feedback

[1687] Terminal: An interface is provided to collect feedback from users after the trip is completed.

[1688] What happens: The chatbot sends a message saying, "Please tell us what you think about our travel plans," and the user enters their feedback.

[1689] Input: User feedback (e.g., "Nishiki Market was crowded, please suggest a different time next time.").

[1690] Output: The entered feedback is sent to the server.

[1691] Step 6:

[1692] Receive feedback and store it in a database

[1693] Server: The server receives the feedback from the user and stores it in a database. The next time a plan is generated, this feedback will be taken into account.

[1694] Specific operation: The server receives the feedback data, inserts the feedback data into the database, and, if necessary, configures the saved feedback so that it is used for the next plan generation.

[1695] Input: User feedback.

[1696] Output: Feedback stored in a database that will be used to improve the next itinerary generation.

[1697] Through these steps, the system can provide users with efficient, precise, and personalized travel plans, and continuously improve those plans.

[1698] (Application example 1)

[1699] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1700] In recent years, there has been a growing demand for the rapid provision of personalized travel plans that meet the diverse needs of travelers. However, conventional systems lack the means to simulate specific experiences before travelers actually visit a destination when proposing travel plans. This has led to challenges in improving traveler satisfaction and low accuracy of plans. It is also difficult to effectively collect feedback from travelers and reflect it in future plans.

[1701] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1702] In this invention, the server includes: a means for a user to input their travel destination, budget, length of stay, and desired travel style; a means for searching a database for related tourist spots and activity information based on the input information; a means for generating a specific travel plan tailored to the user's length of stay based on the search results; a means for presenting the generated travel plan to the user; and a means for the user to experience the generated travel plan in a virtual reality environment. This allows travelers to experience specific tourist experiences in advance in a virtual space, and allows them to provide more accurate feedback based on that experience, which can be reflected in future travel plans.

[1703] "User" refers to a person who uses the System to generate and experience travel plans.

[1704] "Destination" means a geographic location that a User wishes to visit.

[1705] "Budget" refers to the financial constraints a user has when traveling.

[1706] "Length of Stay" refers to the length of time a user plans to stay at a travel destination.

[1707] "Desired travel style" refers to the types of activities and experiences users seek while traveling.

[1708] "Input means" refers to an interface through which a user provides information about travel destination, budget, length of stay, and travel style to the system.

[1709] "Database" refers to a system that stores travel-related data such as tourist destination and activity information.

[1710] "Searching means" refers to the process of extracting relevant information from a database based on input information.

[1711] "Means of generation" refers to the process of creating a specific travel plan based on the search results.

[1712] "Presentation means" refers to an interface for providing the generated travel plan to the user.

[1713] "Virtual reality environment" refers to an environment in which users can use virtual reality technology to simulate a travel plan as if it were a real experience.

[1714] "Feedback" refers to ratings and opinions about travel plans provided by users.

[1715] "Measures to improve" refers to the process of improving the accuracy and satisfaction of future travel plans based on collected feedback.

[1716] This invention provides a system that allows users to input their travel destination, budget, length of stay, and desired travel style, generate an optimal travel plan based on the input, and then experience the plan in a virtual reality environment. Specific embodiments for implementing the invention are described below.

[1717] User Input Method

[1718] Users input their travel destination, budget, length of stay, and travel style via devices such as smartphones or PCs, using interfaces provided on web pages or mobile applications.

[1719] Database search methods

[1720] The server has a means for receiving the information sent by the user and searching the database for information on related tourist spots, restaurants, and activities. For example, if the travel destination is "Kyoto" and the travel style is "eating around," information on "markets" and "restaurants" is retrieved from the database.

[1721] Travel plan generation method

[1722] The server generates a specific itinerary based on the information retrieved from the database, tailored to the user's length of stay. For example, a possible itinerary on the first day could be "eating around the marketplace" in the morning, "exploring the historic area" in the afternoon, and "cafe-hopping" in the evening.

[1723] Travel plan presentation method

[1724] The server uses chatbots and notification functions to present the generated travel plans to users, who can then check the plans on their smartphones or PCs.

[1725] Virtual experience means

[1726] One of the features of this system is that users can experience the travel plan generated in a virtual reality environment by wearing smart glasses or a head-mounted display and simulating the travel plan in a virtual space.

[1727] Feedback collection methods

[1728] After the trip, feedback is collected through the device and the travel plan is improved based on that feedback. For example, specific feedback such as "The market was crowded, so please suggest a different time."

[1729] Hardware and software used

[1730] Server: Executes programs, performs database searches, and generates plans. For example, we use a cloud server (AWS, GCP).

[1731] Database: Use a database management system such as SQLite or MySQL.

[1732] Chatbots: Use natural language processing solutions such as Dialogflow (Google).

[1733] Virtual reality system: A VR environment developed with Unity or Unreal Engine.

[1734] Specific examples

[1735] The user inputs their travel destination "Kyoto," their budget "50,000 yen," their stay length "2 days," and their travel style "food-hopping." The system extracts tourist spots related to "food-hopping" in "Kyoto" from a database and generates a plan that includes, for example, "food-hopping at markets," "strolling around historical areas," and "cafe-hopping." The user puts on a VR headset and experiences these spots in virtual reality. After the trip, feedback is collected from the user and reflected in future plans.

[1736] Prompt Sentence Examples

[1737] "My next trip is to Kyoto, my budget is 50,000 yen, I'll be there for two days, and my travel style will be food-hopping. What's your recommended plan?"

[1738] "The market was crowded, so please suggest a different time."

[1739] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1740] Step 1:

[1741] The user inputs their travel destination, budget, length of stay, and desired travel style through the device interface. The input data is sent to the server in JSON format. The input data specifically includes information such as "Destination: Kyoto," "Budget: 50,000 yen," "Length of stay: 2 days," and "Travel style: Eating around."

[1742] Step 2:

[1743] The server analyzes the received user data and stores it in variables. The variables store the travel destination, budget, length of stay, and travel style. This defines the parameters required for database searches. For example, the variable destination might store "Kyoto," budget "50,000 yen," duration "2 days," and style "food tour."

[1744] Step 3:

[1745] The server generates a query to search for related tourist spots and activity information from the database. The generated query is constructed in the form of an SQL statement based on variables. For example, the SQL query "SELECT FROM activities WHERE location="Kyoto" AND style="food-hopping"" is generated. This extracts related tourist spots and activity information from the database.

[1746] Step 4:

[1747] The server generates a specific travel plan tailored to the user's length of stay based on the extracted tourist destination and activity information. The plan generation algorithm allocates the extracted data to appropriate time slots to create a schedule that best suits the user's needs. For example, an itinerary such as "eating around the market" in the morning of the first day, "strolling around the historical area" in the afternoon, and "cafe hopping" in the evening could be automatically generated.

[1748] Step 5:

[1749] The generated travel plan is converted into JSON format and presented to the user. The server then sends the generated plan to the user in the form of a chatbot. The user can then check the plan on their smartphone or PC. For example, a specific schedule such as "Day 1: Eat your way around the market, stroll through the historical area, and visit cafes. Day 2: Visit a famous local temple and have lunch at a cafe" is presented.

[1750] Step 6:

[1751] Users use smart glasses or a head-mounted display to experience the generated travel plan in a virtual reality environment. The virtual reality application is developed using Unity or Unreal Engine and simulates tourist spots and activities with the feeling of visiting them in real life. Users can visit specific spots in VR and check the experience.

[1752] Step 7:

[1753] After completing the trip, the user enters feedback through the device. The device interface includes a simple evaluation form and a free response section, where the user provides their evaluation and opinion on the travel plan. For example, specific feedback such as "The market was crowded, so please suggest a different time next time" can be included.

[1754] Step 8:

[1755] The server analyzes the feedback collected from users and stores it in a database. The stored feedback is taken into consideration when generating future travel plans and is used to improve user satisfaction. The feedback analysis algorithm extracts areas for improvement based on the collected data and reflects them in the parameters for generating new plans.

[1756] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1757] The following describes an embodiment of the present invention. The present invention allows travelers to input their travel destination, budget, length of stay, and desired travel style, and proposes the optimal travel plan. Furthermore, it combines an emotion engine that recognizes the user's emotions to provide a more personalized travel experience.

[1758] User Input Method

[1759] Device:

[1760] Users are presented with an interface, which can be in the form of a web page or a mobile application, for inputting their travel destination, budget, length of stay, and travel style.

[1761] Examples:

[1762] The user enters their travel destination "Kyoto," their budget "50,000 yen," their length of stay "2 days," and their travel style "food tour."

[1763] Emotion Engine

[1764] Device:

[1765] As users type, emotions are recognized and analyzed by an emotion engine that uses facial recognition software and voice analysis algorithms to identify the user's emotions.

[1766] Examples:

[1767] If the user is excited while typing, a positive emotion is perceived.

[1768] Database search methods

[1769] server:

[1770] The server receives the information and recognized emotions sent by the user and searches the database for information on related tourist spots, restaurants, and activities, including queries to extract information on "Kyoto" and "food tours."

[1771] Examples:

[1772] If the travel destination is "Kyoto" and the travel style is "food-hopping," the server retrieves information such as "Nishiki Market" and "Japanese confectionery shops" from the database.

[1773] Emotion-Based Adjustments

[1774] server:

[1775] Based on the information obtained, the travel plan can be adjusted taking into account the user's emotions: if positive emotions are recognized, more adventurous activities can be included in the plan.

[1776] Examples:

[1777] If the user is excited, the destinations will include things like "visiting cafes in the Gion district at night."

[1778] Travel plan generation method

[1779] server:

[1780] Based on the information retrieved from the database, the server generates a specific itinerary tailored to the user's length of stay, incorporating the results of the emotion engine. The itinerary includes places to visit and activities tailored to the user's preferences and needs.

[1781] Examples:

[1782] The generated schedule includes "eating around Nishiki Market" in the morning of the first day, "strolling around the Gion district" in the afternoon, and "visiting a Japanese sweets shop" in the evening. The schedule also includes "visiting a historical temple" in the morning of the second day, and "lunch at a local cafe" in the afternoon.

[1783] Travel plan presentation method

[1784] Device:

[1785] The server generates a travel plan and presents it to the user through the chatbot, who can then check the plan on their smartphone or PC.

[1786] Examples:

[1787] The chatbot sends users messages like, "Here's a recommended itinerary: Day 1: Eat your way through Nishiki Market, then explore the Gion district. Day 2: Visit a historic temple and have lunch at a local cafe."

[1788] Feedback collection methods

[1789] Device:

[1790] Provide an interface for collecting user feedback after the trip is completed.

[1791] Examples:

[1792] After the chatbot sends a message such as "Please tell us your thoughts about the travel plan," the user enters feedback such as "Nishiki Market was crowded, so please suggest a different time next time."

[1793] server:

[1794] The server receives the feedback from the user and stores it in a database, which is then taken into account when generating the next plan.

[1795] Utilizing Emotional Data

[1796] server:

[1797] The company will analyze sentiment data collected from users and use it to improve its travel plan generation algorithm, enabling even more advanced personalization in the future.

[1798] Examples:

[1799] Record activities that excited users on past trips and include similar activities in your next travel plans.

[1800] This allows travelers to efficiently plan their trips, and since the plans are continually improved based on post-trip feedback and emotional data, future trip plans will be more accurate and satisfying. This system allows travelers to easily obtain the optimal travel plan that suits their needs and emotions.

[1801] The processing flow will be explained below.

[1802] Step 1: Displaying a user input form

[1803] Device:

[1804] Present an interface for travelers to input their travel destination, budget, length of stay, and preferred travel style. This can be done using text boxes and drop-down lists in the form of a web page or mobile application.

[1805] Specific behavior:

[1806] Displays input fields for destination, budget, length of stay, and travel style.

[1807] Provide a "Submit" button so users can submit their information as soon as it is entered.

[1808] Step 2: Sending User Input

[1809] User:

[1810] Enter information about your destination, budget, length of stay, and travel style into the fields and press the submit button.

[1811] Specific behavior:

[1812] Enter information such as travel destination "Kyoto," budget "50,000 yen," length of stay "2 days," and travel style "food tour."

[1813] Press the send button and the information will be sent to the server.

[1814] Step 3: Receiving and parsing input information

[1815] server:

[1816] It receives user-submitted travel information, parses it for use in generating database queries, and passes the information to the emotion engine.

[1817] Specific behavior:

[1818] Analyze the received form data and store the travel destination, budget, length of stay, and travel style in variables.

[1819] Pass user input information to the emotion engine to obtain emotion data.

[1820] Step 4: Recognize user emotions

[1821] Device:

[1822] The emotion engine analyzes the user's facial expressions and voice in real time as they type, recognizing their emotional state.

[1823] Specific behavior:

[1824] It uses facial recognition software and voice analysis algorithms to recognize emotions (e.g., joy or excitement) that users express while typing.

[1825] The recognized emotion data is sent to the server.

[1826] Step 5: Generate and execute database queries

[1827] server:

[1828] Based on the analyzed user input information and emotion data, a database query is generated to search for tourist destinations and activity information.

[1829] Specific behavior:

[1830] If the travel destination is "Kyoto" and the travel style is "food-hopping," generate a query to search for related tourist spots and restaurants.

[1831] Execute the query and retrieve the results from the database.

[1832] Step 6: Parse the search results

[1833] server:

[1834] The search results obtained from the database are analyzed and used to generate travel plans.

[1835] Specific behavior:

[1836] Get a list of tourist attractions and restaurants from your search results and prioritize them based on length of stay and budget.

[1837] Step 7: Generate your travel plan

[1838] server:

[1839] A specific travel plan is generated based on the information acquired by the server and the user's emotional data.

[1840] Specific behavior:

[1841] A schedule is generated for the first day, such as "eating around Nishiki Market" in the morning, "strolling around the Gion district" in the afternoon, and "visiting a Japanese confectionery shop" in the evening.

[1842] Generate a schedule such as "visit a historical temple" in the morning of the second day and "have lunch at a local cafe" in the afternoon.

[1843] If the user's sentiment is positive, make adjustments, such as including evening activities.

[1844] Step 8: Present your travel plans

[1845] Device:

[1846] The server generates a travel plan and presents it to the user through the chatbot.

[1847] Specific behavior:

[1848] The chatbot will message the user saying, "Here's a suggested itinerary: Day 1: Eat your way through Nishiki Market, then explore the Gion district. Day 2: Visit a historic temple and have lunch at a local cafe."

[1849] Step 9: Request feedback

[1850] Chatbots:

[1851] Send a message after the trip to ask for user feedback.

[1852] Specific behavior:

[1853] Send a message asking for feedback: "Tell us what you think about our travel plans."

[1854] Step 10: Receive and store feedback

[1855] User:

[1856] Enter and submit feedback on your travel plans.

[1857] Specific behavior:

[1858] Enter comments such as "Nishiki Market was crowded, so please suggest a different time next time" into the feedback form.

[1859] Click the submit button to send your feedback.

[1860] server:

[1861] Receive user feedback and store it in a database.

[1862] Specific behavior:

[1863] Analyze the feedback received and store it in the relevant travel plan record.

[1864] The saved feedback is used to improve the plan generation algorithm for the next iteration.

[1865] Step 11: Analyze and use sentiment data

[1866] server:

[1867] The collected emotional data is analyzed and used to generate future plans.

[1868] Specific behavior:

[1869] Analyze the positive emotional data users have shown on past trips and reflect it in their next travel plans.

[1870] For example, if a user expresses high satisfaction with a particular activity, we will take that into account and include a similar activity in our next plan.

[1871] Example 2

[1872] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1873] Conventional travel plan generation systems propose travel plans without considering the user's feelings, making it difficult to provide plans that satisfy the user. Furthermore, they do not fully utilize feedback and are unable to provide continuously improved plans. This leads to a decrease in user satisfaction.

[1874] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for the user to input the travel destination, budget, length of stay, and desired travel style, means for recognizing and analyzing the user's emotions based on the input information, means for searching for related tourist destination and activity information from a database based on the analyzed emotion data and the input information, means for adjusting the travel plan taking the user's emotions into consideration based on the acquired information, means for generating a specific travel plan tailored to the user's length of stay using the adjusted information, and means for presenting the generated travel plan to the user. This makes it possible to provide an optimal travel plan based on the user's emotions and needs, thereby improving user satisfaction.

[1875] "User" means an individual who utilizes the System and inputs information to generate a travel plan.

[1876] "Travel Destination" means a destination that a User wishes to visit.

[1877] "Budget" means the range of funds available to User for Travel.

[1878] "Length of Stay" means the period of time that a User intends to stay at a particular travel destination.

[1879] "Travel style" refers to the type or theme of travel based on the user's preferences.

[1880] "Input means" refers to the interface that allows users to provide information such as travel destination, budget, length of stay, and travel style to the system.

[1881] "Means for recognizing and analyzing emotions" refers to the function of capturing the user's facial expressions and voice and analyzing them using an emotion engine.

[1882] "Database" refers to a collection of information that stores information about travel destinations, tourist attractions, restaurants, and activities.

[1883] "Searching means" refers to the function of extracting relevant information from a database based on user input and emotional data.

[1884] "Adjustment" refers to the ability to optimize travel plans to meet the user's needs based on the information obtained and the user's emotional data.

[1885] "Means for generating" refers to the function of using the adjusted information to create a specific travel plan tailored to the user's length of stay.

[1886] "Presentation means" refers to the function for displaying and providing the generated travel plan to the user.

[1887] "Feedback" refers to the evaluations and opinions about the plan provided by the user after the trip is completed.

[1888] The present invention is a system that allows travelers to input their travel destination, budget, length of stay, and desired travel style, and then proposes an optimal travel plan taking the user's emotions into consideration. This system acquires the user's input information and emotion data, performs a database search based on this, and generates and presents an appropriate travel plan. Specific methods for implementing this system are described below.

[1889] Hardware and Software Configuration

[1890] Device: The device that provides the interface for the user to enter input. This can be a smartphone, tablet, or PC. The interface can be implemented in the form of a web page or mobile application.

[1891] Emotion Engine: Analyzes user emotions using facial expression recognition software and voice analysis algorithms, such as OpenCV for facial expression recognition and Google Cloud Speech-to-Text API for voice analysis.

[1892] Server: The central server performs database searches, information retrieval, and plan generation, coordination, and presentation. The database contains detailed information about tourist spots, restaurants, and activities.

[1893] Chatbots: Used to interact with users, for example, by providing travel itineraries and collecting feedback in a natural conversational format using Dialogflow or the Microsoft Bot Framework.

[1894] System Overview

[1895] User Input Method

[1896] Users input their travel destination, budget, length of stay, and travel style using a device. The interface is designed to be intuitive and easy to use. For example, a user inputs their travel destination "Kyoto," their budget "50,000 yen," their stay length "2 days," and their travel style "food-hopping."

[1897] Emotion Engine

[1898] When a user enters this information, the device's camera and microphone are used to capture the user's facial expressions and voice, which are then analyzed by the emotion engine. The emotion engine uses facial recognition software and voice analysis algorithms to identify the user's emotional state (e.g., excitement, joy, etc.). For example, if the user is excited while entering information, a positive emotion is recognized.

[1899] Database search methods

[1900] The server receives the information sent by the user and analyzed emotion data, and searches the database for information on related tourist spots, restaurants, and activities. For example, if the travel destination is "Kyoto" and the travel style is "eating around," the server will retrieve information such as "Nishiki Market" and "Japanese confectionery shops" from the database.

[1901] Emotion-Based Adjustments

[1902] The server then uses the information it has acquired to adjust the itinerary, taking into account the user's emotions. If a positive emotion is detected, it can include more adventurous activities in the itinerary. For example, if the user is excited, it can add a trip to the Gion district at night to the itinerary.

[1903] Travel plan generation method

[1904] Based on the information retrieved from the database, the server generates a specific itinerary tailored to the user's length of stay, while also incorporating the results of the emotion engine. The itinerary includes visits and activities tailored to the user's preferences and needs. For example, a schedule may be generated such as "eating around Nishiki Market" in the morning of the first day, "strolling around the Gion district" in the afternoon, and "visiting a Japanese confectionery shop" in the evening. Another schedule may include "visiting a historical temple" in the morning of the second day, and "lunch at a local cafe" in the afternoon.

[1905] Travel plan presentation method

[1906] The server generates a travel plan and presents it to the user via the device. The user can then view the plan on their smartphone or PC, checking detailed schedules and location information. For example, the chatbot could send a message to the user saying, "Here's a recommended travel plan: On day one, enjoy a bite to eat at Nishiki Market, then stroll through the Gion district. On day two, visit a historic temple and have lunch at a local cafe."

[1907] Feedback collection methods

[1908] After the trip, an interface is provided to collect feedback from the user. For example, after the chatbot sends a message such as "Please tell us your thoughts about the trip plan," the user can enter feedback such as "Nishiki Market was crowded, so please suggest a different time next time."

[1909] Utilizing Emotional Data

[1910] The server receives user feedback and sentiment data, analyzes it, and uses it to improve the itinerary generation algorithm, enabling greater personalization in the future. For example, it can record activities that excited users on past trips and include similar activities in the next itinerary.

[1911] Examples of prompt statements

[1912] 1. "Enter your travel destination as 'Kyoto,' your budget as '50,000 yen,' your stay period as '2 days,' and your travel style as 'eating around.' Then, if the emotion engine detects an excited state, add positive activities to your plan."

[1913] 2. "The system uses facial recognition software and voice analysis algorithms to identify the user's emotions. Based on the information and emotional data entered by the user, the server then searches for relevant information from a database and generates a travel plan, which includes activities tailored based on the emotions."

[1914] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1915] Step 1: Receiving User Input

[1916] Terminal: Provides an interface where users can input their travel destination, budget, length of stay, and desired travel style. The input information is sent to the server. For example, a user might input "Travel destination: Kyoto, Budget: 50,000 yen, Length of stay: 2 days, Travel style: Eating around" into a smartphone app.

[1917] Input: Travel destination, budget, length of stay, travel style

[1918] Output: User input data (travel destination "Kyoto", budget "50,000 yen", length of stay "2 days", travel style "food-hopping")

[1919] Step 2: Emotion analysis using the emotion engine

[1920] Device: When a user provides input, the device's camera and microphone are used to capture facial expressions and voice, and the emotion engine analyzes the data. Using facial recognition software and voice analysis algorithms, the user's emotions are identified. For example, if a user says "eating out" in an excited voice, the emotion engine recognizes a positive emotion.

[1921] Input: Real-time facial expression data, voice data

[1922] Output: Parsed emotion data (positive, excited)

[1923] Step 3: Database search

[1924] Server: Based on the acquired user input data and emotion data, the server searches the database for information on related tourist spots, restaurants, and activities. For example, if the travel destination is "Kyoto" and the travel style is "eating around," the server will search and extract information such as "Nishiki Market" and "Japanese confectionery shops."

[1925] Input: User input data, emotion data

[1926] Output: Related information (tourist information, restaurant information, activity information)

[1927] Step 4: Emotionally Based Adjustment

[1928] Server: Based on the acquired tourist destination and activity information, the plan contents are adjusted taking into account the user's emotional state. If a positive emotion is recognized, more adventurous activities are added. For example, if the user is excited, "Café hopping in the Gion district at night" is added to the plan.

[1929] Input: related information, emotion data

[1930] Output: Adjusted itinerary information

[1931] Step 5: Generate your travel plan

[1932] Server: Using the adjusted information, the server generates a specific itinerary tailored to the user's length of stay. The itinerary includes visits and activities tailored to the user's preferences and needs. For example, the server generates a schedule such as "eating around Nishiki Market" in the morning of the first day, "strolling around the Gion district" in the afternoon, and "visiting a Japanese confectionery shop" in the evening, and "visiting a historical temple" in the morning of the second day, and "lunch at a local cafe" in the afternoon.

[1933] Input: Adjusted travel plan information, length of stay data

[1934] Output: Final itinerary

[1935] Step 6: Present your travel plans

[1936] Device: Presents the generated itinerary to the user. The user can then view the itinerary on their smartphone or PC, along with detailed schedules and location information. For example, the chatbot could send a message such as, "Here's a recommended itinerary: Day 1, eat your way through Nishiki Market, then explore the Gion district. Day 2, visit a historic temple and have lunch at a local cafe."

[1937] Input: Final travel plan

[1938] Output: Plan data to be presented to the user

[1939] Step 7: Gather feedback

[1940] Terminal: Provides an interface for collecting feedback from users after the trip. For example, the chatbot sends a message saying, "Please tell us what you thought about the trip plan," and the user enters feedback such as, "Nishiki Market was crowded, so please suggest a different time next time."

[1941] Input: User feedback

[1942] Output: Feedback data

[1943] Step 8: Leverage feedback data

[1944] Server: Receives user feedback and sentiment data, analyzes it, and uses it to improve the itinerary generation algorithm. For example, it records activities that excited users on past trips and includes similar activities in the next itinerary.

[1945] Input: Feedback data, emotion data

[1946] Output: Improved algorithms and database updates

[1947] (Application example 2)

[1948] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1949] Conventional travel plan generation systems create travel plans without considering user emotions, making it difficult to provide a fully optimized travel experience for each individual user. Even if feedback is collected, there is a lack of effective ways to utilize it, making it difficult to reflect it in future travel plans. Furthermore, there are limited ways to visually check the travel plan, making it difficult to meet user expectations.

[1950] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for the user to input their travel destination, budget, length of stay, and desired travel style; means for recognizing and analyzing emotions; means for searching a database for related tourist destination and activity information based on the input information and the recognized emotions; means for generating a travel plan taking into account the search results and the user's emotions; and means for presenting the generated travel plan to the user in a virtual reality space. This makes it possible to generate and present a travel plan optimized for each individual user, taking into account the user's emotions, thereby improving the user's experience and satisfaction.

[1951] "User" means an individual or group who wishes to use the system to generate a travel plan.

[1952] A "destination" is a specific geographic location that a user wishes to visit.

[1953] "Budget" is the amount of money the user plans to spend during the trip.

[1954] "Length of Stay" means the length of time a user intends to stay at a particular travel destination.

[1955] "Travel style" refers to the user's preferred travel method or theme (e.g., food tours, sightseeing, activities).

[1956] The "means for inputting" is an interface that allows a user to input travel destination, budget, length of stay, and travel style into the system.

[1957] "Means for recognizing and analyzing emotions" refers to software or hardware that identifies and analyzes emotions from a user's facial expressions and voice.

[1958] The "database search means" is a function for searching for related tourist destination and activity information based on the input information and recognized emotions.

[1959] The "means for generating a travel plan" refers to algorithms and software for creating a specific travel plan taking into account the searched information and the user's emotions.

[1960] The "means for presenting in virtual reality space" is an interface for visually presenting the generated travel plan to the user through a virtual reality device.

[1961] "Means for collecting feedback" refers to an interface for receiving opinions and impressions from users after the trip is completed.

[1962] The "means for improving travel plans based on feedback" refers to algorithms and software that analyze collected user feedback and incorporate it into future travel plans.

[1963] The present invention is a system that generates and presents optimal travel plans while recognizing emotions, based on the traveler's input of destination, budget, length of stay, and desired travel style. This system is configured as follows:

[1964] First, users use an interface to input their travel destination, budget, length of stay, and desired travel style. This interface is provided through devices such as smartphones or head-mounted displays (HMDs). For example, a user inputs information such as "Kyoto," "50,000 yen," "2 days," and "food tour" through the device.

[1965] Next, an emotion engine is activated to recognize and analyze emotions. This emotion engine uses facial recognition software and voice analysis algorithms to identify the user's emotions. For example, if the user is excited while typing, a positive emotion is recognized.

[1966] The server searches the database for information on related tourist spots and activities based on the information sent by the user and the recognized emotions. Specifically, it searches for information on "Kyoto" and "food tours" and extracts tourist spots such as Nishiki Market and Japanese confectionery shops.

[1967] The server then generates an itinerary based on the search results and the user's emotions, potentially including more adventurous activities if positive emotions are recognized. For example, an excited user might be suggested an activity like "cafe-hopping in the Gion district at night."

[1968] The generated travel plan is presented to the user in a virtual reality space. Specifically, when the user is wearing an HMD, the generated plan is displayed visually and the user can check the plan details in the virtual environment. For example, the presented plan might include a schedule of "Day 1: Eat your way around Nishiki Market and stroll around the Gion district."

[1969] After the trip is over, the server collects feedback from the user. The collected feedback is stored in a database and used as a reference when generating the next travel plan. For example, if a user provides feedback such as "Nishiki Market was crowded, so please suggest a different time next time," that information will be reflected in generating the next plan.

[1970] Examples and prompts

[1971] If a user uses the device to input data such as "Kyoto," "50,000 yen," "2 days," "food tour," and "excitement," the generated itinerary will include things like "food tour at Nishiki Market" and "stroll around the Gion district," thus providing the user with the optimal travel plan.

[1972] An example of a prompt for the generative AI model is as follows:

[1973] Generate the best itinerary based on the following data:

[1974] Travel destination: Kyoto

[1975] Budget: 50,000 yen

[1976] Length of stay: 2 days

[1977] Travel Style: Eating out

[1978] User Sentiment: Excitement

[1979] Necessary information: Nishiki Market, Japanese sweets shops, Gion area cafes, etc.

[1980] In this way, the present invention takes into account the user's emotions, generates an individually optimized travel plan, and makes it possible to visually present it in a virtual environment.

[1981] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1982] Step 1:

[1983] Users input their destination, budget, length of stay, and desired travel style.

[1984] Input: Information entered by the user via the device (destination, budget, length of stay, travel style).

[1985] Output: User's travel planning information provided to the system.

[1986] How it works: The user uses a smartphone or head-mounted display (HMD) to input textual information into the application's interface.

[1987] Step 2:

[1988] The device uses an emotion engine to recognize and analyze the user's emotions.

[1989] Input: The facial expressions and voice of the user when typing.

[1990] Output: The user's emotional state (e.g., excitement, joy).

[1991] How it works: Using facial recognition software and voice recognition algorithms to analyze your facial expressions and tone of voice to determine your current emotional state, for example, whether your face is smiling or your tone of voice is excited.

[1992] Step 3:

[1993] The server searches the database based on the input information and the recognized emotion.

[1994] Input: Travel destination, travel style, and user emotional state.

[1995] Output: A list of related tourist attractions and activities.

[1996] How it works: The database search engine queries information that matches the input travel destination and style, and extracts information on related tourist spots and activities. For example, based on "Kyoto" and "food tour," it retrieves information on "Nishiki Market" and "famous Japanese confectionery shops."

[1997] Step 4:

[1998] The server generates a travel plan taking into account the search results and the user's emotions.

[1999] Input: A list of search results and the user's emotional state.

[2000] Output: A customized itinerary.

[2001] How it works: The itinerary generation algorithm combines search results with the perceived emotions to generate a specific itinerary. If positive emotions are detected, it will adjust the itinerary to include more adventurous activities. For example, for "excited users," it will add options such as "nighttime cafe hopping in the Gion district."

[2002] Step 5:

[2003] The server presents the generated travel plan to the user in a virtual reality space.

[2004] Input: The generated itinerary.

[2005] Output: A visual presentation of the itinerary in virtual reality space.

[2006] How it works: Through a virtual reality interface, users can visually experience the generated itinerary using a head-mounted display. For example, the itinerary might say, "Day 1: Eat your way through Nishiki Market, Day 2: Visit a historic temple."

[2007] Step 6:

[2008] After the trip is over, the server collects feedback from the user and uses it as a reference when generating the next travel plan.

[2009] Input: User feedback (e.g., "How crowded is Nishiki Market?").

[2010] Output: Feedback data stored in a database.

[2011] How it works: Through a feedback collection interface, users submit their thoughts and opinions after completing their trip. The collected feedback is stored in a database and used to generate future travel plans.

[2012] Step 7:

[2013] The server improves its itinerary generation algorithm based on the collected feedback and sentiment data.

[2014] Input: User feedback and sentiment data.

[2015] Output: An improved trip plan generation algorithm.

[2016] How it works: The algorithm for generating itineraries is improved based on the analysis of sentiment data and feedback. This allows future itineraries to be more personalized. For example, it might take into account the crowding of Nishiki Market and suggest different times of day.

[2017] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2018] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2019] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2020] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2021] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[2022] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[2023] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[2024] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[2025] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[2026] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[2027] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[2028] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[2029] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[2030] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[2031] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[2032] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[2033] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[2034] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[2035] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[2036] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[2037] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[2038] The following is further disclosed regarding the above embodiment.

[2039] (Claim 1)

[2040] A means for users to input their destination, budget, length of stay, and desired travel style;

[2041] A means for searching for related tourist destination and activity information from a database based on the input information;

[2042] A means for generating a specific travel plan based on the search results and tailored to the user's duration of stay;

[2043] means for presenting the generated travel plan to a user;

[2044] A system including:

[2045] (Claim 2)

[2046] 10. The system of claim 1, further comprising means for collecting feedback from the user and improving the travel plan based on the feedback.

[2047] (Claim 3)

[2048] 10. The system of claim 1, further comprising means for parsing user input information and storing information required for the travel plan in variables.

[2049] "Example 1"

[2050] (Claim 1)

[2051] A means for users to input their destination, budget, length of stay, and desired travel style;

[2052] computer server means for receiving the input information and searching a database for related tourist destination and activity information;

[2053] A means to generate a specific travel plan based on the search results using a generative AI model tailored to the user's length of stay; and

[2054] a terminal means for presenting the generated travel plan to a user and providing an interactive interface for the user to check the plan;

[2055] A system including:

[2056] (Claim 2)

[2057] 2. The system according to claim 1, further comprising server means for collecting feedback from users on the generated travel plan, improving the travel plan based on the collected feedback, and reflecting the improved feedback when generating the next travel plan.

[2058] (Claim 3)

[2059] 2. The system according to claim 1, further comprising means for analyzing information input by a user and storing information required for generating a travel plan in variables.

[2060] "Application Example 1"

[2061] (Claim 1)

[2062] A means for users to input their destination, budget, length of stay, and desired travel style;

[2063] A means for searching for related tourist destination and activity information from a database based on the input information;

[2064] A means for generating a specific travel plan based on the search results and tailored to the user's duration of stay;

[2065] means for presenting the generated travel plan to a user;

[2066] A means for users to experience the generated itinerary in a virtual reality environment; and

[2067] A system including:

[2068] (Claim 2)

[2069] 10. The system of claim 1, further comprising means for collecting feedback from the user and improving the travel plan based on the feedback.

[2070] (Claim 3)

[2071] 10. The system of claim 1, further comprising means for parsing user input information and storing information required for the travel plan in variables.

[2072] "Example 2: Combining Emotion Engines"

[2073] (Claim 1)

[2074] A means for users to input their destination, budget, length of stay, and desired travel style;

[2075] A means of recognizing and analyzing the user's emotions based on the input information;

[2076] A means for searc...

Claims

1. A means for users to input their destination, budget, length of stay, and desired travel style; A means for searching for related tourist destination and activity information from a database based on the input information; A means for generating a specific travel plan based on the search results and tailored to the user's duration of stay; means for presenting the generated travel plan to a user; A system including:

2. The system of claim 1 further comprising means for collecting feedback from users and improving the travel plan based on the feedback.

3. 10. The system of claim 1, further comprising means for parsing user input information and storing information required for the travel plan in variables.

Images