System

Abstract

A system is provided.SOLUTION: An input unit configured to input a travel date and time, a destination, and a budget of a user; a generation unit configured to automatically generate a travel plan based on the input information; a presentation unit configured to present a plurality of generated travel plans; a storage unit configured to store a plan selected from the presented travel plans; an information provision unit configured to provide weather information, a suitable outfit suggestion, and a list of belongings before a travel; a local information provision unit configured to provide information on tourist spots and restaurants in real time using location information of a user during a travel; and a questionnaire provision unit configured to provide a questionnaire after a travel; A system comprising: feedback means for storing feedback data; and next suggestion means for generating a next travel plan based on the feedback data.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Traditional travel planning methods require a lot of effort from users, making trip planning complex and time-consuming. It's also difficult to provide optimal plans tailored to individual user needs, and on-site support is limited. Furthermore, there are few ways to provide ongoing value to users even after a trip is over. This creates a need for ways to improve satisfaction with the overall travel experience. [Means for solving the problem]

[0005] To solve the above problems, the following means are provided. A system is provided that includes an input means for inputting a user's travel date and time, destination, budget, and interests, and a generation means for automatically generating a travel plan based on the input information. The system also includes a presentation means for presenting multiple generated travel plans, and a storage means for saving a plan selected from the presented travel plans. An information provision means is provided that provides weather information, appropriate clothing suggestions, and a packing list before the trip. A local information provision means is provided that provides real-time information on local tourist spots and restaurants using the user's location information during the trip. After the trip, a feedback means is provided that conducts a questionnaire and stores feedback data, and a next-time suggestion means is provided that generates the next travel plan based on the feedback data, thereby improving satisfaction with the overall travel experience.

[0006] The "input means" is an interface through which the user inputs information such as travel date and time, destination, budget, interests, etc.

[0007] The "generator" is the part of the system that automatically generates a travel plan based on input information.

[0008] The "presentation means" is an interface for displaying the generated travel plans to the user.

[0009] "Storage means" is a function for saving the travel plan selected by the user in a database or the like.

[0010] The "information provider" is the part of the system that notifies the user of weather information, appropriate clothing suggestions, and packing lists before the trip.

[0011] The "local information providing means" is a function that uses the user's location information while traveling to provide real-time information on local tourist spots and restaurants.

[0012] The "feedback means" is the part of the system that collects questionnaires from users after their trip and stores the feedback data.

[0013] The "next suggestion means" is a function for generating a next travel plan based on the collected feedback data and proposing it to the user. [Brief explanation of the drawings]

[0014] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0015] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0016] First, the terms used in the following description will be explained.

[0017] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0018] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0019] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0020] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0021] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0022] [First embodiment]

[0023] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0024] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0025] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0026] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0027] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0028] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0029] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0030] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0031] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0032] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0033] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0034] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0035] The tourism concierge service of the present invention is a system that individually optimizes the user's travel experience and provides consistent support before, during, and after the trip. This system is designed to reduce the hassle of travel planning for users and provide a more enjoyable travel experience.

[0036] System configuration

[0037] The system consists of the following main components:

[0038] 1. Input Method

[0039] 2. Generation means

[0040] 3. Presentation means

[0041] 4. Preservation means

[0042] 5. Means of providing information

[0043] 6. Local information provision methods

[0044] 7. Feedback channels

[0045] 8. Next proposal method

[0046] Program processing

[0047] User registration and initial settings

[0048] When a user opens the application, the device displays a user registration form. The user registers by entering their name, email address, password, etc. When the user clicks the registration button, the device sends the input data to the server, which then stores this information in a database.

[0049] Next, the initial setup screen is displayed, and the user inputs the travel date and time, destination, budget, and interests. The input data is sent to the server and saved.

[0050] Generate personalized and optimized travel plans

[0051] The server collects information entered by the user and external data sources (weather forecasts, local information), and uses generation AI to create multiple travel plans. The generated plans are categorized and sent to the device in a structured format.

[0052] The terminal displays the generated travel plan to the user, who selects the plan they like best and enters additional requests if necessary. This selection and request are sent to the server and stored.

[0053] Pre-travel information

[0054] As the travel date approaches, the server automatically generates weather information, appropriate clothing suggestions, and a packing list, which are then sent to the user's device.

[0055] Users can review this information and prepare for their trip.

[0056] Travel support

[0057] The server generates real-time information about local tourist spots and restaurants based on the user's location and time, and this information is sent to the device and displayed immediately to the user.

[0058] Additionally, the device provides a chat function, allowing users to ask additional questions or make requests. The server responds to these requests and provides the necessary information.

[0059] Post-trip feedback and suggestions for next time

[0060] Once the trip is over, the device displays a feedback survey to the user and accepts their responses. The survey results are sent to the server, where they are stored in a database.

[0061] The server generates a next travel plan based on the collected feedback data. It also provides purchasing information for local specialties and makes suggestions to the user. The terminal notifies the user of this next suggestion information and prompts them to select and book their next travel plan.

[0062] Specific examples

[0063] For example, if a 25-year-old woman plans a trip to Kyoto, she first registers with the app and enters the travel date and time, Kyoto as the destination, 200,000 yen as her budget, and her interests of cultural experiences and cafe hopping. Based on this information, the server generates a travel plan that includes Japanese sweets-making experiences, tea ceremony experiences, sightseeing routes, etc., and presents it to the user through the device.

[0064] The day before her trip, the server automatically generates weather information, appropriate clothing, and a packing list, and the device notifies her. During the trip, real-time information about nearby tourist spots and restaurants is provided based on her location information.

[0065] After the trip, she answers a feedback questionnaire via her device, and the server uses this information to suggest her next trip. For example, it may suggest a trip to Kanazawa for her next trip, along with links to purchase local specialties.

[0066] In this way, the present invention provides users with consistent support before, during, and after their trip, significantly improving the satisfaction of their travel experience.

[0067] The processing flow will be explained below.

[0068] Step 1:

[0069] When a user opens the application, the device displays a user registration form, where the user enters their name, email address, and password.

[0070] Step 2:

[0071] The user enters the necessary information and clicks the registration button, which sends the input data from the terminal to the server.

[0072] Step 3:

[0073] The server saves the received user data in the database, generates a new user ID, and sends a success message to the terminal when saving is complete.

[0074] Step 4:

[0075] The device displays an initial setup screen and asks the user to enter travel dates and times, destination, budget, and interests.

[0076] Step 5:

[0077] The user enters the travel date and time, destination (e.g., Kyoto), budget (e.g., 200,000 yen), and interests (e.g., cultural experiences, cafe hopping), and clicks the send button.

[0078] Step 6:

[0079] The terminal transmits the input initial setting data to the server.

[0080] Step 7:

[0081] The server stores the received initial setting data in a database, and also collects related data such as weather forecasts, local tourist information, and restaurant information.

[0082] Step 8:

[0083] The server uses AI to generate multiple travel plans based on the collected data and user input. The plans are then categorized.

[0084] Step 9:

[0085] The server transmits the generated travel plan to the terminal.

[0086] Step 10:

[0087] The terminal displays a screen for presenting a plurality of travel plans to the user.

[0088] Step 11:

[0089] The user selects the plan they like from the ones presented and, if necessary, enters additional requests. This selection and request are sent from the terminal to the server.

[0090] Step 12:

[0091] The server stores the selected plan and any additional requests in a database.

[0092] Step 13:

[0093] As the travel date approaches, the server automatically generates weather information, appropriate clothing suggestions, and a packing list, which are then sent to the device.

[0094] Step 14:

[0095] The terminal notifies the user of the received information and asks for confirmation.

[0096] Step 15:

[0097] Before traveling, users check the weather information, clothing suggestions, and packing list that are notified to them.

[0098] Step 16:

[0099] To support users during their trip, the server generates real-time information about nearby tourist spots and restaurants based on the user's location and time, and sends it to the device.

[0100] Step 17:

[0101] The terminal displays the received local information in real time and provides it to the user.

[0102] Step 18:

[0103] Users can use the provided information about tourist spots and restaurants to visit the locations, and can also use the chat function to ask additional questions or make requests.

[0104] Step 19:

[0105] The server responds to the user's request received through the chat function, generates the necessary additional information, and sends it to the terminal.

[0106] Step 20:

[0107] Once the trip is over, the device will display a feedback survey to the user and ask them to complete it.

[0108] Step 21:

[0109] The user answers the feedback survey and clicks the send button, and the answers are sent from the terminal to the server.

[0110] Step 22:

[0111] The server stores the received feedback data in a database, then analyzes the data and generates a next travel plan.

[0112] Step 23:

[0113] The server transmits the generated next travel plan and local specialty product purchase information to the terminal.

[0114] Step 24:

[0115] The device displays information to users about their next travel plans and local product purchases.

[0116] Step 25:

[0117] The user then checks the proposed travel plans and makes a reservation if they like them.

[0118] Example 1

[0119] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0120] Conventional tourism concierge services have limitations in providing optimal travel plans tailored to each user's individual needs and circumstances. They also lack consistent support before, during, and after a trip, preventing them from fully improving user satisfaction. In particular, they lack real-time information and feedback-based suggestions for future itineraries, making it difficult for users to have a comfortable and satisfying travel experience.

[0121] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0122] In this invention, the server includes: an input means for inputting a user's travel date and time, destination, budget, and interests; a generation means for automatically generating a travel plan based on the input information; a presentation means for presenting multiple generated travel plans; a storage means for saving a plan selected from the presented travel plans; an information provision means for providing weather information, appropriate clothing suggestions, and a packing list before the trip; a local information provision means for providing real-time information on local tourist spots and restaurants during the trip using location information and behavioral data; a feedback means for conducting a questionnaire after the trip and saving feedback data; a next suggestion means for generating a next travel plan based on the feedback data; a means for generating a travel plan using a generative AI model; and a means for generating prompt sentences to be input to the generative AI model. This makes it possible to provide users with consistent, high-quality travel support and travel plans optimized for their individual needs.

[0123] "Input means" refers to a means by which a user inputs information such as travel date and time, destination, budget, interests, etc.

[0124] The "generation means" is a means for automatically generating a travel plan based on input information.

[0125] The "presentation means" is a means for presenting a plurality of generated travel plans.

[0126] The "storage means" is a means for saving a plan selected from the presented travel plans.

[0127] The "information providing means" is a means for providing weather information, appropriate clothing suggestions, and a packing list before a trip.

[0128] The "local information providing means" is a means for providing real-time information on local tourist spots and restaurants using the user's location information and behavioral data while traveling.

[0129] "Feedback means" refers to means for providing a post-trip survey and collecting and storing feedback data.

[0130] The "next suggestion means" is a means for generating and suggesting a next travel plan based on feedback data.

[0131] A "means for generating a travel plan using a generative AI model" is a means for automatically generating a travel plan using a generative AI model.

[0132] The "means for generating a prompt sentence" is a means for generating a prompt sentence to provide appropriate input to the generative AI model.

[0133] MODE FOR CARRYING OUT THE INVENTION

[0134] The tourism concierge service of the present invention is a system designed to individually optimize a user's travel experience and provide consistent support before, during, and after the trip. This system combines multiple processing means to reduce the hassle of travel planning for users and provide a more enjoyable travel experience.

[0135] User registration and initial settings

[0136] When a user launches the application, the device displays a user registration form, and the user enters information such as their name, email address, and password. When the registration button is clicked, the device sends this information to the server, which stores it in a database. Next, an initial setup screen is displayed, and the user enters the travel date and time, destination, budget, and interests. The entered data is sent to the server and saved.

[0137] Generate personalized and optimized travel plans

[0138] The server collects information entered by the user and external data sources (such as weather forecasts and local information) and uses a generative AI to create multiple travel plans. This generative AI uses OpenAI's GPT-4 and other technologies. The generated plans are categorized and sent to the device in a structured state. The device displays these travel plans to the user and saves the selected plan from the presented plans. If the user enters additional requests as needed, these are also sent to the server and stored in a database.

[0139] Pre-travel information

[0140] As the travel date approaches, the server automatically generates weather information, appropriate clothing suggestions, and a packing list. This information is sent to the terminal and notified to the user, allowing the user to check the information and prepare for the trip.

[0141] Travel support

[0142] The server generates real-time information about local tourist attractions and restaurants based on the user's location and time. This information is sent to the device and displayed immediately to the user. In addition, the device provides a chat function, allowing the user to ask additional questions or make requests. The server responds to these requests and provides the necessary information.

[0143] Post-trip feedback and suggestions for next time

[0144] After the trip is over, the device displays a feedback questionnaire to the user and accepts their responses. The questionnaire results are sent to the server, where they are stored in a database. The server then generates a next travel plan based on the collected feedback data. It also provides purchasing information for local specialties and makes suggestions to the user. The device then notifies the user of these next travel plan suggestions and prompts them to select and book their next travel plan.

[0145] Specific examples

[0146] For example, if a 25-year-old woman plans a trip to Kyoto, she first registers with the app and enters the travel date and time, Kyoto as the destination, 200,000 yen as her budget, and her interests of cultural experiences and cafe hopping. Based on this information, the server generates a travel plan that includes Japanese sweets-making experiences, tea ceremony experiences, sightseeing routes, etc., and presents it to the user through the device.

[0147] The day before her trip, the server automatically generates weather information, appropriate clothing, and a packing list, and the device notifies her. During the trip, real-time information about nearby tourist spots and restaurants is provided based on her location information.

[0148] After the trip, she answers a feedback questionnaire via her device, and the server uses this information to suggest her next trip. For example, it may suggest a trip to Kanazawa for her next trip, along with links to purchase local specialties.

[0149] Prompt Sentence Examples

[0150] "List the tasks a 25-year-old woman will complete before traveling. She is going to Kyoto, and her travel date is next weekend."

[0151] In this way, the present invention provides users with consistent, high-quality support before, during, and after their trip, significantly improving satisfaction with their travel experience.

[0152] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0153] Program processing flow

[0154] Step 1: User registration and initial setup

[0155] 1-1: User registration

[0156] When the user starts the application, the terminal displays a user registration form.

[0157] The user enters their name, email address, and password and clicks the Register button.

[0158] The terminal transmits the input data to the server.

[0159] The server stores the received data in a database.

[0160] Input: Name, Email Address, Password

[0161] Data processing: Convert data into database format

[0162] Output: Save to database

[0163] 1-2: Initial settings

[0164] The terminal displays an initial setup screen, and the user inputs the travel date and time, destination, budget, and interests.

[0165] The terminal transmits the input data to the server.

[0166] The server stores the received data in a database.

[0167] Input: Travel date and time, destination, budget, interests

[0168] Data processing: Convert each item into database format

[0169] Output: Save to database

[0170] Step 2: Generate personalized optimized travel plans

[0171] 2-1: Information gathering

[0172] The server uses an API to collect external data sources (weather forecasts, local information) based on the information entered by the user.

[0173] Input: User registration information, initial setting information

[0174] Data processing: Information acquisition through API

[0175] Output: Collected data

[0176] 2-2: Travel plan generation

[0177] The server generates multiple travel plans using the collected data and generative AI (e.g., OpenAI's GPT-4).

[0178] Input: User information, external data, generative AI model

[0179] Data processing: Data analysis, prompt generation, and plan generation using AI models

[0180] Output: Multiple itineraries

[0181] 2-3: Plan presentation

[0182] The server classifies the generated plans by category and sends them to the terminal.

[0183] The terminal displays these plans to the user.

[0184] Input: Generated itinerary

[0185] Data processing: Category classification

[0186] Output: What is displayed to the user

[0187] 2-4: Select and save a plan

[0188] The user selects one of the plans presented and enters additional requests as necessary.

[0189] The terminal sends this information to the server.

[0190] The server stores the selected plan and any additional requests in a database.

[0191] Input: Selected plan, additional requests

[0192] Data processing: Convert to database format

[0193] Output: Save to database

[0194] Step 3: Pre-travel information

[0195] 3-1: Weather information generation and notification

[0196] As the travel date approaches, the server automatically generates weather information, appropriate clothing suggestions, and a packing list.

[0197] Input: Travel date, Destination

[0198] Data processing: Calling weather forecast API, generating clothing suggestions, generating a list of belongings

[0199] Output: Notification information

[0200] The server transmits the generated information to the terminal.

[0201] The terminal notifies the user of this.

[0202] Step 4: Travel Support

[0203] 4-1: Real-time local information

[0204] The server generates information about local tourist spots and restaurants based on the user's location information and time.

[0205] Input: User's location, time

[0206] Data processing: Calling tourist information API, matching with location data

[0207] Output: Real-time information

[0208] The server transmits this information to the terminal.

[0209] The terminal displays this to the user.

[0210] 4-2: Chat support

[0211] The device provides a chat function, allowing users to ask additional questions or make requests.

[0212] The server responds to these requests and provides the necessary information.

[0213] Input: User question, request

[0214] Data processing: Analysis of questions and search for necessary information

[0215] Output: Answer information

[0216] Step 5: Post-trip feedback and suggestions for next time

[0217] 5-1: Gather feedback

[0218] When the trip ends, the terminal displays a feedback questionnaire to the user and accepts responses.

[0219] The terminal transmits the survey results to the server.

[0220] The server stores this in a database.

[0221] Input: Feedback survey response

[0222] Data processing: Convert to database format

[0223] Output: Save to database

[0224] 5-2: Next proposal

[0225] The server generates the next itinerary based on the collected feedback data.

[0226] The server sends the generated next proposal to the terminal.

[0227] The terminal notifies the user of this and prompts them to select and book their next travel plan.

[0228] Input: Feedback data

[0229] Data processing: Feedback analysis, plan generation

[0230] Output: Next proposal information

[0231] The above is the specific flow and operation of the program processing of this system.

[0232] (Application example 1)

[0233] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0234] Today's travelers expect consistent access to information about tourist attractions and restaurants at their destinations, as well as support during their trip. However, current systems require travelers to use different applications and services before, during, and after their trip, resulting in a lack of consistency in their travel experience. It is also difficult to obtain timely information about local restaurants and delivery menus while traveling, which reduces user satisfaction with their travel experience. Therefore, there is a need for a system that provides consistent support from before, during, and after a trip, and in particular, provides relevant food delivery information in real time during travel.

[0235] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0236] In this invention, the server includes an input means for inputting the user's travel date and time, destination, budget, and interests, a generation means for automatically generating a travel plan based on the input information, and a presentation means for presenting multiple generated travel plans. This allows the user to consistently receive individually optimized plans from before, during, and after the trip, improving satisfaction with the travel experience. Furthermore, by including a means for automatically generating a food delivery plan for the travel destination and suggesting appropriate restaurants and delivery menus in real time based on the user's location information and time of day, meal selection during the trip is simplified, improving convenience.

[0237] "Input means" refers to a means by which a user inputs information such as travel date and time, destination, budget, and interests.

[0238] The "generation means" is a means for automatically creating travel plans and food delivery plans based on input information.

[0239] The "presentation means" is a means for displaying the generated multiple travel plans and food delivery plans to the user.

[0240] A "storage means" is a means for saving travel plans or food delivery plans selected by a user.

[0241] The "information providing means" is a means for providing weather information, appropriate clothing suggestions, a packing list, and the like before a trip.

[0242] The "local information providing means" is a means for providing real-time information on local tourist spots and restaurants using the user's location information while traveling.

[0243] "Feedback means" refers to the means for providing a post-trip survey and recording and storing that feedback data.

[0244] The "next proposal means" is a means for generating the next travel plan based on the feedback data and making new proposals based on previous travel data.

[0245] "Real-time suggestion means" is a means for suggesting appropriate restaurants and delivery menus in real time based on the user's location information and time of day.

[0246] To implement this invention, it is necessary to build a system that individually optimizes the user's travel experience and provides consistent support. This is mainly achieved by linking a smartphone app with a server-side system.

[0247] Hardware and Software

[0248] Hardware

[0249] Smartphone (iOS / Android)

[0250] software

[0251] Mobile Development Framework (React Native, Flutter, etc.)

[0252] Backend Server (Node.js, Django, etc.)

[0253] Database (MySQL, MongoDB, etc.)

[0254] Cloud Services (AWS, Google Cloud Platform, etc.)

[0255] User registration and initial settings

[0256] When a user opens the application, the device displays a user registration form, where the user enters their name, email address, password, travel date and time, destination, budget, and interests. This data is sent to the server and stored in a database.

[0257] Generate personalized and optimized travel plans

[0258] The server collects external data sources (weather forecasts, local information) based on the information entered by the user and uses generative AI to create multiple travel plans. The generated plans are categorized, sent to the device, and presented to the user.

[0259] Local information provided

[0260] During travel, the server provides real-time information on local attractions, restaurants, and automatically generated food delivery menus based on the user's location and time zone, allowing users to easily select local dining options.

[0261] Feedback and suggestions for next time

[0262] When the trip is over, the terminal presents the user with a feedback questionnaire. The results of the questionnaire are sent to the server and stored in a database. This feedback data is used to generate the next travel plan and is notified to the user via the next proposal means.

[0263] Specific examples

[0264] For example, a user may register a name such as "Taro Tanaka," travel dates and times as "2023-12-01 to 2023-12-10," destination as "Tokyo," budget as "5,000 yen / day," and food preference as "Japanese food." Based on this information, the server uses generative AI to create a delivery menu and sightseeing plan centered around Japanese food.

[0265] When a user inputs keywords such as "tempura" or "sushi" as their preferences, the generative AI creates a meal plan using prompts like the following:

[0266] User: "Taro Tanaka"

[0267] Destination: "Tokyo"

[0268] Period: "2023-12-01~2023-12-10"

[0269] Food preference: "Japanese food"

[0270] Budget: 5,000 yen / day

[0271] Generate a proposal:

[0272] The server sends the generated suggestions to the terminal, allowing users to receive consistent support before, during, and after their trip. This system significantly improves users' travel experience and increases their satisfaction.

[0273] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0274] Step 1:

[0275] When a user launches the application, the device displays a user registration form. The user enters their name, email address, password, travel date and time, destination, budget, and interests. This input data is then sent to the server and stored in a database.

[0276] Input: User basic information and travel-related information

[0277] Output: Saved user and trip information

[0278] Step 2:

[0279] The server processes the stored trip information and collects necessary data from external data sources (weather forecasts, local information), thus providing the necessary information to generate the travel plan desired by the user.

[0280] Input: Stored user information and information from external data sources

[0281] Output: A set of information required for generating plans

[0282] Step 3:

[0283] The server uses a generative AI model to automatically generate multiple travel plans based on the collected information, including plans customized to the user's interests and budget. The generated plans are then categorized by the server.

[0284] Input: User information set and information set from external data source

[0285] Output: Multiple customised itineraries generated

[0286] Step 4:

[0287] The server sends the generated travel plan to the terminal, which then presents it to the user. The user selects their preferred plan from the presented plans, enters any additional requests, and sends them to the server.

[0288] Input: Generated itinerary

[0289] Output: Travel plan presented to the user and any additional requests

[0290] Step 5:

[0291] The server stores the selected plan and any additional requests received from the user, and uses this information to prepare the necessary support information before, during and after the trip.

[0292] Input: User's selected plan and additional requests

[0293] Output: Saved selected plans and additional requests

[0294] Step 6:

[0295] Before a trip, the server automatically generates weather information, appropriate clothing suggestions, and a packing list, and sends them to the terminal, which then notifies the user.

[0296] Input: Travel date and time, destination

[0297] Output: Weather information, clothing suggestions, packing list

[0298] Step 7:

[0299] During the trip, the device sends the user's location information to the server. The server generates real-time information about local tourist spots and delivery menus based on the location information and time of day, and sends it to the device. The device then displays this information to the user.

[0300] Input: Real-time location of the user

[0301] Output: Real-time tourist spot information and delivery menu information

[0302] Step 8:

[0303] After the trip is over, the device displays a feedback questionnaire to the user and sends the answers to the server, which stores the feedback data and uses it to generate and suggest next trip plans.

[0304] Input: User feedback

[0305] Output: Feedback data and next trip suggestions

[0306] Examples:

[0307] For example, user "Taro Tanaka" registers the travel date and time "2023-12-01~2023-12-10", destination "Tokyo", budget "5,000 yen / day", and food preference "Japanese food." Based on this information, the server uses generation AI to create a delivery menu and sightseeing plan centered on Japanese food.

[0308] When a user inputs keywords such as "tempura" or "sushi" as their preferences, the generative AI creates a meal plan using prompts like the following:

[0309] User: "Taro Tanaka"

[0310] Destination: "Tokyo"

[0311] Period: "2023-12-01~2023-12-10"

[0312] Food preference: "Japanese food"

[0313] Budget: 5,000 yen / day

[0314] Generate a proposal:

[0315] This will provide consistent support before, during and after travel, significantly improving users' travel experience.

[0316] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0317] The tourism concierge service of the present invention is a system that individually optimizes the user's travel experience and provides consistent support before, during, and after the trip. This system incorporates an emotion engine that recognizes the user's emotions and provides the optimal travel plan based on those emotions.

[0318] System configuration

[0319] The system consists of the following main components:

[0320] 1. Input Method

[0321] 2. Generation means

[0322] 3. Presentation means

[0323] 4. Preservation means

[0324] 5. Means of providing information

[0325] 6. Local information provision methods

[0326] 7. Feedback channels

[0327] 8. Next proposal method

[0328] 9. Emotion Engine

[0329] Program processing

[0330] User registration and initial settings

[0331] When a user opens the application, the terminal displays a user registration form. The user registers by entering their name, email address, and password. When the user clicks the registration button, the terminal sends the input data to the server, which stores this information in a database.

[0332] Next, the initial setup screen is displayed, and the user inputs the travel date and time, destination, budget, and interests. The input data is sent to the server and saved.

[0333] Generate personalized and optimized travel plans

[0334] The server collects information entered by the user and external data sources (weather forecasts, local information), and uses generation AI to create multiple travel plans. The generated plans are categorized and sent to the device in a structured format.

[0335] The terminal displays the generated travel plan to the user, who selects the plan they like best and enters additional requests if necessary. This selection and request are sent to the server and stored.

[0336] Pre-travel information

[0337] As the travel date approaches, the server automatically generates weather information, appropriate clothing suggestions, and a packing list, which are then sent to the user's device.

[0338] Users can review this information and prepare for their trip.

[0339] Travel support

[0340] The server generates real-time information about local tourist spots and restaurants based on the user's location and time, and this information is sent to the device and displayed immediately to the user.

[0341] Additionally, the device provides a chat function, allowing users to ask additional questions or make requests. The server responds to these requests and provides the necessary information.

[0342] Post-trip feedback and suggestions for next time

[0343] Once the trip is over, the device displays a feedback survey to the user and accepts their responses. The survey results are sent to the server, where they are stored in a database.

[0344] The server generates a next travel plan based on the collected feedback data. It also provides purchasing information for local specialties and makes suggestions to the user. The terminal notifies the user of this next suggestion information and prompts them to select and book their next travel plan.

[0345] Optimization by Emotion Engine

[0346] The server recognizes the user's emotions using an emotion engine, which can analyze emotions from the user's facial expressions and input data. This emotion data is used to optimize the generated travel plan.

[0347] For example, if a user expresses joy when selecting a travel plan, the server will prioritize that plan and incorporate similar plans into the next proposal. On the other hand, if the user expresses stress or dissatisfaction, the server will offer a different plan to increase user satisfaction.

[0348] Specific examples

[0349] For example, if a 25-year-old woman plans a trip to Kyoto, she first registers with the app and enters the travel date and time, Kyoto as the destination, 200,000 yen as her budget, and her interests of cultural experiences and cafe hopping. Based on this information, the server generates a travel plan that includes Japanese sweets-making experiences, tea ceremony experiences, sightseeing routes, etc., and presents it to the user through the device.

[0350] While selecting a travel plan, the device analyzes her facial expressions and, if it detects a happy emotion, prioritizes that plan and provides real-time information on the best tourist spots and restaurants based on her emotions.

[0351] The day before her trip, the server automatically generates weather information, appropriate clothing, and a packing list, and the device notifies her. During the trip, real-time information about nearby tourist spots and restaurants is provided based on her location information.

[0352] After the trip, she answers a feedback questionnaire via her device, and the server uses this information to make suggestions for her next trip. For example, a travel plan to Kanazawa may be suggested for her next trip, along with links to purchase local specialties. The emotion engine also analyzes her emotional data during the trip and uses it to optimize her next travel plan.

[0353] In this way, the present invention provides users with consistent support before, during, and after their trip, significantly improving the satisfaction of their travel experience.

[0354] The processing flow will be explained below.

[0355] Step 1:

[0356] When a user opens the application, the device displays a user registration form, where the user enters their name, email address, and password.

[0357] Step 2:

[0358] The user enters the necessary information and clicks the registration button, which sends the input data from the terminal to the server.

[0359] Step 3:

[0360] The server saves the received user data in the database, generates a new user ID, and sends a success message to the terminal when saving is complete.

[0361] Step 4:

[0362] The device displays an initial setup screen and asks the user to enter travel dates and times, destination, budget, and interests.

[0363] Step 5:

[0364] The user enters the travel date and time, destination (e.g., Kyoto), budget, and interests (e.g., cultural experiences, cafe hopping), and clicks the send button.

[0365] Step 6:

[0366] The terminal transmits the input initial setting data to the server.

[0367] Step 7:

[0368] The server stores the received initial setting data in a database, and also collects related data such as weather forecasts, local tourist information, and restaurant information.

[0369] Step 8:

[0370] The server uses AI to generate multiple travel plans based on the collected data and user input. The plans are then categorized.

[0371] Step 9:

[0372] The server transmits the generated travel plan to the terminal.

[0373] Step 10:

[0374] The terminal displays a screen for presenting a plurality of travel plans to the user.

[0375] Step 11:

[0376] The user selects the plan they like from the ones presented and, if necessary, enters additional requests. This selection and request are sent from the terminal to the server.

[0377] Step 12:

[0378] The server stores the selected plan and any additional requests in a database.

[0379] Step 13:

[0380] As the travel date approaches, the server automatically generates weather information, appropriate clothing suggestions, and a packing list, which are then sent to the device.

[0381] Step 14:

[0382] The terminal notifies the user of the received information and asks for confirmation.

[0383] Step 15:

[0384] Before traveling, users check the weather information, clothing suggestions, and packing list that are notified to them.

[0385] Step 16:

[0386] To support users during their trip, the server generates real-time information about nearby tourist spots and restaurants based on the user's location and time, and sends it to the device.

[0387] Step 17:

[0388] The terminal displays the received local information in real time and provides it to the user.

[0389] Step 18:

[0390] Users can use the provided information about tourist spots and restaurants to visit the locations, and can also use the chat function to ask additional questions or make requests.

[0391] Step 19:

[0392] The server responds to the user's request received through the chat function, generates the necessary additional information, and sends it to the terminal.

[0393] Step 20:

[0394] Once the trip is over, the device will display a feedback survey to the user and ask them to complete it.

[0395] Step 21:

[0396] The user answers the feedback survey and clicks the send button, and the answers are sent from the terminal to the server.

[0397] Step 22:

[0398] The server stores the received feedback data in a database, then analyzes the data and generates a next travel plan.

[0399] Step 23:

[0400] The server transmits the generated next travel plan and local specialty product purchase information to the terminal.

[0401] Step 24:

[0402] The device displays information to users about their next travel plans and local product purchases.

[0403] Step 25:

[0404] The user then checks the proposed travel plans and makes a reservation if they like them.

[0405] Implementing the Emotion Engine

[0406] Step 26:

[0407] The server collects real-time emotion data from users using an emotion engine, which analyzes emotions identified from the user's facial expressions and input data.

[0408] Step 27:

[0409] The server proposes a travel plan that best suits the user's emotions based on the emotional data collected at the time of plan selection. For example, if the user shows a happy expression when selecting a plan, the server will prioritize the plan.

[0410] Step 28:

[0411] During the trip, the server monitors emotional data and suggests alternative tourist spots and restaurants if the user shows signs of dissatisfaction or stress.

[0412] Step 29:

[0413] When collecting feedback after the trip, the server analyzes the emotional data collected when answering the questionnaire and reflects this data in generating the next travel plan.

[0414] As a concrete example, if a 25-year-old woman plans a trip to Kyoto and selects a Japanese sweets-making experience, a tea ceremony experience, and a sightseeing route, the system will analyze her emotional data and prioritize providing her with experiences that she is particularly interested in. Furthermore, if she feels uneasy about a particular tourist spot during her stay in Kyoto, the system will suggest alternative recommended spots in real time, increasing her satisfaction with the trip. In this way, incorporating an emotional engine can further personalize users' travel experiences and significantly improve overall satisfaction.

[0415] Example 2

[0416] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0417] Conventional travel planning systems have difficulty generating plans based on individual user preferences, and the plans often result in low satisfaction. They also lack real-time support during the trip or a mechanism for incorporating post-trip feedback into future plans. Another issue is that plans are not optimized to take into account the user's emotions.

[0418] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0419] In this invention, the server includes: an input means for inputting the user's planned travel date and time, destination, travel funds, and areas of interest; a generation means for automatically generating a travel plan based on the input information; a presentation means for presenting multiple generated travel plans; a storage means for saving a plan selected from the presented travel plans; an information provision means for providing weather information, appropriate clothing suggestions, and a packing list before the trip; a local information provision means for providing real-time information on local tourist attractions and restaurants using the user's location information during the trip; a feedback means for conducting a questionnaire after the trip and saving feedback data; a next-trip suggestion means for generating a next travel plan based on the feedback data; and an emotion recognition means for analyzing the user's emotions and optimizing the travel plan. This makes it possible to generate an individually optimized travel plan tailored to the user's preferences, and by providing real-time support during the trip and reflecting post-trip feedback in the next plan, it is possible to increase user satisfaction.

[0420] The "input means" is a means for a user to input information such as the planned travel date and time, destination, travel funds, and areas of interest.

[0421] The "generation means" is a means for automatically generating a travel plan based on input information.

[0422] The "presentation means" is a means for displaying the generated travel plans to the user.

[0423] The "storage means" is a means for saving the travel plan selected by the user.

[0424] The "information providing means" is a means for providing the user with weather information, appropriate clothing suggestions, and a list of items to bring before the trip.

[0425] The "local information providing means" is a means for providing real-time information on local tourist spots and restaurants based on the user's location information while traveling.

[0426] The "feedback means" is a means for providing a questionnaire after a trip and storing feedback data from users.

[0427] The "next travel suggestion means" is a means for generating the next travel plan based on the user's feedback data.

[0428] The "emotion recognition means" is a means for analyzing the user's emotions and optimizing the travel plan.

[0429] The tourism concierge service system of the present invention individually optimizes a user's travel experience and provides consistent support throughout the entire period before, during, and after the trip. The system includes an emotion engine that recognizes the user's emotions and provides an optimal travel plan based on the emotions.

[0430] System Components

[0431] The system consists of the following main components:

[0432] 1. Input Method

[0433] 2. Generation means

[0434] 3. Presentation means

[0435] 4. Preservation means

[0436] 5. Means of providing information

[0437] 6. Local information provision methods

[0438] 7. Feedback channels

[0439] 8. Next proposal method

[0440] 9. Emotion recognition means

[0441] Main hardware and software

[0442] The server plays a central role in generating itineraries and storing and analyzing data. Image and voice analysis software is used for emotion recognition, and generative AI models are used to generate itineraries. Specifically, the server is operated using a high-performance database system and cloud-based AI models (e.g., Google Cloud AI, AWS AI).

[0443] The terminal transmits the information input by the user to the server and presents the information received from the server to the user. Mobile devices such as smartphones and tablets are commonly used as terminals.

[0444] Program processing explanation

[0445] First, the user opens the application and enters their name, email address, and password into the user registration form. This information is sent from the device to the server and stored in a database. Next, an initial setup screen is displayed, where users are asked to enter their planned travel date and time, destination, travel funds, and areas of interest, and this information is also sent to the server.

[0446] The server uses a generative AI model to create multiple travel plans based on user input and external data sources (weather information, local information). The generated plans are organized by category and sent to the device. The user reviews the plans on their device and sends their selected plan and any additional requests to the server. This creates an individually optimized travel plan.

[0447] As the travel date approaches, the server automatically generates weather information, appropriate clothing, and a packing list and sends them to the device. During the trip, the server provides real-time information on local tourist attractions and restaurants based on the user's location information. It also responds to any additional questions or requests via the device's chat function.

[0448] After the trip, the device provides a feedback questionnaire and transmits the user's response data to the server. The server generates a next travel plan based on the feedback data and proposes it through the device. The emotion recognition means analyzes the user's emotions and optimizes the travel plan based on this.

[0449] Specific examples

[0450] For example, if a 25-year-old woman plans a trip to Kyoto, she opens the app and registers as a user by entering her name, email address, and password. Next, she enters the planned travel date and time, Kyoto as the destination, 200,000 yen as the travel budget, and cultural experiences and cafe hopping as her areas of interest. Based on this information, the server generates a travel plan that includes Japanese sweets making experiences, tea ceremony experiences, and sightseeing routes, and presents it to the user through the device. While selecting a travel plan, the device analyzes the user's facial expressions, and if it detects an emotion of joy, it prioritizes and presents that plan.

[0451] The day before the trip, the device notifies her of weather information, appropriate clothing, and a packing list automatically generated by the server. During the trip, real-time information on nearby tourist spots and restaurants is provided based on her location information. After the trip ends, the device displays a feedback survey, which she responds to. Based on the feedback, the server generates a travel plan for her next trip to Kanazawa and notifies the device.

[0452] Prompt Sentence Examples

[0453] Below are some example prompts to input to a generative AI model:

[0454] User information: 25-year-old female, travel destination: Kyoto, budget: 200,000 yen, interests: cultural experiences, cafe hopping

[0455] Overview of the itinerary to generate:

[0456] 1. Japanese sweets making experience

[0457] 2. Tea Ceremony Experience

[0458] 3. Tourist Route (Major temples and historical buildings in the city)

[0459] In this way, the present invention provides users with consistent support before, during, and after their trip, significantly improving the satisfaction of their travel experience.

[0460] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0461] Step 1: User registration and initial setup

[0462] A user opens the application and enters their name, email address, and password into the registration form. This data is then sent from the device to the server, which stores it in a database.

[0463] Next, the initial setting screen is displayed, and the user inputs the planned travel date and time, destination, travel funds, and areas of interest. This input data is also sent from the terminal to the server and saved in the database.

[0464] Input: Name, email address, password, planned travel date and time, destination, travel funds, areas of interest

[0465] Output: User data stored on the server

[0466] Specific operations: application launch, registration form display, data submission, data saving

[0467] Step 2: Generate personalized optimized travel plans

[0468] The server collects external data sources (weather information, local information, etc.) based on the user's input data (travel date and time, destination, travel budget, areas of interest), and inputs the collected data into a generative AI model to generate multiple travel plans.

[0469] The generated plans are organized by category and sent to the terminal by the server. The user reviews the presented travel plans and selects the most suitable one. The selected plan and any additional requests are sent from the terminal to the server and stored in a database.

[0470] Input: User data, external data (weather forecast, local information)

[0471] Output: Generated itinerary, saved selection data

[0472] Specific operations: Data collection, input prompts into the generation AI model, generate a plan, send the plan, confirm with the user, and save the data.

[0473] Step 3: Pre-travel information

[0474] As the travel date approaches, the server generates a list of appropriate clothing and items to bring based on the collected weather information. This information is sent to the device, which then notifies the user. The user can then check the information and prepare for their trip.

[0475] Input: Travel date, weather information

[0476] Output: clothing suggestions, packing list, notified information

[0477] Specific operations: weather information collection, list creation, information transmission, user notification

[0478] Step 4: Travel Support

[0479] The server generates real-time information about local tourist spots and restaurants based on the user's location and time information, and the generated information is sent to the device and displayed to the user immediately.

[0480] Additionally, the device is equipped with a chat function, allowing users to enter additional questions or requests, which are then sent to the server, which then sends the corresponding information back to the device.

[0481] Input: location information, time information, user request

[0482] Output: Tourist attraction information, restaurant information, request response

[0483] Specific actions: location tracking, real-time data generation, information transmission, chat support

[0484] Step 5: Post-trip feedback and suggestions for next time

[0485] After the trip is over, the device displays a feedback questionnaire, and the user answers it. The response data is sent to the server and stored in a database. The server then generates a next travel plan based on the feedback and sends the proposed information to the device.

[0486] Input: Feedback data

[0487] Output: Next travel plan, suggested information

[0488] Specific operations: Displaying surveys, sending data, analyzing feedback, creating plans, sending information

[0489] Step 6: Optimize with emotion recognition

[0490] The server analyzes the user's emotions using emotion recognition. The emotion data is used to optimize the generated travel plan. For example, if the user expresses joy toward a particular plan, the server will prioritize that plan.

[0491] Input: User facial expression data, emotion data

[0492] Output: Optimized itinerary

[0493] Specific operations: facial expression analysis, emotional data collection, plan optimization, priority setting

[0494] (Application example 2)

[0495] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0496] Conventional tourism service systems have difficulty providing travel plans based on users' individual interests and emotions, and have faced challenges in providing real-time information and improving the quality of experiences in virtual spaces. Furthermore, systems that provide consistent support from before, during, and after a trip are lacking. This has resulted in users' travel experiences being partial, making it difficult to improve satisfaction.

[0497] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: input means for inputting the user's travel date and time, destination, budget, and interests; generation means for automatically generating a travel plan based on the input information; presentation means for presenting multiple generated travel plans; storage means for saving a plan selected from the presented travel plans; information provision means for providing weather information, appropriate clothing suggestions, and a packing list before the trip; local information provision means for providing real-time information on local tourist spots and restaurants using the user's location information during the trip; feedback means for conducting a questionnaire after the trip and saving feedback data; next suggestion means for generating a next travel plan based on the feedback data; means including an emotion engine for analyzing emotions from the user's facial expressions and input data; means for suggesting optimal tourist spots and activities in real time based on the emotion data; and means for providing a travel experience in a virtual space. This makes it possible to provide consistent support to users and significantly improve their satisfaction with their travel experience.

[0498] "Input means" refers to a means by which a user inputs travel dates and times, destinations, budgets, and interests.

[0499] The "generation means" is a means for automatically generating a travel plan based on input information.

[0500] The "presentation means" is a means for presenting the generated travel plans to the user.

[0501] The "save means" is a means for saving a plan selected by the user from the travel plans presented.

[0502] "Information providing means" refers to means for providing weather information, appropriate clothing suggestions, and a packing list before a trip.

[0503] The "local information providing means" is a means for providing real-time information on local tourist spots and restaurants using the user's location information while traveling.

[0504] "Feedback means" refers to means for providing a survey after a trip and storing feedback data.

[0505] The "next travel suggestion means" is a means for generating the next travel plan based on the feedback data.

[0506] The "means including an emotion engine" is a means including an engine for analyzing emotions from the user's facial expressions and input data, and providing an optimal travel plan based on the emotions.

[0507] "A means for suggesting optimal tourist spots and activities in real time based on emotional data" refers to a means for suggesting optimal tourist spots and activities to users in real time based on emotional data analyzed by the emotion engine.

[0508] "Means for providing a travel experience in a virtual space" means means for enabling users to experience travel in a virtual space using virtual reality technology.

[0509] To implement the present invention, the following system configuration and processing procedures are required.

[0510] System Configuration

[0511] The system mainly consists of the following components:

[0512] 1. Input method: A method for users to input travel dates and times, destinations, budget, and interests. It works on smartphones or head-mounted displays (HMDs).

[0513] 2. Generation method: A method for automatically generating a travel plan based on input information. This is done using a generative AI model.

[0514] 3. Presentation method: This is the method by which the generated travel plans are presented to the user. They are displayed on a smartphone or HMD display.

[0515] 4. Saving method: A method for saving the plan selected by the user from the presented travel plans.

[0516] 5. Information tools: These tools provide weather information, appropriate clothing suggestions, and packing lists before a trip.

[0517] 6. Local information provision: This is a means of providing real-time information on local tourist spots and restaurants using the user's location information while traveling.

[0518] 7. Feedback channels: A means to provide post-trip surveys and store feedback data.

[0519] 8. Next suggestion method: A method to generate next travel plans based on feedback data.

[0520] 9. Means including an emotion engine: A means including an engine for analyzing emotions from the user's facial expressions and input data and providing an optimal travel plan based on the emotions.

[0521] 10. A means of suggesting the best tourist spots and activities in real time based on emotional data: A means of suggesting the best tourist spots and activities to users in real time based on emotional data analyzed by the emotion engine.

[0522] 11. Means of providing travel experiences in virtual space: This means that users can experience travel in a virtual space using virtual reality technology. The hardware used includes smartphones, HMDs, and servers.

[0523] Program Processing and Data Flow

[0524] 1. User input:

[0525] Users use their smartphones or HMDs to input information about their travel dates and times, destinations, budgets, and interests using the application's input methods, and this data is sent to the server.

[0526] 2. Generate a travel plan:

[0527] The server uses the input information to input prompts into the generative AI model and generate a travel plan.

[0528] example:

[0529] User Data:

[0530] Name: Username

[0531] Age: 30

[0532] Interests: Cultural experiences, food tours

[0533] Travel date and time: May 1 - May 5, 2024

[0534] External Data:

[0535] Local weather forecast: Sunny

[0536] Local recommended tourist spots: Tourist attractions

[0537] Recommended gourmet restaurants: Famous restaurants

[0538] Suggested travel plans

[0539] 3. Present the generated plan:

[0540] The server sends the generated travel plans to a smartphone or HMD and presents them to the user, who then selects the most suitable plan.

[0541] 4. Preservation and Information Provision:

[0542] The selected travel plan is stored on the server, and weather information, a packing list, clothing suggestions, etc. are provided before the trip.

[0543] 5. Travel support:

[0544] The server provides real-time information on the best tourist spots and restaurants based on the user's location and emotion data. The emotion engine uses FaceAPI and Emotion API to analyze facial expression data.

[0545] 6. Post-trip feedback and suggestions for next time:

[0546] After the trip is over, the server sends a feedback questionnaire to the user's device and saves the response data, which is used to generate the next travel plan.

[0547] In this way, the present invention analyzes the user's facial expressions and emotional data, making it possible to individually optimize the virtual travel experience.

[0548] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0549] Step 1: User Input

[0550] The server receives information from the user, such as travel date and time, destination, budget, and interests, via input means provided by the device. Input data also includes name, email address, and password. This data is sent to the server and stored in a database.

[0551] input:

[0552] User information (name, email address, password)

[0553] Travel information (date, time, destination, budget, interests)

[0554] output:

[0555] User and travel information stored in a database

[0556] Step 2: Generate a travel plan

[0557] The server collects the user's travel information stored in the database, as well as external weather forecasts and local information, and inputs prompts into the generative AI model, which then generates multiple travel plans based on these, which are then received by the server.

[0558] input:

[0559] Saved user trip information

[0560] External data (weather forecast, local information)

[0561] output:

[0562] Generated multiple itineraries

[0563] Specific behavior:

[0564] The server uses Python and TensorFlow to generate travel plans by inputting prompt sentences into a generative AI model.

[0565] Step 3: Present your plan

[0566] The server sends the generated itineraries to the terminal, which then presents them to the user. The user selects the most suitable itinerary and sends it to the server via the terminal.

[0567] input:

[0568] Generated multiple itineraries

[0569] output:

[0570] Travel plan selected by the user

[0571] Specific behavior:

[0572] The device uses React Native to display itineraries and allow users to select them.

[0573] Step 4: Save the selected plan

[0574] The server stores the user's selected travel plans in a database.

[0575] input:

[0576] The travel plan selected by the user

[0577] output:

[0578] Travel plans stored in a database

[0579] Step 5: Pre-travel information

[0580] As the travel date and time approaches, the server automatically generates weather information, appropriate clothing suggestions, and a list of items to bring, and sends them to the terminal, which then notifies the user.

[0581] input:

[0582] Travel date and time

[0583] Weather information, clothing suggestions, and packing list generation algorithms

[0584] output:

[0585] Generated weather information, clothing suggestions, and packing lists

[0586] Specific behavior:

[0587] The server uses Python to run algorithms to generate weather information, outfit suggestions, and packing lists.

[0588] Step 6: Travel Support

[0589] The server collects location information and emotion data of the user while traveling, and provides the user with information on the best tourist spots and restaurants in real time, using an emotion engine.

[0590] input:

[0591] User location information

[0592] Emotional Data

[0593] output:

[0594] Information on the best tourist spots and restaurants

[0595] Specific behavior:

[0596] The server uses FaceAPI and Emotion API to analyze emotional data and suggest tourist spots in real time.

[0597] Step 7: Post-trip feedback

[0598] After the trip, the server provides a feedback questionnaire to the user via the terminal and stores the response data in a database.

[0599] input:

[0600] User Feedback

[0601] output:

[0602] Feedback data stored in a database

[0603] Specific behavior:

[0604] The terminal displays the feedback questionnaire and transmits the user's input to the server.

[0605] Step 8: Generate next proposal

[0606] The server generates a next travel plan based on the feedback data and notifies the user.

[0607] input:

[0608] Feedback Data

[0609] output:

[0610] Plan your next trip

[0611] Specific behavior:

[0612] The server analyzes the collected feedback data and inputs the results into a generative AI model to generate the next proposed travel plan.

[0613] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0614] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0615] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0616] [Second embodiment]

[0617] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0618] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0619] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0620] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0621] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0622] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0623] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0624] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0625] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0626] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0627] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0628] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0629] The tourism concierge service of the present invention is a system that individually optimizes the user's travel experience and provides consistent support before, during, and after the trip. This system is designed to reduce the hassle of travel planning for users and provide a more enjoyable travel experience.

[0630] System configuration

[0631] The system consists of the following main components:

[0632] 1. Input Method

[0633] 2. Generation means

[0634] 3. Presentation means

[0635] 4. Preservation means

[0636] 5. Means of providing information

[0637] 6. Local information provision methods

[0638] 7. Feedback channels

[0639] 8. Next proposal method

[0640] Program processing

[0641] User registration and initial settings

[0642] When a user opens the application, the device displays a user registration form. The user registers by entering their name, email address, password, etc. When the user clicks the registration button, the device sends the input data to the server, which then stores this information in a database.

[0643] Next, the initial setup screen is displayed, and the user inputs the travel date and time, destination, budget, and interests. The input data is sent to the server and saved.

[0644] Generate personalized and optimized travel plans

[0645] The server collects information entered by the user and external data sources (weather forecasts, local information), and uses generation AI to create multiple travel plans. The generated plans are categorized and sent to the device in a structured format.

[0646] The terminal displays the generated travel plan to the user, who selects the plan they like best and enters additional requests if necessary. This selection and request are sent to the server and stored.

[0647] Pre-travel information

[0648] As the travel date approaches, the server automatically generates weather information, appropriate clothing suggestions, and a packing list, which are then sent to the user's device.

[0649] Users can review this information and prepare for their trip.

[0650] Travel support

[0651] The server generates real-time information about local tourist spots and restaurants based on the user's location and time, and this information is sent to the device and displayed immediately to the user.

[0652] Additionally, the device provides a chat function, allowing users to ask additional questions or make requests. The server responds to these requests and provides the necessary information.

[0653] Post-trip feedback and suggestions for next time

[0654] Once the trip is over, the device displays a feedback survey to the user and accepts their responses. The survey results are sent to the server, where they are stored in a database.

[0655] The server generates a next travel plan based on the collected feedback data. It also provides purchasing information for local specialties and makes suggestions to the user. The terminal notifies the user of this next suggestion information and prompts them to select and book their next travel plan.

[0656] Specific examples

[0657] For example, if a 25-year-old woman plans a trip to Kyoto, she first registers with the app and enters the travel date and time, Kyoto as the destination, 200,000 yen as her budget, and her interests of cultural experiences and cafe hopping. Based on this information, the server generates a travel plan that includes Japanese sweets-making experiences, tea ceremony experiences, sightseeing routes, etc., and presents it to the user through the device.

[0658] The day before her trip, the server automatically generates weather information, appropriate clothing, and a packing list, and the device notifies her. During the trip, real-time information about nearby tourist spots and restaurants is provided based on her location information.

[0659] After the trip, she answers a feedback questionnaire via her device, and the server uses this information to suggest her next trip. For example, it may suggest a trip to Kanazawa for her next trip, along with links to purchase local specialties.

[0660] In this way, the present invention provides users with consistent support before, during, and after their trip, significantly improving the satisfaction of their travel experience.

[0661] The processing flow will be explained below.

[0662] Step 1:

[0663] When a user opens the application, the device displays a user registration form, where the user enters their name, email address, and password.

[0664] Step 2:

[0665] The user enters the necessary information and clicks the registration button, which sends the input data from the terminal to the server.

[0666] Step 3:

[0667] The server saves the received user data in the database, generates a new user ID, and sends a success message to the terminal when saving is complete.

[0668] Step 4:

[0669] The device displays an initial setup screen and asks the user to enter travel dates and times, destination, budget, and interests.

[0670] Step 5:

[0671] The user enters the travel date and time, destination (e.g., Kyoto), budget (e.g., 200,000 yen), and interests (e.g., cultural experiences, cafe hopping), and clicks the send button.

[0672] Step 6:

[0673] The terminal transmits the input initial setting data to the server.

[0674] Step 7:

[0675] The server stores the received initial setting data in a database, and also collects related data such as weather forecasts, local tourist information, and restaurant information.

[0676] Step 8:

[0677] The server uses AI to generate multiple travel plans based on the collected data and user input. The plans are then categorized.

[0678] Step 9:

[0679] The server transmits the generated travel plan to the terminal.

[0680] Step 10:

[0681] The terminal displays a screen for presenting a plurality of travel plans to the user.

[0682] Step 11:

[0683] The user selects the plan they like from the ones presented and, if necessary, enters additional requests. This selection and request are sent from the terminal to the server.

[0684] Step 12:

[0685] The server stores the selected plan and any additional requests in a database.

[0686] Step 13:

[0687] As the travel date approaches, the server automatically generates weather information, appropriate clothing suggestions, and a packing list, which are then sent to the device.

[0688] Step 14:

[0689] The terminal notifies the user of the received information and asks for confirmation.

[0690] Step 15:

[0691] Before traveling, users check the weather information, clothing suggestions, and packing list that are notified to them.

[0692] Step 16:

[0693] To support users during their trip, the server generates real-time information about nearby tourist spots and restaurants based on the user's location and time, and sends it to the device.

[0694] Step 17:

[0695] The terminal displays the received local information in real time and provides it to the user.

[0696] Step 18:

[0697] Users can use the provided information about tourist spots and restaurants to visit the locations, and can also use the chat function to ask additional questions or make requests.

[0698] Step 19:

[0699] The server responds to the user's request received through the chat function, generates the necessary additional information, and sends it to the terminal.

[0700] Step 20:

[0701] Once the trip is over, the device will display a feedback survey to the user and ask them to complete it.

[0702] Step 21:

[0703] The user answers the feedback survey and clicks the send button, and the answers are sent from the terminal to the server.

[0704] Step 22:

[0705] The server stores the received feedback data in a database, then analyzes the data and generates a next travel plan.

[0706] Step 23:

[0707] The server transmits the generated next travel plan and local specialty product purchase information to the terminal.

[0708] Step 24:

[0709] The device displays information to users about their next travel plans and local product purchases.

[0710] Step 25:

[0711] The user then checks the proposed travel plans and makes a reservation if they like them.

[0712] Example 1

[0713] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0714] Conventional tourism concierge services have limitations in providing optimal travel plans tailored to each user's individual needs and circumstances. They also lack consistent support before, during, and after a trip, preventing them from fully improving user satisfaction. In particular, they lack real-time information and feedback-based suggestions for future itineraries, making it difficult for users to have a comfortable and satisfying travel experience.

[0715] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0716] In this invention, the server includes: an input means for inputting a user's travel date and time, destination, budget, and interests; a generation means for automatically generating a travel plan based on the input information; a presentation means for presenting multiple generated travel plans; a storage means for saving a plan selected from the presented travel plans; an information provision means for providing weather information, appropriate clothing suggestions, and a packing list before the trip; a local information provision means for providing real-time information on local tourist spots and restaurants during the trip using location information and behavioral data; a feedback means for conducting a questionnaire after the trip and saving feedback data; a next suggestion means for generating a next travel plan based on the feedback data; a means for generating a travel plan using a generative AI model; and a means for generating prompt sentences to be input to the generative AI model. This makes it possible to provide users with consistent, high-quality travel support and travel plans optimized for their individual needs.

[0717] "Input means" refers to a means by which a user inputs information such as travel date and time, destination, budget, interests, etc.

[0718] The "generation means" is a means for automatically generating a travel plan based on input information.

[0719] The "presentation means" is a means for presenting a plurality of generated travel plans.

[0720] The "storage means" is a means for saving a plan selected from the presented travel plans.

[0721] The "information providing means" is a means for providing weather information, appropriate clothing suggestions, and a packing list before a trip.

[0722] The "local information providing means" is a means for providing real-time information on local tourist spots and restaurants using the user's location information and behavioral data while traveling.

[0723] "Feedback means" refers to means for providing a post-trip survey and collecting and storing feedback data.

[0724] The "next suggestion means" is a means for generating and suggesting a next travel plan based on feedback data.

[0725] A "means for generating a travel plan using a generative AI model" is a means for automatically generating a travel plan using a generative AI model.

[0726] The "means for generating a prompt sentence" is a means for generating a prompt sentence to provide appropriate input to the generative AI model.

[0727] MODE FOR CARRYING OUT THE INVENTION

[0728] The tourism concierge service of the present invention is a system designed to individually optimize a user's travel experience and provide consistent support before, during, and after the trip. This system combines multiple processing means to reduce the hassle of travel planning for users and provide a more enjoyable travel experience.

[0729] User registration and initial settings

[0730] When a user launches the application, the device displays a user registration form, and the user enters information such as their name, email address, and password. When the registration button is clicked, the device sends this information to the server, which stores it in a database. Next, an initial setup screen is displayed, and the user enters the travel date and time, destination, budget, and interests. The entered data is sent to the server and saved.

[0731] Generate personalized and optimized travel plans

[0732] The server collects information entered by the user and external data sources (such as weather forecasts and local information) and uses a generative AI to create multiple travel plans. This generative AI uses OpenAI's GPT-4 and other technologies. The generated plans are categorized and sent to the device in a structured state. The device displays these travel plans to the user and saves the selected plan from the presented plans. If the user enters additional requests as needed, these are also sent to the server and stored in a database.

[0733] Pre-travel information

[0734] As the travel date approaches, the server automatically generates weather information, appropriate clothing suggestions, and a packing list. This information is sent to the terminal and notified to the user, allowing the user to check the information and prepare for the trip.

[0735] Travel support

[0736] The server generates real-time information about local tourist attractions and restaurants based on the user's location and time. This information is sent to the device and displayed immediately to the user. In addition, the device provides a chat function, allowing the user to ask additional questions or make requests. The server responds to these requests and provides the necessary information.

[0737] Post-trip feedback and suggestions for next time

[0738] After the trip is over, the device displays a feedback questionnaire to the user and accepts their responses. The questionnaire results are sent to the server, where they are stored in a database. The server then generates a next travel plan based on the collected feedback data. It also provides purchasing information for local specialties and makes suggestions to the user. The device then notifies the user of these next travel plan suggestions and prompts them to select and book their next travel plan.

[0739] Specific examples

[0740] For example, if a 25-year-old woman plans a trip to Kyoto, she first registers with the app and enters the travel date and time, Kyoto as the destination, 200,000 yen as her budget, and her interests of cultural experiences and cafe hopping. Based on this information, the server generates a travel plan that includes Japanese sweets-making experiences, tea ceremony experiences, sightseeing routes, etc., and presents it to the user through the device.

[0741] The day before her trip, the server automatically generates weather information, appropriate clothing, and a packing list, and the device notifies her. During the trip, real-time information about nearby tourist spots and restaurants is provided based on her location information.

[0742] After the trip, she answers a feedback questionnaire via her device, and the server uses this information to suggest her next trip. For example, it may suggest a trip to Kanazawa for her next trip, along with links to purchase local specialties.

[0743] Prompt Sentence Examples

[0744] "List the tasks a 25-year-old woman will complete before traveling. She is going to Kyoto, and her travel date is next weekend."

[0745] In this way, the present invention provides users with consistent, high-quality support before, during, and after their trip, significantly improving satisfaction with their travel experience.

[0746] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0747] Program processing flow

[0748] Step 1: User registration and initial setup

[0749] 1-1: User registration

[0750] When the user starts the application, the terminal displays a user registration form.

[0751] The user enters their name, email address, and password and clicks the Register button.

[0752] The terminal transmits the input data to the server.

[0753] The server stores the received data in a database.

[0754] Input: Name, Email Address, Password

[0755] Data processing: Convert data into database format

[0756] Output: Save to database

[0757] 1-2: Initial settings

[0758] The terminal displays an initial setup screen, and the user inputs the travel date and time, destination, budget, and interests.

[0759] The terminal transmits the input data to the server.

[0760] The server stores the received data in a database.

[0761] Input: Travel date and time, destination, budget, interests

[0762] Data processing: Convert each item into database format

[0763] Output: Save to database

[0764] Step 2: Generate personalized optimized travel plans

[0765] 2-1: Information gathering

[0766] The server uses an API to collect external data sources (weather forecasts, local information) based on the information entered by the user.

[0767] Input: User registration information, initial setting information

[0768] Data processing: Information acquisition through API

[0769] Output: Collected data

[0770] 2-2: Travel plan generation

[0771] The server generates multiple travel plans using the collected data and generative AI (e.g., OpenAI's GPT-4).

[0772] Input: User information, external data, generative AI model

[0773] Data processing: Data analysis, prompt generation, and plan generation using AI models

[0774] Output: Multiple itineraries

[0775] 2-3: Plan presentation

[0776] The server classifies the generated plans by category and sends them to the terminal.

[0777] The terminal displays these plans to the user.

[0778] Input: Generated itinerary

[0779] Data processing: Category classification

[0780] Output: What is displayed to the user

[0781] 2-4: Select and save a plan

[0782] The user selects one of the plans presented and enters additional requests as necessary.

[0783] The terminal sends this information to the server.

[0784] The server stores the selected plan and any additional requests in a database.

[0785] Input: Selected plan, additional requests

[0786] Data processing: Convert to database format

[0787] Output: Save to database

[0788] Step 3: Pre-travel information

[0789] 3-1: Weather information generation and notification

[0790] As the travel date approaches, the server automatically generates weather information, appropriate clothing suggestions, and a packing list.

[0791] Input: Travel date, Destination

[0792] Data processing: Calling weather forecast API, generating clothing suggestions, generating a list of belongings

[0793] Output: Notification information

[0794] The server transmits the generated information to the terminal.

[0795] The terminal notifies the user of this.

[0796] Step 4: Travel Support

[0797] 4-1: Real-time local information

[0798] The server generates information about local tourist spots and restaurants based on the user's location information and time.

[0799] Input: User's location, time

[0800] Data processing: Calling tourist information API, matching with location data

[0801] Output: Real-time information

[0802] The server transmits this information to the terminal.

[0803] The terminal displays this to the user.

[0804] 4-2: Chat support

[0805] The device provides a chat function, allowing users to ask additional questions or make requests.

[0806] The server responds to these requests and provides the necessary information.

[0807] Input: User question, request

[0808] Data processing: Analysis of questions and search for necessary information

[0809] Output: Answer information

[0810] Step 5: Post-trip feedback and suggestions for next time

[0811] 5-1: Gather feedback

[0812] When the trip ends, the terminal displays a feedback questionnaire to the user and accepts responses.

[0813] The terminal transmits the survey results to the server.

[0814] The server stores this in a database.

[0815] Input: Feedback survey response

[0816] Data processing: Convert to database format

[0817] Output: Save to database

[0818] 5-2: Next proposal

[0819] The server generates the next itinerary based on the collected feedback data.

[0820] The server sends the generated next proposal to the terminal.

[0821] The terminal notifies the user of this and prompts them to select and book their next travel plan.

[0822] Input: Feedback data

[0823] Data processing: Feedback analysis, plan generation

[0824] Output: Next proposal information

[0825] The above is the specific flow and operation of the program processing of this system.

[0826] (Application example 1)

[0827] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0828] Today's travelers expect consistent access to information about tourist attractions and restaurants at their destinations, as well as support during their trip. However, current systems require travelers to use different applications and services before, during, and after their trip, resulting in a lack of consistency in their travel experience. It is also difficult to obtain timely information about local restaurants and delivery menus while traveling, which reduces user satisfaction with their travel experience. Therefore, there is a need for a system that provides consistent support from before, during, and after a trip, and in particular, provides relevant food delivery information in real time during travel.

[0829] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0830] In this invention, the server includes an input means for inputting the user's travel date and time, destination, budget, and interests, a generation means for automatically generating a travel plan based on the input information, and a presentation means for presenting multiple generated travel plans. This allows the user to consistently receive individually optimized plans from before, during, and after the trip, improving satisfaction with the travel experience. Furthermore, by including a means for automatically generating a food delivery plan for the travel destination and suggesting appropriate restaurants and delivery menus in real time based on the user's location information and time of day, meal selection during the trip is simplified, improving convenience.

[0831] "Input means" refers to a means by which a user inputs information such as travel date and time, destination, budget, and interests.

[0832] The "generation means" is a means for automatically creating travel plans and food delivery plans based on input information.

[0833] The "presentation means" is a means for displaying the generated multiple travel plans and food delivery plans to the user.

[0834] A "storage means" is a means for saving travel plans or food delivery plans selected by a user.

[0835] The "information providing means" is a means for providing weather information, appropriate clothing suggestions, a packing list, and the like before a trip.

[0836] The "local information providing means" is a means for providing real-time information on local tourist spots and restaurants using the user's location information while traveling.

[0837] "Feedback means" refers to the means for providing a post-trip survey and recording and storing that feedback data.

[0838] The "next proposal means" is a means for generating the next travel plan based on the feedback data and making new proposals based on previous travel data.

[0839] "Real-time suggestion means" is a means for suggesting appropriate restaurants and delivery menus in real time based on the user's location information and time of day.

[0840] To implement this invention, it is necessary to build a system that individually optimizes the user's travel experience and provides consistent support. This is mainly achieved by linking a smartphone app with a server-side system.

[0841] Hardware and Software

[0842] Hardware

[0843] Smartphone (iOS / Android)

[0844] software

[0845] Mobile Development Framework (React Native, Flutter, etc.)

[0846] Backend Server (Node.js, Django, etc.)

[0847] Database (MySQL, MongoDB, etc.)

[0848] Cloud Services (AWS, Google Cloud Platform, etc.)

[0849] User registration and initial settings

[0850] When a user opens the application, the device displays a user registration form, where the user enters their name, email address, password, travel date and time, destination, budget, and interests. This data is sent to the server and stored in a database.

[0851] Generate personalized and optimized travel plans

[0852] The server collects external data sources (weather forecasts, local information) based on the information entered by the user and uses generative AI to create multiple travel plans. The generated plans are categorized, sent to the device, and presented to the user.

[0853] Local information provided

[0854] During travel, the server provides real-time information on local attractions, restaurants, and automatically generated food delivery menus based on the user's location and time zone, allowing users to easily select local dining options.

[0855] Feedback and suggestions for next time

[0856] When the trip is over, the terminal presents the user with a feedback questionnaire. The results of the questionnaire are sent to the server and stored in a database. This feedback data is used to generate the next travel plan and is notified to the user via the next proposal means.

[0857] Specific examples

[0858] For example, a user may register a name such as "Taro Tanaka," travel dates and times as "2023-12-01 to 2023-12-10," destination as "Tokyo," budget as "5,000 yen / day," and food preference as "Japanese food." Based on this information, the server uses generative AI to create a delivery menu and sightseeing plan centered around Japanese food.

[0859] When a user inputs keywords such as "tempura" or "sushi" as their preferences, the generative AI creates a meal plan using prompts like the following:

[0860] User: "Taro Tanaka"

[0861] Destination: "Tokyo"

[0862] Period: "2023-12-01~2023-12-10"

[0863] Food preference: "Japanese food"

[0864] Budget: 5,000 yen / day

[0865] Generate a proposal:

[0866] The server sends the generated suggestions to the terminal, allowing users to receive consistent support before, during, and after their trip. This system significantly improves users' travel experience and increases their satisfaction.

[0867] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0868] Step 1:

[0869] When a user launches the application, the device displays a user registration form. The user enters their name, email address, password, travel date and time, destination, budget, and interests. This input data is then sent to the server and stored in a database.

[0870] Input: User basic information and travel-related information

[0871] Output: Saved user and trip information

[0872] Step 2:

[0873] The server processes the stored trip information and collects necessary data from external data sources (weather forecasts, local information), thus providing the necessary information to generate the travel plan desired by the user.

[0874] Input: Stored user information and information from external data sources

[0875] Output: A set of information required for generating plans

[0876] Step 3:

[0877] The server uses a generative AI model to automatically generate multiple travel plans based on the collected information, including plans customized to the user's interests and budget. The generated plans are then categorized by the server.

[0878] Input: User information set and information set from external data source

[0879] Output: Multiple customised itineraries generated

[0880] Step 4:

[0881] The server sends the generated travel plan to the terminal, which then presents it to the user. The user selects their preferred plan from the presented plans, enters any additional requests, and sends them to the server.

[0882] Input: Generated itinerary

[0883] Output: Travel plan presented to the user and any additional requests

[0884] Step 5:

[0885] The server stores the selected plan and any additional requests received from the user, and uses this information to prepare the necessary support information before, during and after the trip.

[0886] Input: User's selected plan and additional requests

[0887] Output: Saved selected plans and additional requests

[0888] Step 6:

[0889] Before a trip, the server automatically generates weather information, appropriate clothing suggestions, and a packing list, and sends them to the terminal, which then notifies the user.

[0890] Input: Travel date and time, destination

[0891] Output: Weather information, clothing suggestions, packing list

[0892] Step 7:

[0893] During the trip, the device sends the user's location information to the server. The server generates real-time information about local tourist spots and delivery menus based on the location information and time of day, and sends it to the device. The device then displays this information to the user.

[0894] Input: Real-time location of the user

[0895] Output: Real-time tourist spot information and delivery menu information

[0896] Step 8:

[0897] After the trip is over, the device displays a feedback questionnaire to the user and sends the answers to the server, which stores the feedback data and uses it to generate and suggest next trip plans.

[0898] Input: User feedback

[0899] Output: Feedback data and next trip suggestions

[0900] Examples:

[0901] For example, user "Taro Tanaka" registers the travel date and time "2023-12-01~2023-12-10", destination "Tokyo", budget "5,000 yen / day", and food preference "Japanese food." Based on this information, the server uses generation AI to create a delivery menu and sightseeing plan centered on Japanese food.

[0902] When a user inputs keywords such as "tempura" or "sushi" as their preferences, the generative AI creates a meal plan using prompts like the following:

[0903] User: "Taro Tanaka"

[0904] Destination: "Tokyo"

[0905] Period: "2023-12-01~2023-12-10"

[0906] Food preference: "Japanese food"

[0907] Budget: 5,000 yen / day

[0908] Generate a proposal:

[0909] This will provide consistent support before, during and after travel, significantly improving users' travel experience.

[0910] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0911] The tourism concierge service of the present invention is a system that individually optimizes the user's travel experience and provides consistent support before, during, and after the trip. This system incorporates an emotion engine that recognizes the user's emotions and provides the optimal travel plan based on those emotions.

[0912] System configuration

[0913] The system consists of the following main components:

[0914] 1. Input Method

[0915] 2. Generation means

[0916] 3. Presentation means

[0917] 4. Preservation means

[0918] 5. Means of providing information

[0919] 6. Local information provision methods

[0920] 7. Feedback channels

[0921] 8. Next proposal method

[0922] 9. Emotion Engine

[0923] Program processing

[0924] User registration and initial settings

[0925] When a user opens the application, the terminal displays a user registration form. The user registers by entering their name, email address, and password. When the user clicks the registration button, the terminal sends the input data to the server, which stores this information in a database.

[0926] Next, the initial setup screen is displayed, and the user inputs the travel date and time, destination, budget, and interests. The input data is sent to the server and saved.

[0927] Generate personalized and optimized travel plans

[0928] The server collects information entered by the user and external data sources (weather forecasts, local information), and uses generation AI to create multiple travel plans. The generated plans are categorized and sent to the device in a structured format.

[0929] The terminal displays the generated travel plan to the user, who selects the plan they like best and enters additional requests if necessary. This selection and request are sent to the server and stored.

[0930] Pre-travel information

[0931] As the travel date approaches, the server automatically generates weather information, appropriate clothing suggestions, and a packing list, which are then sent to the user's device.

[0932] Users can review this information and prepare for their trip.

[0933] Travel support

[0934] The server generates real-time information about local tourist spots and restaurants based on the user's location and time, and this information is sent to the device and displayed immediately to the user.

[0935] Additionally, the device provides a chat function, allowing users to ask additional questions or make requests. The server responds to these requests and provides the necessary information.

[0936] Post-trip feedback and suggestions for next time

[0937] Once the trip is over, the device displays a feedback survey to the user and accepts their responses. The survey results are sent to the server, where they are stored in a database.

[0938] The server generates a next travel plan based on the collected feedback data. It also provides purchasing information for local specialties and makes suggestions to the user. The terminal notifies the user of this next suggestion information and prompts them to select and book their next travel plan.

[0939] Optimization by Emotion Engine

[0940] The server recognizes the user's emotions using an emotion engine, which can analyze emotions from the user's facial expressions and input data. This emotion data is used to optimize the generated travel plan.

[0941] For example, if a user expresses joy when selecting a travel plan, the server will prioritize that plan and incorporate similar plans into the next proposal. On the other hand, if the user expresses stress or dissatisfaction, the server will offer a different plan to increase user satisfaction.

[0942] Specific examples

[0943] For example, if a 25-year-old woman plans a trip to Kyoto, she first registers with the app and enters the travel date and time, Kyoto as the destination, 200,000 yen as her budget, and her interests of cultural experiences and cafe hopping. Based on this information, the server generates a travel plan that includes Japanese sweets-making experiences, tea ceremony experiences, sightseeing routes, etc., and presents it to the user through the device.

[0944] While selecting a travel plan, the device analyzes her facial expressions and, if it detects a happy emotion, prioritizes that plan and provides real-time information on the best tourist spots and restaurants based on her emotions.

[0945] The day before her trip, the server automatically generates weather information, appropriate clothing, and a packing list, and the device notifies her. During the trip, real-time information about nearby tourist spots and restaurants is provided based on her location information.

[0946] After the trip, she answers a feedback questionnaire via her device, and the server uses this information to make suggestions for her next trip. For example, a travel plan to Kanazawa may be suggested for her next trip, along with links to purchase local specialties. The emotion engine also analyzes her emotional data during the trip and uses it to optimize her next travel plan.

[0947] In this way, the present invention provides users with consistent support before, during, and after their trip, significantly improving the satisfaction of their travel experience.

[0948] The processing flow will be explained below.

[0949] Step 1:

[0950] When a user opens the application, the device displays a user registration form, where the user enters their name, email address, and password.

[0951] Step 2:

[0952] The user enters the necessary information and clicks the registration button, which sends the input data from the terminal to the server.

[0953] Step 3:

[0954] The server saves the received user data in the database, generates a new user ID, and sends a success message to the terminal when saving is complete.

[0955] Step 4:

[0956] The device displays an initial setup screen and asks the user to enter travel dates and times, destination, budget, and interests.

[0957] Step 5:

[0958] The user enters the travel date and time, destination (e.g., Kyoto), budget, and interests (e.g., cultural experiences, cafe hopping), and clicks the send button.

[0959] Step 6:

[0960] The terminal transmits the input initial setting data to the server.

[0961] Step 7:

[0962] The server stores the received initial setting data in a database, and also collects related data such as weather forecasts, local tourist information, and restaurant information.

[0963] Step 8:

[0964] The server uses AI to generate multiple travel plans based on the collected data and user input. The plans are then categorized.

[0965] Step 9:

[0966] The server transmits the generated travel plan to the terminal.

[0967] Step 10:

[0968] The terminal displays a screen for presenting a plurality of travel plans to the user.

[0969] Step 11:

[0970] The user selects the plan they like from the ones presented and, if necessary, enters additional requests. This selection and request are sent from the terminal to the server.

[0971] Step 12:

[0972] The server stores the selected plan and any additional requests in a database.

[0973] Step 13:

[0974] As the travel date approaches, the server automatically generates weather information, appropriate clothing suggestions, and a packing list, which are then sent to the device.

[0975] Step 14:

[0976] The terminal notifies the user of the received information and asks for confirmation.

[0977] Step 15:

[0978] Before traveling, users check the weather information, clothing suggestions, and packing list that are notified to them.

[0979] Step 16:

[0980] To support users during their trip, the server generates real-time information about nearby tourist spots and restaurants based on the user's location and time, and sends it to the device.

[0981] Step 17:

[0982] The terminal displays the received local information in real time and provides it to the user.

[0983] Step 18:

[0984] Users can use the provided information about tourist spots and restaurants to visit the locations, and can also use the chat function to ask additional questions or make requests.

[0985] Step 19:

[0986] The server responds to the user's request received through the chat function, generates the necessary additional information, and sends it to the terminal.

[0987] Step 20:

[0988] Once the trip is over, the device will display a feedback survey to the user and ask them to complete it.

[0989] Step 21:

[0990] The user answers the feedback survey and clicks the send button, and the answers are sent from the terminal to the server.

[0991] Step 22:

[0992] The server stores the received feedback data in a database, then analyzes the data and generates a next travel plan.

[0993] Step 23:

[0994] The server transmits the generated next travel plan and local specialty product purchase information to the terminal.

[0995] Step 24:

[0996] The device displays information to users about their next travel plans and local product purchases.

[0997] Step 25:

[0998] The user then checks the proposed travel plans and makes a reservation if they like them.

[0999] Implementing the Emotion Engine

[1000] Step 26:

[1001] The server collects real-time emotion data from users using an emotion engine, which analyzes emotions identified from the user's facial expressions and input data.

[1002] Step 27:

[1003] The server proposes a travel plan that best suits the user's emotions based on the emotional data collected at the time of plan selection. For example, if the user shows a happy expression when selecting a plan, the server will prioritize the plan.

[1004] Step 28:

[1005] During the trip, the server monitors emotional data and suggests alternative tourist spots and restaurants if the user shows signs of dissatisfaction or stress.

[1006] Step 29:

[1007] When collecting feedback after the trip, the server analyzes the emotional data collected when answering the questionnaire and reflects this data in generating the next travel plan.

[1008] As a concrete example, if a 25-year-old woman plans a trip to Kyoto and selects a Japanese sweets-making experience, a tea ceremony experience, and a sightseeing route, the system will analyze her emotional data and prioritize providing her with experiences that she is particularly interested in. Furthermore, if she feels uneasy about a particular tourist spot during her stay in Kyoto, the system will suggest alternative recommended spots in real time, increasing her satisfaction with the trip. In this way, incorporating an emotional engine can further personalize users' travel experiences and significantly improve overall satisfaction.

[1009] Example 2

[1010] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1011] Conventional travel planning systems have difficulty generating plans based on individual user preferences, and the plans often result in low satisfaction. They also lack real-time support during the trip or a mechanism for incorporating post-trip feedback into future plans. Another issue is that plans are not optimized to take into account the user's emotions.

[1012] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1013] In this invention, the server includes: an input means for inputting the user's planned travel date and time, destination, travel funds, and areas of interest; a generation means for automatically generating a travel plan based on the input information; a presentation means for presenting multiple generated travel plans; a storage means for saving a plan selected from the presented travel plans; an information provision means for providing weather information, appropriate clothing suggestions, and a packing list before the trip; a local information provision means for providing real-time information on local tourist attractions and restaurants using the user's location information during the trip; a feedback means for conducting a questionnaire after the trip and saving feedback data; a next-trip suggestion means for generating a next travel plan based on the feedback data; and an emotion recognition means for analyzing the user's emotions and optimizing the travel plan. This makes it possible to generate an individually optimized travel plan tailored to the user's preferences, and by providing real-time support during the trip and reflecting post-trip feedback in the next plan, it is possible to increase user satisfaction.

[1014] The "input means" is a means for a user to input information such as the planned travel date and time, destination, travel funds, and areas of interest.

[1015] The "generation means" is a means for automatically generating a travel plan based on input information.

[1016] The "presentation means" is a means for displaying the generated travel plans to the user.

[1017] The "storage means" is a means for saving the travel plan selected by the user.

[1018] The "information providing means" is a means for providing the user with weather information, appropriate clothing suggestions, and a list of items to bring before the trip.

[1019] The "local information providing means" is a means for providing real-time information on local tourist spots and restaurants based on the user's location information while traveling.

[1020] The "feedback means" is a means for providing a questionnaire after a trip and storing feedback data from users.

[1021] The "next travel suggestion means" is a means for generating the next travel plan based on the user's feedback data.

[1022] The "emotion recognition means" is a means for analyzing the user's emotions and optimizing the travel plan.

[1023] The tourism concierge service system of the present invention individually optimizes a user's travel experience and provides consistent support throughout the entire period before, during, and after the trip. The system includes an emotion engine that recognizes the user's emotions and provides an optimal travel plan based on the emotions.

[1024] System Components

[1025] The system consists of the following main components:

[1026] 1. Input Method

[1027] 2. Generation means

[1028] 3. Presentation means

[1029] 4. Preservation means

[1030] 5. Means of providing information

[1031] 6. Local information provision methods

[1032] 7. Feedback channels

[1033] 8. Next proposal method

[1034] 9. Emotion recognition means

[1035] Main hardware and software

[1036] The server plays a central role in generating itineraries and storing and analyzing data. Image and voice analysis software is used for emotion recognition, and generative AI models are used to generate itineraries. Specifically, the server is operated using a high-performance database system and cloud-based AI models (e.g., Google Cloud AI, AWS AI).

[1037] The terminal transmits the information input by the user to the server and presents the information received from the server to the user. Mobile devices such as smartphones and tablets are commonly used as terminals.

[1038] Program processing explanation

[1039] First, the user opens the application and enters their name, email address, and password into the user registration form. This information is sent from the device to the server and stored in a database. Next, an initial setup screen is displayed, where users are asked to enter their planned travel date and time, destination, travel funds, and areas of interest, and this information is also sent to the server.

[1040] The server uses a generative AI model to create multiple travel plans based on user input and external data sources (weather information, local information). The generated plans are organized by category and sent to the device. The user reviews the plans on their device and sends their selected plan and any additional requests to the server. This creates an individually optimized travel plan.

[1041] As the travel date approaches, the server automatically generates weather information, appropriate clothing, and a packing list and sends them to the device. During the trip, the server provides real-time information on local tourist attractions and restaurants based on the user's location information. It also responds to any additional questions or requests via the device's chat function.

[1042] After the trip, the device provides a feedback questionnaire and transmits the user's response data to the server. The server generates a next travel plan based on the feedback data and proposes it through the device. The emotion recognition means analyzes the user's emotions and optimizes the travel plan based on this.

[1043] Specific examples

[1044] For example, if a 25-year-old woman plans a trip to Kyoto, she opens the app and registers as a user by entering her name, email address, and password. Next, she enters the planned travel date and time, Kyoto as the destination, 200,000 yen as the travel budget, and cultural experiences and cafe hopping as her areas of interest. Based on this information, the server generates a travel plan that includes Japanese sweets making experiences, tea ceremony experiences, and sightseeing routes, and presents it to the user through the device. While selecting a travel plan, the device analyzes the user's facial expressions, and if it detects an emotion of joy, it prioritizes and presents that plan.

[1045] The day before the trip, the device notifies her of weather information, appropriate clothing, and a packing list automatically generated by the server. During the trip, real-time information on nearby tourist spots and restaurants is provided based on her location information. After the trip ends, the device displays a feedback survey, which she responds to. Based on the feedback, the server generates a travel plan for her next trip to Kanazawa and notifies the device.

[1046] Prompt Sentence Examples

[1047] Below are some example prompts to input to a generative AI model:

[1048] User information: 25-year-old female, travel destination: Kyoto, budget: 200,000 yen, interests: cultural experiences, cafe hopping

[1049] Overview of the itinerary to generate:

[1050] 1. Japanese sweets making experience

[1051] 2. Tea Ceremony Experience

[1052] 3. Tourist Route (Major temples and historical buildings in the city)

[1053] In this way, the present invention provides users with consistent support before, during, and after their trip, significantly improving the satisfaction of their travel experience.

[1054] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1055] Step 1: User registration and initial setup

[1056] A user opens the application and enters their name, email address, and password into the registration form. This data is then sent from the device to the server, which stores it in a database.

[1057] Next, the initial setting screen is displayed, and the user inputs the planned travel date and time, destination, travel funds, and areas of interest. This input data is also sent from the terminal to the server and saved in the database.

[1058] Input: Name, email address, password, planned travel date and time, destination, travel funds, areas of interest

[1059] Output: User data stored on the server

[1060] Specific operations: application launch, registration form display, data submission, data saving

[1061] Step 2: Generate personalized optimized travel plans

[1062] The server collects external data sources (weather information, local information, etc.) based on the user's input data (travel date and time, destination, travel budget, areas of interest), and inputs the collected data into a generative AI model to generate multiple travel plans.

[1063] The generated plans are organized by category and sent to the terminal by the server. The user reviews the presented travel plans and selects the most suitable one. The selected plan and any additional requests are sent from the terminal to the server and stored in a database.

[1064] Input: User data, external data (weather forecast, local information)

[1065] Output: Generated itinerary, saved selection data

[1066] Specific operations: Data collection, input prompts into the generation AI model, generate a plan, send the plan, confirm with the user, and save the data.

[1067] Step 3: Pre-travel information

[1068] As the travel date approaches, the server generates a list of appropriate clothing and items to bring based on the collected weather information. This information is sent to the device, which then notifies the user. The user can then check the information and prepare for their trip.

[1069] Input: Travel date, weather information

[1070] Output: clothing suggestions, packing list, notified information

[1071] Specific operations: weather information collection, list creation, information transmission, user notification

[1072] Step 4: Travel Support

[1073] The server generates real-time information about local tourist spots and restaurants based on the user's location and time information, and the generated information is sent to the device and displayed to the user immediately.

[1074] Additionally, the device is equipped with a chat function, allowing users to enter additional questions or requests, which are then sent to the server, which then sends the corresponding information back to the device.

[1075] Input: location information, time information, user request

[1076] Output: Tourist attraction information, restaurant information, request response

[1077] Specific actions: location tracking, real-time data generation, information transmission, chat support

[1078] Step 5: Post-trip feedback and suggestions for next time

[1079] After the trip is over, the device displays a feedback questionnaire, and the user answers it. The response data is sent to the server and stored in a database. The server then generates a next travel plan based on the feedback and sends the proposed information to the device.

[1080] Input: Feedback data

[1081] Output: Next travel plan, suggested information

[1082] Specific operations: Displaying surveys, sending data, analyzing feedback, creating plans, sending information

[1083] Step 6: Optimize with emotion recognition

[1084] The server analyzes the user's emotions using emotion recognition. The emotion data is used to optimize the generated travel plan. For example, if the user expresses joy toward a particular plan, the server will prioritize that plan.

[1085] Input: User facial expression data, emotion data

[1086] Output: Optimized itinerary

[1087] Specific operations: facial expression analysis, emotional data collection, plan optimization, priority setting

[1088] (Application example 2)

[1089] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1090] Conventional tourism service systems have difficulty providing travel plans based on users' individual interests and emotions, and have faced challenges in providing real-time information and improving the quality of experiences in virtual spaces. Furthermore, systems that provide consistent support from before, during, and after a trip are lacking. This has resulted in users' travel experiences being partial, making it difficult to improve satisfaction.

[1091] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: input means for inputting the user's travel date and time, destination, budget, and interests; generation means for automatically generating a travel plan based on the input information; presentation means for presenting multiple generated travel plans; storage means for saving a plan selected from the presented travel plans; information provision means for providing weather information, appropriate clothing suggestions, and a packing list before the trip; local information provision means for providing real-time information on local tourist spots and restaurants using the user's location information during the trip; feedback means for conducting a questionnaire after the trip and saving feedback data; next suggestion means for generating a next travel plan based on the feedback data; means including an emotion engine for analyzing emotions from the user's facial expressions and input data; means for suggesting optimal tourist spots and activities in real time based on the emotion data; and means for providing a travel experience in a virtual space. This makes it possible to provide consistent support to users and significantly improve their satisfaction with their travel experience.

[1092] "Input means" refers to a means by which a user inputs travel dates and times, destinations, budgets, and interests.

[1093] The "generation means" is a means for automatically generating a travel plan based on input information.

[1094] The "presentation means" is a means for presenting the generated travel plans to the user.

[1095] The "save means" is a means for saving a plan selected by the user from the travel plans presented.

[1096] "Information providing means" refers to means for providing weather information, appropriate clothing suggestions, and a packing list before a trip.

[1097] The "local information providing means" is a means for providing real-time information on local tourist spots and restaurants using the user's location information while traveling.

[1098] "Feedback means" refers to means for providing a survey after a trip and storing feedback data.

[1099] The "next travel suggestion means" is a means for generating the next travel plan based on the feedback data.

[1100] The "means including an emotion engine" is a means including an engine for analyzing emotions from the user's facial expressions and input data, and providing an optimal travel plan based on the emotions.

[1101] "A means for suggesting optimal tourist spots and activities in real time based on emotional data" refers to a means for suggesting optimal tourist spots and activities to users in real time based on emotional data analyzed by the emotion engine.

[1102] "Means for providing a travel experience in a virtual space" means means for enabling users to experience travel in a virtual space using virtual reality technology.

[1103] To implement the present invention, the following system configuration and processing procedures are required.

[1104] System Configuration

[1105] The system mainly consists of the following components:

[1106] 1. Input method: A method for users to input travel dates and times, destinations, budget, and interests. It works on smartphones or head-mounted displays (HMDs).

[1107] 2. Generation method: A method for automatically generating a travel plan based on input information. This is done using a generative AI model.

[1108] 3. Presentation method: This is the method by which the generated travel plans are presented to the user. They are displayed on a smartphone or HMD display.

[1109] 4. Saving method: A method for saving the plan selected by the user from the presented travel plans.

[1110] 5. Information tools: These tools provide weather information, appropriate clothing suggestions, and packing lists before a trip.

[1111] 6. Local information provision: This is a means of providing real-time information on local tourist spots and restaurants using the user's location information while traveling.

[1112] 7. Feedback channels: A means to provide post-trip surveys and store feedback data.

[1113] 8. Next suggestion method: A method to generate next travel plans based on feedback data.

[1114] 9. Means including an emotion engine: A means including an engine for analyzing emotions from the user's facial expressions and input data and providing an optimal travel plan based on the emotions.

[1115] 10. A means of suggesting the best tourist spots and activities in real time based on emotional data: A means of suggesting the best tourist spots and activities to users in real time based on emotional data analyzed by the emotion engine.

[1116] 11. Means of providing travel experiences in virtual space: This means that users can experience travel in a virtual space using virtual reality technology. The hardware used includes smartphones, HMDs, and servers.

[1117] Program Processing and Data Flow

[1118] 1. User input:

[1119] Users use their smartphones or HMDs to input information about their travel dates and times, destinations, budgets, and interests using the application's input methods, and this data is sent to the server.

[1120] 2. Generate a travel plan:

[1121] The server uses the input information to input prompts into the generative AI model and generate a travel plan.

[1122] example:

[1123] User Data:

[1124] Name: Username

[1125] Age: 30

[1126] Interests: Cultural experiences, food tours

[1127] Travel date and time: May 1 - May 5, 2024

[1128] External Data:

[1129] Local weather forecast: Sunny

[1130] Local recommended tourist spots: Tourist attractions

[1131] Recommended gourmet restaurants: Famous restaurants

[1132] Suggested travel plans

[1133] 3. Present the generated plan:

[1134] The server sends the generated travel plans to a smartphone or HMD and presents them to the user, who then selects the most suitable plan.

[1135] 4. Preservation and Information Provision:

[1136] The selected travel plan is stored on the server, and weather information, a packing list, clothing suggestions, etc. are provided before the trip.

[1137] 5. Travel support:

[1138] The server provides real-time information on the best tourist spots and restaurants based on the user's location and emotion data. The emotion engine uses FaceAPI and Emotion API to analyze facial expression data.

[1139] 6. Post-trip feedback and suggestions for next time:

[1140] After the trip is over, the server sends a feedback questionnaire to the user's device and saves the response data, which is used to generate the next travel plan.

[1141] In this way, the present invention analyzes the user's facial expressions and emotional data, making it possible to individually optimize the virtual travel experience.

[1142] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1143] Step 1: User Input

[1144] The server receives information from the user, such as travel date and time, destination, budget, and interests, via input means provided by the device. Input data also includes name, email address, and password. This data is sent to the server and stored in a database.

[1145] input:

[1146] User information (name, email address, password)

[1147] Travel information (date, time, destination, budget, interests)

[1148] output:

[1149] User and travel information stored in a database

[1150] Step 2: Generate a travel plan

[1151] The server collects the user's travel information stored in the database, as well as external weather forecasts and local information, and inputs prompts into the generative AI model, which then generates multiple travel plans based on these, which are then received by the server.

[1152] input:

[1153] Saved user trip information

[1154] External data (weather forecast, local information)

[1155] output:

[1156] Generated multiple itineraries

[1157] Specific behavior:

[1158] The server uses Python and TensorFlow to generate travel plans by inputting prompt sentences into a generative AI model.

[1159] Step 3: Present your plan

[1160] The server sends the generated itineraries to the terminal, which then presents them to the user. The user selects the most suitable itinerary and sends it to the server via the terminal.

[1161] input:

[1162] Generated multiple itineraries

[1163] output:

[1164] Travel plan selected by the user

[1165] Specific behavior:

[1166] The device uses React Native to display itineraries and allow users to select them.

[1167] Step 4: Save the selected plan

[1168] The server stores the user's selected travel plans in a database.

[1169] input:

[1170] The travel plan selected by the user

[1171] output:

[1172] Travel plans stored in a database

[1173] Step 5: Pre-travel information

[1174] As the travel date and time approaches, the server automatically generates weather information, appropriate clothing suggestions, and a list of items to bring, and sends them to the terminal, which then notifies the user.

[1175] input:

[1176] Travel date and time

[1177] Weather information, clothing suggestions, and packing list generation algorithms

[1178] output:

[1179] Generated weather information, clothing suggestions, and packing lists

[1180] Specific behavior:

[1181] The server uses Python to run algorithms to generate weather information, outfit suggestions, and packing lists.

[1182] Step 6: Travel Support

[1183] The server collects location information and emotion data of the user while traveling, and provides the user with information on the best tourist spots and restaurants in real time, using an emotion engine.

[1184] input:

[1185] User location information

[1186] Emotional Data

[1187] output:

[1188] Information on the best tourist spots and restaurants

[1189] Specific behavior:

[1190] The server uses FaceAPI and Emotion API to analyze emotional data and suggest tourist spots in real time.

[1191] Step 7: Post-trip feedback

[1192] After the trip, the server provides a feedback questionnaire to the user via the terminal and stores the response data in a database.

[1193] input:

[1194] User Feedback

[1195] output:

[1196] Feedback data stored in a database

[1197] Specific behavior:

[1198] The terminal displays the feedback questionnaire and transmits the user's input to the server.

[1199] Step 8: Generate next proposal

[1200] The server generates a next travel plan based on the feedback data and notifies the user.

[1201] input:

[1202] Feedback Data

[1203] output:

[1204] Plan your next trip

[1205] Specific behavior:

[1206] The server analyzes the collected feedback data and inputs the results into a generative AI model to generate the next proposed travel plan.

[1207] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1208] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1209] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1210] [Third embodiment]

[1211] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1212] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1213] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1214] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1215] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1216] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1217] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1218] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1219] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1220] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1221] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1222] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1223] The tourism concierge service of the present invention is a system that individually optimizes the user's travel experience and provides consistent support before, during, and after the trip. This system is designed to reduce the hassle of travel planning for users and provide a more enjoyable travel experience.

[1224] System configuration

[1225] The system consists of the following main components:

[1226] 1. Input Method

[1227] 2. Generation means

[1228] 3. Presentation means

[1229] 4. Preservation means

[1230] 5. Means of providing information

[1231] 6. Local information provision methods

[1232] 7. Feedback channels

[1233] 8. Next proposal method

[1234] Program processing

[1235] User registration and initial settings

[1236] When a user opens the application, the device displays a user registration form. The user registers by entering their name, email address, password, etc. When the user clicks the registration button, the device sends the input data to the server, which then stores this information in a database.

[1237] Next, the initial setup screen is displayed, and the user inputs the travel date and time, destination, budget, and interests. The input data is sent to the server and saved.

[1238] Generate personalized and optimized travel plans

[1239] The server collects information entered by the user and external data sources (weather forecasts, local information), and uses generation AI to create multiple travel plans. The generated plans are categorized and sent to the device in a structured format.

[1240] The terminal displays the generated travel plan to the user, who selects the plan they like best and enters additional requests if necessary. This selection and request are sent to the server and stored.

[1241] Pre-travel information

[1242] As the travel date approaches, the server automatically generates weather information, appropriate clothing suggestions, and a packing list, which are then sent to the user's device.

[1243] Users can review this information and prepare for their trip.

[1244] Travel support

[1245] The server generates real-time information about local tourist spots and restaurants based on the user's location and time, and this information is sent to the device and displayed immediately to the user.

[1246] Additionally, the device provides a chat function, allowing users to ask additional questions or make requests. The server responds to these requests and provides the necessary information.

[1247] Post-trip feedback and suggestions for next time

[1248] Once the trip is over, the device displays a feedback survey to the user and accepts their responses. The survey results are sent to the server, where they are stored in a database.

[1249] The server generates a next travel plan based on the collected feedback data. It also provides purchasing information for local specialties and makes suggestions to the user. The terminal notifies the user of this next suggestion information and prompts them to select and book their next travel plan.

[1250] Specific examples

[1251] For example, if a 25-year-old woman plans a trip to Kyoto, she first registers with the app and enters the travel date and time, Kyoto as the destination, 200,000 yen as her budget, and her interests of cultural experiences and cafe hopping. Based on this information, the server generates a travel plan that includes Japanese sweets-making experiences, tea ceremony experiences, sightseeing routes, etc., and presents it to the user through the device.

[1252] The day before her trip, the server automatically generates weather information, appropriate clothing, and a packing list, and the device notifies her. During the trip, real-time information about nearby tourist spots and restaurants is provided based on her location information.

[1253] After the trip, she answers a feedback questionnaire via her device, and the server uses this information to suggest her next trip. For example, it may suggest a trip to Kanazawa for her next trip, along with links to purchase local specialties.

[1254] In this way, the present invention provides users with consistent support before, during, and after their trip, significantly improving the satisfaction of their travel experience.

[1255] The processing flow will be explained below.

[1256] Step 1:

[1257] When a user opens the application, the device displays a user registration form, where the user enters their name, email address, and password.

[1258] Step 2:

[1259] The user enters the necessary information and clicks the registration button, which sends the input data from the terminal to the server.

[1260] Step 3:

[1261] The server saves the received user data in the database, generates a new user ID, and sends a success message to the terminal when saving is complete.

[1262] Step 4:

[1263] The device displays an initial setup screen and asks the user to enter travel dates and times, destination, budget, and interests.

[1264] Step 5:

[1265] The user enters the travel date and time, destination (e.g., Kyoto), budget (e.g., 200,000 yen), and interests (e.g., cultural experiences, cafe hopping), and clicks the send button.

[1266] Step 6:

[1267] The terminal transmits the input initial setting data to the server.

[1268] Step 7:

[1269] The server stores the received initial setting data in a database, and also collects related data such as weather forecasts, local tourist information, and restaurant information.

[1270] Step 8:

[1271] The server uses AI to generate multiple travel plans based on the collected data and user input. The plans are then categorized.

[1272] Step 9:

[1273] The server transmits the generated travel plan to the terminal.

[1274] Step 10:

[1275] The terminal displays a screen for presenting a plurality of travel plans to the user.

[1276] Step 11:

[1277] The user selects the plan they like from the ones presented and, if necessary, enters additional requests. This selection and request are sent from the terminal to the server.

[1278] Step 12:

[1279] The server stores the selected plan and any additional requests in a database.

[1280] Step 13:

[1281] As the travel date approaches, the server automatically generates weather information, appropriate clothing suggestions, and a packing list, which are then sent to the device.

[1282] Step 14:

[1283] The terminal notifies the user of the received information and asks for confirmation.

[1284] Step 15:

[1285] Before traveling, users check the weather information, clothing suggestions, and packing list that are notified to them.

[1286] Step 16:

[1287] To support users during their trip, the server generates real-time information about nearby tourist spots and restaurants based on the user's location and time, and sends it to the device.

[1288] Step 17:

[1289] The terminal displays the received local information in real time and provides it to the user.

[1290] Step 18:

[1291] Users can use the provided information about tourist spots and restaurants to visit the locations, and can also use the chat function to ask additional questions or make requests.

[1292] Step 19:

[1293] The server responds to the user's request received through the chat function, generates the necessary additional information, and sends it to the terminal.

[1294] Step 20:

[1295] Once the trip is over, the device will display a feedback survey to the user and ask them to complete it.

[1296] Step 21:

[1297] The user answers the feedback survey and clicks the send button, and the answers are sent from the terminal to the server.

[1298] Step 22:

[1299] The server stores the received feedback data in a database, then analyzes the data and generates a next travel plan.

[1300] Step 23:

[1301] The server transmits the generated next travel plan and local specialty product purchase information to the terminal.

[1302] Step 24:

[1303] The device displays information to users about their next travel plans and local product purchases.

[1304] Step 25:

[1305] The user then checks the proposed travel plans and makes a reservation if they like them.

[1306] Example 1

[1307] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1308] Conventional tourism concierge services have limitations in providing optimal travel plans tailored to each user's individual needs and circumstances. They also lack consistent support before, during, and after a trip, preventing them from fully improving user satisfaction. In particular, they lack real-time information and feedback-based suggestions for future itineraries, making it difficult for users to have a comfortable and satisfying travel experience.

[1309] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1310] In this invention, the server includes: an input means for inputting a user's travel date and time, destination, budget, and interests; a generation means for automatically generating a travel plan based on the input information; a presentation means for presenting multiple generated travel plans; a storage means for saving a plan selected from the presented travel plans; an information provision means for providing weather information, appropriate clothing suggestions, and a packing list before the trip; a local information provision means for providing real-time information on local tourist spots and restaurants during the trip using location information and behavioral data; a feedback means for conducting a questionnaire after the trip and saving feedback data; a next suggestion means for generating a next travel plan based on the feedback data; a means for generating a travel plan using a generative AI model; and a means for generating prompt sentences to be input to the generative AI model. This makes it possible to provide users with consistent, high-quality travel support and travel plans optimized for their individual needs.

[1311] "Input means" refers to a means by which a user inputs information such as travel date and time, destination, budget, interests, etc.

[1312] The "generation means" is a means for automatically generating a travel plan based on input information.

[1313] The "presentation means" is a means for presenting a plurality of generated travel plans.

[1314] The "storage means" is a means for saving a plan selected from the presented travel plans.

[1315] The "information providing means" is a means for providing weather information, appropriate clothing suggestions, and a packing list before a trip.

[1316] The "local information providing means" is a means for providing real-time information on local tourist spots and restaurants using the user's location information and behavioral data while traveling.

[1317] "Feedback means" refers to means for providing a post-trip survey and collecting and storing feedback data.

[1318] The "next suggestion means" is a means for generating and suggesting a next travel plan based on feedback data.

[1319] A "means for generating a travel plan using a generative AI model" is a means for automatically generating a travel plan using a generative AI model.

[1320] The "means for generating a prompt sentence" is a means for generating a prompt sentence to provide appropriate input to the generative AI model.

[1321] MODE FOR CARRYING OUT THE INVENTION

[1322] The tourism concierge service of the present invention is a system designed to individually optimize a user's travel experience and provide consistent support before, during, and after the trip. This system combines multiple processing means to reduce the hassle of travel planning for users and provide a more enjoyable travel experience.

[1323] User registration and initial settings

[1324] When a user launches the application, the device displays a user registration form, and the user enters information such as their name, email address, and password. When the registration button is clicked, the device sends this information to the server, which stores it in a database. Next, an initial setup screen is displayed, and the user enters the travel date and time, destination, budget, and interests. The entered data is sent to the server and saved.

[1325] Generate personalized and optimized travel plans

[1326] The server collects information entered by the user and external data sources (such as weather forecasts and local information) and uses a generative AI to create multiple travel plans. This generative AI uses OpenAI's GPT-4 and other technologies. The generated plans are categorized and sent to the device in a structured state. The device displays these travel plans to the user and saves the selected plan from the presented plans. If the user enters additional requests as needed, these are also sent to the server and stored in a database.

[1327] Pre-travel information

[1328] As the travel date approaches, the server automatically generates weather information, appropriate clothing suggestions, and a packing list. This information is sent to the terminal and notified to the user, allowing the user to check the information and prepare for the trip.

[1329] Travel support

[1330] The server generates real-time information about local tourist attractions and restaurants based on the user's location and time. This information is sent to the device and displayed immediately to the user. In addition, the device provides a chat function, allowing the user to ask additional questions or make requests. The server responds to these requests and provides the necessary information.

[1331] Post-trip feedback and suggestions for next time

[1332] After the trip is over, the device displays a feedback questionnaire to the user and accepts their responses. The questionnaire results are sent to the server, where they are stored in a database. The server then generates a next travel plan based on the collected feedback data. It also provides purchasing information for local specialties and makes suggestions to the user. The device then notifies the user of these next travel plan suggestions and prompts them to select and book their next travel plan.

[1333] Specific examples

[1334] For example, if a 25-year-old woman plans a trip to Kyoto, she first registers with the app and enters the travel date and time, Kyoto as the destination, 200,000 yen as her budget, and her interests of cultural experiences and cafe hopping. Based on this information, the server generates a travel plan that includes Japanese sweets-making experiences, tea ceremony experiences, sightseeing routes, etc., and presents it to the user through the device.

[1335] The day before her trip, the server automatically generates weather information, appropriate clothing, and a packing list, and the device notifies her. During the trip, real-time information about nearby tourist spots and restaurants is provided based on her location information.

[1336] After the trip, she answers a feedback questionnaire via her device, and the server uses this information to suggest her next trip. For example, it may suggest a trip to Kanazawa for her next trip, along with links to purchase local specialties.

[1337] Prompt Sentence Examples

[1338] "List the tasks a 25-year-old woman will complete before traveling. She is going to Kyoto, and her travel date is next weekend."

[1339] In this way, the present invention provides users with consistent, high-quality support before, during, and after their trip, significantly improving satisfaction with their travel experience.

[1340] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1341] Program processing flow

[1342] Step 1: User registration and initial setup

[1343] 1-1: User registration

[1344] When the user starts the application, the terminal displays a user registration form.

[1345] The user enters their name, email address, and password and clicks the Register button.

[1346] The terminal transmits the input data to the server.

[1347] The server stores the received data in a database.

[1348] Input: Name, Email Address, Password

[1349] Data processing: Convert data into database format

[1350] Output: Save to database

[1351] 1-2: Initial settings

[1352] The terminal displays an initial setup screen, and the user inputs the travel date and time, destination, budget, and interests.

[1353] The terminal transmits the input data to the server.

[1354] The server stores the received data in a database.

[1355] Input: Travel date and time, destination, budget, interests

[1356] Data processing: Convert each item into database format

[1357] Output: Save to database

[1358] Step 2: Generate personalized optimized travel plans

[1359] 2-1: Information gathering

[1360] The server uses an API to collect external data sources (weather forecasts, local information) based on the information entered by the user.

[1361] Input: User registration information, initial setting information

[1362] Data processing: Information acquisition through API

[1363] Output: Collected data

[1364] 2-2: Travel plan generation

[1365] The server generates multiple travel plans using the collected data and generative AI (e.g., OpenAI's GPT-4).

[1366] Input: User information, external data, generative AI model

[1367] Data processing: Data analysis, prompt generation, and plan generation using AI models

[1368] Output: Multiple itineraries

[1369] 2-3: Plan presentation

[1370] The server classifies the generated plans by category and sends them to the terminal.

[1371] The terminal displays these plans to the user.

[1372] Input: Generated itinerary

[1373] Data processing: Category classification

[1374] Output: What is displayed to the user

[1375] 2-4: Select and save a plan

[1376] The user selects one of the plans presented and enters additional requests as necessary.

[1377] The terminal sends this information to the server.

[1378] The server stores the selected plan and any additional requests in a database.

[1379] Input: Selected plan, additional requests

[1380] Data processing: Convert to database format

[1381] Output: Save to database

[1382] Step 3: Pre-travel information

[1383] 3-1: Weather information generation and notification

[1384] As the travel date approaches, the server automatically generates weather information, appropriate clothing suggestions, and a packing list.

[1385] Input: Travel date, Destination

[1386] Data processing: Calling weather forecast API, generating clothing suggestions, generating a list of belongings

[1387] Output: Notification information

[1388] The server transmits the generated information to the terminal.

[1389] The terminal notifies the user of this.

[1390] Step 4: Travel Support

[1391] 4-1: Real-time local information

[1392] The server generates information about local tourist spots and restaurants based on the user's location information and time.

[1393] Input: User's location, time

[1394] Data processing: Calling tourist information API, matching with location data

[1395] Output: Real-time information

[1396] The server transmits this information to the terminal.

[1397] The terminal displays this to the user.

[1398] 4-2: Chat support

[1399] The device provides a chat function, allowing users to ask additional questions or make requests.

[1400] The server responds to these requests and provides the necessary information.

[1401] Input: User question, request

[1402] Data processing: Analysis of questions and search for necessary information

[1403] Output: Answer information

[1404] Step 5: Post-trip feedback and suggestions for next time

[1405] 5-1: Gather feedback

[1406] When the trip ends, the terminal displays a feedback questionnaire to the user and accepts responses.

[1407] The terminal transmits the survey results to the server.

[1408] The server stores this in a database.

[1409] Input: Feedback survey response

[1410] Data processing: Convert to database format

[1411] Output: Save to database

[1412] 5-2: Next proposal

[1413] The server generates the next itinerary based on the collected feedback data.

[1414] The server sends the generated next proposal to the terminal.

[1415] The terminal notifies the user of this and prompts them to select and book their next travel plan.

[1416] Input: Feedback data

[1417] Data processing: Feedback analysis, plan generation

[1418] Output: Next proposal information

[1419] The above is the specific flow and operation of the program processing of this system.

[1420] (Application example 1)

[1421] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1422] Today's travelers expect consistent access to information about tourist attractions and restaurants at their destinations, as well as support during their trip. However, current systems require travelers to use different applications and services before, during, and after their trip, resulting in a lack of consistency in their travel experience. It is also difficult to obtain timely information about local restaurants and delivery menus while traveling, which reduces user satisfaction with their travel experience. Therefore, there is a need for a system that provides consistent support from before, during, and after a trip, and in particular, provides relevant food delivery information in real time during travel.

[1423] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1424] In this invention, the server includes an input means for inputting the user's travel date and time, destination, budget, and interests, a generation means for automatically generating a travel plan based on the input information, and a presentation means for presenting multiple generated travel plans. This allows the user to consistently receive individually optimized plans from before, during, and after the trip, improving satisfaction with the travel experience. Furthermore, by including a means for automatically generating a food delivery plan for the travel destination and suggesting appropriate restaurants and delivery menus in real time based on the user's location information and time of day, meal selection during the trip is simplified, improving convenience.

[1425] "Input means" refers to a means by which a user inputs information such as travel date and time, destination, budget, and interests.

[1426] The "generation means" is a means for automatically creating travel plans and food delivery plans based on input information.

[1427] The "presentation means" is a means for displaying the generated multiple travel plans and food delivery plans to the user.

[1428] A "storage means" is a means for saving travel plans or food delivery plans selected by a user.

[1429] The "information providing means" is a means for providing weather information, appropriate clothing suggestions, a packing list, and the like before a trip.

[1430] The "local information providing means" is a means for providing real-time information on local tourist spots and restaurants using the user's location information while traveling.

[1431] "Feedback means" refers to the means for providing a post-trip survey and recording and storing that feedback data.

[1432] The "next proposal means" is a means for generating the next travel plan based on the feedback data and making new proposals based on previous travel data.

[1433] "Real-time suggestion means" is a means for suggesting appropriate restaurants and delivery menus in real time based on the user's location information and time of day.

[1434] To implement this invention, it is necessary to build a system that individually optimizes the user's travel experience and provides consistent support. This is mainly achieved by linking a smartphone app with a server-side system.

[1435] Hardware and Software

[1436] Hardware

[1437] Smartphone (iOS / Android)

[1438] software

[1439] Mobile Development Framework (React Native, Flutter, etc.)

[1440] Backend Server (Node.js, Django, etc.)

[1441] Database (MySQL, MongoDB, etc.)

[1442] Cloud Services (AWS, Google Cloud Platform, etc.)

[1443] User registration and initial settings

[1444] When a user opens the application, the device displays a user registration form, where the user enters their name, email address, password, travel date and time, destination, budget, and interests. This data is sent to the server and stored in a database.

[1445] Generate personalized and optimized travel plans

[1446] The server collects external data sources (weather forecasts, local information) based on the information entered by the user and uses generative AI to create multiple travel plans. The generated plans are categorized, sent to the device, and presented to the user.

[1447] Local information provided

[1448] During travel, the server provides real-time information on local attractions, restaurants, and automatically generated food delivery menus based on the user's location and time zone, allowing users to easily select local dining options.

[1449] Feedback and suggestions for next time

[1450] When the trip is over, the terminal presents the user with a feedback questionnaire. The results of the questionnaire are sent to the server and stored in a database. This feedback data is used to generate the next travel plan and is notified to the user via the next proposal means.

[1451] Specific examples

[1452] For example, a user may register a name such as "Taro Tanaka," travel dates and times as "2023-12-01 to 2023-12-10," destination as "Tokyo," budget as "5,000 yen / day," and food preference as "Japanese food." Based on this information, the server uses generative AI to create a delivery menu and sightseeing plan centered around Japanese food.

[1453] When a user inputs keywords such as "tempura" or "sushi" as their preferences, the generative AI creates a meal plan using prompts like the following:

[1454] User: "Taro Tanaka"

[1455] Destination: "Tokyo"

[1456] Period: "2023-12-01~2023-12-10"

[1457] Food preference: "Japanese food"

[1458] Budget: 5,000 yen / day

[1459] Generate a proposal:

[1460] The server sends the generated suggestions to the terminal, allowing users to receive consistent support before, during, and after their trip. This system significantly improves users' travel experience and increases their satisfaction.

[1461] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1462] Step 1:

[1463] When a user launches the application, the device displays a user registration form. The user enters their name, email address, password, travel date and time, destination, budget, and interests. This input data is then sent to the server and stored in a database.

[1464] Input: User basic information and travel-related information

[1465] Output: Saved user and trip information

[1466] Step 2:

[1467] The server processes the stored trip information and collects necessary data from external data sources (weather forecasts, local information), thus providing the necessary information to generate the travel plan desired by the user.

[1468] Input: Stored user information and information from external data sources

[1469] Output: A set of information required for generating plans

[1470] Step 3:

[1471] The server uses a generative AI model to automatically generate multiple travel plans based on the collected information, including plans customized to the user's interests and budget. The generated plans are then categorized by the server.

[1472] Input: User information set and information set from external data source

[1473] Output: Multiple customised itineraries generated

[1474] Step 4:

[1475] The server sends the generated travel plan to the terminal, which then presents it to the user. The user selects their preferred plan from the presented plans, enters any additional requests, and sends them to the server.

[1476] Input: Generated itinerary

[1477] Output: Travel plan presented to the user and any additional requests

[1478] Step 5:

[1479] The server stores the selected plan and any additional requests received from the user, and uses this information to prepare the necessary support information before, during and after the trip.

[1480] Input: User's selected plan and additional requests

[1481] Output: Saved selected plans and additional requests

[1482] Step 6:

[1483] Before a trip, the server automatically generates weather information, appropriate clothing suggestions, and a packing list, and sends them to the terminal, which then notifies the user.

[1484] Input: Travel date and time, destination

[1485] Output: Weather information, clothing suggestions, packing list

[1486] Step 7:

[1487] During the trip, the device sends the user's location information to the server. The server generates real-time information about local tourist spots and delivery menus based on the location information and time of day, and sends it to the device. The device then displays this information to the user.

[1488] Input: Real-time location of the user

[1489] Output: Real-time tourist spot information and delivery menu information

[1490] Step 8:

[1491] After the trip is over, the device displays a feedback questionnaire to the user and sends the answers to the server, which stores the feedback data and uses it to generate and suggest next trip plans.

[1492] Input: User feedback

[1493] Output: Feedback data and next trip suggestions

[1494] Examples:

[1495] For example, user "Taro Tanaka" registers the travel date and time "2023-12-01~2023-12-10", destination "Tokyo", budget "5,000 yen / day", and food preference "Japanese food." Based on this information, the server uses generation AI to create a delivery menu and sightseeing plan centered on Japanese food.

[1496] When a user inputs keywords such as "tempura" or "sushi" as their preferences, the generative AI creates a meal plan using prompts like the following:

[1497] User: "Taro Tanaka"

[1498] Destination: "Tokyo"

[1499] Period: "2023-12-01~2023-12-10"

[1500] Food preference: "Japanese food"

[1501] Budget: 5,000 yen / day

[1502] Generate a proposal:

[1503] This will provide consistent support before, during and after travel, significantly improving users' travel experience.

[1504] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1505] The tourism concierge service of the present invention is a system that individually optimizes the user's travel experience and provides consistent support before, during, and after the trip. This system incorporates an emotion engine that recognizes the user's emotions and provides the optimal travel plan based on those emotions.

[1506] System configuration

[1507] The system consists of the following main components:

[1508] 1. Input Method

[1509] 2. Generation means

[1510] 3. Presentation means

[1511] 4. Preservation means

[1512] 5. Means of providing information

[1513] 6. Local information provision methods

[1514] 7. Feedback channels

[1515] 8. Next proposal method

[1516] 9. Emotion Engine

[1517] Program processing

[1518] User registration and initial settings

[1519] When a user opens the application, the terminal displays a user registration form. The user registers by entering their name, email address, and password. When the user clicks the registration button, the terminal sends the input data to the server, which stores this information in a database.

[1520] Next, the initial setup screen is displayed, and the user inputs the travel date and time, destination, budget, and interests. The input data is sent to the server and saved.

[1521] Generate personalized and optimized travel plans

[1522] The server collects information entered by the user and external data sources (weather forecasts, local information), and uses generation AI to create multiple travel plans. The generated plans are categorized and sent to the device in a structured format.

[1523] The terminal displays the generated travel plan to the user, who selects the plan they like best and enters additional requests if necessary. This selection and request are sent to the server and stored.

[1524] Pre-travel information

[1525] As the travel date approaches, the server automatically generates weather information, appropriate clothing suggestions, and a packing list, which are then sent to the user's device.

[1526] Users can review this information and prepare for their trip.

[1527] Travel support

[1528] The server generates real-time information about local tourist spots and restaurants based on the user's location and time, and this information is sent to the device and displayed immediately to the user.

[1529] Additionally, the device provides a chat function, allowing users to ask additional questions or make requests. The server responds to these requests and provides the necessary information.

[1530] Post-trip feedback and suggestions for next time

[1531] Once the trip is over, the device displays a feedback survey to the user and accepts their responses. The survey results are sent to the server, where they are stored in a database.

[1532] The server generates a next travel plan based on the collected feedback data. It also provides purchasing information for local specialties and makes suggestions to the user. The terminal notifies the user of this next suggestion information and prompts them to select and book their next travel plan.

[1533] Optimization by Emotion Engine

[1534] The server recognizes the user's emotions using an emotion engine, which can analyze emotions from the user's facial expressions and input data. This emotion data is used to optimize the generated travel plan.

[1535] For example, if a user expresses joy when selecting a travel plan, the server will prioritize that plan and incorporate similar plans into the next proposal. On the other hand, if the user expresses stress or dissatisfaction, the server will offer a different plan to increase user satisfaction.

[1536] Specific examples

[1537] For example, if a 25-year-old woman plans a trip to Kyoto, she first registers with the app and enters the travel date and time, Kyoto as the destination, 200,000 yen as her budget, and her interests of cultural experiences and cafe hopping. Based on this information, the server generates a travel plan that includes Japanese sweets-making experiences, tea ceremony experiences, sightseeing routes, etc., and presents it to the user through the device.

[1538] While selecting a travel plan, the device analyzes her facial expressions and, if it detects a happy emotion, prioritizes that plan and provides real-time information on the best tourist spots and restaurants based on her emotions.

[1539] The day before her trip, the server automatically generates weather information, appropriate clothing, and a packing list, and the device notifies her. During the trip, real-time information about nearby tourist spots and restaurants is provided based on her location information.

[1540] After the trip, she answers a feedback questionnaire via her device, and the server uses this information to make suggestions for her next trip. For example, a travel plan to Kanazawa may be suggested for her next trip, along with links to purchase local specialties. The emotion engine also analyzes her emotional data during the trip and uses it to optimize her next travel plan.

[1541] In this way, the present invention provides users with consistent support before, during, and after their trip, significantly improving the satisfaction of their travel experience.

[1542] The processing flow will be explained below.

[1543] Step 1:

[1544] When a user opens the application, the device displays a user registration form, where the user enters their name, email address, and password.

[1545] Step 2:

[1546] The user enters the necessary information and clicks the registration button, which sends the input data from the terminal to the server.

[1547] Step 3:

[1548] The server saves the received user data in the database, generates a new user ID, and sends a success message to the terminal when saving is complete.

[1549] Step 4:

[1550] The device displays an initial setup screen and asks the user to enter travel dates and times, destination, budget, and interests.

[1551] Step 5:

[1552] The user enters the travel date and time, destination (e.g., Kyoto), budget, and interests (e.g., cultural experiences, cafe hopping), and clicks the send button.

[1553] Step 6:

[1554] The terminal transmits the input initial setting data to the server.

[1555] Step 7:

[1556] The server stores the received initial setting data in a database, and also collects related data such as weather forecasts, local tourist information, and restaurant information.

[1557] Step 8:

[1558] The server uses AI to generate multiple travel plans based on the collected data and user input. The plans are then categorized.

[1559] Step 9:

[1560] The server transmits the generated travel plan to the terminal.

[1561] Step 10:

[1562] The terminal displays a screen for presenting a plurality of travel plans to the user.

[1563] Step 11:

[1564] The user selects the plan they like from the ones presented and, if necessary, enters additional requests. This selection and request are sent from the terminal to the server.

[1565] Step 12:

[1566] The server stores the selected plan and any additional requests in a database.

[1567] Step 13:

[1568] As the travel date approaches, the server automatically generates weather information, appropriate clothing suggestions, and a packing list, which are then sent to the device.

[1569] Step 14:

[1570] The terminal notifies the user of the received information and asks for confirmation.

[1571] Step 15:

[1572] Before traveling, users check the weather information, clothing suggestions, and packing list that are notified to them.

[1573] Step 16:

[1574] To support users during their trip, the server generates real-time information about nearby tourist spots and restaurants based on the user's location and time, and sends it to the device.

[1575] Step 17:

[1576] The terminal displays the received local information in real time and provides it to the user.

[1577] Step 18:

[1578] Users can use the provided information about tourist spots and restaurants to visit the locations, and can also use the chat function to ask additional questions or make requests.

[1579] Step 19:

[1580] The server responds to the user's request received through the chat function, generates the necessary additional information, and sends it to the terminal.

[1581] Step 20:

[1582] Once the trip is over, the device will display a feedback survey to the user and ask them to complete it.

[1583] Step 21:

[1584] The user answers the feedback survey and clicks the send button, and the answers are sent from the terminal to the server.

[1585] Step 22:

[1586] The server stores the received feedback data in a database, then analyzes the data and generates a next travel plan.

[1587] Step 23:

[1588] The server transmits the generated next travel plan and local specialty product purchase information to the terminal.

[1589] Step 24:

[1590] The device displays information to users about their next travel plans and local product purchases.

[1591] Step 25:

[1592] The user then checks the proposed travel plans and makes a reservation if they like them.

[1593] Implementing the Emotion Engine

[1594] Step 26:

[1595] The server collects real-time emotion data from users using an emotion engine, which analyzes emotions identified from the user's facial expressions and input data.

[1596] Step 27:

[1597] The server proposes a travel plan that best suits the user's emotions based on the emotional data collected at the time of plan selection. For example, if the user shows a happy expression when selecting a plan, the server will prioritize the plan.

[1598] Step 28:

[1599] During the trip, the server monitors emotional data and suggests alternative tourist spots and restaurants if the user shows signs of dissatisfaction or stress.

[1600] Step 29:

[1601] When collecting feedback after the trip, the server analyzes the emotional data collected when answering the questionnaire and reflects this data in generating the next travel plan.

[1602] As a concrete example, if a 25-year-old woman plans a trip to Kyoto and selects a Japanese sweets-making experience, a tea ceremony experience, and a sightseeing route, the system will analyze her emotional data and prioritize providing her with experiences that she is particularly interested in. Furthermore, if she feels uneasy about a particular tourist spot during her stay in Kyoto, the system will suggest alternative recommended spots in real time, increasing her satisfaction with the trip. In this way, incorporating an emotional engine can further personalize users' travel experiences and significantly improve overall satisfaction.

[1603] Example 2

[1604] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1605] Conventional travel planning systems have difficulty generating plans based on individual user preferences, and the plans often result in low satisfaction. They also lack real-time support during the trip or a mechanism for incorporating post-trip feedback into future plans. Another issue is that plans are not optimized to take into account the user's emotions.

[1606] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1607] In this invention, the server includes: an input means for inputting the user's planned travel date and time, destination, travel funds, and areas of interest; a generation means for automatically generating a travel plan based on the input information; a presentation means for presenting multiple generated travel plans; a storage means for saving a plan selected from the presented travel plans; an information provision means for providing weather information, appropriate clothing suggestions, and a packing list before the trip; a local information provision means for providing real-time information on local tourist attractions and restaurants using the user's location information during the trip; a feedback means for conducting a questionnaire after the trip and saving feedback data; a next-trip suggestion means for generating a next travel plan based on the feedback data; and an emotion recognition means for analyzing the user's emotions and optimizing the travel plan. This makes it possible to generate an individually optimized travel plan tailored to the user's preferences, and by providing real-time support during the trip and reflecting post-trip feedback in the next plan, it is possible to increase user satisfaction.

[1608] The "input means" is a means for a user to input information such as the planned travel date and time, destination, travel funds, and areas of interest.

[1609] The "generation means" is a means for automatically generating a travel plan based on input information.

[1610] The "presentation means" is a means for displaying the generated travel plans to the user.

[1611] The "storage means" is a means for saving the travel plan selected by the user.

[1612] The "information providing means" is a means for providing the user with weather information, appropriate clothing suggestions, and a list of items to bring before the trip.

[1613] The "local information providing means" is a means for providing real-time information on local tourist spots and restaurants based on the user's location information while traveling.

[1614] The "feedback means" is a means for providing a questionnaire after a trip and storing feedback data from users.

[1615] The "next travel suggestion means" is a means for generating the next travel plan based on the user's feedback data.

[1616] The "emotion recognition means" is a means for analyzing the user's emotions and optimizing the travel plan.

[1617] The tourism concierge service system of the present invention individually optimizes a user's travel experience and provides consistent support throughout the entire period before, during, and after the trip. The system includes an emotion engine that recognizes the user's emotions and provides an optimal travel plan based on the emotions.

[1618] System Components

[1619] The system consists of the following main components:

[1620] 1. Input Method

[1621] 2. Generation means

[1622] 3. Presentation means

[1623] 4. Preservation means

[1624] 5. Means of providing information

[1625] 6. Local information provision methods

[1626] 7. Feedback channels

[1627] 8. Next proposal method

[1628] 9. Emotion recognition means

[1629] Main hardware and software

[1630] The server plays a central role in generating itineraries and storing and analyzing data. Image and voice analysis software is used for emotion recognition, and generative AI models are used to generate itineraries. Specifically, the server is operated using a high-performance database system and cloud-based AI models (e.g., Google Cloud AI, AWS AI).

[1631] The terminal transmits the information input by the user to the server and presents the information received from the server to the user. Mobile devices such as smartphones and tablets are commonly used as terminals.

[1632] Program processing explanation

[1633] First, the user opens the application and enters their name, email address, and password into the user registration form. This information is sent from the device to the server and stored in a database. Next, an initial setup screen is displayed, where users are asked to enter their planned travel date and time, destination, travel funds, and areas of interest, and this information is also sent to the server.

[1634] The server uses a generative AI model to create multiple travel plans based on user input and external data sources (weather information, local information). The generated plans are organized by category and sent to the device. The user reviews the plans on their device and sends their selected plan and any additional requests to the server. This creates an individually optimized travel plan.

[1635] As the travel date approaches, the server automatically generates weather information, appropriate clothing, and a packing list and sends them to the device. During the trip, the server provides real-time information on local tourist attractions and restaurants based on the user's location information. It also responds to any additional questions or requests via the device's chat function.

[1636] After the trip, the device provides a feedback questionnaire and transmits the user's response data to the server. The server generates a next travel plan based on the feedback data and proposes it through the device. The emotion recognition means analyzes the user's emotions and optimizes the travel plan based on this.

[1637] Specific examples

[1638] For example, if a 25-year-old woman plans a trip to Kyoto, she opens the app and registers as a user by entering her name, email address, and password. Next, she enters the planned travel date and time, Kyoto as the destination, 200,000 yen as the travel budget, and cultural experiences and cafe hopping as her areas of interest. Based on this information, the server generates a travel plan that includes Japanese sweets making experiences, tea ceremony experiences, and sightseeing routes, and presents it to the user through the device. While selecting a travel plan, the device analyzes the user's facial expressions, and if it detects an emotion of joy, it prioritizes and presents that plan.

[1639] The day before the trip, the device notifies her of weather information, appropriate clothing, and a packing list automatically generated by the server. During the trip, real-time information on nearby tourist spots and restaurants is provided based on her location information. After the trip ends, the device displays a feedback survey, which she responds to. Based on the feedback, the server generates a travel plan for her next trip to Kanazawa and notifies the device.

[1640] Prompt Sentence Examples

[1641] Below are some example prompts to input to a generative AI model:

[1642] User information: 25-year-old female, travel destination: Kyoto, budget: 200,000 yen, interests: cultural experiences, cafe hopping

[1643] Overview of the itinerary to generate:

[1644] 1. Japanese sweets making experience

[1645] 2. Tea Ceremony Experience

[1646] 3. Tourist Route (Major temples and historical buildings in the city)

[1647] In this way, the present invention provides users with consistent support before, during, and after their trip, significantly improving the satisfaction of their travel experience.

[1648] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1649] Step 1: User registration and initial setup

[1650] A user opens the application and enters their name, email address, and password into the registration form. This data is then sent from the device to the server, which stores it in a database.

[1651] Next, the initial setting screen is displayed, and the user inputs the planned travel date and time, destination, travel funds, and areas of interest. This input data is also sent from the terminal to the server and saved in the database.

[1652] Input: Name, email address, password, planned travel date and time, destination, travel funds, areas of interest

[1653] Output: User data stored on the server

[1654] Specific operations: application launch, registration form display, data submission, data saving

[1655] Step 2: Generate personalized optimized travel plans

[1656] The server collects external data sources (weather information, local information, etc.) based on the user's input data (travel date and time, destination, travel budget, areas of interest), and inputs the collected data into a generative AI model to generate multiple travel plans.

[1657] The generated plans are organized by category and sent to the terminal by the server. The user reviews the presented travel plans and selects the most suitable one. The selected plan and any additional requests are sent from the terminal to the server and stored in a database.

[1658] Input: User data, external data (weather forecast, local information)

[1659] Output: Generated itinerary, saved selection data

[1660] Specific operations: Data collection, input prompts into the generation AI model, generate a plan, send the plan, confirm with the user, and save the data.

[1661] Step 3: Pre-travel information

[1662] As the travel date approaches, the server generates a list of appropriate clothing and items to bring based on the collected weather information. This information is sent to the device, which then notifies the user. The user can then check the information and prepare for their trip.

[1663] Input: Travel date, weather information

[1664] Output: clothing suggestions, packing list, notified information

[1665] Specific operations: weather information collection, list creation, information transmission, user notification

[1666] Step 4: Travel Support

[1667] The server generates real-time information about local tourist spots and restaurants based on the user's location and time information, and the generated information is sent to the device and displayed to the user immediately.

[1668] Additionally, the device is equipped with a chat function, allowing users to enter additional questions or requests, which are then sent to the server, which then sends the corresponding information back to the device.

[1669] Input: location information, time information, user request

[1670] Output: Tourist attraction information, restaurant information, request response

[1671] Specific actions: location tracking, real-time data generation, information transmission, chat support

[1672] Step 5: Post-trip feedback and suggestions for next time

[1673] After the trip is over, the device displays a feedback questionnaire, and the user answers it. The response data is sent to the server and stored in a database. The server then generates a next travel plan based on the feedback and sends the proposed information to the device.

[1674] Input: Feedback data

[1675] Output: Next travel plan, suggested information

[1676] Specific operations: Displaying surveys, sending data, analyzing feedback, creating plans, sending information

[1677] Step 6: Optimize with emotion recognition

[1678] The server analyzes the user's emotions using emotion recognition. The emotion data is used to optimize the generated travel plan. For example, if the user expresses joy toward a particular plan, the server will prioritize that plan.

[1679] Input: User facial expression data, emotion data

[1680] Output: Optimized itinerary

[1681] Specific operations: facial expression analysis, emotional data collection, plan optimization, priority setting

[1682] (Application example 2)

[1683] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1684] Conventional tourism service systems have difficulty providing travel plans based on users' individual interests and emotions, and have faced challenges in providing real-time information and improving the quality of experiences in virtual spaces. Furthermore, systems that provide consistent support from before, during, and after a trip are lacking. This has resulted in users' travel experiences being partial, making it difficult to improve satisfaction.

[1685] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: input means for inputting the user's travel date and time, destination, budget, and interests; generation means for automatically generating a travel plan based on the input information; presentation means for presenting multiple generated travel plans; storage means for saving a plan selected from the presented travel plans; information provision means for providing weather information, appropriate clothing suggestions, and a packing list before the trip; local information provision means for providing real-time information on local tourist spots and restaurants using the user's location information during the trip; feedback means for conducting a questionnaire after the trip and saving feedback data; next suggestion means for generating a next travel plan based on the feedback data; means including an emotion engine for analyzing emotions from the user's facial expressions and input data; means for suggesting optimal tourist spots and activities in real time based on the emotion data; and means for providing a travel experience in a virtual space. This makes it possible to provide consistent support to users and significantly improve their satisfaction with their travel experience.

[1686] "Input means" refers to a means by which a user inputs travel dates and times, destinations, budgets, and interests.

[1687] The "generation means" is a means for automatically generating a travel plan based on input information.

[1688] The "presentation means" is a means for presenting the generated travel plans to the user.

[1689] The "save means" is a means for saving a plan selected by the user from the travel plans presented.

[1690] "Information providing means" refers to means for providing weather information, appropriate clothing suggestions, and a packing list before a trip.

[1691] The "local information providing means" is a means for providing real-time information on local tourist spots and restaurants using the user's location information while traveling.

[1692] "Feedback means" refers to means for providing a survey after a trip and storing feedback data.

[1693] The "next travel suggestion means" is a means for generating the next travel plan based on the feedback data.

[1694] The "means including an emotion engine" is a means including an engine for analyzing emotions from the user's facial expressions and input data, and providing an optimal travel plan based on the emotions.

[1695] "A means for suggesting optimal tourist spots and activities in real time based on emotional data" refers to a means for suggesting optimal tourist spots and activities to users in real time based on emotional data analyzed by the emotion engine.

[1696] "Means for providing a travel experience in a virtual space" means means for enabling users to experience travel in a virtual space using virtual reality technology.

[1697] To implement the present invention, the following system configuration and processing procedures are required.

[1698] System Configuration

[1699] The system mainly consists of the following components:

[1700] 1. Input method: A method for users to input travel dates and times, destinations, budget, and interests. It works on smartphones or head-mounted displays (HMDs).

[1701] 2. Generation method: A method for automatically generating a travel plan based on input information. This is done using a generative AI model.

[1702] 3. Presentation method: This is the method by which the generated travel plans are presented to the user. They are displayed on a smartphone or HMD display.

[1703] 4. Saving method: A method for saving the plan selected by the user from the presented travel plans.

[1704] 5. Information tools: These tools provide weather information, appropriate clothing suggestions, and packing lists before a trip.

[1705] 6. Local information provision: This is a means of providing real-time information on local tourist spots and restaurants using the user's location information while traveling.

[1706] 7. Feedback channels: A means to provide post-trip surveys and store feedback data.

[1707] 8. Next suggestion method: A method to generate next travel plans based on feedback data.

[1708] 9. Means including an emotion engine: A means including an engine for analyzing emotions from the user's facial expressions and input data and providing an optimal travel plan based on the emotions.

[1709] 10. A means of suggesting the best tourist spots and activities in real time based on emotional data: A means of suggesting the best tourist spots and activities to users in real time based on emotional data analyzed by the emotion engine.

[1710] 11. Means of providing travel experiences in virtual space: This means that users can experience travel in a virtual space using virtual reality technology. The hardware used includes smartphones, HMDs, and servers.

[1711] Program Processing and Data Flow

[1712] 1. User input:

[1713] Users use their smartphones or HMDs to input information about their travel dates and times, destinations, budgets, and interests using the application's input methods, and this data is sent to the server.

[1714] 2. Generate a travel plan:

[1715] The server uses the input information to input prompts into the generative AI model and generate a travel plan.

[1716] example:

[1717] User Data:

[1718] Name: Username

[1719] Age: 30

[1720] Interests: Cultural experiences, food tours

[1721] Travel date and time: May 1 - May 5, 2024

[1722] External Data:

[1723] Local weather forecast: Sunny

[1724] Local recommended tourist spots: Tourist attractions

[1725] Recommended gourmet restaurants: Famous restaurants

[1726] Suggested travel plans

[1727] 3. Present the generated plan:

[1728] The server sends the generated travel plans to a smartphone or HMD and presents them to the user, who then selects the most suitable plan.

[1729] 4. Preservation and Information Provision:

[1730] The selected travel plan is stored on the server, and weather information, a packing list, clothing suggestions, etc. are provided before the trip.

[1731] 5. Travel support:

[1732] The server provides real-time information on the best tourist spots and restaurants based on the user's location and emotion data. The emotion engine uses FaceAPI and Emotion API to analyze facial expression data.

[1733] 6. Post-trip feedback and suggestions for next time:

[1734] After the trip is over, the server sends a feedback questionnaire to the user's device and saves the response data, which is used to generate the next travel plan.

[1735] In this way, the present invention analyzes the user's facial expressions and emotional data, making it possible to individually optimize the virtual travel experience.

[1736] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1737] Step 1: User Input

[1738] The server receives information from the user, such as travel date and time, destination, budget, and interests, via input means provided by the device. Input data also includes name, email address, and password. This data is sent to the server and stored in a database.

[1739] input:

[1740] User information (name, email address, password)

[1741] Travel information (date, time, destination, budget, interests)

[1742] output:

[1743] User and travel information stored in a database

[1744] Step 2: Generate a travel plan

[1745] The server collects the user's travel information stored in the database, as well as external weather forecasts and local information, and inputs prompts into the generative AI model, which then generates multiple travel plans based on these, which are then received by the server.

[1746] input:

[1747] Saved user trip information

[1748] External data (weather forecast, local information)

[1749] output:

[1750] Generated multiple itineraries

[1751] Specific behavior:

[1752] The server uses Python and TensorFlow to generate travel plans by inputting prompt sentences into a generative AI model.

[1753] Step 3: Present your plan

[1754] The server sends the generated itineraries to the terminal, which then presents them to the user. The user selects the most suitable itinerary and sends it to the server via the terminal.

[1755] input:

[1756] Generated multiple itineraries

[1757] output:

[1758] Travel plan selected by the user

[1759] Specific behavior:

[1760] The device uses React Native to display itineraries and allow users to select them.

[1761] Step 4: Save the selected plan

[1762] The server stores the user's selected travel plans in a database.

[1763] input:

[1764] The travel plan selected by the user

[1765] output:

[1766] Travel plans stored in a database

[1767] Step 5: Pre-travel information

[1768] As the travel date and time approaches, the server automatically generates weather information, appropriate clothing suggestions, and a list of items to bring, and sends them to the terminal, which then notifies the user.

[1769] input:

[1770] Travel date and time

[1771] Weather information, clothing suggestions, and packing list generation algorithms

[1772] output:

[1773] Generated weather information, clothing suggestions, and packing lists

[1774] Specific behavior:

[1775] The server uses Python to run algorithms to generate weather information, outfit suggestions, and packing lists.

[1776] Step 6: Travel Support

[1777] The server collects location information and emotion data of the user while traveling, and provides the user with information on the best tourist spots and restaurants in real time, using an emotion engine.

[1778] input:

[1779] User location information

[1780] Emotional Data

[1781] output:

[1782] Information on the best tourist spots and restaurants

[1783] Specific behavior:

[1784] The server uses FaceAPI and Emotion API to analyze emotional data and suggest tourist spots in real time.

[1785] Step 7: Post-trip feedback

[1786] After the trip, the server provides a feedback questionnaire to the user via the terminal and stores the response data in a database.

[1787] input:

[1788] User Feedback

[1789] output:

[1790] Feedback data stored in a database

[1791] Specific behavior:

[1792] The terminal displays the feedback questionnaire and transmits the user's input to the server.

[1793] Step 8: Generate next proposal

[1794] The server generates a next travel plan based on the feedback data and notifies the user.

[1795] input:

[1796] Feedback Data

[1797] output:

[1798] Plan your next trip

[1799] Specific behavior:

[1800] The server analyzes the collected feedback data and inputs the results into a generative AI model to generate the next proposed travel plan.

[1801] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1802] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1803] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1804] [Fourth embodiment]

[1805] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1806] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1807] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1808] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1809] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1810] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1811] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1812] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1813] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1814] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1815] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1816] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1817] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1818] The tourism concierge service of the present invention is a system that individually optimizes the user's travel experience and provides consistent support before, during, and after the trip. This system is designed to reduce the hassle of travel planning for users and provide a more enjoyable travel experience.

[1819] System configuration

[1820] The system consists of the following main components:

[1821] 1. Input Method

[1822] 2. Generation means

[1823] 3. Presentation means

[1824] 4. Preservation means

[1825] 5. Means of providing information

[1826] 6. Local information provision methods

[1827] 7. Feedback channels

[1828] 8. Next proposal method

[1829] Program processing

[1830] User registration and initial settings

[1831] When a user opens the application, the device displays a user registration form. The user registers by entering their name, email address, password, etc. When the user clicks the registration button, the device sends the input data to the server, which then stores this information in a database.

[1832] Next, the initial setup screen is displayed, and the user inputs the travel date and time, destination, budget, and interests. The input data is sent to the server and saved.

[1833] Generate personalized and optimized travel plans

[1834] The server collects information entered by the user and external data sources (weather forecasts, local information), and uses generation AI to create multiple travel plans. The generated plans are categorized and sent to the device in a structured format.

[1835] The terminal displays the generated travel plan to the user, who selects the plan they like best and enters additional requests if necessary. This selection and request are sent to the server and stored.

[1836] Pre-travel information

[1837] As the travel date approaches, the server automatically generates weather information, appropriate clothing suggestions, and a packing list, which are then sent to the user's device.

[1838] Users can review this information and prepare for their trip.

[1839] Travel support

[1840] The server generates real-time information about local tourist spots and restaurants based on the user's location and time, and this information is sent to the device and displayed immediately to the user.

[1841] Additionally, the device provides a chat function, allowing users to ask additional questions or make requests. The server responds to these requests and provides the necessary information.

[1842] Post-trip feedback and suggestions for next time

[1843] Once the trip is over, the device displays a feedback survey to the user and accepts their responses. The survey results are sent to the server, where they are stored in a database.

[1844] The server generates a next travel plan based on the collected feedback data. It also provides purchasing information for local specialties and makes suggestions to the user. The terminal notifies the user of this next suggestion information and prompts them to select and book their next travel plan.

[1845] Specific examples

[1846] For example, if a 25-year-old woman plans a trip to Kyoto, she first registers with the app and enters the travel date and time, Kyoto as the destination, 200,000 yen as her budget, and her interests of cultural experiences and cafe hopping. Based on this information, the server generates a travel plan that includes Japanese sweets-making experiences, tea ceremony experiences, sightseeing routes, etc., and presents it to the user through the device.

[1847] The day before her trip, the server automatically generates weather information, appropriate clothing, and a packing list, and the device notifies her. During the trip, real-time information about nearby tourist spots and restaurants is provided based on her location information.

[1848] After the trip, she answers a feedback questionnaire via her device, and the server uses this information to suggest her next trip. For example, it may suggest a trip to Kanazawa for her next trip, along with links to purchase local specialties.

[1849] In this way, the present invention provides users with consistent support before, during, and after their trip, significantly improving the satisfaction of their travel experience.

[1850] The processing flow will be explained below.

[1851] Step 1:

[1852] When a user opens the application, the device displays a user registration form, where the user enters their name, email address, and password.

[1853] Step 2:

[1854] The user enters the necessary information and clicks the registration button, which sends the input data from the terminal to the server.

[1855] Step 3:

[1856] The server saves the received user data in the database, generates a new user ID, and sends a success message to the terminal when saving is complete.

[1857] Step 4:

[1858] The device displays an initial setup screen and asks the user to enter travel dates and times, destination, budget, and interests.

[1859] Step 5:

[1860] The user enters the travel date and time, destination (e.g., Kyoto), budget (e.g., 200,000 yen), and interests (e.g., cultural experiences, cafe hopping), and clicks the send button.

[1861] Step 6:

[1862] The terminal transmits the input initial setting data to the server.

[1863] Step 7:

[1864] The server stores the received initial setting data in a database, and also collects related data such as weather forecasts, local tourist information, and restaurant information.

[1865] Step 8:

[1866] The server uses AI to generate multiple travel plans based on the collected data and user input. The plans are then categorized.

[1867] Step 9:

[1868] The server transmits the generated travel plan to the terminal.

[1869] Step 10:

[1870] The terminal displays a screen for presenting a plurality of travel plans to the user.

[1871] Step 11:

[1872] The user selects the plan they like from the ones presented and, if necessary, enters additional requests. This selection and request are sent from the terminal to the server.

[1873] Step 12:

[1874] The server stores the selected plan and any additional requests in a database.

[1875] Step 13:

[1876] As the travel date approaches, the server automatically generates weather information, appropriate clothing suggestions, and a packing list, which are then sent to the device.

[1877] Step 14:

[1878] The terminal notifies the user of the received information and asks for confirmation.

[1879] Step 15:

[1880] Before traveling, users check the weather information, clothing suggestions, and packing list that are notified to them.

[1881] Step 16:

[1882] To support users during their trip, the server generates real-time information about nearby tourist spots and restaurants based on the user's location and time, and sends it to the device.

[1883] Step 17:

[1884] The terminal displays the received local information in real time and provides it to the user.

[1885] Step 18:

[1886] Users can use the provided information about tourist spots and restaurants to visit the locations, and can also use the chat function to ask additional questions or make requests.

[1887] Step 19:

[1888] The server responds to the user's request received through the chat function, generates the necessary additional information, and sends it to the terminal.

[1889] Step 20:

[1890] Once the trip is over, the device will display a feedback survey to the user and ask them to complete it.

[1891] Step 21:

[1892] The user answers the feedback survey and clicks the send button, and the answers are sent from the terminal to the server.

[1893] Step 22:

[1894] The server stores the received feedback data in a database, then analyzes the data and generates a next travel plan.

[1895] Step 23:

[1896] The server transmits the generated next travel plan and local specialty product purchase information to the terminal.

[1897] Step 24:

[1898] The device displays information to users about their next travel plans and local product purchases.

[1899] Step 25:

[1900] The user then checks the proposed travel plans and makes a reservation if they like them.

[1901] Example 1

[1902] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1903] Conventional tourism concierge services have limitations in providing optimal travel plans tailored to each user's individual needs and circumstances. They also lack consistent support before, during, and after a trip, preventing them from fully improving user satisfaction. In particular, they lack real-time information and feedback-based suggestions for future itineraries, making it difficult for users to have a comfortable and satisfying travel experience.

[1904] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1905] In this invention, the server includes: an input means for inputting a user's travel date and time, destination, budget, and interests; a generation means for automatically generating a travel plan based on the input information; a presentation means for presenting multiple generated travel plans; a storage means for saving a plan selected from the presented travel plans; an information provision means for providing weather information, appropriate clothing suggestions, and a packing list before the trip; a local information provision means for providing real-time information on local tourist spots and restaurants during the trip using location information and behavioral data; a feedback means for conducting a questionnaire after the trip and saving feedback data; a next suggestion means for generating a next travel plan based on the feedback data; a means for generating a travel plan using a generative AI model; and a means for generating prompt sentences to be input to the generative AI model. This makes it possible to provide users with consistent, high-quality travel support and travel plans optimized for their individual needs.

[1906] "Input means" refers to a means by which a user inputs information such as travel date and time, destination, budget, interests, etc.

[1907] The "generation means" is a means for automatically generating a travel plan based on input information.

[1908] The "presentation means" is a means for presenting a plurality of generated travel plans.

[1909] The "storage means" is a means for saving a plan selected from the presented travel plans.

[1910] The "information providing means" is a means for providing weather information, appropriate clothing suggestions, and a packing list before a trip.

[1911] The "local information providing means" is a means for providing real-time information on local tourist spots and restaurants using the user's location information and behavioral data while traveling.

[1912] "Feedback means" refers to means for providing a post-trip survey and collecting and storing feedback data.

[1913] The "next suggestion means" is a means for generating and suggesting a next travel plan based on feedback data.

[1914] A "means for generating a travel plan using a generative AI model" is a means for automatically generating a travel plan using a generative AI model.

[1915] The "means for generating a prompt sentence" is a means for generating a prompt sentence to provide appropriate input to the generative AI model.

[1916] MODE FOR CARRYING OUT THE INVENTION

[1917] The tourism concierge service of the present invention is a system designed to individually optimize a user's travel experience and provide consistent support before, during, and after the trip. This system combines multiple processing means to reduce the hassle of travel planning for users and provide a more enjoyable travel experience.

[1918] User registration and initial settings

[1919] When a user launches the application, the device displays a user registration form, and the user enters information such as their name, email address, and password. When the registration button is clicked, the device sends this information to the server, which stores it in a database. Next, an initial setup screen is displayed, and the user enters the travel date and time, destination, budget, and interests. The entered data is sent to the server and saved.

[1920] Generate personalized and optimized travel plans

[1921] The server collects information entered by the user and external data sources (such as weather forecasts and local information) and uses a generative AI to create multiple travel plans. This generative AI uses OpenAI's GPT-4 and other technologies. The generated plans are categorized and sent to the device in a structured state. The device displays these travel plans to the user and saves the selected plan from the presented plans. If the user enters additional requests as needed, these are also sent to the server and stored in a database.

[1922] Pre-travel information

[1923] As the travel date approaches, the server automatically generates weather information, appropriate clothing suggestions, and a packing list. This information is sent to the terminal and notified to the user, allowing the user to check the information and prepare for the trip.

[1924] Travel support

[1925] The server generates real-time information about local tourist attractions and restaurants based on the user's location and time. This information is sent to the device and displayed immediately to the user. In addition, the device provides a chat function, allowing the user to ask additional questions or make requests. The server responds to these requests and provides the necessary information.

[1926] Post-trip feedback and suggestions for next time

[1927] After the trip is over, the device displays a feedback questionnaire to the user and accepts their responses. The questionnaire results are sent to the server, where they are stored in a database. The server then generates a next travel plan based on the collected feedback data. It also provides purchasing information for local specialties and makes suggestions to the user. The device then notifies the user of these next travel plan suggestions and prompts them to select and book their next travel plan.

[1928] Specific examples

[1929] For example, if a 25-year-old woman plans a trip to Kyoto, she first registers with the app and enters the travel date and time, Kyoto as the destination, 200,000 yen as her budget, and her interests of cultural experiences and cafe hopping. Based on this information, the server generates a travel plan that includes Japanese sweets-making experiences, tea ceremony experiences, sightseeing routes, etc., and presents it to the user through the device.

[1930] The day before her trip, the server automatically generates weather information, appropriate clothing, and a packing list, and the device notifies her. During the trip, real-time information about nearby tourist spots and restaurants is provided based on her location information.

[1931] After the trip, she answers a feedback questionnaire via her device, and the server uses this information to suggest her next trip. For example, it may suggest a trip to Kanazawa for her next trip, along with links to purchase local specialties.

[1932] Prompt Sentence Examples

[1933] "List the tasks a 25-year-old woman will complete before traveling. She is going to Kyoto, and her travel date is next weekend."

[1934] In this way, the present invention provides users with consistent, high-quality support before, during, and after their trip, significantly improving satisfaction with their travel experience.

[1935] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1936] Program processing flow

[1937] Step 1: User registration and initial setup

[1938] 1-1: User registration

[1939] When the user starts the application, the terminal displays a user registration form.

[1940] The user enters their name, email address, and password and clicks the Register button.

[1941] The terminal transmits the input data to the server.

[1942] The server stores the received data in a database.

[1943] Input: Name, Email Address, Password

[1944] Data processing: Convert data into database format

[1945] Output: Save to database

[1946] 1-2: Initial settings

[1947] The terminal displays an initial setup screen, and the user inputs the travel date and time, destination, budget, and interests.

[1948] The terminal transmits the input data to the server.

[1949] The server stores the received data in a database.

[1950] Input: Travel date and time, destination, budget, interests

[1951] Data processing: Convert each item into database format

[1952] Output: Save to database

[1953] Step 2: Generate personalized optimized travel plans

[1954] 2-1: Information gathering

[1955] The server uses an API to collect external data sources (weather forecasts, local information) based on the information entered by the user.

[1956] Input: User registration information, initial setting information

[1957] Data processing: Information acquisition through API

[1958] Output: Collected data

[1959] 2-2: Travel plan generation

[1960] The server generates multiple travel plans using the collected data and generative AI (e.g., OpenAI's GPT-4).

[1961] Input: User information, external data, generative AI model

[1962] Data processing: Data analysis, prompt generation, and plan generation using AI models

[1963] Output: Multiple itineraries

[1964] 2-3: Plan presentation

[1965] The server classifies the generated plans by category and sends them to the terminal.

[1966] The terminal displays these plans to the user.

[1967] Input: Generated itinerary

[1968] Data processing: Category classification

[1969] Output: What is displayed to the user

[1970] 2-4: Select and save a plan

[1971] The user selects one of the plans presented and enters additional requests as necessary.

[1972] The terminal sends this information to the server.

[1973] The server stores the selected plan and any additional requests in a database.

[1974] Input: Selected plan, additional requests

[1975] Data processing: Convert to database format

[1976] Output: Save to database

[1977] Step 3: Pre-travel information

[1978] 3-1: Weather information generation and notification

[1979] As the travel date approaches, the server automatically generates weather information, appropriate clothing suggestions, and a packing list.

[1980] Input: Travel date, Destination

[1981] Data processing: Calling weather forecast API, generating clothing suggestions, generating a list of belongings

[1982] Output: Notification information

[1983] The server transmits the generated information to the terminal.

[1984] The terminal notifies the user of this.

[1985] Step 4: Travel Support

[1986] 4-1: Real-time local information

[1987] The server generates information about local tourist spots and restaurants based on the user's location information and time.

[1988] Input: User's location, time

[1989] Data processing: Calling tourist information API, matching with location data

[1990] Output: Real-time information

[1991] The server transmits this information to the terminal.

[1992] The terminal displays this to the user.

[1993] 4-2: Chat support

[1994] The device provides a chat function, allowing users to ask additional questions or make requests.

[1995] The server responds to these requests and provides the necessary information.

[1996] Input: User question, request

[1997] Data processing: Analysis of questions and search for necessary information

[1998] Output: Answer information

[1999] Step 5: Post-trip feedback and suggestions for next time

[2000] 5-1: Gather feedback

[2001] When the trip ends, the terminal displays a feedback questionnaire to the user and accepts responses.

[2002] The terminal transmits the survey results to the server.

[2003] The server stores this in a database.

[2004] Input: Feedback survey response

[2005] Data processing: Convert to database format

[2006] Output: Save to database

[2007] 5-2: Next proposal

[2008] The server generates the next itinerary based on the collected feedback data.

[2009] The server sends the generated next proposal to the terminal.

[2010] The terminal notifies the user of this and prompts them to select and book their next travel plan.

[2011] Input: Feedback data

[2012] Data processing: Feedback analysis, plan generation

[2013] Output: Next proposal information

[2014] The above is the specific flow and operation of the program processing of this system.

[2015] (Application example 1)

[2016] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2017] Today's travelers expect consistent access to information about tourist attractions and restaurants at their destinations, as well as support during their trip. However, current systems require travelers to use different applications and services before, during, and after their trip, resulting in a lack of consistency in their travel experience. It is also difficult to obtain timely information about local restaurants and delivery menus while traveling, which reduces user satisfaction with their travel experience. Therefore, there is a need for a system that provides consistent support from before, during, and after a trip, and in particular, provides relevant food delivery information in real time during travel.

[2018] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2019] In this invention, the server includes an input means for inputting the user's travel date and time, destination, budget, and interests, a generation means for automatically generating a travel plan based on the input information, and a presentation means for presenting multiple generated travel plans. This allows the user to consistently receive individually optimized plans from before, during, and after the trip, improving satisfaction with the travel experience. Furthermore, by including a means for automatically generating a food delivery plan for the travel destination and suggesting appropriate restaurants and delivery menus in real time based on the user's location information and time of day, meal selection during the trip is simplified, improving convenience.

[2020] "Input means" refers to a means by which a user inputs information such as travel date and time, destination, budget, and interests.

[2021] The "generation means" is a means for automatically creating travel plans and food delivery plans based on input information.

[2022] The "presentation means" is a means for displaying the generated multiple travel plans and food delivery plans to the user.

[2023] A "storage means" is a means for saving travel plans or food delivery plans selected by a user.

[2024] The "information providing means" is a means for providing weather information, appropriate clothing suggestions, a packing list, and the like before a trip.

[2025] The "local information providing means" is a means for providing real-time information on local tourist spots and restaurants using the user's location information while traveling.

[2026] "Feedback means" refers to the means for providing a post-trip survey and recording and storing that feedback data.

[2027] The "next proposal means" is a means for generating the next travel plan based on the feedback data and making new proposals based on previous travel data.

[2028] "Real-time suggestion means" is a means for suggesting appropriate restaurants and delivery menus in real time based on the user's location information and time of day.

[2029] To implement this invention, it is necessary to build a system that individually optimizes the user's travel experience and provides consistent support. This is mainly achieved by linking a smartphone app with a server-side system.

[2030] Hardware and Software

[2031] Hardware

[2032] Smartphone (iOS / Android)

[2033] software

[2034] Mobile Development Framework (React Native, Flutter, etc.)

[2035] Backend Server (Node.js, Django, etc.)

[2036] Database (MySQL, MongoDB, etc.)

[2037] Cloud Services (AWS, Google Cloud Platform, etc.)

[2038] User registration and initial settings

[2039] When a user opens the application, the device displays a user registration form, where the user enters their name, email address, password, travel date and time, destination, budget, and interests. This data is sent to the server and stored in a database.

[2040] Generate personalized and optimized travel plans

[2041] The server collects external data sources (weather forecasts, local information) based on the information entered by the user and uses generative AI to create multiple travel plans. The generated plans are categorized, sent to the device, and presented to the user.

[2042] Local information provided

[2043] During travel, the server provides real-time information on local attractions, restaurants, and automatically generated food delivery menus based on the user's location and time zone, allowing users to easily select local dining options.

[2044] Feedback and suggestions for next time

[2045] When the trip is over, the terminal presents the user with a feedback questionnaire. The results of the questionnaire are sent to the server and stored in a database. This feedback data is used to generate the next travel plan and is notified to the user via the next proposal means.

[2046] Specific examples

[2047] For example, a user may register a name such as "Taro Tanaka," travel dates and times as "2023-12-01 to 2023-12-10," destination as "Tokyo," budget as "5,000 yen / day," and food preference as "Japanese food." Based on this information, the server uses generative AI to create a delivery menu and sightseeing plan centered around Japanese food.

[2048] When a user inputs keywords such as "tempura" or "sushi" as their preferences, the generative AI creates a meal plan using prompts like the following:

[2049] User: "Taro Tanaka"

[2050] Destination: "Tokyo"

[2051] Period: "2023-12-01~2023-12-10"

[2052] Food preference: "Japanese food"

[2053] Budget: 5,000 yen / day

[2054] Generate a proposal:

[2055] The server sends the generated suggestions to the terminal, allowing users to receive consistent support before, during, and after their trip. This system significantly improves users' travel experience and increases their satisfaction.

[2056] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2057] Step 1:

[2058] When a user launches the application, the device displays a user registration form. The user enters their name, email address, password, travel date and time, destination, budget, and interests. This input data is then sent to the server and stored in a database.

[2059] Input: User basic information and travel-related information

[2060] Output: Saved user and trip information

[2061] Step 2:

[2062] The server processes the stored trip information and collects necessary data from external data sources (weather forecasts, local information), thus providing the necessary information to generate the travel plan desired by the user.

[2063] Input: Stored user information and information from external data sources

[2064] Output: A set of information required for generating plans

[2065] Step 3:

[2066] The server uses a generative AI model to automatically generate multiple travel plans based on the collected information, including plans customized to the user's interests and budget. The generated plans are then categorized by the server.

[2067] Input: User information set and information set from external data source

[2068] Output: Multiple customised itineraries generated

[2069] Step 4:

[2070] The server sends the generated travel plan to the terminal, which then presents it to the user. The user selects their preferred plan from the presented plans, enters any additional requests, and sends them to the server.

[2071] Input: Generated itinerary

[2072] Output: Travel plan presented to the user and any additional requests

[2073] Step 5:

[2074] The server stores the selected plan and any additional requests received from the user, and uses this information to prepare the necessary support information before, during and after the trip.

[2075] Input: User's selected plan and additional requests

[2076] Output: Saved selected plans and additional requests

[2077] Step 6:

[2078] Before a trip, the server automatically generates weather information, appropriate clothing suggestions, and a packing list, and sends them to the terminal, which then notifies the user.

[2079] Input: Travel date and time, destination

[2080] Output: Weather information, clothing suggestions, packing list

[2081] Step 7:

[2082] During the trip, the device sends the user's location information to the server. The server generates real-time information about local tourist spots and delivery menus based on the location information and time of day, and sends it to the device. The device then displays this information to the user.

[2083] Input: Real-time location of the user

[2084] Output: Real-time tourist spot information and delivery menu information

[2085] Step 8:

[2086] After the trip is over, the device displays a feedback questionnaire to the user and sends the answers to the server, which stores the feedback data and uses it to generate and suggest next trip plans.

[2087] Input: User feedback

[2088] Output: Feedback data and next trip suggestions

[2089] Examples:

[2090] For example, user "Taro Tanaka" registers the travel date and time "2023-12-01~2023-12-10", destination "Tokyo", budget "5,000 yen / day", and food preference "Japanese food." Based on this information, the server uses generation AI to create a delivery menu and sightseeing plan centered on Japanese food.

[2091] When a user inputs keywords such as "tempura" or "sushi" as their preferences, the generative AI creates a meal plan using prompts like the following:

[2092] User: "Taro Tanaka"

[2093] Destination: "Tokyo"

[2094] Period: "2023-12-01~2023-12-10"

[2095] Food preference: "Japanese food"

[2096] Budget: 5,000 yen / day

[2097] Generate a proposal:

[2098] This will provide consistent support before, during and after travel, significantly improving users' travel experience.

[2099] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2100] The tourism concierge service of the present invention is a system that individually optimizes the user's travel experience and provides consistent support before, during, and after the trip. This system incorporates an emotion engine that recognizes the user's emotions and provides the optimal travel plan based on those emotions.

[2101] System configuration

[2102] The system consists of the following main components:

[2103] 1. Input Method

[2104] 2. Generation means

[2105] 3. Presentation means

[2106] 4. Preservation means

[2107] 5. Means of providing information

[2108] 6. Local information provision methods

[2109] 7. Feedback channels

[2110] 8. Next proposal method

[2111] 9. Emotion Engine

[2112] Program processing

[2113] User registration and initial settings

[2114] When a user opens the application, the terminal displays a user registration form. The user registers by entering their name, email address, and password. When the user clicks the registration button, the terminal sends the input data to the server, which stores this information in a database.

[2115] Next, the initial setup screen is displayed, and the user inputs the travel date and time, destination, budget, and interests. The input data is sent to the server and saved.

[2116] Generate personalized and optimized travel plans

[2117] The server collects information entered by the user and external data sources (weather forecasts, local information), and uses generation AI to create multiple travel plans. The generated plans are categorized and sent to the device in a structured format.

[2118] The terminal displays the generated travel plan to the user, who selects the plan they like best and enters additional requests if necessary. This selection and request are sent to the server and stored.

[2119] Pre-travel information

[2120] As the travel date approaches, the server automatically generates weather information, appropriate clothing suggestions, and a packing list, which are then sent to the user's device.

[2121] Users can review this information and prepare for their trip.

[2122] Travel support

[2123] The server generates real-time information about local tourist spots and restaurants based on the user's location and time, and this information is sent to the device and displayed immediately to the user.

[2124] Additionally, the device provides a chat function, allowing users to ask additional questions or make requests. The server responds to these requests and provides the necessary information.

[2125] Post-trip feedback and suggestions for next time

[2126] Once the trip is over, the device displays a feedback survey to the user and accepts their responses. The survey results are sent to the server, where they are stored in a database.

[2127] The server generates a next travel plan based on the collected feedback data. It also provides purchasing information for local specialties and makes suggestions to the user. The terminal notifies the user of this next suggestion information and prompts them to select and book their next travel plan.

[2128] Optimization by Emotion Engine

[2129] The server recognizes the user's emotions using an emotion engine, which can analyze emotions from the user's facial expressions and input data. This emotion data is used to optimize the generated travel plan.

[2130] For example, if a user expresses joy when selecting a travel plan, the server will prioritize that plan and incorporate similar plans into the next proposal. On the other hand, if the user expresses stress or dissatisfaction, the server will offer a different plan to increase user satisfaction.

[2131] Specific examples

[2132] For example, if a 25-year-old woman plans a trip to Kyoto, she first registers with the app and enters the travel date and time, Kyoto as the destination, 200,000 yen as her budget, and her interests of cultural experiences and cafe hopping. Based on this information, the server generates a travel plan that includes Japanese sweets-making experiences, tea ceremony experiences, sightseeing routes, etc., and presents it to the user through the device.

[2133] While selecting a travel plan, the device analyzes her facial expressions and, if it detects a happy emotion, prioritizes that plan and provides real-time information on the best tourist spots and restaurants based on her emotions.

[2134] The day before her trip, the server automatically generates weather information, appropriate clothing, and a packing list, and the device notifies her. During the trip, real-time information about nearby tourist spots and restaurants is provided based on her location information.

[2135] After the trip, she answers a feedback questionnaire via her device, and the server uses this information to make suggestions for her next trip. For example, a travel plan to Kanazawa may be suggested for her next trip, along with links to purchase local specialties. The emotion engine also analyzes her emotional data during the trip and uses it to optimize her next travel plan.

[2136] In this way, the present invention provides users with consistent support before, during, and after their trip, significantly improving the satisfaction of their travel experience.

[2137] The processing flow will be explained below.

[2138] Step 1:

[2139] When a user opens the application, the device displays a user registration form, where the user enters their name, email address, and password.

[2140] Step 2:

[2141] The user enters the necessary information and clicks the registration button, which sends the input data from the terminal to the server.

[2142] Step 3:

[2143] The server saves the received user data in the database, generates a new user ID, and sends a success message to the terminal when saving is complete.

[2144] Step 4:

[2145] The device displays an initial setup screen and asks the user to enter travel dates and times, destination, budget, and interests.

[2146] Step 5:

[2147] The user enters the travel date and time, destination (e.g., Kyoto), budget, and interests (e.g., cultural experiences, cafe hopping), and clicks the send button.

[2148] Step 6:

[2149] The terminal transmits the input initial setting data to the server.

[2150] Step 7:

[2151] The server stores the received initial setting data in a database, and also collects related data such as weather forecasts, local tourist information, and restaurant information.

[2152] Step 8:

[2153] The server uses AI to generate multiple travel plans based on the collected data and user input. The plans are then categorized.

[2154] Step 9:

[2155] The server transmits the generated travel plan to the terminal.

[2156] Step 10:

[2157] The terminal displays a screen for presenting a plurality of travel plans to the user.

[2158] Step 11:

[2159] The user selects the plan they like from the ones presented and, if necessary, enters additional requests. This selection and request are sent from the terminal to the server.

[2160] Step 12:

[2161] The server stores the selected plan and any additional requests in a database.

[2162] Step 13:

[2163] As the travel date approaches, the server automatically generates weather information, appropriate clothing suggestions, and a packing list, which are then sent to the device.

[2164] Step 14:

[2165] The terminal notifies the user of the received information and asks for confirmation.

[2166] Step 15:

[2167] Before traveling, users check the weather information, clothing suggestions, and packing list that are notified to them.

[2168] Step 16:

[2169] To support users during their trip, the server generates real-time information about nearby tourist spots and restaurants based on the user's location and time, and sends it to the device.

[2170] Step 17:

[2171] The terminal displays the received local information in real time and provides it to the user.

[2172] Step 18:

[2173] Users can use the provided information about tourist spots and restaurants to visit the locations, and can also use the chat function to ask additional questions or make requests.

[2174] Step 19:

[2175] The server responds to the user's request received through the chat function, generates the necessary additional information, and sends it to the terminal.

[2176] Step 20:

[2177] Once the trip is over, the device will display a feedback survey to the user and ask them to complete it.

[2178] Step 21:

[2179] The user answers the feedback survey and clicks the send button, and the answers are sent from the terminal to the server.

[2180] Step 22:

[2181] The server stores the received feedback data in a database, then analyzes the data and generates a next travel plan.

[2182] Step 23:

[2183] The server transmits the generated next travel plan and local specialty product purchase information to the terminal.

[2184] Step 24:

[2185] The device displays information to users about their next travel plans and local product purchases.

[2186] Step 25:

[2187] The user then checks the proposed travel plans and makes a reservation if they like them.

[2188] Implementing the Emotion Engine

[2189] Step 26:

[2190] The server collects real-time emotion data from users using an emotion engine, which analyzes emotions identified from the user's facial expressions and input data.

[2191] Step 27:

[2192] The server proposes a travel plan that best suits the user's emotions based on the emotional data collected at the time of plan selection. For example, if the user shows a happy expression when selecting a plan, the server will prioritize the plan.

[2193] Step 28:

[2194] During the trip, the server monitors emotional data and suggests alternative tourist spots and restaurants if the user shows signs of dissatisfaction or stress.

[2195] Step 29:

[2196] When collecting feedback after the trip, the server analyzes the emotional data collected when answering the questionnaire and reflects this data in generating the next travel plan.

[2197] As a concrete example, if a 25-year-old woman plans a trip to Kyoto and selects a Japanese sweets-making experience, a tea ceremony experience, and a sightseeing route, the system will analyze her emotional data and prioritize providing her with experiences that she is particularly interested in. Furthermore, if she feels uneasy about a particular tourist spot during her stay in Kyoto, the system will suggest alternative recommended spots in real time, increasing her satisfaction with the trip. In this way, incorporating an emotional engine can further personalize users' travel experiences and significantly improve overall satisfaction.

[2198] Example 2

[2199] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2200] Conventional travel planning systems have difficulty generating plans based on individual user preferences, and the plans often result in low satisfaction. They also lack real-time support during the trip or a mechanism for incorporating post-trip feedback into future plans. Another issue is that plans are not optimized to take into account the user's emotions.

[2201] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2202] In this invention, the server includes: an input means for inputting the user's planned travel date and time, destination, travel funds, and areas of interest; a generation means for automatically generating a travel plan based on the input information; a presentation means for presenting multiple generated travel plans; a storage means for saving a plan selected from the presented travel plans; an information provision means for providing weather information, appropriate clothing suggestions, and a packing list before the trip; a local information provision means for providing real-time information on local tourist attractions and restaurants using the user's location information during the trip; a feedback means for conducting a questionnaire after the trip and saving feedback data; a next-trip suggestion means for generating a next travel plan based on the feedback data; and an emotion recognition means for analyzing the user's emotions and optimizing the travel plan. This makes it possible to generate an individually optimized travel plan tailored to the user's preferences, and by providing real-time support during the trip and reflecting post-trip feedback in the next plan, it is possible to increase user satisfaction.

[2203] The "input means" is a means for a user to input information such as the planned travel date and time, destination, travel funds, and areas of interest.

[2204] The "generation means" is a means for automatically generating a travel plan based on input information.

[2205] The "presentation means" is a means for displaying the generated travel plans to the user.

[2206] The "storage means" is a means for saving the travel plan selected by the user.

[2207] The "information providing means" is a means for providing the user with weather information, appropriate clothing suggestions, and a list of items to bring before the trip.

[2208] The "local information providing means" is a means for providing real-time information on local tourist spots and restaurants based on the user's location information while traveling.

[2209] The "feedback means" is a means for providing a questionnaire after a trip and storing feedback data from users.

[2210] The "next travel suggestion means" is a means for generating the next travel plan based on the user's feedback data.

[2211] The "emotion recognition means" is a means for analyzing the user's emotions and optimizing the travel plan.

[2212] The tourism concierge service system of the present invention individually optimizes a user's travel experience and provides consistent support throughout the entire period before, during, and after the trip. The system includes an emotion engine that recognizes the user's emotions and provides an optimal travel plan based on the emotions.

[2213] System Components

[2214] The system consists of the following main components:

[2215] 1. Input Method

[2216] 2. Generation means

[2217] 3. Presentation means

[2218] 4. Preservation means

[2219] 5. Means of providing information

[2220] 6. Local information provision methods

[2221] 7. Feedback channels

[2222] 8. Next proposal method

[2223] 9. Emotion recognition means

[2224] Main hardware and software

[2225] The server plays a central role in generating itineraries and storing and analyzing data. Image and voice analysis software is used for emotion recognition, and generative AI models are used to generate itineraries. Specifically, the server is operated using a high-performance database system and cloud-based AI models (e.g., Google Cloud AI, AWS AI).

[2226] The terminal transmits the information input by the user to the server and presents the information received from the server to the user. Mobile devices such as smartphones and tablets are commonly used as terminals.

[2227] Program processing explanation

[2228] First, the user opens the application and enters their name, email address, and password into the user registration form. This information is sent from the device to the server and stored in a database. Next, an initial setup screen is displayed, where users are asked to enter their planned travel date and time, destination, travel funds, and areas of interest, and this information is also sent to the server.

[2229] The server uses a generative AI model to create multiple travel plans based on user input and external data sources (weather information, local information). The generated plans are organized by category and sent to the device. The user reviews the plans on their device and sends their selected plan and any additional requests to the server. This creates an individually optimized travel plan.

[2230] As the travel date approaches, the server automatically generates weather information, appropriate clothing, and a packing list and sends them to the device. During the trip, the server provides real-time information on local tourist attractions and restaurants based on the user's location information. It also responds to any additional questions or requests via the device's chat function.

[2231] After the trip, the device provides a feedback questionnaire and transmits the user's response data to the server. The server generates a next travel plan based on the feedback data and proposes it through the device. The emotion recognition means analyzes the user's emotions and optimizes the travel plan based on this.

[2232] Specific examples

[2233] For example, if a 25-year-old woman plans a trip to Kyoto, she opens the app and registers as a user by entering her name, email address, and password. Next, she enters the planned travel date and time, Kyoto as the destination, 200,000 yen as the travel budget, and cultural experiences and cafe hopping as her areas of interest. Based on this information, the server generates a travel plan that includes Japanese sweets making experiences, tea ceremony experiences, and sightseeing routes, and presents it to the user through the device. While selecting a travel plan, the device analyzes the user's facial expressions, and if it detects an emotion of joy, it prioritizes and presents that plan.

[2234] The day before the trip, the device notifies her of weather information, appropriate clothing, and a packing list automatically generated by the server. During the trip, real-time information on nearby tourist spots and restaurants is provided based on her location information. After the trip ends, the device displays a feedback survey, which she responds to. Based on the feedback, the server generates a travel plan for her next trip to Kanazawa and notifies the device.

[2235] Prompt Sentence Examples

[2236] Below are some example prompts to input to a generative AI model:

[2237] User information: 25-year-old female, travel destination: Kyoto, budget: 200,000 yen, interests: cultural experiences, cafe hopping

[2238] Overview of the itinerary to generate:

[2239] 1. Japanese sweets making experience

[2240] 2. Tea Ceremony Experience

[2241] 3. Tourist Route (Major temples and historical buildings in the city)

[2242] In this way, the present invention provides users with consistent support before, during, and after their trip, significantly improving the satisfaction of their travel experience.

[2243] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2244] Step 1: User registration and initial setup

[2245] A user opens the application and enters their name, email address, and password into the registration form. This data is then sent from the device to the server, which stores it in a database.

[2246] Next, the initial setting screen is displayed, and the user inputs the planned travel date and time, destination, travel funds, and areas of interest. This input data is also sent from the terminal to the server and saved in the database.

[2247] Input: Name, email address, password, planned travel date and time, destination, travel funds, areas of interest

[2248] Output: User data stored on the server

[2249] Specific operations: application launch, registration form display, data submission, data saving

[2250] Step 2: Generate personalized optimized travel plans

[2251] The server collects external data sources (weather information, local information, etc.) based on the user's input data (travel date and time, destination, travel budget, areas of interest), and inputs the collected data into a generative AI model to generate multiple travel plans.

[2252] The generated plans are organized by category and sent to the terminal by the server. The user reviews the presented travel plans and selects the most suitable one. The selected plan and any additional requests are sent from the terminal to the server and stored in a database.

[2253] Input: User data, external data (weather forecast, local information)

[2254] Output: Generated itinerary, saved selection data

[2255] Specific operations: Data collection, input prompts into the generation AI model, generate a plan, send the plan, confirm with the user, and save the data.

[2256] Step 3: Pre-travel information

[2257] As the travel date approaches, the server generates a list of appropriate clothing and items to bring based on the collected weather information. This information is sent to the device, which then notifies the user. The user can then check the information and prepare for their trip.

[2258] Input: Travel date, weather information

[2259] Output: clothing suggestions, packing list, notified information

[2260] Specific operations: weather information collection, list creation, information transmission, user notification

[2261] Step 4: Travel Support

[2262] The server generates real-time information about local tourist spots and restaurants based on the user's location and time information, and the generated information is sent to the device and displayed to the user immediately.

[2263] Additionally, the device is equipped with a chat function, allowing users to enter additional questions or requests, which are then sent to the server, which then sends the corresponding information back to the device.

[2264] Input: location information, time information, user request

[2265] Output: Tourist attraction information, restaurant information, request response

[2266] Specific actions: location tracking, real-time data generation, information transmission, chat support

[2267] Step 5: Post-trip feedback and suggestions for next time

[2268] After the trip is over, the device displays a feedback questionnaire, and the user answers it. The response data is sent to the server and stored in a database. The server then generates a next travel plan based on the feedback and sends the proposed information to the device.

[2269] Input: Feedback data

[2270] Output: Next travel plan, suggested information

[2271] Specific operations: Displaying surveys, sending data, analyzing feedback, creating plans, sending information

[2272] Step 6: Optimize with emotion recognition

[2273] The server analyzes the user's emotions using emotion recognition. The emotion data is used to optimize the generated travel plan. For example, if the user expresses joy toward a particular plan, the server will prioritize that plan.

[2274] Input: User facial expression data, emotion data

[2275] Output: Optimized itinerary

[2276] Specific operations: facial expression analysis, emotional data collection, plan optimization, priority setting

[2277] (Application example 2)

[2278] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2279] Conventional tourism service systems have difficulty providing travel plans based on users' individual interests and emotions, and have faced challenges in providing real-time information and improving the quality of experiences in virtual spaces. Furthermore, systems that provide consistent support from before, during, and after a trip are lacking. This has resulted in users' travel experiences being partial, making it difficult to improve satisfaction.

[2280] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: input means for inputting the user's travel date and time, destination, budget, and interests; generation means for automatically generating a travel plan based on the input information; presentation means for presenting multiple generated travel plans; storage means for saving a plan selected from the presented travel plans; information provision means for providing weather information, appropriate clothing suggestions, and a packing list before the trip; local information provision means for providing real-time information on local tourist spots and restaurants using the user's location information during the trip; feedback means for conducting a questionnaire after the trip and saving feedback data; next suggestion means for generating a next travel plan based on the feedback data; means including an emotion engine for analyzing emotions from the user's facial expressions and input data; means for suggesting optimal tourist spots and activities in real time based on the emotion data; and means for providing a travel experience in a virtual space. This makes it possible to provide consistent support to users and significantly improve their satisfaction with their travel experience.

[2281] "Input means" refers to a means by which a user inputs travel dates and times, destinations, budgets, and interests.

[2282] The "generation means" is a means for automatically generating a travel plan based on input information.

[2283] The "presentation means" is a means for presenting the generated travel plans to the user.

[2284] The "save means" is a means for saving a plan selected by the user from the travel plans presented.

[2285] "Information providing means" refers to means for providing weather information, appropriate clothing suggestions, and a packing list before a trip.

[2286] The "local information providing means" is a means for providing real-time information on local tourist spots and restaurants using the user's location information while traveling.

[2287] "Feedback means" refers to means for providing a survey after a trip and storing feedback data.

[2288] The "next travel suggestion means" is a means for generating the next travel plan based on the feedback data.

[2289] The "means including an emotion engine" is a means including an engine for analyzing emotions from the user's facial expressions and input data, and providing an optimal travel plan based on the emotions.

[2290] "A means for suggesting optimal tourist spots and activities in real time based on emotional data" refers to a means for suggesting optimal tourist spots and activities to users in real time based on emotional data analyzed by the emotion engine.

[2291] "Means for providing a travel experience in a virtual space" means means for enabling users to experience travel in a virtual space using virtual reality technology.

[2292] To implement the present invention, the following system configuration and processing procedures are required.

[2293] System Configuration

[2294] The system mainly consists of the following components:

[2295] 1. Input method: A method for users to input travel dates and times, destinations, budget, and interests. It works on smartphones or head-mounted displays (HMDs).

[2296] 2. Generation method: A method for automatically generating a travel plan based on input information. This is done using a generative AI model.

[2297] 3. Presentation method: This is the method by which the generated travel plans are presented to the user. They are displayed on a smartphone or HMD display.

[2298] 4. Saving method: A method for saving the plan selected by the user from the presented travel plans.

[2299] 5. Information tools: These tools provide weather information, appropriate clothing suggestions, and packing lists before a trip.

[2300] 6. Local information provision: This is a means of providing real-time information on local tourist spots and restaurants using the user's location information while traveling.

[2301] 7. Feedback channels: A means to provide post-tri...

Claims

1. An input means for inputting the user's travel date and time, destination, budget, and interests; A generation means for automatically generating a travel plan based on input information; a presentation means for presenting a plurality of generated travel plans; a storage means for storing a selected plan from the presented travel plans; A means of providing information before a trip, including weather information, appropriate clothing suggestions, and a packing list; A local information providing means for providing real-time information on local tourist spots and restaurants using the user's location information during the trip; a feedback means for providing a post-trip survey and storing feedback data; a next-time suggestion means for generating a next travel plan based on the feedback data; A system including:

2. The system of claim 1 , further comprising means for automatically generating weather information, appropriate clothing suggestions, and a packing list based on the input information.

3. The system according to claim 1 , further comprising means for analyzing the user's location information and behavior data and reflecting the results in generating a next travel plan.

4. The system of claim 1 further comprising means for providing real-time information on local tourist attractions and restaurants and responding to additional requests from users through a chat function.

5. The system of claim 1 , further comprising means for analyzing the post-trip feedback data and providing next trip planning and local specialty product purchasing information.

Images