System

Abstract

A system is provided.SOLUTION: A system comprising: means for receiving information about travel preferences, budget, travel duration, areas of interest, and locations visited from a user; means for querying a database based on the received information to obtain travel information about the locations visited; means for executing a generation algorithm to generate an optimal travel plan based on the obtained travel information and the received information; and means for transmitting the generated travel plan to the user.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Travel planning involves many options and factors to consider, making it particularly complex when visiting a new destination, and creating a custom itinerary tailored to each traveler's preferences is difficult. Traditional travel agencies and online travel platforms often offer generic package tours, which limits their ability to meet the individual needs of travelers. There is a need to solve these problems and provide the best possible travel experience for each individual traveler. [Means for solving the problem]

[0005] The system includes: means for receiving information on travel preferences, budget, travel period, areas of interest, and places to visit from a user; means for querying a database based on the received information to obtain travel information on the places to visit; means for executing a generation algorithm to generate an optimal travel plan based on the obtained travel information and the received information; and means for sending the generated travel plan to the user. This system allows travelers to enjoy a customized travel experience that perfectly matches their preferences and needs. Furthermore, the generation algorithm can analyze past user data to create a more personalized travel plan.

[0006] "User Information" refers to information about traveler preferences, budget, travel duration, areas of interest, and places to visit.

[0007] "Means of receiving" refers to the function for obtaining information from users via a terminal or network.

[0008] "Means for querying the database" refers to the functionality for searching and retrieving relevant travel information from the database based on collected user information.

[0009] "Travel Information" refers to data such as tourist attractions, accommodation, transportation options, and feedback from past travelers related to a particular destination.

[0010] "Generation algorithm" refers to a calculation method for creating an optimal, individually customized travel plan using acquired travel information and user information.

[0011] "Optimal Travel Plan" refers to a detailed itinerary and activities that are created based on the information and preferences provided by the user, taking into account each element of the trip to the fullest extent possible.

[0012] "Means for sending" refers to the function for providing the generated travel plan to the user via a communication means.

[0013] "Means for displaying" refers to a function for visually presenting the travel plan generated via the terminal to the user.

[0014] "Historical User Data" refers to information, feedback, and travel performance data provided by previous travelers.

[0015] "Customization" refers to the ability to use past and current user data to tailor travel plans to individual needs. [Brief explanation of the drawings]

[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be explained.

[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0024] [First embodiment]

[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0037] The present invention is a system for simplifying travel planning for users and providing individually customized itineraries. The system uses a generation algorithm to generate an optimal travel plan based on information provided by the user, and then provides the plan to the user.

[0038] Program Generation and Processing

[0039] Collection of user information (device)

[0040] The device collects the following information from the user:

[0041] budget

[0042] Travel period

[0043] Areas of interest (e.g. culture, history, food)

[0044] Places visited

[0045] Once the user enters this information, the device sends it to the server.

[0046] Obtaining data based on received information (server)

[0047] The server queries the database based on the user information received from the terminal to obtain travel information such as tourist attractions, accommodation, transportation, and feedback from past travelers about the destination.

[0048] Execution of the generation algorithm (server)

[0049] The server combines the acquired travel information with the information provided by the user and runs a generation algorithm to generate an optimal travel plan. The algorithm analyzes the user's preferences and past traveler data to create a plan that best suits their individual needs.

[0050] Sending the generated travel plan (server)

[0051] The generated travel plan is transmitted from the server to the terminal.

[0052] Display travel plan (device)

[0053] The device displays the received travel plan on the user's screen, allowing the user to check the travel itinerary and activity details.

[0054] Specific examples

[0055] Example 1: Family trip

[0056] A user wants to plan a family trip. The user enters the following information into the device:

[0057] Budget: 500,000 yen

[0058] Travel period: December 1, 2023 to December 10, 2023

[0059] Areas of interest: Culture, history

[0060] Visited: Kyoto

[0061] The device collects this information and sends it to a server. The server queries a database to retrieve information about Kyoto's tourist attractions, accommodations, and events based on past feedback and interests. A generation algorithm analyzes this data and generates a travel plan that is optimized for the user. The generated plan is then sent to the device, where the user can review it.

[0062] Example 2: Business Travel

[0063] Another user wants to plan a business trip. The user enters the following information into the device:

[0064] Budget: 300,000 yen

[0065] Travel period: November 5, 2023 to November 7, 2023

[0066] Areas of interest: Business, Meeting Spaces

[0067] Visited: Tokyo

[0068] The device collects this information and sends it to a server. The server queries a database to retrieve information about hotels, meeting spaces, and transportation options in Tokyo based on past feedback and business needs. A generative algorithm analyzes this data and generates a business travel plan that is optimized for the user. The plan is then sent to the device, where the user can review it.

[0069] This allows users to easily enjoy a personalized travel experience tailored to their preferences and needs.The system's unique feature is that it efficiently performs a series of processes, from collecting user information to running the generation algorithm and providing the final travel plan.

[0070] The processing flow will be explained below.

[0071] Step 1:

[0072] The device presents the user with a travel planning form, into which the user enters the following information:

[0073] budget

[0074] Travel period

[0075] Areas of interest (e.g. culture, history, food)

[0076] Places visited

[0077] Step 2:

[0078] The device collects information entered by the user and sends it to the server. For example, the information is sent in the following format:

[0079] json

[0080] {

[0081] "budget": 500000,

[0082] "travel_period": "2023-12-01 to 2023-12-10",

[0083] "interests": ["culture", "history", "food"],

[0084] "location": "Kyoto"

[0085] }

[0086] Step 3:

[0087] The server receives the user information sent from the device and creates a database query to retrieve the most relevant travel information from the database based on the user's interests and destinations.

[0088] Step 4:

[0089] The server executes the query and retrieves travel information from the database, including tourist destinations, accommodations, transportation options, and feedback from past travelers.

[0090] Step 5:

[0091] The server runs a generation algorithm based on the acquired travel information and user information, which analyzes the user's preferences and past user data to generate a customized, optimal travel plan.

[0092] Step 6:

[0093] The server then sends the generated itinerary to the device, which includes details such as a daily schedule, recommended sightseeing spots, accommodations, and transportation options.

[0094] Step 7:

[0095] The device receives the travel plan sent from the server and displays it on the user's screen, allowing the user to check the details of the travel plan and fine-tune the plan.

[0096] For example, if a user is planning a family trip, they can go through steps 1 to 7 to get a trip plan that perfectly suits their needs. For example, based on the information they enter, the device will display the following trip plan:

[0097] Travel period: 2023-12-01 to 2023-12-10

[0098] Budget: 500,000 yen

[0099] Visited: Kyoto

[0100] Day 1: Kiyomizu-dera Temple - Visit the historic building followed by a meal at a local restaurant.

[0101] Day 2: Ginkakuji Temple - After sightseeing, take a break at a traditional teahouse.

[0102] ...

[0103] Accommodation: XYZ Hotel

[0104] Transportation: Train, bus

[0105] This detailed flow provides an optimized itinerary generated from the user's input, greatly simplifying travel preparation.

[0106] Example 1

[0107] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0108] Modern travel planning is complex, requiring the collection and organization of a large amount of information. Users must manually research information using numerous websites and applications, which takes time and effort. Furthermore, it can be difficult to find the optimal travel plan that meets a user's individual preferences and budget. The present invention aims to eliminate the complexity of travel planning and provide users with a simple, personalized travel plan.

[0109] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0110] In this invention, the server includes means for receiving information on travel preferences, budget, travel period, areas of interest, and places to visit from a user, means for querying a database based on the received information to obtain travel information on the places to visit, means for executing a generation algorithm to generate an optimal travel plan based on the obtained travel information and the received information, means for transmitting the generated travel plan to the user, means for the terminal to compile the information collected from the user into a single data packet and transmit it to the server, means for the server to analyze the received information and execute a query to obtain the necessary travel information from the database, means for converting the generated travel plan into JSON format and transmitting it to the terminal, and means for displaying the received travel plan to the user in an easy-to-read format. This allows users to easily obtain an optimal travel plan based on their preferences and needs and efficiently plan their trip.

[0111] "User" means any individual or group of people who use the System to plan their travel.

[0112] "Server" refers to a computer system that receives information sent by a user, processes the information, generates an optimal travel plan, and sends it to a terminal.

[0113] "Terminal" refers to the device (e.g., smartphone, tablet, or PC) through which a user inputs information and displays the travel plan received from the server.

[0114] "Budget" refers to the amount of money a user sets for travel expenses.

[0115] "Travel Period" refers to the period from the start date to the end date of a User's trip.

[0116] "Areas of Interest" refers to activities or themes (e.g., culture, history, food) that a user is particularly interested in while traveling.

[0117] "Destination" means a geographic location selected by a User for travel planning purposes.

[0118] "Database" refers to a collection of data that the server queries to obtain a user's travel information.

[0119] "Generation algorithm" refers to a calculation method for generating the optimal travel plan for a user based on the information received and the travel information acquired.

[0120] "Travel Plan" means a detailed plan, including the overall schedule and suggested activities, for your trip.

[0121] "Data Packet" refers to the formatted unit of data used to transmit information collected from a user to a server.

[0122] A "query" refers to a query command that is executed to retrieve information from a database.

[0123] "JSON format" stands for JavaScript Object Notation and refers to a common format used to store and transfer data in a structured manner.

[0124] "User Information" means all data provided by a User to the System for the purposes of planning a trip (e.g., budget, duration of trip, areas of interest, places to visit).

[0125] The present invention is a system for simplifying travel planning for users and providing individually customized itineraries. The system uses a generation algorithm to generate an optimal travel plan based on information provided by the user, and then provides the plan to the user.

[0126] The system primarily consists of the following hardware and software components:

[0127] Device (e.g. smartphone, tablet, PC)

[0128] Server (cloud computing environment)

[0129] Database systems (e.g., SQL databases)

[0130] Generative algorithms (e.g., AI models)

[0131] First, the user uses the device to enter information about their trip, including budget, travel duration, areas of interest, and places to visit. The user enters this information through the device's interface and presses the send button.

[0132] The device collects information from the user and sends it to the server, which then parses it into JSON format data. The server then queries a database based on the user information to retrieve travel information about the destination, including tourist attractions, accommodations, transportation options, and feedback from past travelers.

[0133] The server combines the acquired travel information with the information provided by the user and runs a generation algorithm that analyzes the user's preferences and past traveler data to generate a travel plan that best suits their individual needs. The generated itinerary is then converted back to JSON format and sent from the server to the device.

[0134] The device displays the received travel plan on the user's screen, allowing the user to review the travel itinerary and activity details, and the user can review the displayed plan and make adjustments or changes as necessary.

[0135] Specific examples

[0136] Example 1: Family trip

[0137] The user enters the following information into the device for a family trip:

[0138] Budget: 500,000 yen

[0139] Travel period: December 1, 2023 to December 10, 2023

[0140] Areas of interest: Culture, history

[0141] Visited: Kyoto

[0142] "Please create a travel plan for Kyoto with a budget of 500,000 yen from December 1st to December 10th that focuses on culture and history."

[0143] The device collects this information and sends it to a server. The server queries a database to obtain Kyoto's tourist attractions (e.g., Kiyomizu-dera Temple, Kinkaku-ji Temple), accommodations, event information, etc. A generation algorithm analyzes this data and generates an optimal travel plan for the user. The generated travel plan is then sent to the device, where the user can review it.

[0144] Example 2: Business Travel

[0145] Another user enters the following information into the device for a business trip:

[0146] Budget: 300,000 yen

[0147] Travel period: November 5, 2023 to November 7, 2023

[0148] Areas of interest: Business, Meeting Spaces

[0149] Visited: Tokyo

[0150] "Please create a travel plan for Tokyo with a budget of 300,000 yen from November 5th to November 7th, with an interest in business and meeting space."

[0151] The device sends this information to a server, which queries a database to obtain information on business hotels, meeting spaces, and transportation options in Tokyo. A generation algorithm analyzes this data and generates an optimal business travel plan. The plan is then sent to the device, where the user can review it.

[0152] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0153] Step 1:

[0154] Collection of user information (device)

[0155] Description: The terminal displays a form that allows the user to enter their travel plans. The form includes fields for budget, travel duration, areas of interest, and places to visit.

[0156] Input: The user enters information about their travel preferences, budget, travel duration, areas of interest, and places to visit.

[0157] Output: The information entered by the user is saved on the device.

[0158] Specific operation: The user enters "500,000 yen" as the budget, "December 1, 2023 to December 10, 2023" as the travel period, "culture" and "history" as areas of interest, and "Kyoto" as the place to visit on the device screen.

[0159] Step 2:

[0160] Sending information (terminal)

[0161] Description: When a user enters information and presses the submit button, the device assembles the information into a single JSON-formatted data packet, which is then sent to the server via an HTTP request.

[0162] Input: Travel information entered by the user into the device.

[0163] Output: Trip information data packet sent from the device to the server.

[0164] Specific operation: The device sends the following JSON data to the server:

[0165] json

[0166] {

[0167] "budget": 500000,

[0168] "travel_period": "2023-12-01 to 2023-12-10",

[0169] "interests": ["culture", "history"],

[0170] "destination": "Kyoto"

[0171] }

[0172] Step 3:

[0173] Data acquisition (server)

[0174] Description: The server parses the received JSON data and extracts the user information. It then queries the database to get information about the places visited, such as tourist attractions, accommodation, transportation options, and feedback from past travelers.

[0175] Input: User's travel information sent from the device.

[0176] Output: Travel information such as tourist attractions, accommodation, transportation, and feedback retrieved from the database.

[0177] What happens: The server executes the following SQL query:

[0178] sql

[0179] SELECT FROM TouristAttractions WHERE location = 'Kyoto';

[0180] SELECT FROM Hotels WHERE location = 'Kyoto';

[0181] SELECT FROM Transportation WHERE location = 'Kyoto';

[0182] SELECT FROM Feedback WHERE location = 'Kyoto';

[0183] Step 4:

[0184] Execution of the generation algorithm (server)

[0185] Description: The server runs a generation algorithm based on the data it receives. This algorithm takes into account user preferences and past traveller data to generate an optimal travel plan.

[0186] Input: Trip information retrieved from the database and information provided by the user.

[0187] Output: The generated optimal travel plan.

[0188] What it does: The generation algorithm does the following:

[0189] 1. Select a tourist destination based on your area of ​​interest.

[0190] 2. Make a list of accommodations that fit within your budget.

[0191] 3. Display available transportation options for travel.

[0192] 4. Create a schedule based on this information.

[0193] Step 5:

[0194] Sending the generated plan (server)

[0195] Description: The generated travel plan is converted to JSON format and sent from the server to the terminal as an HTTP response.

[0196] Input: The generated itinerary.

[0197] Output: JSON data of the travel plan sent from the server to the device.

[0198] Specific operation: The server sends the following JSON data to the terminal:

[0199] json

[0200] {

[0201] "itinerary": [

[0202] {

[0203] "date": "2023-12-01",

[0204] "activities": [

[0205] {

[0206] "time": "10:00",

[0207] "activity": "Visit Kiyomizu Temple"

[0208] },

[0209] {

[0210] "time": "14:00",

[0211] "activity": "Lunch at local restaurant"

[0212] }

[0213] ]

[0214] },

[0215] / / The travel itinerary continues below...

[0216] ],

[0217] "accommodations": [

[0218] {

[0219] "name": "Kyoto Hotel",

[0220] "check_in": "2023-12-01",

[0221] "check_out": "2023-12-10"

[0222] }

[0223] ],

[0224] "transportation": [

[0225] {

[0226] "type": "Shinkansen",

[0227] "from": "Tokyo",

[0228] "to": "Kyoto",

[0229] "departure": "2023-12-01 08:00"

[0230] }

[0231]

[0232] }

[0233] Step 6:

[0234] Display the travel plan (on the terminal)

[0235] Description: The terminal parses the received travel plan JSON data and displays it on the screen in a user-friendly format. The user can view the schedule, accommodation information, and details of the means of transportation.

[0236] Input: JSON data of the travel plan sent from the server.

[0237] Output: The travel plan displayed to the user.

[0238] Specific operation: The terminal generates the following HTML and displays it in the browser:

[0239] html

[0240] <h1> Travel Planner< / h1>

[0241] <h2>2023-12-01< / h2>

[0242]

[0243] 10:00 - Visit Kiyomizu Temple

[0244] 14:00 - Lunch at local restaurant

[0245]

[0246] <!-- The following is the continuation of the travel schedule... -->

[0247] <h2> Accommodation Information< / h2>

[0248] Kyoto Hotel (Check-in: 2023-12-01, Check-out: 2023-12-10)

[0249] ​<h2> means of transportation< / h2>

[0250] Shinkansen (Tokyo to Kyoto, Departure: 2023-12-01 08:00)

[0251] (Application example 1)

[0252] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0253] Conventional travel planning systems generate customized itineraries based on user-provided information, but the display methods are limited, making it difficult for users to visually understand what kind of trip they will actually experience. Furthermore, it is difficult to provide real-time feedback or review the itinerary, resulting in a poor user experience.

[0254] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0255] In this invention, the server includes means for receiving information on travel preferences, budget, travel period, areas of interest, and places to visit from a user, means for querying a database based on the received information to obtain travel information on the places to visit, means for executing a generation algorithm to generate an optimal travel plan based on the obtained travel information and the received information, and means for displaying the generated travel plan in real time to provide virtual tour options, thereby allowing the user to visually check the customized travel plan in real time and easily consider travel details.

[0256] "User Information" means information provided by a User regarding travel preferences, budget, travel duration, areas of interest, and places to visit.

[0257] A "database" is a collection of information including travel information such as tourist attractions, accommodation, transportation options, and feedback from past travelers about the destinations visited.

[0258] A "generation algorithm" is a calculation method for generating optimal travel plans based on acquired travel information and user information.

[0259] A "virtual tour" is an online simulation that provides users with a visual and interactive travel experience of the places they plan to visit.

[0260] "Real-time" refers to the time period in which data processing and information provision are carried out immediately.

[0261] "Travel Plan" means a detailed plan of places to visit, attractions, accommodations, and transportation that is customized based on information provided by a User.

[0262] "User experience" refers to the ease of use and satisfaction that users feel when using a system.

[0263] A "server" is a computer system that processes data, receives user information, and generates and provides travel plans.

[0264] The present invention is a system that simplifies user travel planning and provides personalized itineraries. The system collects user information, runs a generation algorithm to generate an optimal itinerary, and provides a virtual tour experience.

[0265] System Configuration

[0266] The system uses the following hardware and software:

[0267] Hardware

[0268] Smartphone (iOS or Android)

[0269] Server (cloud server, e.g. AWS, Google Cloud)

[0270] software

[0271] Smartphone applications (e.g., Swift, Kotlin)

[0272] Server-side applications (e.g., Node.js, Python)

[0273] Database (e.g. PostgreSQL, MongoDB)

[0274] Generative AI models (e.g., GPT-4)

[0275] Processing flow

[0276] 1. Collection of User Information

[0277] Users enter information such as budget, travel duration, areas of interest, and places to visit through a smartphone application.

[0278] The smartphone application sends this information to a server.

[0279] 2. Database Queries

[0280] Based on the received user information, the server queries the database to obtain travel information such as tourist attractions, accommodation, transportation options, and feedback from past travelers regarding the destination.

[0281] 3. Executing the generation algorithm

[0282] The server combines the acquired travel information with the information provided by the user and generates an optimal travel plan using a generative AI model (e.g., GPT-4).

[0283] 4. Providing travel plans

[0284] The generated travel plan is sent from the server to the smartphone application.

[0285] The smartphone application displays the received itinerary to the user and offers the option of a virtual tour.

[0286] Example

[0287] For example, a user enters the following information into a smartphone application for a family trip:

[0288] Budget: 500,000 yen

[0289] Travel period: December 1, 2023 to December 10, 2023

[0290] Areas of interest: Culture, history

[0291] Visited: Kyoto

[0292] The server queries the database to obtain information such as Kyoto's tourist attractions, accommodations, transportation options, and feedback from past travelers. A generative algorithm (e.g., GPT-4) analyzes this data and generates an optimal travel plan. This plan is provided to the user in the form of a virtual tour, allowing them to visually check the plan details in real time.

[0293] Prompt Sentence Examples

[0294] User Information:

[0295] Budget: 500,000 yen

[0296] Travel period: December 1, 2023 to December 10, 2023

[0297] Areas of interest: Culture, history

[0298] Visited: Kyoto

[0299] Acquired data:

[0300] Tourist attractions: Kiyomizu-dera Temple, Fushimi Inari Shrine, Ginkaku-ji Temple

[0301] Accommodation: Hotel Okura, Kyoto Century Hotel, Granvia

[0302] Transportation: City bus, subway

[0303] Past traveller feedback: Highly rated attractions

[0304] prompt:

[0305] Use this information to optimize your users' travel plans and generate customized itineraries.

[0306] The above is an embodiment of the present invention, which allows users to conveniently enjoy a personalized travel experience that is tailored to their preferences and needs.

[0307] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0308] Step 1:

[0309] The user enters information such as budget, travel duration, areas of interest, and places to visit into the smartphone application. The device then sends the data to the server. Specifically, the user enters their travel information into the application form and presses the submit button. The transmitted data is received by the server in JSON format.

[0310] Step 2:

[0311] The server queries the database based on the received user information to retrieve travel information such as tourist attractions, accommodations, transportation options, and feedback from past travelers about the destination. The queried data is retrieved by filtering information that matches specific keywords or conditions. The input is the user's travel information, and the output is the retrieved travel-related data.

[0312] Step 3:

[0313] The server integrates the acquired travel information with information from the user and generates an optimal travel plan using a generative AI model (GPT-4). Specifically, it selects the dates and places to visit that best suit the user's preferences and travel conditions, and creates a detailed plan. The input here is the travel information acquired in Step 2 and user information, and the output is the generated travel plan.

[0314] Step 4:

[0315] The generated itinerary is sent from the server to a smartphone application. The device displays the received itinerary, allowing the user to review each item of the itinerary (such as accommodation, sightseeing spots, and transportation) in detail. Specifically, the application displays each section of the plan in an easy-to-read format, allowing the user to scroll through the plan.

[0316] Step 5:

[0317] The device provides a virtual tour option, and the user selects the virtual tour and starts the simulation. For example, when the user selects the virtual tour mode displayed on the device, an interactive map and 3D visuals are displayed, allowing the user to experience a virtual trip.

[0318] The above are the specific processing steps for carrying out the present invention, which allow the user to visually check the customized travel plan in real time and consider the details of the trip.

[0319] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0320] The present invention is a system for maximizing the customization of a user's travel experience and providing real-time emotional feedback. The system generates and provides optimal travel plans by combining user input, travel information from a database, a generation algorithm, and an emotion engine.

[0321] Program Generation and Processing

[0322] Collection of user information (device)

[0323] The device collects the following information from the user:

[0324] budget

[0325] Travel period

[0326] Areas of interest (e.g. culture, history, food)

[0327] Places visited

[0328] Once the user enters this information, the device sends it to the server.

[0329] Obtaining data based on received information (server)

[0330] The server queries the database based on the user information received from the terminal to obtain travel information such as tourist attractions, accommodation, transportation, and feedback from past travelers about the destination.

[0331] Execution of the generation algorithm (server)

[0332] The server combines the acquired travel information with the information provided by the user and runs a generation algorithm to generate an optimal travel plan. This algorithm analyzes the user's preferences and past user data to create a plan that best suits their individual needs.

[0333] Utilizing emotion engine (server)

[0334] The server uses an emotion engine to recognize the user's emotions. The emotion engine analyzes the user's voice and facial expression data to understand the user's current emotional state.

[0335] Travel plan adjustment (server)

[0336] The emotion engine recognizes the user's emotions and re-runs the generation algorithm to adjust the itinerary in real time. For example, if the user expresses dissatisfaction with the itinerary, the itinerary will be changed to reflect the user's preferences.

[0337] Sending the generated travel plan (server)

[0338] The generated itinerary is sent from the server to the device, and includes details such as a daily schedule, recommended sightseeing spots, accommodations, and transportation options.

[0339] Display travel plan (device)

[0340] The device displays the received travel plan on the user's screen, allowing them to check the trip itinerary and activity details, and provides real-time feedback based on the user's emotional state.

[0341] Specific examples

[0342] Example 1: Family trip

[0343] A user wants to plan a family trip. The user enters the following information into the device:

[0344] Budget: 500,000 yen

[0345] Travel period: December 1, 2023 to December 10, 2023

[0346] Areas of interest: Culture, history

[0347] Visited: Kyoto

[0348] The device collects this information and sends it to a server. The server queries a database to obtain information on Kyoto's tourist attractions, accommodations, and events. A generation algorithm analyzes this data and generates an optimal travel plan for the user. Furthermore, an emotion engine analyzes the user's emotions and adjusts the plan in real time if the plan is deemed unsatisfactory. The generated travel plan is then sent to the device, where the user can view it.

[0349] Example 2: Business Travel

[0350] Another user wants to plan a business trip. The user enters the following information into the device:

[0351] Budget: 300,000 yen

[0352] Travel period: November 5, 2023 to November 7, 2023

[0353] Areas of interest: Business, Meeting Spaces

[0354] Visited: Tokyo

[0355] The device collects this information and sends it to a server. The server queries a database to obtain information on hotels, meeting spaces, and transportation options in Tokyo. A generation algorithm analyzes this data and generates a business travel plan that is optimal for the user. Furthermore, an emotion engine analyzes the user's emotions and adjusts the plan in real time if the plan is deemed unsatisfactory. The generated plan is then sent to the device, where the user can review it.

[0356] This allows users to easily enjoy a personalized travel experience tailored to their preferences and needs.The system's unique feature is that it efficiently performs a series of processes, from collecting user information, running a generation algorithm, providing real-time feedback using an emotion engine, and finally providing a final travel plan.

[0357] The processing flow will be explained below.

[0358] Step 1:

[0359] The device presents the user with a travel planning form, into which the user enters the following information:

[0360] budget

[0361] Travel period

[0362] Areas of interest (e.g. culture, history, food)

[0363] Places visited

[0364] Step 2:

[0365] The device collects information entered by the user and sends it to the server. For example, the information is sent in the following format:

[0366] json

[0367] {

[0368] "budget": 500000,

[0369] "travel_period": "2023-12-01 to 2023-12-10",

[0370] "interests": ["culture", "history", "food"],

[0371] "location": "Kyoto"

[0372] }

[0373] Step 3:

[0374] The server receives the user information sent from the device and creates a database query to retrieve the most relevant travel information from the database based on the user's interests and destinations.

[0375] Step 4:

[0376] The server executes the query and retrieves travel information from the database, including tourist destinations, accommodations, transportation options, and feedback from past travelers.

[0377] Step 5:

[0378] The server runs a generation algorithm based on the acquired travel information and user information, which analyzes the user's preferences and past user data to generate a customized, optimal travel plan.

[0379] Step 6:

[0380] Before sending the generated travel plan to the user, the server recognizes the user's emotions using an emotion engine, which analyzes the user's voice data and facial expression data in real time to understand the user's emotional state.

[0381] Step 7:

[0382] The server evaluates whether the generated itinerary meets the user's expectations based on the analysis results of the emotion engine. If the user expresses dissatisfaction, the generation algorithm is run again and the itinerary is adjusted.

[0383] Step 8:

[0384] The server then sends the final itinerary to the device, which includes details such as daily schedules, recommended sightseeing spots, accommodations, and transportation options.

[0385] Step 9:

[0386] The device receives the travel plan sent from the server and displays it on the user's screen, allowing the user to check the details of the travel plan and fine-tune the plan.

[0387] For example, if a user plans a family trip, they can go through steps 1 to 9 to get a trip plan that perfectly suits their needs. For example, based on the information they enter, the device will display the following trip plan:

[0388] Travel period: 2023-12-01 to 2023-12-10

[0389] Budget: 500,000 yen

[0390] Visited: Kyoto

[0391] Day 1: Kiyomizu-dera Temple - Visit the historic building followed by a meal at a local restaurant.

[0392] Day 2: Ginkakuji Temple - After sightseeing, take a break at a traditional teahouse.

[0393] ...

[0394] Accommodation: XYZ Hotel

[0395] Transportation: Train, bus

[0396] For business travel, the same steps are followed to provide users with the best business travel plan, which incorporates real-time feedback from the user's emotion engine, allowing users to adjust the plan on the fly.

[0397] Example 2

[0398] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0399] Modern travelers have very diverse needs and preferences, and there is a lack of systems that can automatically generate travel plans that comprehensively satisfy these. It is also difficult to adjust plans to reflect real-time emotions and feedback during the trip. For this reason, current systems have difficulty providing users with a satisfying travel experience.

[0400] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for collecting user information, means for querying a database based on the received information to obtain travel information, means for executing a generative model based on the obtained information to generate an optimal travel plan, means for recognizing the user's emotional state and adjusting the travel plan in real time, and means for transmitting the generated travel plan to the user. This makes it possible to provide a highly customized travel plan that reflects the user's individual needs in real time.

[0401] "User" refers to an individual or organization that uses the System to generate travel plans.

[0402] "Travel preferences" are criteria for selecting a travel destination based on a user's interests and concerns, including specific areas such as culture, history, and food.

[0403] "Budget" means the range of amounts a User is willing to spend for the entire trip.

[0404] "Travel Period" refers to the time range from the start date to the end date for which a User plans to travel.

[0405] A "visited location" is a geographic location selected by a user as a travel destination.

[0406] "Database" refers to an information system that stores travel information in response to user requests and makes it searchable through queries.

[0407] A "generative model" is a type of algorithm or AI technology that generates optimal travel plans based on user input information and data obtained from a database.

[0408] "Emotional state" refers to the user's current psychological state and mood, which can be obtained by analyzing the user's voice and facial expression data.

[0409] "Travel information" includes various data related to travel, such as tourist destinations, accommodation, transportation, and feedback from past travelers.

[0410] "Real-time" refers to processing timing that is conscious of immediately reflecting the user's current behavior and emotions.

[0411] "Travel Plan" means a specific plan including travel dates, places to visit, accommodation, transportation, etc., customized according to the User's requirements and preferences.

[0412] "Generating means" refers to the hardware or software functionality used by the system to automatically generate a travel plan.

[0413] "Transmission Means" means the communications technology or protocol used to transmit the generated itinerary to the user.

[0414] "Means for displaying" refers to an interface that allows a user to view the generated travel plan on the screen of the terminal.

[0415] This invention is a system for maximizing the customization of a user's travel experience and providing real-time emotional feedback. The system generates and provides optimal travel plans by combining user input, travel information from a database, a generative model, and an emotion engine.

[0416] Collection of user information (device)

[0417] The device collects information from the user about travel preferences, budget, travel duration, areas of interest, and places to visit. Once the user enters this information, the device transmits the information to a server. The device can be a mobile device such as a tablet or smartphone.

[0418] Obtaining data based on received information (server)

[0419] The server analyzes the user information received from the device and queries a database based on that information. The database stores travel information such as tourist spots, accommodations, transportation options, and feedback from past travelers. The database is managed using a relational database such as MySQL or PostgreSQL.

[0420] Execution of the generative model (server)

[0421] The server combines the acquired travel information with the information provided by the user and runs a generative model to generate an optimal travel plan. This generative model uses a generative AI model such as GPT-4. The generative model generates the optimal travel plan via a prompt sentence.

[0422] Prompt Sentence Examples

[0423] "Create a travel plan for a family trip to Kyoto from December 1, 2023 to December 10, 2023 with a budget of 500,000 yen. Your areas of interest are culture and history. Your itinerary should include details of recommended tourist attractions, accommodation, and transportation, and take into account feedback based on the user's emotional state."

[0424] Utilizing emotion engine (server)

[0425] The server analyzes voice and facial expression data to understand the user's emotional state. For example, it uses emotion recognition services such as Microsoft Azure's Emotion Recognition API and Amazon Rekognition. Based on the results of the user's emotion analysis, real-time adjustments to the travel plan are made.

[0426] Travel plan adjustment (server)

[0427] The emotional state data obtained from the emotion engine is compared with the travel plan, and if it is determined that the user is dissatisfied, the generative model is re-run to adjust the travel plan, thereby generating an optimal travel plan that is in line with the user's emotional state.

[0428] Sending the generated travel plan (server)

[0429] The final itinerary is then sent from the server to the device using a secure communication protocol such as HTTPS. After sending, an error check is performed to ensure the data was sent correctly.

[0430] Display travel plan (device)

[0431] The device receives the travel plan from the server and displays it on the user's screen, including a daily schedule, recommended sightseeing spots, accommodations, and transportation options. The screen also features real-time feedback, allowing additional adjustments to be made immediately based on the user's emotional state.

[0432] This allows users to easily enjoy a personalized travel experience that is tailored to their preferences and needs, and further enhances their satisfaction during their trip by providing real-time emotional feedback.

[0433] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0434] Step 1: Collecting user information (device)

[0435] The terminal receives input from the user regarding travel preferences, budget, travel duration, areas of interest, and places to visit. Specifically, the terminal provides an interface into which the user can input information, and once the information is entered, it formats the data and sends it to the server. The input information includes budget (e.g., 500,000 yen), travel duration (e.g., December 1, 2023 to December 10, 2023), areas of interest (e.g., culture, history), and places to visit (e.g., Kyoto). This data is sent to the server.

[0436] Step 2: Retrieving data based on received information (server)

[0437] The server analyzes the user information received from the device as input and queries the database based on that information to obtain travel information. Specifically, the server executes an SQL query such as "SELECT FROM TravelData WHERE Location = 'Kyoto'" and obtains travel information (e.g., a list of tourist attractions and accommodations) from the database as output. The obtained data is stored in internal storage.

[0438] Step 3: Execute the generative model (server)

[0439] The server combines the acquired travel information with the information provided by the user as input, runs the generative model using the prompt sentence, and generates the optimal travel plan. Specifically, the server inputs the following prompt sentence into the generative AI model (e.g., GPT-4):

[0440] "Create a travel plan for a family trip to Kyoto from December 1, 2023 to December 10, 2023 with a budget of 500,000 yen. Your areas of interest are culture and history. Your itinerary should include details of recommended tourist attractions, accommodation, and transportation, and take into account feedback based on the user's emotional state."

[0441] The generated itinerary is obtained as output and is temporarily saved.

[0442] Step 4: Utilizing the Emotion Engine (Server)

[0443] The server receives voice and facial expression data from the device as input to understand the user's emotional state. Specifically, the device captures the user's voice and facial expressions and sends them to the server. The server then uses emotion recognition services such as the Microsoft Azure Emotion Recognition API and Amazon Rekognition to analyze the emotional state and obtain emotional data as output. This data is stored in the internal storage.

[0444] Step 5: Adjusting Travel Plans (Server)

[0445] The server analyzes the emotion data obtained from the emotion engine and the existing travel plan as input. Specifically, if the server recognizes that the user's emotion is dissatisfied, it re-runs the generative model and readjusts the travel plan based on the new prompt. The regenerated travel plan is saved as output.

[0446] Step 6: Sending the generated travel plan (server)

[0447] The server takes the final generated travel plan as input and sends it to the terminal. Specifically, the server sends the travel plan to the terminal using a secure communication protocol such as "HTTPS." After sending, an error check is performed to confirm that the data was sent correctly. The transmission result is obtained as output.

[0448] Step 7: View your travel plans (device)

[0449] The terminal takes the travel plan received from the server as input, analyzes it, and displays it on the user's screen. Specifically, the terminal displays the travel plan's daily schedule, recommended tourist spots, accommodations, transportation options, etc., and also provides real-time feedback based on the user's emotional state. The user can review the travel plan and select the next action based on its contents. The travel plan is displayed to the user as output.

[0450] (Application example 2)

[0451] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0452] Current travel planning systems have difficulty adjusting travel plans based on users' individual preferences and real-time changing emotions, which can lead to a decline in the quality and satisfaction of the travel experience. Furthermore, the lack of customization and real-time adjustment of travel plans makes it difficult to meet the diverse needs of users.

[0453] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for receiving information on travel preferences, budget, travel period, areas of interest, and places to visit from a user; means for querying a database based on the received information and acquiring travel information on the places to visit; means for executing a generation algorithm to generate an optimal travel plan based on the acquired travel information and the received information; means for sending the generated travel plan to the user; means for analyzing the user's emotional state and adjusting the travel plan in real time; and means for virtually displaying the adjusted travel plan on a visual device. This enables customization of the travel plan and further allows the plan to be adjusted according to the user's real-time emotional state, thereby improving the quality and satisfaction of the travel experience.

[0454] "Means for receiving information from the user regarding travel preferences, budget, travel duration, areas of interest, and places to visit" refers to an interface through which the user can input various information necessary for travel planning and through which the system collects that information.

[0455] "Means for querying a database based on the received information to obtain travel information related to the destination" refers to the process of searching and extracting appropriate travel information from a database based on the information provided by the user.

[0456] "Means for executing a generation algorithm to generate an optimal travel plan based on the acquired travel information and received information" refers to a function that executes an algorithm that combines and analyzes user-entered information and travel information acquired from the database to create an optimal travel plan.

[0457] The "means for transmitting the generated travel plan to the user" is a communication function for transmitting the generated travel plan to the user's terminal so that the user can access it.

[0458] "Means for analyzing the user's emotional state and adjusting travel plans in real time" refers to a function that analyzes the user's emotional data to understand the user's current emotional state and adjusts travel plans accordingly in real time.

[0459] "Means for virtually displaying the adjusted travel plan on a visual device" refers to a function that visually displays the adjusted travel plan on a visual device used by the user, such as a smartphone or head-mounted display.

[0460] To implement the present invention, the following system configuration and procedure are used.

[0461] User Information Collection:

[0462] The user uses a device such as a smartphone or head-mounted display to input information about their travel preferences, budget, travel period, areas of interest, and places to visit. A user interface is used to set up an appropriate form to collect the user's input. For example, a specific prompt sentence such as "I am planning a business trip to Tokyo from November 5, 2023 to November 7, 2023. My budget is 300,000 yen. Please tell me the optimal travel plan, including information about meeting spaces." is input.

[0463] Database queries and information retrieval:

[0464] The server receives the user information from the device and queries the database to retrieve travel information such as tourist attractions, accommodations, transportation options, and user reviews for the destination. This query uses an efficient search algorithm to explore the extensive database.

[0465] Run the generation algorithm:

[0466] The server combines the acquired travel information with the information provided by the user and runs a generative algorithm to generate an optimal travel plan. The algorithm uses machine learning technology to provide personalized plans based on past user data. A specific generative AI model is used to generate the plan, providing content that best suits the user's characteristics.

[0467] Leveraging the Emotion Engine:

[0468] The server uses an emotion engine to analyze the user's emotional state. This emotion analysis is performed by collecting the user's voice and facial expression data in real time and evaluating their psychological state. For example, if the user is dissatisfied with the travel plan, the analysis result will be determined as unsatisfactory. Based on this information, the server re-runs the generation algorithm and adjusts the plan.

[0469] Adjust and view your travel plans:

[0470] The server then sends the adjusted itinerary to the user's visual device, where the user can view the itinerary in real time via a smartphone, head-mounted display, or other device, including detailed itinerary and recommended sightseeing spots, accommodations, and transportation options.

[0471] Hardware and software used:

[0472] Hardware: Smartphones, smart glasses, head-mounted displays

[0473] Software: Python, Emotion Engine API, Travel Data API, Travel Plan Generator API, Device Interface Module

[0474] The system allows users to view and adjust their travel plans in real time according to their preferences and needs, significantly improving the quality of their travel experience. Utilizing artificial intelligence models and prompts, it can provide a more personalized experience, increasing user satisfaction.

[0475] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0476] Step 1:

[0477] The user uses a device such as a smartphone or head-mounted display to input information about their travel preferences, budget, travel duration, areas of interest, and places to visit. This information is collected through a user interface. Specifically, the user enters a prompt such as, "I am planning a business trip to Tokyo from November 5, 2023 to November 7, 2023. My budget is 300,000 yen. Please tell me the optimal travel plan, including information about meeting spaces." The input information is sent to the server as structured data in JSON format, etc. The input is user information data, and the output is the user input data sent to the server.

[0478] Step 2:

[0479] The server queries the database based on the user information received from the device to obtain travel information related to the relevant destinations. This query operation includes tourist destination information, accommodation information, transportation information, and user reviews. The input is user input data, and the output is travel information data. Information is efficiently extracted from large databases using SQL and various APIs.

[0480] Step 3:

[0481] The server combines the acquired travel information with information provided by the user and executes a generation algorithm. This generation algorithm references past user data and similar travel plans and uses machine learning technology to generate the optimal travel plan. Specifically, it uses Python and machine learning libraries (such as TensorFlow and PyTorch). The inputs are user input data and travel information data, and the output is the optimal travel plan data.

[0482] Step 4:

[0483] The server adjusts the generated travel plan based on the results of the user's emotion analysis. The emotion engine analyzes the user's voice data and facial expression data to understand their current emotional state. This analysis uses the Emotion Engine API and voice and image processing technology. The input is the generated travel plan data and emotion data, and the output is the adjusted travel plan data. If the user is deemed dissatisfied, the server executes a process to automatically generate a new plan or modify the existing plan.

[0484] Step 5:

[0485] The server generates data for a virtual display of the adjusted itinerary on a visual device and sends it to the user's terminal. The terminal receives the data and displays it so that the user can visually check the itinerary. The display format is adapted to the smartphone application screen or head-mounted display. The input is the adjusted itinerary data, and the output is the display data of the terminal. The travel itinerary, recommended sightseeing spots, accommodations, and transportation methods are displayed in detail on the terminal screen.

[0486] Through this series of processes, users can check and enjoy the optimal travel plan based on their preferences and real-time emotional state.

[0487] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0488] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0489] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0490] [Second embodiment]

[0491] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0492] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0493] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0494] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0495] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0496] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0497] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0498] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0499] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0500] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0501] In the smart glasses 214, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0502] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0503] The present invention is a system for simplifying travel planning for users and providing individually customized itineraries. The system uses a generation algorithm to generate an optimal travel plan based on information provided by the user, and then provides the plan to the user.

[0504] Program Generation and Processing

[0505] Collection of user information (device)

[0506] The device collects the following information from the user:

[0507] budget

[0508] Travel period

[0509] Areas of interest (e.g. culture, history, food)

[0510] Places visited

[0511] Once the user enters this information, the device sends it to the server.

[0512] Obtaining data based on received information (server)

[0513] The server queries the database based on the user information received from the terminal to obtain travel information such as tourist attractions, accommodation, transportation, and feedback from past travelers about the destination.

[0514] Execution of the generation algorithm (server)

[0515] The server combines the acquired travel information with the information provided by the user and runs a generation algorithm to generate an optimal travel plan. The algorithm analyzes the user's preferences and past traveler data to create a plan that best suits their individual needs.

[0516] Sending the generated travel plan (server)

[0517] The generated travel plan is transmitted from the server to the terminal.

[0518] Display travel plan (device)

[0519] The device displays the received travel plan on the user's screen, allowing the user to check the travel itinerary and activity details.

[0520] Specific examples

[0521] Example 1: Family trip

[0522] A user wants to plan a family trip. The user enters the following information into the device:

[0523] Budget: 500,000 yen

[0524] Travel period: December 1, 2023 to December 10, 2023

[0525] Areas of interest: Culture, history

[0526] Visited: Kyoto

[0527] The device collects this information and sends it to a server. The server queries a database to retrieve information about Kyoto's tourist attractions, accommodations, and events based on past feedback and interests. A generation algorithm analyzes this data and generates a travel plan that is optimized for the user. The generated plan is then sent to the device, where the user can review it.

[0528] Example 2: Business Travel

[0529] Another user wants to plan a business trip. The user enters the following information into the device:

[0530] Budget: 300,000 yen

[0531] Travel period: November 5, 2023 to November 7, 2023

[0532] Areas of interest: Business, Meeting Spaces

[0533] Visited: Tokyo

[0534] The device collects this information and sends it to a server. The server queries a database to retrieve information about hotels, meeting spaces, and transportation options in Tokyo based on past feedback and business needs. A generative algorithm analyzes this data and generates a business travel plan that is optimized for the user. The plan is then sent to the device, where the user can review it.

[0535] This allows users to easily enjoy a personalized travel experience tailored to their preferences and needs.The system's unique feature is that it efficiently performs a series of processes, from collecting user information to running the generation algorithm and providing the final travel plan.

[0536] The processing flow will be explained below.

[0537] Step 1:

[0538] The device presents the user with a travel planning form, into which the user enters the following information:

[0539] budget

[0540] Travel period

[0541] Areas of interest (e.g. culture, history, food)

[0542] Places visited

[0543] Step 2:

[0544] The device collects information entered by the user and sends it to the server. For example, the information is sent in the following format:

[0545] json

[0546] {

[0547] "budget": 500000,

[0548] "travel_period": "2023-12-01 to 2023-12-10",

[0549] "interests": ["culture", "history", "food"],

[0550] "location": "Kyoto"

[0551] }

[0552] Step 3:

[0553] The server receives the user information sent from the device and creates a database query to retrieve the most relevant travel information from the database based on the user's interests and destinations.

[0554] Step 4:

[0555] The server executes the query and retrieves travel information from the database, including tourist destinations, accommodations, transportation options, and feedback from past travelers.

[0556] Step 5:

[0557] The server runs a generation algorithm based on the acquired travel information and user information, which analyzes the user's preferences and past user data to generate a customized, optimal travel plan.

[0558] Step 6:

[0559] The server then sends the generated itinerary to the device, which includes details such as a daily schedule, recommended sightseeing spots, accommodations, and transportation options.

[0560] Step 7:

[0561] The device receives the travel plan sent from the server and displays it on the user's screen, allowing the user to check the details of the travel plan and fine-tune the plan.

[0562] For example, if a user is planning a family trip, they can go through steps 1 to 7 to get a trip plan that perfectly suits their needs. For example, based on the information they enter, the device will display the following trip plan:

[0563] Travel period: 2023-12-01 to 2023-12-10

[0564] Budget: 500,000 yen

[0565] Visited: Kyoto

[0566] Day 1: Kiyomizu-dera Temple - Visit the historic building followed by a meal at a local restaurant.

[0567] Day 2: Ginkakuji Temple - After sightseeing, take a break at a traditional teahouse.

[0568] ...

[0569] Accommodation: XYZ Hotel

[0570] Transportation: Train, bus

[0571] This detailed flow provides an optimized itinerary generated from the user's input, greatly simplifying travel preparation.

[0572] Example 1

[0573] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0574] Modern travel planning is complex, requiring the collection and organization of a large amount of information. Users must manually research information using numerous websites and applications, which takes time and effort. Furthermore, it can be difficult to find the optimal travel plan that meets a user's individual preferences and budget. The present invention aims to eliminate the complexity of travel planning and provide users with a simple, personalized travel plan.

[0575] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0576] In this invention, the server includes means for receiving information on travel preferences, budget, travel period, areas of interest, and places to visit from a user, means for querying a database based on the received information to obtain travel information on the places to visit, means for executing a generation algorithm to generate an optimal travel plan based on the obtained travel information and the received information, means for transmitting the generated travel plan to the user, means for the terminal to compile the information collected from the user into a single data packet and transmit it to the server, means for the server to analyze the received information and execute a query to obtain the necessary travel information from the database, means for converting the generated travel plan into JSON format and transmitting it to the terminal, and means for displaying the received travel plan to the user in an easy-to-read format. This allows users to easily obtain an optimal travel plan based on their preferences and needs and efficiently plan their trip.

[0577] "User" means any individual or group of people who use the System to plan their travel.

[0578] "Server" refers to a computer system that receives information sent by a user, processes the information, generates an optimal travel plan, and sends it to a terminal.

[0579] "Terminal" refers to the device (e.g., smartphone, tablet, or PC) through which a user inputs information and displays the travel plan received from the server.

[0580] "Budget" refers to the amount of money a user sets for travel expenses.

[0581] "Travel Period" refers to the period from the start date to the end date of a User's trip.

[0582] "Areas of Interest" refers to activities or themes (e.g., culture, history, food) that a user is particularly interested in while traveling.

[0583] "Destination" means a geographic location selected by a User for travel planning purposes.

[0584] "Database" refers to a collection of data that the server queries to obtain a user's travel information.

[0585] "Generation algorithm" refers to a calculation method for generating the optimal travel plan for a user based on the information received and the travel information acquired.

[0586] "Travel Plan" means a detailed plan, including the overall schedule and suggested activities, for your trip.

[0587] "Data Packet" refers to the formatted unit of data used to transmit information collected from a user to a server.

[0588] A "query" refers to a query command that is executed to retrieve information from a database.

[0589] "JSON format" stands for JavaScript Object Notation and refers to a common format used to store and transfer data in a structured manner.

[0590] "User Information" means all data provided by a User to the System for the purposes of planning a trip (e.g., budget, duration of trip, areas of interest, places to visit).

[0591] The present invention is a system for simplifying travel planning for users and providing individually customized itineraries. The system uses a generation algorithm to generate an optimal travel plan based on information provided by the user, and then provides the plan to the user.

[0592] The system primarily consists of the following hardware and software components:

[0593] Device (e.g. smartphone, tablet, PC)

[0594] Server (cloud computing environment)

[0595] Database systems (e.g., SQL databases)

[0596] Generative algorithms (e.g., AI models)

[0597] First, the user uses the device to enter information about their trip, including budget, travel duration, areas of interest, and places to visit. The user enters this information through the device's interface and presses the send button.

[0598] The device collects information from the user and sends it to the server, which then parses it into JSON format data. The server then queries a database based on the user information to retrieve travel information about the destination, including tourist attractions, accommodation, transportation options, and feedback from past travelers.

[0599] The server combines the acquired travel information with the information provided by the user and runs a generation algorithm that analyzes the user's preferences and past traveler data to generate a travel plan that best suits their individual needs. The generated itinerary is then converted back to JSON format and sent from the server to the device.

[0600] The device displays the received travel plan on the user's screen, allowing the user to review the travel itinerary and activity details, and the user can review the displayed plan and make adjustments or changes as necessary.

[0601] Specific examples

[0602] Example 1: Family trip

[0603] The user enters the following information into the device for a family trip:

[0604] Budget: 500,000 yen

[0605] Travel period: December 1, 2023 to December 10, 2023

[0606] Areas of interest: Culture, history

[0607] Visited: Kyoto

[0608] "Please create a travel plan for Kyoto with a budget of 500,000 yen from December 1st to December 10th that focuses on culture and history."

[0609] The device collects this information and sends it to a server. The server queries a database to obtain Kyoto's tourist attractions (e.g., Kiyomizu-dera Temple, Kinkaku-ji Temple), accommodations, event information, etc. A generation algorithm analyzes this data and generates an optimal travel plan for the user. The generated plan is then sent to the device, where the user can review it.

[0610] Example 2: Business Travel

[0611] Another user enters the following information into the device for a business trip:

[0612] Budget: 300,000 yen

[0613] Travel period: November 5, 2023 to November 7, 2023

[0614] Areas of interest: Business, Meeting Spaces

[0615] Visited: Tokyo

[0616] "Please create a travel plan for Tokyo with a budget of 300,000 yen from November 5th to November 7th, with an interest in business and meeting space."

[0617] The device sends this information to a server, which queries a database to obtain information on business hotels, meeting spaces, and transportation options in Tokyo. A generation algorithm analyzes this data and generates an optimal business travel plan. The plan is then sent to the device, where the user can review it.

[0618] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0619] Step 1:

[0620] Collection of user information (device)

[0621] Description: The terminal displays a form that allows the user to enter their travel plans. The form includes fields for budget, travel duration, areas of interest, and places to visit.

[0622] Input: The user enters information about their travel preferences, budget, travel duration, areas of interest, and places to visit.

[0623] Output: The information entered by the user is saved on the device.

[0624] Specific operation: The user enters "500,000 yen" as the budget, "December 1, 2023 to December 10, 2023" as the travel period, "culture" and "history" as areas of interest, and "Kyoto" as the place to visit on the device screen.

[0625] Step 2:

[0626] Sending information (terminal)

[0627] Description: When a user enters information and presses the submit button, the device assembles the information into a single JSON-formatted data packet, which is then sent to the server via an HTTP request.

[0628] Input: Travel information entered by the user into the device.

[0629] Output: Trip information data packet sent from the device to the server.

[0630] Specific operation: The device sends the following JSON data to the server:

[0631] json

[0632] {

[0633] "budget": 500000,

[0634] "travel_period": "2023-12-01 to 2023-12-10",

[0635] "interests": ["culture", "history"],

[0636] "destination": "Kyoto"

[0637] }

[0638] Step 3:

[0639] Data acquisition (server)

[0640] Description: The server parses the received JSON data and extracts the user information. It then queries the database to get information about the places visited, such as tourist attractions, accommodation, transportation options, and feedback from past travelers.

[0641] Input: User's travel information sent from the device.

[0642] Output: Travel information such as tourist attractions, accommodation, transportation, and feedback retrieved from the database.

[0643] What happens: The server executes the following SQL query:

[0644] sql

[0645] SELECT FROM TouristAttractions WHERE location = 'Kyoto';

[0646] SELECT FROM Hotels WHERE location = 'Kyoto';

[0647] SELECT FROM Transportation WHERE location = 'Kyoto';

[0648] SELECT FROM Feedback WHERE location = 'Kyoto';

[0649] Step 4:

[0650] Execution of the generation algorithm (server)

[0651] Description: The server runs a generation algorithm based on the data it receives. This algorithm takes into account user preferences and past traveller data to generate an optimal travel plan.

[0652] Input: Trip information retrieved from the database and information provided by the user.

[0653] Output: The generated optimal travel plan.

[0654] What it does: The generation algorithm does the following:

[0655] 1. Select a tourist destination based on your area of ​​interest.

[0656] 2. Make a list of accommodations that fit within your budget.

[0657] 3. Display available transportation options for travel.

[0658] 4. Create a schedule based on this information.

[0659] Step 5:

[0660] Sending the generated plan (server)

[0661] Description: The generated travel plan is converted to JSON format and sent from the server to the terminal as an HTTP response.

[0662] Input: The generated itinerary.

[0663] Output: JSON data of the travel plan sent from the server to the device.

[0664] Specific operation: The server sends the following JSON data to the terminal:

[0665] json

[0666] {

[0667] "itinerary": [

[0668] {

[0669] "date": "2023-12-01",

[0670] "activities": [

[0671] {

[0672] "time": "10:00",

[0673] "activity": "Visit Kiyomizu Temple"

[0674] },

[0675] {

[0676] "time": "14:00",

[0677] "activity": "Lunch at local restaurant"

[0678] }

[0679] ]

[0680] },

[0681] / / The travel itinerary continues below...

[0682] ],

[0683] "accommodations": [

[0684] {

[0685] "name": "Kyoto Hotel",

[0686] "check_in": "2023-12-01",

[0687] "check_out": "2023-12-10"

[0688] }

[0689] ],

[0690] "transportation": [

[0691] {

[0692] "type": "Shinkansen",

[0693] "from": "Tokyo",

[0694] "to": "Kyoto",

[0695] "departure": "2023-12-01 08:00"

[0696] }

[0697] ]

[0698] }

[0699] Step 6:

[0700] Display travel plan (device)

[0701] Description: The device parses the received travel plan JSON data and displays it on the screen in a user-friendly format, allowing the user to see the itinerary, accommodation information, and transportation details.

[0702] Input: JSON data of the travel plan sent from the server.

[0703] Output: The itinerary displayed to the user.

[0704] Specific operation: The terminal generates the following HTML and displays it on the browser:

[0705] html

[0706] <h1> Travel Planner< / h1>

[0707] <h2>2023-12-01< / h2>

[0708]

[0709] 10:00 - Visit Kiyomizu Temple

[0710] 14:00 - Lunch at local restaurant

[0711]

[0712] <!-- The following is the continuation of the travel schedule... -->

[0713] <h2> Accommodation Information< / h2>

[0714] Kyoto Hotel (Check-in: 2023-12-01, Check-out: 2023-12-10)

[0715] <h2> means of transportation< / h2>

[0716] Shinkansen (Tokyo to Kyoto, Departure: 2023-12-01 08:00)

[0717] (Application Example 1)

[0718] Next, Application Example 1 will be described. In the following description, the data processing device 12 is referred to as the "server", and the smart glasses 214 are referred to as the "terminal".

[0719] In the conventional travel planning system, a customized travel plan is generated based on the information provided by the user, but the display method is limited, and it is difficult for the user to visually understand what kind of travel they will actually experience. In addition, it is difficult to provide real-time feedback and review the travel plan, which has been a problem with poor user experience.

[0720] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0721] In this invention, the server includes: means for receiving information on travel preferences, budget, travel period, areas of interest, and places to visit from a user; means for querying a database based on the received information to obtain travel information on the places to visit; means for executing a generation algorithm to generate an optimal travel plan based on the obtained travel information and the received information; and means for displaying the generated travel plan in real time to provide virtual tour options, thereby allowing the user to visually check the customized travel plan in real time and easily consider travel details.

[0722] "User Information" means information provided by a User regarding travel preferences, budget, travel duration, areas of interest, and places to visit.

[0723] A "database" is a collection of information including travel information such as tourist attractions, accommodation, transportation options, and feedback from past travelers about the destinations visited.

[0724] A "generation algorithm" is a calculation method for generating optimal travel plans based on acquired travel information and user information.

[0725] A "virtual tour" is an online simulation that provides users with a visual and interactive travel experience of the places they plan to visit.

[0726] "Real-time" refers to the time period in which data processing and information provision are carried out immediately.

[0727] "Travel Plan" means a detailed plan of places to visit, attractions, accommodations, and transportation that is customized based on information provided by a User.

[0728] "User experience" refers to the ease of use and satisfaction that users feel when using a system.

[0729] A "server" is a computer system that processes data, receives user information, and generates and provides travel plans.

[0730] The present invention is a system that simplifies user travel planning and provides personalized itineraries. The system collects user information, runs a generation algorithm to generate an optimal itinerary, and provides a virtual tour experience.

[0731] System Configuration

[0732] The system uses the following hardware and software:

[0733] Hardware

[0734] Smartphone (iOS or Android)

[0735] Server (cloud server, e.g. AWS, Google Cloud)

[0736] software

[0737] Smartphone applications (e.g., Swift, Kotlin)

[0738] Server-side applications (e.g., Node.js, Python)

[0739] Database (e.g. PostgreSQL, MongoDB)

[0740] Generative AI models (e.g., GPT-4)

[0741] Processing Flow

[0742] 1. Collection of User Information

[0743] Users enter information such as budget, travel duration, areas of interest, and places to visit through a smartphone application.

[0744] The smartphone application sends this information to a server.

[0745] 2. Database Queries

[0746] Based on the received user information, the server queries the database to obtain travel information such as tourist attractions, accommodation, transportation options, and feedback from past travelers about the destination.

[0747] 3. Executing the generation algorithm

[0748] The server combines the acquired travel information with the information provided by the user and generates an optimal travel plan using a generative AI model (e.g., GPT-4).

[0749] 4. Providing travel plans

[0750] The generated travel plan is sent from the server to the smartphone application.

[0751] The smartphone application displays the received itinerary to the user and offers the option of a virtual tour.

[0752] Example

[0753] For example, a user enters the following information into a smartphone application for a family trip:

[0754] Budget: 500,000 yen

[0755] Travel period: December 1, 2023 to December 10, 2023

[0756] Areas of interest: Culture, history

[0757] Visited: Kyoto

[0758] The server queries the database to obtain information such as Kyoto's tourist attractions, accommodations, transportation options, and feedback from past travelers. A generative algorithm (e.g., GPT-4) analyzes this data and generates an optimal travel plan. This plan is provided to the user in the form of a virtual tour, allowing them to visually check the plan details in real time.

[0759] Prompt Sentence Examples

[0760] User Information:

[0761] Budget: 500,000 yen

[0762] Travel period: December 1, 2023 to December 10, 2023

[0763] Areas of interest: Culture, history

[0764] Visited: Kyoto

[0765] Acquired data:

[0766] Tourist attractions: Kiyomizu-dera Temple, Fushimi Inari Shrine, Ginkaku-ji Temple

[0767] Accommodation: Hotel Okura, Kyoto Century Hotel, Granvia

[0768] Transportation: City bus, subway

[0769] Past traveller feedback: Highly rated attractions

[0770] prompt:

[0771] Use this information to optimize your users' travel plans and generate customized itineraries.

[0772] The above is an embodiment of the present invention, which allows users to conveniently enjoy a personalized travel experience that is tailored to their preferences and needs.

[0773] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0774] Step 1:

[0775] The user enters information such as budget, travel duration, areas of interest, and places to visit into the smartphone application. The device then sends the data to the server. Specifically, the user enters their travel information into the application form and presses the submit button. The transmitted data is received by the server in JSON format.

[0776] Step 2:

[0777] The server queries the database based on the received user information to retrieve travel information such as tourist attractions, accommodations, transportation options, and feedback from past travelers about the destination. The queried data is retrieved by filtering information that matches specific keywords or conditions. The input is the user's travel information, and the output is the retrieved travel-related data.

[0778] Step 3:

[0779] The server integrates the acquired travel information with information from the user and generates an optimal travel plan using a generative AI model (GPT-4). Specifically, it selects the dates and places to visit that best suit the user's preferences and travel conditions, and creates a detailed plan. The input here is the travel information acquired in Step 2 and user information, and the output is the generated travel plan.

[0780] Step 4:

[0781] The generated itinerary is sent from the server to a smartphone application. The device displays the received itinerary, allowing the user to review each item of the itinerary (such as accommodation, sightseeing spots, and transportation) in detail. Specifically, the application displays each section of the plan in an easy-to-read format, allowing the user to scroll through the plan.

[0782] Step 5:

[0783] The device provides a virtual tour option, and the user selects the virtual tour and starts the simulation. For example, when the user selects the virtual tour mode displayed on the device, an interactive map and 3D visuals are displayed, allowing the user to experience a virtual trip.

[0784] The above are the specific processing steps for carrying out the present invention, which allow the user to visually check the customized travel plan in real time and consider the details of the trip.

[0785] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0786] The present invention is a system for maximizing the customization of a user's travel experience and providing real-time emotional feedback. The system generates and provides optimal travel plans by combining user input, travel information from a database, a generation algorithm, and an emotion engine.

[0787] Program Generation and Processing

[0788] Collection of user information (device)

[0789] The device collects the following information from the user:

[0790] budget

[0791] Travel period

[0792] Areas of interest (e.g. culture, history, food)

[0793] Places visited

[0794] Once the user enters this information, the device sends it to the server.

[0795] Obtaining data based on received information (server)

[0796] The server queries the database based on the user information received from the terminal to obtain travel information such as tourist attractions, accommodation, transportation, and feedback from past travelers about the visited destination.

[0797] Execution of the generation algorithm (server)

[0798] The server combines the acquired travel information with the information provided by the user and runs a generation algorithm to generate an optimal travel plan. This algorithm analyzes the user's preferences and past user data to create a plan that best suits their individual needs.

[0799] Utilizing emotion engine (server)

[0800] The server uses an emotion engine to recognize the user's emotions. The emotion engine analyzes the user's voice and facial expression data to understand the user's current emotional state.

[0801] Travel plan adjustment (server)

[0802] The emotion engine recognizes the user's emotions and re-runs the generation algorithm to adjust the itinerary in real time. For example, if the user expresses dissatisfaction with the itinerary, the itinerary will be changed to reflect the user's preferences.

[0803] Sending the generated travel plan (server)

[0804] The generated itinerary is sent from the server to the device, and includes details such as a daily schedule, recommended sightseeing spots, accommodations, and transportation options.

[0805] Display travel plan (device)

[0806] The device displays the received travel plan on the user's screen, allowing them to check the trip itinerary and activity details, and provides real-time feedback based on the user's emotional state.

[0807] Specific examples

[0808] Example 1: Family trip

[0809] A user wants to plan a family trip. The user enters the following information into the device:

[0810] Budget: 500,000 yen

[0811] Travel period: December 1, 2023 to December 10, 2023

[0812] Areas of interest: Culture, history

[0813] Visited: Kyoto

[0814] The device collects this information and sends it to a server. The server queries a database to obtain information on Kyoto's tourist attractions, accommodations, and events. A generation algorithm analyzes this data and generates an optimal travel plan for the user. Furthermore, an emotion engine analyzes the user's emotions and adjusts the plan in real time if the plan is deemed unsatisfactory. The generated travel plan is then sent to the device, where the user can view it.

[0815] Example 2: Business Travel

[0816] Another user wants to plan a business trip. The user enters the following information into the device:

[0817] Budget: 300,000 yen

[0818] Travel period: November 5, 2023 to November 7, 2023

[0819] Areas of interest: Business, Meeting Spaces

[0820] Visited: Tokyo

[0821] The device collects this information and sends it to a server. The server queries a database to obtain information on hotels, meeting spaces, and transportation options in Tokyo. A generation algorithm analyzes this data and generates a business travel plan that is optimal for the user. Furthermore, an emotion engine analyzes the user's emotions and adjusts the plan in real time if the plan is deemed unsatisfactory. The generated plan is then sent to the device, where the user can review it.

[0822] This allows users to easily enjoy a personalized travel experience tailored to their preferences and needs.The system's unique feature is that it efficiently performs a series of processes, from collecting user information, running a generation algorithm, providing real-time feedback using an emotion engine, and finally providing a final travel plan.

[0823] The processing flow will be explained below.

[0824] Step 1:

[0825] The device presents the user with a travel planning form, into which the user enters the following information:

[0826] budget

[0827] Travel period

[0828] Areas of interest (e.g. culture, history, food)

[0829] Places visited

[0830] Step 2:

[0831] The device collects information entered by the user and sends it to the server. For example, the information is sent in the following format:

[0832] json

[0833] {

[0834] "budget": 500000,

[0835] "travel_period": "2023-12-01 to 2023-12-10",

[0836] "interests": ["culture", "history", "food"],

[0837] "location": "Kyoto"

[0838] }

[0839] Step 3:

[0840] The server receives the user information sent from the device and creates a database query to retrieve the most relevant travel information from the database based on the user's interests and destinations.

[0841] Step 4:

[0842] The server executes the query and retrieves travel information from the database, including tourist destinations, accommodations, transportation options, and feedback from past travelers.

[0843] Step 5:

[0844] The server runs a generation algorithm based on the acquired travel information and user information, which analyzes the user's preferences and past user data to generate a customized, optimal travel plan.

[0845] Step 6:

[0846] Before sending the generated travel plan to the user, the server recognizes the user's emotions using an emotion engine, which analyzes the user's voice data and facial expression data in real time to understand the user's emotional state.

[0847] Step 7:

[0848] The server evaluates whether the generated itinerary meets the user's expectations based on the analysis results of the emotion engine. If the user expresses dissatisfaction, the generation algorithm is run again and the itinerary is adjusted.

[0849] Step 8:

[0850] The server then sends the final itinerary to the device, which includes details such as daily schedules, recommended sightseeing spots, accommodations, and transportation options.

[0851] Step 9:

[0852] The device receives the travel plan sent from the server and displays it on the user's screen, allowing the user to check the details of the travel plan and fine-tune the plan.

[0853] For example, if a user plans a family trip, they can go through steps 1 to 9 to get a trip plan that perfectly suits their needs. For example, based on the information they enter, the device will display the following trip plan:

[0854] Travel period: 2023-12-01 to 2023-12-10

[0855] Budget: 500,000 yen

[0856] Visited: Kyoto

[0857] Day 1: Kiyomizu-dera Temple - Visit the historic building followed by a meal at a local restaurant.

[0858] Day 2: Ginkakuji Temple - After sightseeing, take a break at a traditional teahouse.

[0859] ...

[0860] Accommodation: XYZ Hotel

[0861] Transportation: Train, bus

[0862] For business travel, the same steps are followed to provide users with the best business travel plan, which incorporates real-time feedback from the user's emotion engine, allowing users to adjust the plan on the fly.

[0863] Example 2

[0864] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0865] Modern travelers have very diverse needs and preferences, and there is a lack of systems that can automatically generate travel plans that comprehensively satisfy these needs. It is also difficult to adjust plans to reflect real-time emotions and feedback during the trip. For this reason, current systems have difficulty providing users with a satisfying travel experience.

[0866] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for collecting user information, means for querying a database based on the received information to obtain travel information, means for executing a generative model based on the obtained information to generate an optimal travel plan, means for recognizing the user's emotional state and adjusting the travel plan in real time, and means for transmitting the generated travel plan to the user. This makes it possible to provide a highly customized travel plan that reflects the user's individual needs in real time.

[0867] "User" refers to an individual or organization that uses the System to generate travel plans.

[0868] "Travel preferences" are criteria for selecting a travel destination based on a user's interests and concerns, including specific areas such as culture, history, and food.

[0869] "Budget" means the range of amounts a User is willing to spend for the entire trip.

[0870] "Travel Period" refers to the time range from the start date to the end date for which a User plans to travel.

[0871] A "visited location" is a geographic location selected by a user as a travel destination.

[0872] "Database" refers to an information system that stores travel information in response to user requests and makes it searchable through queries.

[0873] A "generative model" is a type of algorithm or AI technology that generates optimal travel plans based on user input information and data obtained from a database.

[0874] "Emotional state" refers to the user's current psychological state and mood, which can be obtained by analyzing the user's voice and facial expression data.

[0875] "Travel information" includes various data related to travel, such as tourist destinations, accommodation, transportation, and feedback from past travelers.

[0876] "Real-time" refers to processing timing that is conscious of immediately reflecting the user's current behavior and emotions.

[0877] "Travel Plan" means a specific plan including travel dates, places to visit, accommodation, transportation, etc., customized according to the User's requirements and preferences.

[0878] "Generating means" refers to the hardware or software functionality used by the system to automatically generate a travel plan.

[0879] "Transmission Means" means the communications technology or protocol used to transmit the generated itinerary to the user.

[0880] "Means for displaying" refers to an interface that allows a user to view the generated travel plan on the screen of the terminal.

[0881] This invention is a system for maximizing the customization of a user's travel experience and providing real-time emotional feedback. The system generates and provides optimal travel plans by combining user input, travel information from a database, a generative model, and an emotion engine.

[0882] Collection of user information (device)

[0883] The device collects information from the user about travel preferences, budget, travel duration, areas of interest, and places to visit. Once the user enters this information, the device transmits the information to a server. The device can be a mobile device such as a tablet or smartphone.

[0884] Obtaining data based on received information (server)

[0885] The server analyzes the user information received from the device and queries a database based on that information. The database stores travel information such as tourist spots, accommodations, transportation options, and feedback from past travelers. The database is managed using a relational database such as MySQL or PostgreSQL.

[0886] Execution of the generative model (server)

[0887] The server combines the acquired travel information with the information provided by the user and runs a generative model to generate an optimal travel plan. This generative model uses a generative AI model such as GPT-4. The generative model generates the optimal travel plan via a prompt sentence.

[0888] Prompt Sentence Examples

[0889] "Create a travel plan for a family trip to Kyoto from December 1, 2023 to December 10, 2023 with a budget of 500,000 yen. Your areas of interest are culture and history. Your itinerary should include details of recommended tourist attractions, accommodation, and transportation, and take into account feedback based on the user's emotional state."

[0890] Utilizing emotion engine (server)

[0891] The server analyzes voice and facial expression data to understand the user's emotional state. For example, it uses emotion recognition services such as Microsoft Azure's Emotion Recognition API and Amazon Rekognition. Based on the results of the user's emotion analysis, real-time adjustments to the travel plan are made.

[0892] Travel plan adjustment (server)

[0893] The emotional state data obtained from the emotion engine is compared with the travel plan, and if it is determined that the user is dissatisfied, the generative model is re-run to adjust the travel plan, thereby generating an optimal travel plan that is in line with the user's emotional state.

[0894] Sending the generated travel plan (server)

[0895] The final itinerary is then sent from the server to the device using a secure communication protocol such as HTTPS. After sending, an error check is performed to ensure the data was sent correctly.

[0896] Display travel plan (device)

[0897] The device receives the travel plan from the server and displays it on the user's screen, including a daily schedule, recommended sightseeing spots, accommodations, and transportation options. The screen also features real-time feedback, allowing additional adjustments to be made immediately based on the user's emotional state.

[0898] This allows users to easily enjoy a personalized travel experience that is tailored to their preferences and needs, and further enhances their satisfaction during their trip by providing real-time emotional feedback.

[0899] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0900] Step 1: Collecting user information (device)

[0901] The terminal receives input from the user regarding travel preferences, budget, travel duration, areas of interest, and places to visit. Specifically, the terminal provides an interface into which the user can input information, and once the information is entered, it formats the data and sends it to the server. The input information includes budget (e.g., 500,000 yen), travel duration (e.g., December 1, 2023 to December 10, 2023), areas of interest (e.g., culture, history), and places to visit (e.g., Kyoto). This data is sent to the server.

[0902] Step 2: Retrieving data based on received information (server)

[0903] The server analyzes the user information received from the device as input and queries the database based on that information to obtain travel information. Specifically, the server executes an SQL query such as "SELECT FROM TravelData WHERE Location = 'Kyoto'" and obtains travel information (e.g., a list of tourist attractions and accommodations) from the database as output. The obtained data is stored in internal storage.

[0904] Step 3: Execute the generative model (server)

[0905] The server combines the acquired travel information with the information provided by the user as input, runs the generative model using the prompt sentence, and generates the optimal travel plan. Specifically, the server inputs the following prompt sentence into the generative AI model (e.g., GPT-4):

[0906] "Create a travel plan for a family trip to Kyoto from December 1, 2023 to December 10, 2023 with a budget of 500,000 yen. Your areas of interest are culture and history. Your itinerary should include details of recommended tourist attractions, accommodation, and transportation, and take into account feedback based on the user's emotional state."

[0907] The generated itinerary is obtained as output and is temporarily saved.

[0908] Step 4: Utilizing the Emotion Engine (Server)

[0909] The server receives voice and facial expression data from the device as input to understand the user's emotional state. Specifically, the device captures the user's voice and facial expressions and sends them to the server. The server then uses emotion recognition services such as the Microsoft Azure Emotion Recognition API and Amazon Rekognition to analyze the emotional state and obtain emotional data as output. This data is stored in the internal storage.

[0910] Step 5: Adjusting Travel Plans (Server)

[0911] The server analyzes the emotion data obtained from the emotion engine and the existing travel plan as input. Specifically, if the server recognizes that the user's emotion is dissatisfied, it re-runs the generative model and readjusts the travel plan based on the new prompt. The regenerated travel plan is saved as output.

[0912] Step 6: Sending the generated travel plan (server)

[0913] The server takes the final generated travel plan as input and sends it to the terminal. Specifically, the server sends the travel plan to the terminal using a secure communication protocol such as "HTTPS." After sending, an error check is performed to confirm that the data was sent correctly. The transmission result is obtained as output.

[0914] Step 7: View your travel plans (device)

[0915] The terminal takes the travel plan received from the server as input, analyzes it, and displays it on the user's screen. Specifically, the terminal displays the travel plan's daily schedule, recommended tourist spots, accommodations, transportation options, etc., and also provides real-time feedback based on the user's emotional state. The user can review the travel plan and select the next action based on its contents. The travel plan is displayed to the user as output.

[0916] (Application example 2)

[0917] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0918] Current travel planning systems have difficulty adjusting travel plans based on users' individual preferences and real-time changing emotions, which can lead to a decline in the quality and satisfaction of the travel experience. Furthermore, the lack of customization and real-time adjustment of travel plans makes it difficult to meet the diverse needs of users.

[0919] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for receiving information on travel preferences, budget, travel period, areas of interest, and places to visit from a user; means for querying a database based on the received information and acquiring travel information on the places to visit; means for executing a generation algorithm to generate an optimal travel plan based on the acquired travel information and the received information; means for sending the generated travel plan to the user; means for analyzing the user's emotional state and adjusting the travel plan in real time; and means for virtually displaying the adjusted travel plan on a visual device. This enables customization of the travel plan and further allows the plan to be adjusted according to the user's real-time emotional state, thereby improving the quality and satisfaction of the travel experience.

[0920] The "means for receiving information from the user regarding travel preferences, budget, travel duration, areas of interest, and places to visit" refers to an interface through which the user can input various information necessary for travel planning and through which the system collects that information.

[0921] "Means for querying a database based on the received information to obtain travel information related to the destination" refers to the process of searching and extracting appropriate travel information from a database based on the information provided by the user.

[0922] "Means for executing a generation algorithm to generate an optimal travel plan based on the acquired travel information and received information" refers to a function that executes an algorithm that combines and analyzes user-entered information and travel information acquired from the database to create an optimal travel plan.

[0923] The "means for transmitting the generated travel plan to the user" is a communication function for transmitting the generated travel plan to the user's terminal so that the user can access it.

[0924] "Means for analyzing the user's emotional state and adjusting travel plans in real time" refers to a function that analyzes the user's emotional data to understand the user's current emotional state and adjusts travel plans accordingly in real time.

[0925] "Means for virtually displaying the adjusted travel plan on a visual device" refers to a function that visually displays the adjusted travel plan on a visual device used by the user, such as a smartphone or head-mounted display.

[0926] To implement the present invention, the following system configuration and procedure are used.

[0927] User Information Collection:

[0928] The user uses a device such as a smartphone or head-mounted display to input information about their travel preferences, budget, travel period, areas of interest, and places to visit. A user interface is used to set up an appropriate form to collect the user's input. For example, a specific prompt sentence such as "I am planning a business trip to Tokyo from November 5, 2023 to November 7, 2023. My budget is 300,000 yen. Please tell me the optimal travel plan, including information about meeting spaces." is input.

[0929] Database queries and information retrieval:

[0930] The server receives the user information from the device and queries the database to retrieve travel information such as tourist attractions, accommodations, transportation options, and user reviews for the destination. This query uses an efficient search algorithm to explore the extensive database.

[0931] Run the generation algorithm:

[0932] The server combines the acquired travel information with the information provided by the user and runs a generative algorithm to generate an optimal travel plan. The algorithm uses machine learning technology to provide personalized plans based on past user data. A specific generative AI model is used to generate the plan, providing content that best suits the user's characteristics.

[0933] Leveraging the Emotion Engine:

[0934] The server uses an emotion engine to analyze the user's emotional state. This emotion analysis is performed by collecting the user's voice and facial expression data in real time and evaluating their psychological state. For example, if the user is dissatisfied with the travel plan, the analysis result will be determined as unsatisfactory. Based on this information, the server re-runs the generation algorithm and adjusts the plan.

[0935] Adjust and view your travel plans:

[0936] The server then sends the adjusted itinerary to the user's visual device, where the user can view the itinerary in real time via a smartphone, head-mounted display, or other device, including detailed itinerary and recommended sightseeing spots, accommodations, and transportation options.

[0937] Hardware and software used:

[0938] Hardware: Smartphones, smart glasses, head-mounted displays

[0939] Software: Python, Emotion Engine API, Travel Data API, Travel Plan Generator API, Device Interface Module

[0940] The system allows users to view and adjust their travel plans in real time according to their preferences and needs, significantly improving the quality of their travel experience. Utilizing artificial intelligence models and prompts, it can provide a more personalized experience, increasing user satisfaction.

[0941] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0942] Step 1:

[0943] The user uses a device such as a smartphone or head-mounted display to input information about their travel preferences, budget, travel duration, areas of interest, and places to visit. This information is collected through a user interface. Specifically, the user enters a prompt such as, "I am planning a business trip to Tokyo from November 5, 2023 to November 7, 2023. My budget is 300,000 yen. Please tell me the optimal travel plan, including information about meeting spaces." The input information is sent to the server as structured data in JSON format, etc. The input is user information data, and the output is the user input data sent to the server.

[0944] Step 2:

[0945] The server queries the database based on the user information received from the device to obtain travel information related to the relevant destinations. This query operation includes tourist destination information, accommodation information, transportation information, and user reviews. The input is user input data, and the output is travel information data. Information is efficiently extracted from large databases using SQL and various APIs.

[0946] Step 3:

[0947] The server combines the acquired travel information with information provided by the user and executes a generation algorithm. This generation algorithm references past user data and similar travel plans and uses machine learning technology to generate the optimal travel plan. Specifically, it uses Python and machine learning libraries (such as TensorFlow and PyTorch). The inputs are user input data and travel information data, and the output is the optimal travel plan data.

[0948] Step 4:

[0949] The server adjusts the generated travel plan based on the results of the user's emotion analysis. The emotion engine analyzes the user's voice data and facial expression data to understand their current emotional state. This analysis uses the Emotion Engine API and voice and image processing technology. The input is the generated travel plan data and emotion data, and the output is the adjusted travel plan data. If the user is deemed dissatisfied, the server executes a process to automatically generate a new plan or modify the existing plan.

[0950] Step 5:

[0951] The server generates data for a virtual display of the adjusted itinerary on a visual device and sends it to the user's terminal. The terminal receives the data and displays it so that the user can visually check the itinerary. The display format is adapted to the smartphone application screen or head-mounted display. The input is the adjusted itinerary data, and the output is the display data of the terminal. The travel itinerary, recommended sightseeing spots, accommodations, and transportation methods are displayed in detail on the terminal screen.

[0952] Through this series of processes, users can check and enjoy the optimal travel plan based on their preferences and real-time emotional state.

[0953] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0954] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0955] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0956] [Third embodiment]

[0957] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0958] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0959] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0960] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0961] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0962] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0963] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0964] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0965] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0966] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0967] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0968] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0969] The present invention is a system for simplifying travel planning for users and providing individually customized itineraries. The system uses a generation algorithm to generate an optimal travel plan based on information provided by the user, and then provides the plan to the user.

[0970] Program Generation and Processing

[0971] Collection of user information (device)

[0972] The device collects the following information from the user:

[0973] budget

[0974] Travel period

[0975] Areas of interest (e.g. culture, history, food)

[0976] Places visited

[0977] Once the user enters this information, the device sends it to the server.

[0978] Obtaining data based on received information (server)

[0979] The server queries the database based on the user information received from the terminal to obtain travel information such as tourist attractions, accommodation, transportation, and feedback from past travelers about the destination.

[0980] Execution of the generation algorithm (server)

[0981] The server combines the acquired travel information with the information provided by the user and runs a generation algorithm to generate an optimal travel plan. The algorithm analyzes the user's preferences and past traveler data to create a plan that best suits their individual needs.

[0982] Sending the generated travel plan (server)

[0983] The generated travel plan is transmitted from the server to the terminal.

[0984] Display travel plan (device)

[0985] The device displays the received travel plan on the user's screen, allowing the user to check the travel itinerary and activity details.

[0986] Specific examples

[0987] Example 1: Family trip

[0988] A user wants to plan a family trip. The user enters the following information into the device:

[0989] Budget: 500,000 yen

[0990] Travel period: December 1, 2023 to December 10, 2023

[0991] Areas of interest: Culture, history

[0992] Visited: Kyoto

[0993] The device collects this information and sends it to a server. The server queries a database to retrieve information about Kyoto's tourist attractions, accommodations, and events based on past feedback and interests. A generation algorithm analyzes this data and generates a travel plan that is optimized for the user. The generated plan is then sent to the device, where the user can review it.

[0994] Example 2: Business Travel

[0995] Another user wants to plan a business trip. The user enters the following information into the device:

[0996] Budget: 300,000 yen

[0997] Travel period: November 5, 2023 to November 7, 2023

[0998] Areas of interest: Business, Meeting Spaces

[0999] Visited: Tokyo

[1000] The device collects this information and sends it to a server. The server queries a database to retrieve information about hotels, meeting spaces, and transportation options in Tokyo based on past feedback and business needs. A generative algorithm analyzes this data and generates a business travel plan that is optimized for the user. The plan is then sent to the device, where the user can review it.

[1001] This allows users to easily enjoy a personalized travel experience tailored to their preferences and needs.The system's unique feature is that it efficiently performs a series of processes, from collecting user information to running the generation algorithm and providing the final travel plan.

[1002] The processing flow will be explained below.

[1003] Step 1:

[1004] The device presents the user with a travel planning form, into which the user enters the following information:

[1005] budget

[1006] Travel period

[1007] Areas of interest (e.g. culture, history, food)

[1008] Places visited

[1009] Step 2:

[1010] The device collects information entered by the user and sends it to the server. For example, the information is sent in the following format:

[1011] json

[1012] {

[1013] "budget": 500000,

[1014] "travel_period": "2023-12-01 to 2023-12-10",

[1015] "interests": ["culture", "history", "food"],

[1016] "location": "Kyoto"

[1017] }

[1018] Step 3:

[1019] The server receives the user information sent from the device and creates a database query to retrieve the most relevant travel information from the database based on the user's interests and destinations.

[1020] Step 4:

[1021] The server executes the query and retrieves travel information from the database, including tourist destinations, accommodations, transportation options, and feedback from past travelers.

[1022] Step 5:

[1023] The server runs a generation algorithm based on the acquired travel information and user information, which analyzes the user's preferences and past user data to generate a customized, optimal travel plan.

[1024] Step 6:

[1025] The server then sends the generated itinerary to the device, which includes details such as a daily schedule, recommended sightseeing spots, accommodations, and transportation options.

[1026] Step 7:

[1027] The device receives the travel plan sent from the server and displays it on the user's screen, allowing the user to check the details of the travel plan and fine-tune the plan.

[1028] For example, if a user is planning a family trip, they can go through steps 1 to 7 to get a trip plan that perfectly suits their needs. For example, based on the information they enter, the device will display the following trip plan:

[1029] Travel period: 2023-12-01 to 2023-12-10

[1030] Budget: 500,000 yen

[1031] Visited: Kyoto

[1032] Day 1: Kiyomizu-dera Temple - Visit the historic building followed by a meal at a local restaurant.

[1033] Day 2: Ginkakuji Temple - After sightseeing, take a break at a traditional teahouse.

[1034] ...

[1035] Accommodation: XYZ Hotel

[1036] Transportation: Train, bus

[1037] This detailed flow provides an optimized itinerary generated from the user's input, greatly simplifying travel preparation.

[1038] Example 1

[1039] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1040] Modern travel planning is complex, requiring the collection and organization of a large amount of information. Users must manually research information using numerous websites and applications, which takes time and effort. Furthermore, it can be difficult to find the optimal travel plan that meets a user's individual preferences and budget. The present invention aims to eliminate the complexity of travel planning and provide users with a simple, personalized travel plan.

[1041] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1042] In this invention, the server includes means for receiving information on travel preferences, budget, travel period, areas of interest, and places to visit from a user, means for querying a database based on the received information to obtain travel information on the places to visit, means for executing a generation algorithm to generate an optimal travel plan based on the obtained travel information and the received information, means for transmitting the generated travel plan to the user, means for the terminal to compile the information collected from the user into a single data packet and transmit it to the server, means for the server to analyze the received information and execute a query to obtain the necessary travel information from the database, means for converting the generated travel plan into JSON format and transmitting it to the terminal, and means for displaying the received travel plan to the user in an easy-to-read format. This allows users to easily obtain an optimal travel plan based on their preferences and needs and efficiently plan their trip.

[1043] "User" means any individual or group of people who use the System to plan their travel.

[1044] "Server" refers to a computer system that receives information sent by a user, processes the information, generates an optimal travel plan, and sends it to a terminal.

[1045] "Terminal" refers to the device (e.g., smartphone, tablet, or PC) through which a user inputs information and displays the travel plan received from the server.

[1046] "Budget" refers to the amount of money a user sets for travel expenses.

[1047] "Travel Period" refers to the period from the start date to the end date of a User's trip.

[1048] "Areas of Interest" refers to activities or themes (e.g., culture, history, food) that a user is particularly interested in while traveling.

[1049] "Destination" means a geographic location selected by a User for travel planning purposes.

[1050] "Database" refers to a collection of data that the server queries to obtain a user's travel information.

[1051] "Generation algorithm" refers to a calculation method for generating the optimal travel plan for a user based on the information received and the travel information acquired.

[1052] "Travel Plan" means a detailed plan, including the overall schedule and suggested activities, for your trip.

[1053] "Data Packet" refers to the formatted unit of data used to transmit information collected from a user to a server.

[1054] A "query" refers to a query command that is executed to retrieve information from a database.

[1055] "JSON format" stands for JavaScript Object Notation and refers to a common format used to store and transfer data in a structured manner.

[1056] "User Information" means all data provided by a User to the System for the purposes of planning a trip (e.g., budget, duration of trip, areas of interest, places to visit).

[1057] The present invention is a system for simplifying travel planning for users and providing individually customized itineraries. The system uses a generation algorithm to generate an optimal travel plan based on information provided by the user, and then provides the plan to the user.

[1058] The system primarily consists of the following hardware and software components:

[1059] Device (e.g. smartphone, tablet, PC)

[1060] Server (cloud computing environment)

[1061] Database systems (e.g., SQL databases)

[1062] Generative algorithms (e.g., AI models)

[1063] First, the user uses the device to enter information about their trip, including budget, travel duration, areas of interest, and places to visit. The user enters this information through the device's interface and presses the send button.

[1064] The device collects information from the user and sends it to the server, which then parses it into JSON format data. The server then queries a database based on the user information to retrieve travel information about the destination, including tourist attractions, accommodation, transportation options, and feedback from past travelers.

[1065] The server combines the acquired travel information with the information provided by the user and runs a generation algorithm that analyzes the user's preferences and past traveler data to generate a travel plan that best suits their individual needs. The generated itinerary is then converted back to JSON format and sent from the server to the device.

[1066] The device displays the received travel plan on the user's screen, allowing the user to review the travel itinerary and activity details, and the user can review the displayed plan and make adjustments or changes as necessary.

[1067] Specific examples

[1068] Example 1: Family trip

[1069] The user enters the following information into the device for a family trip:

[1070] Budget: 500,000 yen

[1071] Travel period: December 1, 2023 to December 10, 2023

[1072] Areas of interest: Culture, history

[1073] Visited: Kyoto

[1074] "Please create a travel plan for Kyoto with a budget of 500,000 yen from December 1st to December 10th that focuses on culture and history."

[1075] The device collects this information and sends it to a server. The server queries a database to obtain Kyoto's tourist attractions (e.g., Kiyomizu-dera Temple, Kinkaku-ji Temple), accommodations, event information, etc. A generation algorithm analyzes this data and generates an optimal travel plan for the user. The generated plan is then sent to the device, where the user can review it.

[1076] Example 2: Business Travel

[1077] Another user enters the following information into the device for a business trip:

[1078] Budget: 300,000 yen

[1079] Travel period: November 5, 2023 to November 7, 2023

[1080] Areas of interest: Business, Meeting Spaces

[1081] Visited: Tokyo

[1082] "Please create a travel plan for Tokyo with a budget of 300,000 yen from November 5th to November 7th, with an interest in business and meeting space."

[1083] The device sends this information to a server, which queries a database to obtain information on business hotels, meeting spaces, and transportation options in Tokyo. A generation algorithm analyzes this data and generates an optimal business travel plan. The plan is then sent to the device, where the user can review it.

[1084] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1085] Step 1:

[1086] Collection of user information (device)

[1087] Description: The terminal displays a form that allows the user to enter their travel plans. The form includes fields for budget, travel duration, areas of interest, and places to visit.

[1088] Input: The user enters information about their travel preferences, budget, travel duration, areas of interest, and places to visit.

[1089] Output: The information entered by the user is saved on the device.

[1090] Specific operation: The user enters "500,000 yen" as the budget, "December 1, 2023 to December 10, 2023" as the travel period, "culture" and "history" as areas of interest, and "Kyoto" as the place to visit on the device screen.

[1091] Step 2:

[1092] Sending information (terminal)

[1093] Description: When a user enters information and presses the submit button, the device assembles the information into a single JSON-formatted data packet, which is then sent to the server via an HTTP request.

[1094] Input: Travel information entered by the user into the device.

[1095] Output: Trip information data packet sent from the device to the server.

[1096] Specific operation: The device sends the following JSON data to the server:

[1097] json

[1098] {

[1099] "budget": 500000,

[1100] "travel_period": "2023-12-01 to 2023-12-10",

[1101] "interests": ["culture", "history"],

[1102] "destination": "Kyoto"

[1103] }

[1104] Step 3:

[1105] Data acquisition (server)

[1106] Description: The server parses the received JSON data and extracts the user information. It then queries the database to get information about the places visited, such as tourist attractions, accommodation, transportation options, and feedback from past travelers.

[1107] Input: User's travel information sent from the device.

[1108] Output: Travel information such as tourist attractions, accommodation, transportation, and feedback retrieved from the database.

[1109] What happens: The server executes the following SQL query:

[1110] sql

[1111] SELECT FROM TouristAttractions WHERE location = 'Kyoto';

[1112] SELECT FROM Hotels WHERE location = 'Kyoto';

[1113] SELECT FROM Transportation WHERE location = 'Kyoto';

[1114] SELECT FROM Feedback WHERE location = 'Kyoto';

[1115] Step 4:

[1116] Execution of the generation algorithm (server)

[1117] Description: The server runs a generation algorithm based on the data it receives. This algorithm takes into account user preferences and past traveller data to generate an optimal travel plan.

[1118] Input: Trip information retrieved from the database and information provided by the user.

[1119] Output: The generated optimal travel plan.

[1120] What it does: The generation algorithm does the following:

[1121] 1. Select a tourist destination based on your area of ​​interest.

[1122] 2. Make a list of accommodations that fit within your budget.

[1123] 3. Display available transportation options for travel.

[1124] 4. Create a schedule based on this information.

[1125] Step 5:

[1126] Sending the generated plan (server)

[1127] Description: The generated travel plan is converted to JSON format and sent from the server to the terminal as an HTTP response.

[1128] Input: The generated itinerary.

[1129] Output: JSON data of the travel plan sent from the server to the device.

[1130] Specific operation: The server sends the following JSON data to the terminal:

[1131] json

[1132] {

[1133] "itinerary": [

[1134] {

[1135] "date": "2023-12-01",

[1136] "activities": [

[1137] {

[1138] "time": "10:00",

[1139] "activity": "Visit Kiyomizu Temple"

[1140] },

[1141] {

[1142] "time": "14:00",

[1143] "activity": "Lunch at local restaurant"

[1144] }

[1145] ]

[1146] },

[1147] / / The travel itinerary continues below...

[1148] ],

[1149] "accommodations": [

[1150] {

[1151] "name": "Kyoto Hotel",

[1152] "check_in": "2023-12-01",

[1153] "check_out": "2023-12-10"

[1154] }

[1155] ],

[1156] "transportation": [

[1157] {

[1158] "type": "Shinkansen",

[1159] "from": "Tokyo",

[1160] "to": "Kyoto",

[1161] "departure": "2023-12-01 08:00"

[1162] }

[1163] ]

[1164] }

[1165] Step 6:

[1166] Display travel plan (device)

[1167] Description: The device parses the received travel plan JSON data and displays it on the screen in a user-friendly format, allowing the user to see the itinerary, accommodation information, and transportation details.

[1168] Input: JSON data of the travel plan sent from the server.

[1169] Output: The itinerary displayed to the user.

[1170] Specific operation: The terminal generates the following HTML and displays it on the browser:

[1171] html

[1172] <h1> Travel Planner< / h1>

[1173] <h2>2023-12-01< / h2>

[1174]

[1175] 10:00 - Visit Kiyomizu Temple

[1176] 14:00 - Lunch at local restaurant

[1177]

[1178] <!-- The following is the continuation of the travel schedule... -->

[1179] <h2> Accommodation Information< / h2>

[1180] Kyoto Hotel (Check-in: 2023-12-01, Check-out: 2023-12-10)

[1181] <h2> means of transportation< / h2>

[1182] Shinkansen (Tokyo to Kyoto, Departure: 2023-12-01 08:00)

[1183] (Application Example 1)

[1184] Next, Application Example 1 will be described. In the following description, the data processing device 12 is referred to as the "server", and the headset-type terminal 314 is referred to as the "terminal".

[1185] In the conventional travel planning system, a customized travel plan is generated based on the information provided by the user, but the display method is limited, and it is difficult for the user to visually understand what kind of travel they will actually experience. In addition, it is difficult to provide real-time feedback and review the travel plan, which has been a problem with poor user experience.

[1186] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1187] In this invention, the server includes: means for receiving information on travel preferences, budget, travel period, areas of interest, and places to visit from a user; means for querying a database based on the received information to obtain travel information on the places to visit; means for executing a generation algorithm to generate an optimal travel plan based on the obtained travel information and the received information; and means for displaying the generated travel plan in real time to provide virtual tour options, thereby allowing the user to visually check the customized travel plan in real time and easily consider travel details.

[1188] "User Information" means information provided by a User regarding travel preferences, budget, travel duration, areas of interest, and places to visit.

[1189] A "database" is a collection of information including travel information such as tourist attractions, accommodation, transportation options, and feedback from past travelers about the destinations visited.

[1190] A "generation algorithm" is a calculation method for generating optimal travel plans based on acquired travel information and user information.

[1191] A "virtual tour" is an online simulation that provides users with a visual and interactive travel experience of the places they plan to visit.

[1192] "Real-time" refers to the time period in which data processing and information provision are carried out immediately.

[1193] "Travel Plan" means a detailed plan of places to visit, attractions, accommodations, and transportation that is customized based on information provided by a User.

[1194] "User experience" refers to the ease of use and satisfaction that users feel when using a system.

[1195] A "server" is a computer system that processes data, receives user information, and generates and provides travel plans.

[1196] The present invention is a system that simplifies user travel planning and provides personalized itineraries. The system collects user information, runs a generation algorithm to generate an optimal itinerary, and provides a virtual tour experience.

[1197] System Configuration

[1198] The system uses the following hardware and software:

[1199] Hardware

[1200] Smartphone (iOS or Android)

[1201] Server (cloud server, e.g. AWS, Google Cloud)

[1202] software

[1203] Smartphone applications (e.g., Swift, Kotlin)

[1204] Server-side applications (e.g., Node.js, Python)

[1205] Database (e.g. PostgreSQL, MongoDB)

[1206] Generative AI models (e.g., GPT-4)

[1207] Processing flow

[1208] 1. Collection of User Information

[1209] Users enter information such as budget, travel duration, areas of interest, and places to visit through a smartphone application.

[1210] The smartphone application sends this information to a server.

[1211] 2. Database Queries

[1212] Based on the received user information, the server queries the database to obtain travel information such as tourist attractions, accommodation, transportation options, and feedback from past travelers regarding the destination.

[1213] 3. Executing the generation algorithm

[1214] The server combines the acquired travel information with the information provided by the user and generates an optimal travel plan using a generative AI model (e.g., GPT-4).

[1215] 4. Providing travel plans

[1216] The generated travel plan is sent from the server to the smartphone application.

[1217] The smartphone application displays the received itinerary to the user and offers the option of a virtual tour.

[1218] Example

[1219] For example, a user enters the following information into a smartphone application for a family trip:

[1220] Budget: 500,000 yen

[1221] Travel period: December 1, 2023 to December 10, 2023

[1222] Areas of interest: Culture, history

[1223] Visited: Kyoto

[1224] The server queries the database to obtain information such as Kyoto's tourist attractions, accommodations, transportation options, and feedback from past travelers. A generative algorithm (e.g., GPT-4) analyzes this data and generates an optimal travel plan. This plan is provided to the user in the form of a virtual tour, allowing them to visually check the plan details in real time.

[1225] Prompt Sentence Examples

[1226] User Information:

[1227] Budget: 500,000 yen

[1228] Travel period: December 1, 2023 to December 10, 2023

[1229] Areas of interest: Culture, history

[1230] Visited: Kyoto

[1231] Acquired data:

[1232] Tourist attractions: Kiyomizu-dera Temple, Fushimi Inari Shrine, Ginkaku-ji Temple

[1233] Accommodation: Hotel Okura, Kyoto Century Hotel, Granvia

[1234] Transportation: City bus, subway

[1235] Past traveller feedback: Highly rated attractions

[1236] prompt:

[1237] Use this information to optimize your users' travel plans and generate customized itineraries.

[1238] The above is an embodiment of the present invention, which allows users to conveniently enjoy a personalized travel experience that is tailored to their preferences and needs.

[1239] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1240] Step 1:

[1241] The user enters information such as budget, travel duration, areas of interest, and places to visit into the smartphone application. The device then sends the data to the server. Specifically, the user enters their travel information into the application form and presses the submit button. The transmitted data is received by the server in JSON format.

[1242] Step 2:

[1243] The server queries the database based on the received user information to retrieve travel information such as tourist attractions, accommodations, transportation options, and feedback from past travelers about the destination. The queried data is retrieved by filtering information that matches specific keywords or conditions. The input is the user's travel information, and the output is the retrieved travel-related data.

[1244] Step 3:

[1245] The server integrates the acquired travel information with information from the user and generates an optimal travel plan using a generative AI model (GPT-4). Specifically, it selects the dates and places to visit that best suit the user's preferences and travel conditions, and creates a detailed plan. The input here is the travel information acquired in Step 2 and user information, and the output is the generated travel plan.

[1246] Step 4:

[1247] The generated itinerary is sent from the server to a smartphone application. The device displays the received itinerary, allowing the user to review each item of the itinerary (such as accommodation, sightseeing spots, and transportation) in detail. Specifically, the application displays each section of the plan in an easy-to-read format, allowing the user to scroll through the plan.

[1248] Step 5:

[1249] The device provides a virtual tour option, and the user selects the virtual tour and starts the simulation. For example, when the user selects the virtual tour mode displayed on the device, an interactive map and 3D visuals are displayed, allowing the user to experience a virtual trip.

[1250] The above are the specific processing steps for carrying out the present invention, which allow the user to visually check the customized travel plan in real time and consider the details of the trip.

[1251] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1252] The present invention is a system for maximizing the customization of a user's travel experience and providing real-time emotional feedback. The system generates and provides optimal travel plans by combining user input, travel information from a database, a generation algorithm, and an emotion engine.

[1253] Program Generation and Processing

[1254] Collection of user information (device)

[1255] The device collects the following information from the user:

[1256] budget

[1257] Travel period

[1258] Areas of interest (e.g. culture, history, food)

[1259] Places visited

[1260] Once the user enters this information, the device sends it to the server.

[1261] Obtaining data based on received information (server)

[1262] The server queries the database based on the user information received from the terminal to obtain travel information such as tourist attractions, accommodation, transportation, and feedback from past travelers about the destination.

[1263] Execution of the generation algorithm (server)

[1264] The server combines the acquired travel information with the information provided by the user and runs a generation algorithm to generate an optimal travel plan. This algorithm analyzes the user's preferences and past user data to create a plan that best suits their individual needs.

[1265] Utilizing emotion engine (server)

[1266] The server uses an emotion engine to recognize the user's emotions. The emotion engine analyzes the user's voice and facial expression data to understand the user's current emotional state.

[1267] Travel plan adjustment (server)

[1268] The emotion engine recognizes the user's emotions and re-runs the generation algorithm to adjust the itinerary in real time. For example, if the user expresses dissatisfaction with the itinerary, the itinerary will be changed to reflect the user's preferences.

[1269] Sending the generated travel plan (server)

[1270] The generated itinerary is sent from the server to the device, and includes details such as a daily schedule, recommended sightseeing spots, accommodations, and transportation options.

[1271] Display travel plan (device)

[1272] The device displays the received travel plan on the user's screen, allowing them to check the trip itinerary and activity details, and provides real-time feedback based on the user's emotional state.

[1273] Specific examples

[1274] Example 1: Family trip

[1275] A user wants to plan a family trip. The user enters the following information into the device:

[1276] Budget: 500,000 yen

[1277] Travel period: December 1, 2023 to December 10, 2023

[1278] Areas of interest: Culture, history

[1279] Visited: Kyoto

[1280] The device collects this information and sends it to a server. The server queries a database to obtain information on Kyoto's tourist attractions, accommodations, and events. A generation algorithm analyzes this data and generates an optimal travel plan for the user. Furthermore, an emotion engine analyzes the user's emotions and adjusts the plan in real time if the plan is deemed unsatisfactory. The generated travel plan is then sent to the device, where the user can view it.

[1281] Example 2: Business Travel

[1282] Another user wants to plan a business trip. The user enters the following information into the device:

[1283] Budget: 300,000 yen

[1284] Travel period: November 5, 2023 to November 7, 2023

[1285] Areas of interest: Business, Meeting Spaces

[1286] Visited: Tokyo

[1287] The device collects this information and sends it to a server. The server queries a database to obtain information on hotels, meeting spaces, and transportation options in Tokyo. A generation algorithm analyzes this data and generates a business travel plan that is optimal for the user. Furthermore, an emotion engine analyzes the user's emotions and adjusts the plan in real time if the plan is deemed unsatisfactory. The generated plan is then sent to the device, where the user can review it.

[1288] This allows users to easily enjoy a personalized travel experience tailored to their preferences and needs.The system's unique feature is that it efficiently performs a series of processes, from collecting user information, running a generation algorithm, providing real-time feedback using an emotion engine, and finally providing a final travel plan.

[1289] The processing flow will be explained below.

[1290] Step 1:

[1291] The device presents the user with a travel planning form, into which the user enters the following information:

[1292] budget

[1293] Travel period

[1294] Areas of interest (e.g. culture, history, food)

[1295] Places visited

[1296] Step 2:

[1297] The device collects information entered by the user and sends it to the server. For example, the information is sent in the following format:

[1298] json

[1299] {

[1300] "budget": 500000,

[1301] "travel_period": "2023-12-01 to 2023-12-10",

[1302] "interests": ["culture", "history", "food"],

[1303] "location": "Kyoto"

[1304] }

[1305] Step 3:

[1306] The server receives the user information sent from the device and creates a database query to retrieve the most relevant travel information from the database based on the user's interests and destinations.

[1307] Step 4:

[1308] The server executes the query and retrieves travel information from the database, including tourist destinations, accommodations, transportation options, and feedback from past travelers.

[1309] Step 5:

[1310] The server runs a generation algorithm based on the acquired travel information and user information, which analyzes the user's preferences and past user data to generate a customized, optimal travel plan.

[1311] Step 6:

[1312] Before sending the generated travel plan to the user, the server recognizes the user's emotions using an emotion engine, which analyzes the user's voice data and facial expression data in real time to understand the user's emotional state.

[1313] Step 7:

[1314] The server evaluates whether the generated itinerary meets the user's expectations based on the analysis results of the emotion engine. If the user expresses dissatisfaction, the generation algorithm is run again and the itinerary is adjusted.

[1315] Step 8:

[1316] The server then sends the final itinerary to the device, which includes details such as daily schedules, recommended sightseeing spots, accommodations, and transportation options.

[1317] Step 9:

[1318] The device receives the travel plan sent from the server and displays it on the user's screen, allowing the user to check the details of the travel plan and fine-tune the plan.

[1319] For example, if a user plans a family trip, they can go through steps 1 to 9 to get a trip plan that perfectly suits their needs. For example, based on the information they enter, the device will display the following trip plan:

[1320] Travel period: 2023-12-01 to 2023-12-10

[1321] Budget: 500,000 yen

[1322] Visited: Kyoto

[1323] Day 1: Kiyomizu-dera Temple - Visit the historic building followed by a meal at a local restaurant.

[1324] Day 2: Ginkakuji Temple - After sightseeing, take a break at a traditional teahouse.

[1325] ...

[1326] Accommodation: XYZ Hotel

[1327] Transportation: Train, bus

[1328] For business travel, the same steps are followed to provide users with the best business travel plan, which incorporates real-time feedback from the user's emotion engine, allowing users to adjust the plan on the fly.

[1329] Example 2

[1330] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1331] Modern travelers have very diverse needs and preferences, and there is a lack of systems that can automatically generate travel plans that comprehensively satisfy these. It is also difficult to adjust plans to reflect real-time emotions and feedback during the trip. For this reason, current systems have difficulty providing users with a satisfying travel experience.

[1332] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for collecting user information, means for querying a database based on the received information to obtain travel information, means for executing a generative model based on the obtained information to generate an optimal travel plan, means for recognizing the user's emotional state and adjusting the travel plan in real time, and means for transmitting the generated travel plan to the user. This makes it possible to provide a highly customized travel plan that reflects the user's individual needs in real time.

[1333] "User" refers to an individual or organization that uses the System to generate travel plans.

[1334] "Travel preferences" are criteria for selecting a travel destination based on a user's interests and concerns, including specific areas such as culture, history, and food.

[1335] "Budget" means the range of amounts a User is willing to spend for the entire trip.

[1336] "Travel Period" refers to the time range from the start date to the end date for which a User plans to travel.

[1337] A "visited location" is a geographic location selected by a user as a travel destination.

[1338] "Database" refers to an information system that stores travel information in response to user requests and makes it searchable through queries.

[1339] A "generative model" is a type of algorithm or AI technology that generates optimal travel plans based on user input information and data obtained from a database.

[1340] "Emotional state" refers to the user's current psychological state and mood, which can be obtained by analyzing the user's voice and facial expression data.

[1341] "Travel information" includes various data related to travel, such as tourist destinations, accommodation, transportation, and feedback from past travelers.

[1342] "Real-time" refers to processing timing that is conscious of immediately reflecting the user's current behavior and emotions.

[1343] "Travel Plan" means a specific plan including travel dates, places to visit, accommodation, transportation, etc., customized according to the User's requirements and preferences.

[1344] "Generating means" refers to the hardware or software functionality used by the system to automatically generate a travel plan.

[1345] "Transmission Means" means the communications technology or protocol used to transmit the generated itinerary to the user.

[1346] "Means for displaying" refers to an interface that allows a user to view the generated travel plan on the screen of the terminal.

[1347] This invention is a system for maximizing the customization of a user's travel experience and providing real-time emotional feedback. The system generates and provides optimal travel plans by combining user input, travel information from a database, a generative model, and an emotion engine.

[1348] Collection of user information (device)

[1349] The device collects information from the user about travel preferences, budget, travel duration, areas of interest, and places to visit. Once the user enters this information, the device transmits the information to a server. The device can be a mobile device such as a tablet or smartphone.

[1350] Obtaining data based on received information (server)

[1351] The server analyzes the user information received from the device and queries a database based on that information. The database stores travel information such as tourist spots, accommodations, transportation options, and feedback from past travelers. The database is managed using a relational database such as MySQL or PostgreSQL.

[1352] Execution of the generative model (server)

[1353] The server combines the acquired travel information with the information provided by the user and runs a generative model to generate an optimal travel plan. This generative model uses a generative AI model such as GPT-4. The generative model generates the optimal travel plan via a prompt sentence.

[1354] Prompt Sentence Examples

[1355] "Create a travel plan for a family trip to Kyoto from December 1, 2023 to December 10, 2023 with a budget of 500,000 yen. Your areas of interest are culture and history. Your itinerary should include details of recommended tourist attractions, accommodation, and transportation, and take into account feedback based on the user's emotional state."

[1356] Utilizing emotion engine (server)

[1357] The server analyzes voice and facial expression data to understand the user's emotional state. For example, it uses emotion recognition services such as Microsoft Azure's Emotion Recognition API and Amazon Rekognition. Based on the results of the user's emotion analysis, real-time adjustments to the travel plan are made.

[1358] Travel plan adjustment (server)

[1359] The emotional state data obtained from the emotion engine is compared with the travel plan, and if it is determined that the user is dissatisfied, the generative model is re-run to adjust the travel plan, thereby generating an optimal travel plan that is in line with the user's emotional state.

[1360] Sending the generated travel plan (server)

[1361] The final itinerary is then sent from the server to the device using a secure communication protocol such as HTTPS. After sending, an error check is performed to ensure the data was sent correctly.

[1362] Display travel plan (device)

[1363] The device receives the travel plan from the server and displays it on the user's screen, including a daily schedule, recommended sightseeing spots, accommodations, and transportation options. The screen also features real-time feedback, allowing additional adjustments to be made immediately based on the user's emotional state.

[1364] This allows users to easily enjoy a personalized travel experience that is tailored to their preferences and needs, and further enhances their satisfaction during their trip by providing real-time emotional feedback.

[1365] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1366] Step 1: Collecting user information (device)

[1367] The terminal receives input from the user regarding travel preferences, budget, travel duration, areas of interest, and places to visit. Specifically, the terminal provides an interface into which the user can input information, and once the information is entered, it formats the data and sends it to the server. The input information includes budget (e.g., 500,000 yen), travel duration (e.g., December 1, 2023 to December 10, 2023), areas of interest (e.g., culture, history), and places to visit (e.g., Kyoto). This data is sent to the server.

[1368] Step 2: Retrieving data based on received information (server)

[1369] The server analyzes the user information received from the device as input and queries the database based on that information to obtain travel information. Specifically, the server executes an SQL query such as "SELECT FROM TravelData WHERE Location = 'Kyoto'" and obtains travel information (e.g., a list of tourist attractions and accommodations) from the database as output. The obtained data is stored in internal storage.

[1370] Step 3: Execute the generative model (server)

[1371] The server combines the acquired travel information with the information provided by the user as input, runs the generative model using the prompt sentence, and generates the optimal travel plan. Specifically, the server inputs the following prompt sentence into the generative AI model (e.g., GPT-4):

[1372] "Create a travel plan for a family trip to Kyoto from December 1, 2023 to December 10, 2023 with a budget of 500,000 yen. Your areas of interest are culture and history. Your itinerary should include details of recommended tourist attractions, accommodation, and transportation, and take into account feedback based on the user's emotional state."

[1373] The generated itinerary is obtained as output and is temporarily saved.

[1374] Step 4: Utilizing the Emotion Engine (Server)

[1375] The server receives voice and facial expression data from the device as input to understand the user's emotional state. Specifically, the device captures the user's voice and facial expressions and sends them to the server. The server then uses emotion recognition services such as the Microsoft Azure Emotion Recognition API and Amazon Rekognition to analyze the emotional state and obtain emotional data as output. This data is stored in the internal storage.

[1376] Step 5: Adjusting Travel Plans (Server)

[1377] The server analyzes the emotion data obtained from the emotion engine and the existing travel plan as input. Specifically, if the server recognizes that the user's emotion is dissatisfied, it re-runs the generative model and readjusts the travel plan based on the new prompt. The regenerated travel plan is saved as output.

[1378] Step 6: Sending the generated travel plan (server)

[1379] The server takes the final generated travel plan as input and sends it to the terminal. Specifically, the server sends the travel plan to the terminal using a secure communication protocol such as "HTTPS." After sending, an error check is performed to confirm that the data was sent correctly. The transmission result is obtained as output.

[1380] Step 7: View your travel plans (device)

[1381] The terminal takes the travel plan received from the server as input, analyzes it, and displays it on the user's screen. Specifically, the terminal displays the travel plan's daily schedule, recommended tourist spots, accommodations, transportation options, etc., and also provides real-time feedback based on the user's emotional state. The user can review the travel plan and select the next action based on its contents. The travel plan is displayed to the user as output.

[1382] (Application example 2)

[1383] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1384] Current travel planning systems have difficulty adjusting travel plans based on users' individual preferences and real-time changing emotions, which can lead to a decline in the quality and satisfaction of the travel experience. Furthermore, the lack of customization and real-time adjustment of travel plans makes it difficult to meet the diverse needs of users.

[1385] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for receiving information on travel preferences, budget, travel period, areas of interest, and places to visit from a user; means for querying a database based on the received information and acquiring travel information on the places to visit; means for executing a generation algorithm to generate an optimal travel plan based on the acquired travel information and the received information; means for sending the generated travel plan to the user; means for analyzing the user's emotional state and adjusting the travel plan in real time; and means for virtually displaying the adjusted travel plan on a visual device. This enables customization of the travel plan and further allows the plan to be adjusted according to the user's real-time emotional state, thereby improving the quality and satisfaction of the travel experience.

[1386] The "means for receiving information from the user regarding travel preferences, budget, travel duration, areas of interest, and places to visit" refers to an interface through which the user can input various information necessary for travel planning and through which the system collects that information.

[1387] "Means for querying a database based on the received information to obtain travel information related to the destination" refers to the process of searching and extracting appropriate travel information from a database based on the information provided by the user.

[1388] "Means for executing a generation algorithm to generate an optimal travel plan based on the acquired travel information and received information" refers to a function that executes an algorithm that combines and analyzes user-entered information and travel information acquired from the database to create an optimal travel plan.

[1389] The "means for transmitting the generated travel plan to the user" is a communication function for transmitting the generated travel plan to the user's terminal so that the user can access it.

[1390] "Means for analyzing the user's emotional state and adjusting travel plans in real time" refers to a function that analyzes the user's emotional data to understand the user's current emotional state and adjusts travel plans accordingly in real time.

[1391] "Means for virtually displaying the adjusted travel plan on a visual device" refers to a function that visually displays the adjusted travel plan on a visual device used by the user, such as a smartphone or head-mounted display.

[1392] To implement the present invention, the following system configuration and procedure are used.

[1393] User Information Collection:

[1394] The user uses a device such as a smartphone or head-mounted display to input information about their travel preferences, budget, travel period, areas of interest, and places to visit. A user interface is used to set up an appropriate form to collect the user's input. For example, a specific prompt sentence such as "I am planning a business trip to Tokyo from November 5, 2023 to November 7, 2023. My budget is 300,000 yen. Please tell me the optimal travel plan, including information about meeting spaces." is input.

[1395] Database queries and information retrieval:

[1396] The server receives the user information from the device and queries the database to retrieve travel information such as tourist attractions, accommodations, transportation options, and user reviews for the destination. This query uses an efficient search algorithm to explore the extensive database.

[1397] Run the generation algorithm:

[1398] The server combines the acquired travel information with the information provided by the user and runs a generative algorithm to generate an optimal travel plan. The algorithm uses machine learning technology to provide personalized plans based on past user data. A specific generative AI model is used to generate the plan, providing content that best suits the user's characteristics.

[1399] Leveraging the Emotion Engine:

[1400] The server uses an emotion engine to analyze the user's emotional state. This emotion analysis is performed by collecting the user's voice and facial expression data in real time and evaluating their psychological state. For example, if the user is dissatisfied with the travel plan, the analysis result will be determined as unsatisfactory. Based on this information, the server re-runs the generation algorithm and adjusts the plan.

[1401] Adjust and view your travel plans:

[1402] The server then sends the adjusted itinerary to the user's visual device, where the user can view the itinerary in real time via a smartphone, head-mounted display, or other device, including detailed itinerary and recommended sightseeing spots, accommodations, and transportation options.

[1403] Hardware and software used:

[1404] Hardware: Smartphones, smart glasses, head-mounted displays

[1405] Software: Python, Emotion Engine API, Travel Data API, Travel Plan Generator API, Device Interface Module

[1406] The system allows users to view and adjust their travel plans in real time according to their preferences and needs, significantly improving the quality of their travel experience. Utilizing artificial intelligence models and prompts, it can provide a more personalized experience, increasing user satisfaction.

[1407] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1408] Step 1:

[1409] The user uses a device such as a smartphone or head-mounted display to input information about their travel preferences, budget, travel duration, areas of interest, and places to visit. This information is collected through a user interface. Specifically, the user enters a prompt such as, "I am planning a business trip to Tokyo from November 5, 2023 to November 7, 2023. My budget is 300,000 yen. Please tell me the optimal travel plan, including information about meeting spaces." The input information is sent to the server as structured data in JSON format, etc. The input is user information data, and the output is the user input data sent to the server.

[1410] Step 2:

[1411] The server queries the database based on the user information received from the device to obtain travel information related to the relevant destinations. This query operation includes tourist destination information, accommodation information, transportation information, and user reviews. The input is user input data, and the output is travel information data. Information is efficiently extracted from large databases using SQL and various APIs.

[1412] Step 3:

[1413] The server combines the acquired travel information with information provided by the user and executes a generation algorithm. This generation algorithm references past user data and similar travel plans and uses machine learning technology to generate the optimal travel plan. Specifically, it uses Python and machine learning libraries (such as TensorFlow and PyTorch). The inputs are user input data and travel information data, and the output is the optimal travel plan data.

[1414] Step 4:

[1415] The server adjusts the generated travel plan based on the results of the user's emotion analysis. The emotion engine analyzes the user's voice data and facial expression data to understand their current emotional state. This analysis uses the Emotion Engine API and voice and image processing technology. The input is the generated travel plan data and emotion data, and the output is the adjusted travel plan data. If the user is deemed dissatisfied, the server executes a process to automatically generate a new plan or modify the existing plan.

[1416] Step 5:

[1417] The server generates data for a virtual display of the adjusted itinerary on a visual device and sends it to the user's terminal. The terminal receives the data and displays it so that the user can visually check the itinerary. The display format is adapted to the smartphone application screen or head-mounted display. The input is the adjusted itinerary data, and the output is the display data of the terminal. The travel itinerary, recommended sightseeing spots, accommodations, and transportation methods are displayed in detail on the terminal screen.

[1418] Through this series of processes, users can check and enjoy the optimal travel plan based on their preferences and real-time emotional state.

[1419] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1420] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1421] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1422] [Fourth embodiment]

[1423] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1424] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1425] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1426] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1427] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1428] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1429] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1430] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1431] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1432] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1433] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1434] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1435] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1436] The present invention is a system for simplifying travel planning for users and providing individually customized itineraries. The system uses a generation algorithm to generate an optimal travel plan based on information provided by the user, and then provides the plan to the user.

[1437] Program Generation and Processing

[1438] Collection of user information (device)

[1439] The device collects the following information from the user:

[1440] budget

[1441] Travel period

[1442] Areas of interest (e.g. culture, history, food)

[1443] Places visited

[1444] Once the user enters this information, the device sends it to the server.

[1445] Obtaining data based on received information (server)

[1446] The server queries the database based on the user information received from the terminal to obtain travel information such as tourist attractions, accommodation, transportation, and feedback from past travelers about the destination.

[1447] Execution of the generation algorithm (server)

[1448] The server combines the acquired travel information with the information provided by the user and runs a generation algorithm to generate an optimal travel plan. The algorithm analyzes the user's preferences and past traveler data to create a plan that best suits their individual needs.

[1449] Sending the generated travel plan (server)

[1450] The generated travel plan is transmitted from the server to the terminal.

[1451] Display travel plan (device)

[1452] The device displays the received travel plan on the user's screen, allowing the user to check the travel itinerary and activity details.

[1453] Specific examples

[1454] Example 1: Family trip

[1455] A user wants to plan a family trip. The user enters the following information into the device:

[1456] Budget: 500,000 yen

[1457] Travel period: December 1, 2023 to December 10, 2023

[1458] Areas of interest: Culture, history

[1459] Visited: Kyoto

[1460] The device collects this information and sends it to a server. The server queries a database to retrieve information about Kyoto's tourist attractions, accommodations, and events based on past feedback and interests. A generation algorithm analyzes this data and generates a travel plan that is optimized for the user. The generated plan is then sent to the device, where the user can review it.

[1461] Example 2: Business Travel

[1462] Another user wants to plan a business trip. The user enters the following information into the device:

[1463] Budget: 300,000 yen

[1464] Travel period: November 5, 2023 to November 7, 2023

[1465] Areas of interest: Business, Meeting Spaces

[1466] Visited: Tokyo

[1467] The device collects this information and sends it to a server. The server queries a database to retrieve information about hotels, meeting spaces, and transportation options in Tokyo based on past feedback and business needs. A generative algorithm analyzes this data and generates a business travel plan that is optimized for the user. The plan is then sent to the device, where the user can review it.

[1468] This allows users to easily enjoy a personalized travel experience tailored to their preferences and needs.The system's unique feature is that it efficiently performs a series of processes, from collecting user information to running the generation algorithm and providing the final travel plan.

[1469] The processing flow will be explained below.

[1470] Step 1:

[1471] The device presents the user with a travel planning form, into which the user enters the following information:

[1472] budget

[1473] Travel period

[1474] Areas of interest (e.g. culture, history, food)

[1475] Places visited

[1476] Step 2:

[1477] The device collects information entered by the user and sends it to the server. For example, the information is sent in the following format:

[1478] json

[1479] {

[1480] "budget": 500000,

[1481] "travel_period": "2023-12-01 to 2023-12-10",

[1482] "interests": ["culture", "history", "food"],

[1483] "location": "Kyoto"

[1484] }

[1485] Step 3:

[1486] The server receives the user information sent from the device and creates a database query to retrieve the most relevant travel information from the database based on the user's interests and destinations.

[1487] Step 4:

[1488] The server executes the query and retrieves travel information from the database, including tourist destinations, accommodations, transportation options, and feedback from past travelers.

[1489] Step 5:

[1490] The server runs a generation algorithm based on the acquired travel information and user information, which analyzes the user's preferences and past user data to generate a customized, optimal travel plan.

[1491] Step 6:

[1492] The server then sends the generated itinerary to the device, which includes details such as a daily schedule, recommended sightseeing spots, accommodations, and transportation options.

[1493] Step 7:

[1494] The device receives the travel plan sent from the server and displays it on the user's screen, allowing the user to check the details of the travel plan and fine-tune the plan.

[1495] For example, if a user is planning a family trip, they can go through steps 1 to 7 to get a trip plan that perfectly suits their needs. For example, based on the information they enter, the device will display the following trip plan:

[1496] Travel period: 2023-12-01 to 2023-12-10

[1497] Budget: 500,000 yen

[1498] Visited: Kyoto

[1499] Day 1: Kiyomizu-dera Temple - Visit the historic building followed by a meal at a local restaurant.

[1500] Day 2: Ginkakuji Temple - After sightseeing, take a break at a traditional teahouse.

[1501] ...

[1502] Accommodation: XYZ Hotel

[1503] Transportation: Train, bus

[1504] This detailed flow provides an optimized itinerary generated from the user's input, greatly simplifying travel preparation.

[1505] Example 1

[1506] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1507] Modern travel planning is complex, requiring the collection and organization of a large amount of information. Users must manually research information using numerous websites and applications, which takes time and effort. Furthermore, it can be difficult to find the optimal travel plan that meets a user's individual preferences and budget. The present invention aims to eliminate the complexity of travel planning and provide users with a simple, personalized travel plan.

[1508] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1509] In this invention, the server includes means for receiving information on travel preferences, budget, travel period, areas of interest, and places to visit from a user, means for querying a database based on the received information to obtain travel information on the places to visit, means for executing a generation algorithm to generate an optimal travel plan based on the obtained travel information and the received information, means for transmitting the generated travel plan to the user, means for the terminal to compile the information collected from the user into a single data packet and transmit it to the server, means for the server to analyze the received information and execute a query to obtain the necessary travel information from the database, means for converting the generated travel plan into JSON format and transmitting it to the terminal, and means for displaying the received travel plan to the user in an easy-to-read format. This allows users to easily obtain an optimal travel plan based on their preferences and needs and efficiently plan their trip.

[1510] "User" means any individual or group of people who use the System to plan their travel.

[1511] "Server" refers to a computer system that receives information sent by a user, processes the information, generates an optimal travel plan, and sends it to a terminal.

[1512] "Terminal" refers to the device (e.g., smartphone, tablet, or PC) through which a user inputs information and displays the travel plan received from the server.

[1513] "Budget" refers to the amount of money a user sets for travel expenses.

[1514] "Travel Period" refers to the period from the start date to the end date of a User's trip.

[1515] "Areas of Interest" refers to activities or themes (e.g., culture, history, food) that a user is particularly interested in while traveling.

[1516] "Destination" means a geographic location selected by a User for travel planning purposes.

[1517] "Database" refers to a collection of data that the server queries to obtain a user's travel information.

[1518] "Generation algorithm" refers to a calculation method for generating the optimal travel plan for a user based on the information received and the travel information acquired.

[1519] "Travel Plan" means a detailed plan, including the overall schedule and suggested activities, for your trip.

[1520] "Data Packet" refers to the formatted unit of data used to transmit information collected from a user to a server.

[1521] A "query" refers to a query command that is executed to retrieve information from a database.

[1522] "JSON format" stands for JavaScript Object Notation and refers to a common format used to store and transfer data in a structured manner.

[1523] "User Information" means all data provided by a User to the System for the purposes of planning a trip (e.g., budget, duration of trip, areas of interest, places to visit).

[1524] The present invention is a system for simplifying travel planning for users and providing individually customized itineraries. The system uses a generation algorithm to generate an optimal travel plan based on information provided by the user, and then provides the plan to the user.

[1525] The system primarily consists of the following hardware and software components:

[1526] Device (e.g. smartphone, tablet, PC)

[1527] Server (cloud computing environment)

[1528] Database systems (e.g., SQL databases)

[1529] Generative algorithms (e.g., AI models)

[1530] First, the user uses the device to enter information about their trip, including budget, travel duration, areas of interest, and places to visit. The user enters this information through the device's interface and presses the send button.

[1531] The device collects information from the user and sends it to the server, which then parses it into JSON format data. The server then queries a database based on the user information to retrieve travel information about the destination, including tourist attractions, accommodation, transportation options, and feedback from past travelers.

[1532] The server combines the acquired travel information with the information provided by the user and runs a generation algorithm that analyzes the user's preferences and past traveler data to generate a travel plan that best suits their individual needs. The generated itinerary is then converted back to JSON format and sent from the server to the device.

[1533] The device displays the received travel plan on the user's screen, allowing the user to review the travel itinerary and activity details, and the user can review the displayed plan and make adjustments or changes as necessary.

[1534] Specific examples

[1535] Example 1: Family trip

[1536] The user enters the following information into the device for a family trip:

[1537] Budget: 500,000 yen

[1538] Travel period: December 1, 2023 to December 10, 2023

[1539] Areas of interest: Culture, history

[1540] Visited: Kyoto

[1541] "Please create a travel plan for Kyoto with a budget of 500,000 yen from December 1st to December 10th that focuses on culture and history."

[1542] The device collects this information and sends it to a server. The server queries a database to obtain Kyoto's tourist attractions (e.g., Kiyomizu-dera Temple, Kinkaku-ji Temple), accommodations, event information, etc. A generation algorithm analyzes this data and generates an optimal travel plan for the user. The generated plan is then sent to the device, where the user can review it.

[1543] Example 2: Business Travel

[1544] Another user enters the following information into the device for a business trip:

[1545] Budget: 300,000 yen

[1546] Travel period: November 5, 2023 to November 7, 2023

[1547] Areas of interest: Business, Meeting Spaces

[1548] Visited: Tokyo

[1549] "Please create a travel plan for Tokyo with a budget of 300,000 yen from November 5th to November 7th, with an interest in business and meeting space."

[1550] The device sends this information to a server, which queries a database to obtain information on business hotels, meeting spaces, and transportation options in Tokyo. A generation algorithm analyzes this data and generates an optimal business travel plan. The plan is then sent to the device, where the user can review it.

[1551] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1552] Step 1:

[1553] Collection of user information (device)

[1554] Description: The terminal displays a form that allows the user to enter their travel plans. The form includes fields for budget, travel duration, areas of interest, and places to visit.

[1555] Input: The user enters information about their travel preferences, budget, travel duration, areas of interest, and places to visit.

[1556] Output: The information entered by the user is saved on the device.

[1557] Specific operation: The user enters "500,000 yen" as the budget, "December 1, 2023 to December 10, 2023" as the travel period, "culture" and "history" as areas of interest, and "Kyoto" as the place to visit on the device screen.

[1558] Step 2:

[1559] Sending information (terminal)

[1560] Description: When a user enters information and presses the submit button, the device assembles the information into a single JSON-formatted data packet, which is then sent to the server via an HTTP request.

[1561] Input: Travel information entered by the user into the device.

[1562] Output: Trip information data packet sent from the device to the server.

[1563] Specific operation: The device sends the following JSON data to the server:

[1564] json

[1565] {

[1566] "budget": 500000,

[1567] "travel_period": "2023-12-01 to 2023-12-10",

[1568] "interests": ["culture", "history"],

[1569] "destination": "Kyoto"

[1570] }

[1571] Step 3:

[1572] Data acquisition (server)

[1573] Description: The server parses the received JSON data and extracts the user information. It then queries the database to get information about the places visited, such as tourist attractions, accommodation, transportation options, and feedback from past travelers.

[1574] Input: User's travel information sent from the device.

[1575] Output: Travel information such as tourist attractions, accommodation, transportation, and feedback retrieved from the database.

[1576] What happens: The server executes the following SQL query:

[1577] sql

[1578] SELECT FROM TouristAttractions WHERE location = 'Kyoto';

[1579] SELECT FROM Hotels WHERE location = 'Kyoto';

[1580] SELECT FROM Transportation WHERE location = 'Kyoto';

[1581] SELECT FROM Feedback WHERE location = 'Kyoto';

[1582] Step 4:

[1583] Execution of the generation algorithm (server)

[1584] Description: The server runs a generation algorithm based on the data it receives. This algorithm takes into account user preferences and past traveller data to generate an optimal travel plan.

[1585] Input: Trip information retrieved from the database and information provided by the user.

[1586] Output: The generated optimal travel plan.

[1587] What it does: The generation algorithm does the following:

[1588] 1. Select a tourist destination based on your area of ​​interest.

[1589] 2. Make a list of accommodations that fit within your budget.

[1590] 3. Display available transportation options for travel.

[1591] 4. Create a schedule based on this information.

[1592] Step 5:

[1593] Sending the generated plan (server)

[1594] Description: The generated travel plan is converted to JSON format and sent from the server to the terminal as an HTTP response.

[1595] Input: The generated itinerary.

[1596] Output: JSON data of the travel plan sent from the server to the device.

[1597] Specific operation: The server sends the following JSON data to the terminal:

[1598] json

[1599] {

[1600] "itinerary": [

[1601] {

[1602] "date": "2023-12-01",

[1603] "activities": [

[1604] {

[1605] "time": "10:00",

[1606] "activity": "Visit Kiyomizu Temple"

[1607] },

[1608] {

[1609] "time": "14:00",

[1610] "activity": "Lunch at local restaurant"

[1611] }

[1612] ]

[1613] },

[1614] / / The travel itinerary continues below...

[1615] ],

[1616] "accommodations": [

[1617] {

[1618] "name": "Kyoto Hotel",

[1619] "check_in": "2023-12-01",

[1620] "check_out": "2023-12-10"

[1621] }

[1622] ],

[1623] "transportation": [

[1624] {

[1625] "type": "Shinkansen",

[1626] "from": "Tokyo",

[1627] "to": "Kyoto",

[1628] "departure": "2023-12-01 08:00"

[1629] }

[1630] ]

[1631] }

[1632] Step 6:

[1633] Display travel plan (device)

[1634] Description: The device parses the received travel plan JSON data and displays it on the screen in a user-friendly format, allowing the user to see the itinerary, accommodation information, and transportation details.

[1635] Input: JSON data of the travel plan sent from the server.

[1636] Output: The itinerary displayed to the user.

[1637] Specific operation: The terminal generates the following HTML and displays it on the browser:

[1638] html

[1639] <h1> Travel Planner< / h1>

[1640] <h2>2023-12-01< / h2>

[1641]

[1642] 10:00 - Visit Kiyomizu Temple

[1643] 14:00 - Lunch at local restaurant

[1644]

[1645] <!-- The following is the continuation of the travel schedule... -->

[1646] <h2> Accommodation Information< / h2>

[1647] Kyoto Hotel (Check-in: 2023-12-01, Check-out: 2023-12-10)

[1648] <h2> means of transportation< / h2>

[1649] Shinkansen (Tokyo to Kyoto, Departure: 2023-12-01 08:00)

[1650] (Application Example 1)

[1651] Next, Application Example 1 will be described. In the following description, the data processing device 12 is referred to as the "server", and the robot 414 is referred to as the "terminal".

[1652] In the conventional travel planning system, a customized travel plan is generated based on the information provided by the user, but the display method is limited, and it is difficult for the user to visually understand what kind of travel they will actually experience. Also, it is difficult to provide real-time feedback or review the travel plan, which has been a problem in terms of user experience.

[1653] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1654] In this invention, the server includes: means for receiving information on travel preferences, budget, travel period, areas of interest, and places to visit from a user; means for querying a database based on the received information to obtain travel information on the places to visit; means for executing a generation algorithm to generate an optimal travel plan based on the obtained travel information and the received information; and means for displaying the generated travel plan in real time to provide virtual tour options, thereby allowing the user to visually check the customized travel plan in real time and easily consider travel details.

[1655] "User Information" means information provided by a User regarding travel preferences, budget, travel duration, areas of interest, and places to visit.

[1656] A "database" is a collection of information including travel information such as tourist attractions, accommodation, transportation options, and feedback from past travelers about the destinations visited.

[1657] A "generation algorithm" is a calculation method for generating optimal travel plans based on acquired travel information and user information.

[1658] A "virtual tour" is an online simulation that provides users with a visual and interactive travel experience of the places they plan to visit.

[1659] "Real-time" refers to the time period in which data processing and information provision are carried out immediately.

[1660] "Travel Plan" means a detailed plan of places to visit, attractions, accommodations, and transportation that is customized based on information provided by a User.

[1661] "User experience" refers to the ease of use and satisfaction that users feel when using a system.

[1662] A "server" is a computer system that processes data, receives user information, and generates and provides travel plans.

[1663] The present invention is a system that simplifies user travel planning and provides personalized itineraries. The system collects user information, runs a generation algorithm to generate an optimal itinerary, and provides a virtual tour experience.

[1664] System Configuration

[1665] The system uses the following hardware and software:

[1666] Hardware

[1667] Smartphone (iOS or Android)

[1668] Server (cloud server, e.g. AWS, Google Cloud)

[1669] software

[1670] Smartphone applications (e.g., Swift, Kotlin)

[1671] Server-side applications (e.g., Node.js, Python)

[1672] Database (e.g. PostgreSQL, MongoDB)

[1673] Generative AI models (e.g., GPT-4)

[1674] Processing flow

[1675] 1. Collection of User Information

[1676] Users enter information such as budget, travel duration, areas of interest, and places to visit through a smartphone application.

[1677] The smartphone application sends this information to a server.

[1678] 2. Database Queries

[1679] Based on the received user information, the server queries the database to obtain travel information such as tourist attractions, accommodation, transportation options, and feedback from past travelers regarding the destination.

[1680] 3. Executing the generation algorithm

[1681] The server combines the acquired travel information with the information provided by the user and generates an optimal travel plan using a generative AI model (e.g., GPT-4).

[1682] 4. Providing travel plans

[1683] The generated travel plan is sent from the server to the smartphone application.

[1684] The smartphone application displays the received itinerary to the user and offers the option of a virtual tour.

[1685] Example

[1686] For example, a user enters the following information into a smartphone application for a family trip:

[1687] Budget: 500,000 yen

[1688] Travel period: December 1, 2023 to December 10, 2023

[1689] Areas of interest: Culture, history

[1690] Visited: Kyoto

[1691] The server queries the database to obtain information such as Kyoto's tourist attractions, accommodations, transportation options, and feedback from past travelers. A generative algorithm (e.g., GPT-4) analyzes this data and generates an optimal travel plan. This plan is provided to the user in the form of a virtual tour, allowing them to visually check the plan details in real time.

[1692] Prompt Sentence Examples

[1693] User Information:

[1694] Budget: 500,000 yen

[1695] Travel period: December 1, 2023 to December 10, 2023

[1696] Areas of interest: Culture, history

[1697] Visited: Kyoto

[1698] Acquired data:

[1699] Tourist attractions: Kiyomizu-dera Temple, Fushimi Inari Shrine, Ginkaku-ji Temple

[1700] Accommodation: Hotel Okura, Kyoto Century Hotel, Granvia

[1701] Transportation: City bus, subway

[1702] Past traveller feedback: Highly rated attractions

[1703] prompt:

[1704] Use this information to optimize your users' travel plans and generate customized itineraries.

[1705] The above is an embodiment of the present invention, which allows users to conveniently enjoy a personalized travel experience that is tailored to their preferences and needs.

[1706] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1707] Step 1:

[1708] The user enters information such as budget, travel duration, areas of interest, and places to visit into the smartphone application. The device then sends the data to the server. Specifically, the user enters their travel information into the application form and presses the submit button. The transmitted data is received by the server in JSON format.

[1709] Step 2:

[1710] The server queries the database based on the received user information to retrieve travel information such as tourist attractions, accommodations, transportation options, and feedback from past travelers about the destination. The queried data is retrieved by filtering information that matches specific keywords or conditions. The input is the user's travel information, and the output is the retrieved travel-related data.

[1711] Step 3:

[1712] The server integrates the acquired travel information with information from the user and generates an optimal travel plan using a generative AI model (GPT-4). Specifically, it selects the dates and places to visit that best suit the user's preferences and travel conditions, and creates a detailed plan. The input here is the travel information acquired in Step 2 and user information, and the output is the generated travel plan.

[1713] Step 4:

[1714] The generated itinerary is sent from the server to a smartphone application. The device displays the received itinerary, allowing the user to review each item of the itinerary (such as accommodation, sightseeing spots, and transportation) in detail. Specifically, the application displays each section of the plan in an easy-to-read format, allowing the user to scroll through the plan.

[1715] Step 5:

[1716] The device provides a virtual tour option, and the user selects the virtual tour and starts the simulation. For example, when the user selects the virtual tour mode displayed on the device, an interactive map and 3D visuals are displayed, allowing the user to experience a virtual trip.

[1717] The above are the specific processing steps for carrying out the present invention, which allow the user to visually check the customized travel plan in real time and consider the details of the trip.

[1718] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1719] The present invention is a system for maximizing the customization of a user's travel experience and providing real-time emotional feedback. The system generates and provides optimal travel plans by combining user input, travel information from a database, a generation algorithm, and an emotion engine.

[1720] Program Generation and Processing

[1721] Collection of user information (device)

[1722] The device collects the following information from the user:

[1723] budget

[1724] Travel period

[1725] Areas of interest (e.g. culture, history, food)

[1726] Places visited

[1727] Once the user enters this information, the device sends it to the server.

[1728] Obtaining data based on received information (server)

[1729] The server queries the database based on the user information received from the terminal to obtain travel information such as tourist attractions, accommodation, transportation, and feedback from past travelers about the destination.

[1730] Execution of the generation algorithm (server)

[1731] The server combines the acquired travel information with the information provided by the user and runs a generation algorithm to generate an optimal travel plan. This algorithm analyzes the user's preferences and past user data to create a plan that best suits their individual needs.

[1732] Utilizing emotion engine (server)

[1733] The server uses an emotion engine to recognize the user's emotions. The emotion engine analyzes the user's voice and facial expression data to understand the user's current emotional state.

[1734] Travel plan adjustment (server)

[1735] The emotion engine recognizes the user's emotions and re-runs the generation algorithm to adjust the itinerary in real time. For example, if the user expresses dissatisfaction with the itinerary, the itinerary will be changed to reflect the user's preferences.

[1736] Sending the generated travel plan (server)

[1737] The generated itinerary is sent from the server to the device, and includes details such as a daily schedule, recommended sightseeing spots, accommodations, and transportation options.

[1738] Display travel plan (device)

[1739] The device displays the received travel plan on the user's screen, allowing them to check the trip itinerary and activity details, and provides real-time feedback based on the user's emotional state.

[1740] Specific examples

[1741] Example 1: Family trip

[1742] A user wants to plan a family trip. The user enters the following information into the device:

[1743] Budget: 500,000 yen

[1744] Travel period: December 1, 2023 to December 10, 2023

[1745] Areas of interest: Culture, history

[1746] Visited: Kyoto

[1747] The device collects this information and sends it to a server. The server queries a database to obtain information on Kyoto's tourist attractions, accommodations, and events. A generation algorithm analyzes this data and generates an optimal travel plan for the user. Furthermore, an emotion engine analyzes the user's emotions and adjusts the plan in real time if the plan is deemed unsatisfactory. The generated travel plan is then sent to the device, where the user can view it.

[1748] Example 2: Business Travel

[1749] Another user wants to plan a business trip. The user enters the following information into the device:

[1750] Budget: 300,000 yen

[1751] Travel period: November 5, 2023 to November 7, 2023

[1752] Areas of interest: Business, Meeting Spaces

[1753] Visited: Tokyo

[1754] The device collects this information and sends it to a server. The server queries a database to obtain information on hotels, meeting spaces, and transportation options in Tokyo. A generation algorithm analyzes this data and generates a business travel plan that is optimal for the user. Furthermore, an emotion engine analyzes the user's emotions and adjusts the plan in real time if the plan is deemed unsatisfactory. The generated plan is then sent to the device, where the user can review it.

[1755] This allows users to easily enjoy a personalized travel experience tailored to their preferences and needs.The system's unique feature is that it efficiently performs a series of processes, from collecting user information, running a generation algorithm, providing real-time feedback using an emotion engine, and finally providing a final travel plan.

[1756] The processing flow will be explained below.

[1757] Step 1:

[1758] The device presents the user with a travel planning form, into which the user enters the following information:

[1759] budget

[1760] Travel period

[1761] Areas of interest (e.g. culture, history, food)

[1762] Places visited

[1763] Step 2:

[1764] The device collects information entered by the user and sends it to the server. For example, the information is sent in the following format:

[1765] json

[1766] {

[1767] "budget": 500000,

[1768] "travel_period": "2023-12-01 to 2023-12-10",

[1769] "interests": ["culture", "history", "food"],

[1770] "location": "Kyoto"

[1771] }

[1772] Step 3:

[1773] The server receives the user information sent from the device and creates a database query to retrieve the most relevant travel information from the database based on the user's interests and destinations.

[1774] Step 4:

[1775] The server executes the query and retrieves travel information from the database, including tourist destinations, accommodations, transportation options, and feedback from past travelers.

[1776] Step 5:

[1777] The server runs a generation algorithm based on the acquired travel information and user information, which analyzes the user's preferences and past user data to generate a customized, optimal travel plan.

[1778] Step 6:

[1779] Before sending the generated travel plan to the user, the server recognizes the user's emotions using an emotion engine, which analyzes the user's voice data and facial expression data in real time to understand the user's emotional state.

[1780] Step 7:

[1781] The server evaluates whether the generated itinerary meets the user's expectations based on the analysis results of the emotion engine. If the user expresses dissatisfaction, the generation algorithm is run again and the itinerary is adjusted.

[1782] Step 8:

[1783] The server then sends the final itinerary to the device, which includes details such as daily schedules, recommended sightseeing spots, accommodations, and transportation options.

[1784] Step 9:

[1785] The device receives the travel plan sent from the server and displays it on the user's screen, allowing the user to check the details of the travel plan and fine-tune the plan.

[1786] For example, if a user plans a family trip, they can go through steps 1 to 9 to get a trip plan that perfectly suits their needs. For example, based on the information they enter, the device will display the following trip plan:

[1787] Travel period: 2023-12-01 to 2023-12-10

[1788] Budget: 500,000 yen

[1789] Visited: Kyoto

[1790] Day 1: Kiyomizu-dera Temple - Visit the historic building followed by a meal at a local restaurant.

[1791] Day 2: Ginkakuji Temple - After sightseeing, take a break at a traditional teahouse.

[1792] ...

[1793] Accommodation: XYZ Hotel

[1794] Transportation: Train, bus

[1795] For business travel, the same steps are followed to provide users with the best business travel plan, which incorporates real-time feedback from the user's emotion engine, allowing users to adjust the plan on the fly.

[1796] Example 2

[1797] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1798] Modern travelers have very diverse needs and preferences, and there is a lack of systems that can automatically generate travel plans that comprehensively satisfy these. It is also difficult to adjust plans to reflect real-time emotions and feedback during the trip. For this reason, current systems have difficulty providing users with a satisfying travel experience.

[1799] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for collecting user information, means for querying a database based on the received information to obtain travel information, means for executing a generative model based on the obtained information to generate an optimal travel plan, means for recognizing the user's emotional state and adjusting the travel plan in real time, and means for transmitting the generated travel plan to the user. This makes it possible to provide a highly customized travel plan that reflects the user's individual needs in real time.

[1800] "User" refers to an individual or organization that uses the System to generate travel plans.

[1801] "Travel preferences" are criteria for selecting a travel destination based on a user's interests and concerns, including specific areas such as culture, history, and food.

[1802] "Budget" means the range of amounts a User is willing to spend for the entire trip.

[1803] "Travel Period" refers to the time range from the start date to the end date for which a User plans to travel.

[1804] A "visited location" is a geographic location selected by a user as a travel destination.

[1805] "Database" refers to an information system that stores travel information in response to user requests and makes it searchable through queries.

[1806] A "generative model" is a type of algorithm or AI technology that generates optimal travel plans based on user input information and data obtained from a database.

[1807] "Emotional state" refers to the user's current psychological state and mood, which can be obtained by analyzing the user's voice and facial expression data.

[1808] "Travel information" includes various data related to travel, such as tourist destinations, accommodation, transportation, and feedback from past travelers.

[1809] "Real-time" refers to processing timing that is conscious of immediately reflecting the user's current behavior and emotions.

[1810] "Travel Plan" means a specific plan including travel dates, places to visit, accommodation, transportation, etc., customized according to the User's requirements and preferences.

[1811] "Generating means" refers to the hardware or software functionality used by the system to automatically generate a travel plan.

[1812] "Transmission Means" means the communications technology or protocol used to transmit the generated itinerary to the user.

[1813] "Means for displaying" refers to an interface that allows a user to view the generated travel plan on the screen of the terminal.

[1814] This invention is a system for maximizing the customization of a user's travel experience and providing real-time emotional feedback. The system generates and provides optimal travel plans by combining user input, travel information from a database, a generative model, and an emotion engine.

[1815] Collection of user information (device)

[1816] The device collects information from the user about travel preferences, budget, travel duration, areas of interest, and places to visit. Once the user enters this information, the device transmits the information to a server. The device can be a mobile device such as a tablet or smartphone.

[1817] Obtaining data based on received information (server)

[1818] The server analyzes the user information received from the device and queries a database based on that information. The database stores travel information such as tourist spots, accommodations, transportation options, and feedback from past travelers. The database is managed using a relational database such as MySQL or PostgreSQL.

[1819] Execution of the generative model (server)

[1820] The server combines the acquired travel information with the information provided by the user and runs a generative model to generate an optimal travel plan. This generative model uses a generative AI model such as GPT-4. The generative model generates the optimal travel plan via a prompt sentence.

[1821] Prompt Sentence Examples

[1822] "Create a travel plan for a family trip to Kyoto from December 1, 2023 to December 10, 2023 with a budget of 500,000 yen. Your areas of interest are culture and history. Your itinerary should include details of recommended tourist attractions, accommodation, and transportation, and take into account feedback based on the user's emotional state."

[1823] Utilizing emotion engine (server)

[1824] The server analyzes voice and facial expression data to understand the user's emotional state. For example, it uses emotion recognition services such as Microsoft Azure's Emotion Recognition API and Amazon Rekognition. Based on the results of the user's emotion analysis, real-time adjustments to the travel plan are made.

[1825] Travel plan adjustment (server)

[1826] The emotional state data obtained from the emotion engine is compared with the travel plan, and if it is determined that the user is dissatisfied, the generative model is re-run to adjust the travel plan, thereby generating an optimal travel plan that is in line with the user's emotional state.

[1827] Sending the generated travel plan (server)

[1828] The final itinerary is then sent from the server to the device using a secure communication protocol such as HTTPS. After sending, an error check is performed to ensure the data was sent correctly.

[1829] Display travel plan (device)

[1830] The device receives the travel plan from the server and displays it on the user's screen, including a daily schedule, recommended sightseeing spots, accommodations, and transportation options. The screen also features real-time feedback, allowing additional adjustments to be made immediately based on the user's emotional state.

[1831] This allows users to easily enjoy a personalized travel experience that is tailored to their preferences and needs, and further enhances their satisfaction during their trip by providing real-time emotional feedback.

[1832] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1833] Step 1: Collecting user information (device)

[1834] The terminal receives input from the user regarding travel preferences, budget, travel duration, areas of interest, and places to visit. Specifically, the terminal provides an interface into which the user can input information, and once the information is entered, it formats the data and sends it to the server. The input information includes budget (e.g., 500,000 yen), travel duration (e.g., December 1, 2023 to December 10, 2023), areas of interest (e.g., culture, history), and places to visit (e.g., Kyoto). This data is sent to the server.

[1835] Step 2: Retrieving data based on received information (server)

[1836] The server analyzes the user information received from the device as input and queries the database based on that information to obtain travel information. Specifically, the server executes an SQL query such as "SELECT FROM TravelData WHERE Location = 'Kyoto'" and obtains travel information (e.g., a list of tourist attractions and accommodations) from the database as output. The obtained data is stored in internal storage.

[1837] Step 3: Execute the generative model (server)

[1838] The server combines the acquired travel information with the information provided by the user as input, runs the generative model using the prompt sentence, and generates the optimal travel plan. Specifically, the server inputs the following prompt sentence into the generative AI model (e.g., GPT-4):

[1839] "Create a travel plan for a family trip to Kyoto from December 1, 2023 to December 10, 2023 with a budget of 500,000 yen. Your areas of interest are culture and history. Your itinerary should include details of recommended tourist attractions, accommodation, and transportation, and take into account feedback based on the user's emotional state."

[1840] The generated itinerary is obtained as output and is temporarily saved.

[1841] Step 4: Utilizing the Emotion Engine (Server)

[1842] The server receives voice and facial expression data from the device as input to understand the user's emotional state. Specifically, the device captures the user's voice and facial expressions and sends them to the server. The server then uses emotion recognition services such as the Microsoft Azure Emotion Recognition API and Amazon Rekognition to analyze the emotional state and obtain emotional data as output. This data is stored in the internal storage.

[1843] Step 5: Adjusting Travel Plans (Server)

[1844] The server analyzes the emotion data obtained from the emotion engine and the existing travel plan as input. Specifically, if the server recognizes that the user's emotion is dissatisfied, it re-runs the generative model and readjusts the travel plan based on the new prompt. The regenerated travel plan is saved as output.

[1845] Step 6: Sending the generated travel plan (server)

[1846] The server takes the final generated travel plan as input and sends it to the terminal. Specifically, the server sends the travel plan to the terminal using a secure communication protocol such as "HTTPS." After sending, an error check is performed to confirm that the data was sent correctly. The transmission result is obtained as output.

[1847] Step 7: View your travel plans (device)

[1848] The terminal takes the travel plan received from the server as input, analyzes it, and displays it on the user's screen. Specifically, the terminal displays the travel plan's daily schedule, recommended tourist spots, accommodations, transportation options, etc., and also provides real-time feedback based on the user's emotional state. The user can review the travel plan and select the next action based on its contents. The travel plan is displayed to the user as output.

[1849] (Application example 2)

[1850] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1851] Current travel planning systems have difficulty adjusting travel plans based on users' individual preferences and real-time changing emotions, which can lead to a decline in the quality and satisfaction of the travel experience. Furthermore, the lack of customization and real-time adjustment of travel plans makes it difficult to meet the diverse needs of users.

[1852] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for receiving information on travel preferences, budget, travel period, areas of interest, and places to visit from a user; means for querying a database based on the received information and acquiring travel information on the places to visit; means for executing a generation algorithm to generate an optimal travel plan based on the acquired travel information and the received information; means for sending the generated travel plan to the user; means for analyzing the user's emotional state and adjusting the travel plan in real time; and means for virtually displaying the adjusted travel plan on a visual device. This enables customization of the travel plan and further allows the plan to be adjusted according to the user's real-time emotional state, thereby improving the quality and satisfaction of the travel experience.

[1853] The "means for receiving information from the user regarding travel preferences, budget, travel duration, areas of interest, and places to visit" refers to an interface through which the user can input various information necessary for travel planning and through which the system collects that information.

[1854] "Means for querying a database based on the received information to obtain travel information related to the destination" refers to the process of searching and extracting appropriate travel information from a database based on the information provided by the user.

[1855] "Means for executing a generation algorithm to generate an optimal travel plan based on the acquired travel information and received information" refers to a function that executes an algorithm that combines and analyzes user-entered information and travel information acquired from the database to create an optimal travel plan.

[1856] The "means for transmitting the generated travel plan to the user" is a communication function for transmitting the generated travel plan to the user's terminal so that the user can access it.

[1857] "Means for analyzing the user's emotional state and adjusting travel plans in real time" refers to a function that analyzes the user's emotional data to understand the user's current emotional state and adjusts travel plans accordingly in real time.

[1858] "Means for virtually displaying the adjusted travel plan on a visual device" refers to a function that visually displays the adjusted travel plan on a visual device used by the user, such as a smartphone or head-mounted display.

[1859] To implement the present invention, the following system configuration and procedure are used.

[1860] User Information Collection:

[1861] The user uses a device such as a smartphone or head-mounted display to input information about their travel preferences, budget, travel period, areas of interest, and places to visit. A user interface is used to set up an appropriate form to collect the user's input. For example, a specific prompt sentence such as "I am planning a business trip to Tokyo from November 5, 2023 to November 7, 2023. My budget is 300,000 yen. Please tell me the optimal travel plan, including information about meeting spaces." is input.

[1862] Database queries and information retrieval:

[1863] The server receives the user information from the device and queries the database to retrieve travel information such as tourist attractions, accommodations, transportation options, and user reviews for the destination. This query uses an efficient search algorithm to explore the extensive database.

[1864] Run the generation algorithm:

[1865] The server combines the acquired travel information with the information provided by the user and runs a generative algorithm to generate an optimal travel plan. The algorithm uses machine learning technology to provide personalized plans based on past user data. A specific generative AI model is used to generate the plan, providing content that best suits the user's characteristics.

[1866] Leveraging the Emotion Engine:

[1867] The server uses an emotion engine to analyze the user's emotional state. This emotion analysis is performed by collecting the user's voice and facial expression data in real time and evaluating their psychological state. For example, if the user is dissatisfied with the travel plan, the analysis result will be determined as unsatisfactory. Based on this information, the server re-runs the generation algorithm and adjusts the plan.

[1868] Adjust and view your travel plans:

[1869] The server then sends the adjusted itinerary to the user's visual device, where the user can view the itinerary in real time via a smartphone, head-mounted display, or other device, including detailed itinerary and recommended sightseeing spots, accommodations, and transportation options.

[1870] Hardware and software used:

[1871] Hardware: Smartphones, smart glasses, head-mounted displays

[1872] Software: Python, Emotion Engine API, Travel Data API, Travel Plan Generator API, Device Interface Module

[1873] The system allows users to view and adjust their travel plans in real time according to their preferences and needs, significantly improving the quality of their travel experience. Utilizing artificial intelligence models and prompts, it can provide a more personalized experience, increasing user satisfaction.

[1874] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1875] Step 1:

[1876] The user uses a device such as a smartphone or head-mounted display to input information about their travel preferences, budget, travel duration, areas of interest, and places to visit. This information is collected through a user interface. Specifically, the user enters a prompt such as, "I am planning a business trip to Tokyo from November 5, 2023 to November 7, 2023. My budget is 300,000 yen. Please tell me the optimal travel plan, including information about meeting spaces." The input information is sent to the server as structured data in JSON format, etc. The input is user information data, and the output is the user input data sent to the server.

[1877] Step 2:

[1878] The server queries the database based on the user information received from the device to obtain travel information related to the relevant destinations. This query operation includes tourist destination information, accommodation information, transportation information, and user reviews. The input is user input data, and the output is travel information data. Information is efficiently extracted from large databases using SQL and various APIs.

[1879] Step 3:

[1880] The server combines the acquired travel information with information provided by the user and executes a generation algorithm. This generation algorithm references past user data and similar travel plans and uses machine learning technology to generate the optimal travel plan. Specifically, it uses Python and machine learning libraries (such as TensorFlow and PyTorch). The inputs are user input data and travel information data, and the output is the optimal travel plan data.

[1881] Step 4:

[1882] The server adjusts the generated travel plan based on the results of the user's emotion analysis. The emotion engine analyzes the user's voice data and facial expression data to understand their current emotional state. This analysis uses the Emotion Engine API and voice and image processing technology. The input is the generated travel plan data and emotion data, and the output is the adjusted travel plan data. If the user is deemed dissatisfied, the server executes a process to automatically generate a new plan or modify the existing plan.

[1883] Step 5:

[1884] The server generates data for a virtual display of the adjusted itinerary on a visual device and sends it to the user's terminal. The terminal receives the data and displays it so that the user can visually check the itinerary. The display format is adapted to the smartphone application screen or head-mounted display. The input is the adjusted itinerary data, and the output is the display data of the terminal. The travel itinerary, recommended sightseeing spots, accommodations, and transportation methods are displayed in detail on the terminal screen.

[1885] Through this series of processes, users can check and enjoy the optimal travel plan based on their preferences and real-time emotional state.

[1886] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1887] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1888] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1889] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1890] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1891] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1892] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1893] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1894] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1895] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1896] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1897] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1898] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1899] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1900] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1901] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1902] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1903] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1904] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1905] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1906] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1907] The following is further disclosed regarding the above embodiment.

[1908] (Claim 1)

[1909] A means of receiving information from users regarding their travel preferences, budget, travel duration, areas of interest, and places to visit;

[1910] means for querying a database based on the received information to obtain travel information regarding the places visited;

[1911] means for executing a generation algorithm to generate an optimal travel plan based on the acquired travel information and the received information;

[1912] means for transmitting the generated itinerary to the user;

[1913] A system including:

[1914] (Claim 2)

[1915] 10. The system of claim 1, further comprising means for displaying the generated itinerary and allowing the user to confirm the trip details.

[1916] (Claim 3)

[1917] 10. The system of claim 1, wherein the generating algorithm includes means for analyzing past user data to customize the travel plan.

[1918] "Example 1"

[1919] (Claim 1)

[1920] A means of receiving information from users regarding their travel preferences, budget, travel duration, areas of interest, and places to visit;

[1921] means for querying a database based on the received information to obtain travel information regarding the places visited;

[1922] means for executing a generation algorithm to generate an optimal travel plan based on the acquired travel information and the received information;

[1923] means for transmitting the generated itinerary to the user;

[1924] A means for the terminal to collect information from the user and send it to a server in a single data packet;

[1925] means for the server to analyze the received information and execute queries to retrieve the required travel information from the database;

[1926] A means to convert the generated travel plan into JSON format and send it to the terminal;

[1927] a means for displaying the travel plan received by the device in a user-friendly format;

[1928] A system including:

[1929] (Claim 2)

[1930] The system of claim 1, wherein the generation algorithm generates an optimal travel plan taking into account user preferences and past traveler data.

[1931] (Claim 3)

[1932] 10. The system of claim 1, further comprising means for generating a travel plan using the generative AI model.

[1933] "Application Example 1"

[1934] (Claim 1)

[1935] A means of receiving information from users regarding their travel preferences, budget, travel duration, areas of interest, and places to visit;

[1936] means for querying a database based on the received information to obtain travel information regarding the places visited;

[1937] means for executing a generation algorithm to generate an optimal travel plan based on the acquired travel information and the received information;

[1938] means for displaying real-time generated itineraries to provide virtual tour options;

[1939] A system including:

[1940] (Claim 2)

[1941] 10. The system of claim 1, further comprising means for displaying the generated itinerary and allowing the user to confirm the trip details.

[1942] (Claim 3)

[1943] 10. The system of claim 1, wherein the generating algorithm includes means for analyzing past user data to customize the travel plan.

[1944] "Example 2: Combining Emotion Engines"

[1945] (Claim 1)

[1946] A means of receiving information from users regarding their travel preferences, budget, travel duration, areas of interest, and places to visit;

[1947] means for querying a database based on the received information to obtain travel information regarding the places visited;

[1948] means for executing a generative model to generate an optimal travel plan based on the acquired travel information and the received information;

[1949] A means of recognizing the user's emotional state and adjusting travel plans in real time;

[1950] means for transmitting the generated itinerary to the user;

[1951] A system including:

[1952] (Claim 2)

[1953] 10. The system of claim 1, further comprising means for displaying the generated itinerary and allowing the user to confirm the trip details.

[1954] (Claim 3)

[1955] 10. The system of claim 1, wherein the generative model includes means for analyzing historical user data to customize the travel plan.

[1956] "Application example 2 when combining emotion engines"

[1957] (Claim 1)

[1958] a means of receiving information from users regarding their travel preferences, budget, travel duration, areas of interest, and places to visit;

[1959] means for querying a database based on the received information to obtain travel information regarding the places visited;

[1960] means for executing a generation algorithm to generate an optimal travel plan based on the acquired travel information and the received information;

[1961] means for transmitting the generated itinerary to the user;

[1962] A means to analyze the user's emotional state and adjust travel plans in real time;

[1963] a means for virtually displaying the adjusted travel plan on a visual device;

[1964] A system including:

[1965] (Claim 2)

[1966] 10. The system of claim 1, further comprising means for displaying the generated itinerary and allowing the user to confirm the trip details.

[1967] (Claim 3)

[1968] 10. The system of claim 1, wherein the generating algorithm includes means for analyzing past user data to customize the travel plan. [Explanation of symbols]

[1969] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. A means of receiving information from users regarding their travel preferences, budget, travel duration, areas of interest, and places to visit; means for querying a database based on the received information to obtain travel information regarding the places visited; means for executing a generation algorithm to generate an optimal travel plan based on the acquired travel information and the received information; means for transmitting the generated itinerary to the user; A system including:

2. 10. The system of claim 1, further comprising means for displaying the generated itinerary and allowing the user to confirm the trip details.

3. 10. The system of claim 1, wherein the generating algorithm includes means for analyzing past user data to customize the travel plan.

Images