system
The system addresses travel planning challenges by using generative AI to create customized itineraries with multilingual and cultural support, enhancing user satisfaction and safety.
Patent Information
- Application Number
- JP2024138862
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-20
- Publication Date
- 2026-03-05
AI Technical Summary
Travelers face difficulties in planning trips that align with their preferences and budget, and language barriers and cultural differences cause stress and anxiety, leading to reduced satisfaction and increased burden during travel.
A system utilizing generative artificial intelligence to create customized travel plans based on user preferences and budget, incorporating multilingual support, cultural guides, and health and safety advice, accessible through terminals and display means.
Enables travelers to obtain personalized and satisfying travel experiences by providing tailored itineraries that meet their needs, reducing anxiety and ensuring safety and comfort.
Smart Images

Figure 2026036335000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] It is difficult for travelers to plan appropriate trips based on their preferences and budget, and language barriers and cultural differences often cause stress and anxiety, especially when traveling abroad. This can increase travelers' burden and reduce their satisfaction during their trip. Traditional travel guides and tour companies have difficulty meeting these individual needs and are unable to provide travelers with an ideal travel experience. The objective of the present invention is to solve these problems. [Means for solving the problem]
[0005] To solve this problem, the present invention provides the following means. First, it comprises a generative artificial intelligence means for generating a customized travel plan based on travel preferences and budget. It also comprises a terminal means for transmitting data to the generative artificial intelligence means in response to a user request. It also comprises a display means for displaying the generated travel plan on a user interface. This allows travelers to easily obtain a travel plan that matches their preferences and budget, thereby improving their travel satisfaction. It also comprises a multilingual function and a function for providing destination cultural guides and health and safety advice, thereby reducing travelers' anxiety and supporting a safe and comfortable travel experience. This provides a system that meets the diverse needs of travelers and allows them to enjoy their trip with peace of mind.
[0006] A "generative artificial intelligence means" is a system that uses artificial intelligence technology to generate appropriate answers and suggestions in real time based on user input information.
[0007] "User" refers to a person or organization that uses this system to create a travel plan.
[0008] "Travel preferences" refers to the specific preferences and wishes of a user regarding desired travel destinations, activities, accommodations, etc.
[0009] "Budget" refers to the range of amounts a user can spend on a trip.
[0010] "Terminal means" refers to a device or interface used by a user to send input data and receive responses from the system.
[0011] "User interface" refers to an interface that includes a display screen and operating means for a user to interact with a system.
[0012] "Display" refers to the display devices and technology utilized to present the generated itinerary and other information to the user.
[0013] "Multilingual functionality" refers to functionality that provides user assistance in multiple languages.
[0014] "Cultural guide" refers to materials and support that provide users with information about the culture, customs, history, etc. of the travel destination.
[0015] "Health and Safety Advice" means providing specific instructions or information to users regarding health and safety management while traveling. [Brief explanation of the drawings]
[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12]FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0018] First, the terms used in the following description will be explained.
[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).
[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0024] [First embodiment]
[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0037] The present invention relates to a system for generating a customized travel plan based on a user's travel preferences and budget, the system including a generating artificial intelligence means, a terminal means, and a display means.
[0038] System Configuration
[0039] 1. Generative AI Methods:
[0040] It is a server-side artificial intelligence model that generates travel plans based on user-entered travel preferences and budget. The model is trained on an extensive dataset and is capable of providing detailed and relevant suggestions for a variety of travel destinations and travel styles.
[0041] 2. Terminal means:
[0042] Refers to a device or interface that receives user input and transmits data to a generative artificial intelligence means. Examples include a smartphone, tablet, or web application on a computer.
[0043] 3. Display means:
[0044] It includes a display screen for providing the generated itinerary and other useful information to the user, allowing the user to view the details of the generated itinerary.
[0045] System operation explanation
[0046] User Action:
[0047] The user inputs their travel preferences (e.g., beach resorts, historical tourist spots, etc.) and budget (e.g., $1,500) using a terminal. The input data is in the form of a form, which is sent to the server by clicking it.
[0048] Terminal means operation:
[0049] The terminal receives user input, converts it into JSON format, and sends it to the generative artificial intelligence means. For example, suppose a travel preference of "beach resort" and a budget of "$1,500" are input.
[0050] Server behavior:
[0051] The server receives the data sent from the device and passes it to a generative AI model, which generates a travel plan based on the input data, including specific suggestions for accommodation, tourist attractions, transportation, etc.
[0052] Display method behavior:
[0053] After receiving the generated itinerary from the server, it is provided to the user through a display means, where the user can check the detailed itinerary and make changes or regenerate it as necessary.
[0054] Specific examples
[0055] For example, if a user inputs "I want to go to a beach resort" and "My budget is $1500," a generative AI solution might generate the following itinerary:
[0056] Destination: Phuket Island, Thailand
[0057] Accommodation: 5-star resort hotel
[0058] Activities: Snorkeling, boat tours, visiting local markets
[0059] Meal: Thai food at a local restaurant
[0060] This information is displayed on the device's display, allowing the user to review the detailed plan and, if necessary, request the server to generate a new plan including additional destinations and activities.
[0061] In this way, the present invention provides a travel plan customized to the traveler's preferences and budget, and builds a system that supports the traveler so that they can enjoy their trip with peace of mind.
[0062] The processing flow will be explained below.
[0063] Step 1:
[0064] The user enters their travel preferences and budget into a form on the terminal.
[0065] As an example, a user enters "beach resort" and "$1500."
[0066] Step 2:
[0067] The user clicks the "Generate Itinerary" button.
[0068] When a click event occurs, a JavaScript event listener captures the event.
[0069] Step 3:
[0070] The terminal takes the form input data and converts it into JSON format.
[0071] The retrieved data will be in the format { "preferences": "Beach Resort", "budget": "$1500"}.
[0072] Step 4:
[0073] The terminal sends the data converted into JSON format to the server as a POST request.
[0074] The destination is the / generate_plan endpoint on the server.
[0075] Step 5:
[0076] The server receives the POST request and extracts the JSON data from the request body.
[0077] The extracted data is {"preferences": "beach resort", "budget": "$1500"}.
[0078] Step 6:
[0079] Based on the extracted data, the server constructs prompts that instruct the generative artificial intelligence means to generate a travel plan.
[0080] For example, the prompt might be "Travel preference: Beach resort, Budget: $1500."
[0081] Step 7:
[0082] The server inputs prompts to the generative artificial intelligence means to generate a travel plan.
[0083] A generative artificial intelligence solution generates itineraries using an extensive data set.
[0084] Step 8:
[0085] The server converts the generated itinerary into JSON format and sends it back to the client as a response.
[0086] For example, {"travel_plan": "Phuket Island, Thailand, 5-star resort hotel, snorkeling, boat tour, local market visit, Thai cuisine"}.
[0087] Step 9:
[0088] The terminal receives the response from the server and parses the response body in JSON format.
[0089] The parsing result is {"travel_plan": "Phuket Island, Thailand, 5-star resort hotel, snorkeling, boat tour, visit to local market, Thai cuisine"}.
[0090] Step 10:
[0091] The device displays the analyzed travel plan in a specific HTML element.
[0092] An example of the displayed content would be "Phuket Island, Thailand, 5-star resort hotel, snorkeling, boat tour, visit to local market, Thai cuisine."
[0093] Step 11:
[0094] The user checks the generated travel plan and decides on the next course of action.
[0095] For example, you can choose to accept the proposed itinerary or request a regeneration.
[0096] Example 1
[0097] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0098] Conventional travel plan generation systems have difficulty quickly and accurately providing optimal travel plans based on users' travel preferences and budgets, even when they input them. Furthermore, they lack multilingual support, cultural guides for travel destinations, and health and safety advice. This makes it difficult for users to easily find travel plans that suit their needs, making travel planning cumbersome.
[0099] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0100] In this invention, the server includes a generative artificial intelligence means for generating a customized travel plan based on a user's travel preferences and budget, a terminal means for sending data to the generative artificial intelligence means in response to a user request, a display means for displaying the generated travel plan on a user interface, a data conversion means for receiving user input data and converting it into JSON format, and a server for receiving data sent from the terminal and inputting it into the generative artificial intelligence model to generate a travel plan. This allows users to quickly and accurately obtain the optimal travel plan that suits their preferences and budget, and can also provide multilingual support, cultural guides for travel destinations, and health and safety advice.
[0101] "Generative AI means" refers to an AI model for generating customized travel plans based on a user's travel preferences and budget.
[0102] "Terminal means" refers to a device or interface that transmits data to generative artificial intelligence means in response to a request from a user.
[0103] "Display means" refers to a display or screen for displaying the generated itinerary on a user interface.
[0104] "Data conversion means" refers to the process or function that takes user input data and converts it into JSON format.
[0105] "Server" refers to a computer that receives data sent from a terminal and inputs it into a generative artificial intelligence model to generate a travel plan.
[0106] "JSON format" refers to a lightweight data interchange format for representing data as key-value pairs.
[0107] "Generative AI models" refer to machine learning algorithms and models that generate travel itineraries based on input data.
[0108] "User interface" refers to the screen or interface through which a user interacts with a system.
[0109] The present invention relates to a system for generating customized travel plans based on a user's travel preferences and budget. This system is mainly composed of a generation system artificial intelligence means, a terminal means, a display means, a data conversion means, and a server.
[0110] First, a user inputs their travel preferences and budget using a terminal (a smartphone, tablet, or web application on a computer). For example, they can input information such as "I want to go to a beach resort" and "My budget is $1,500."
[0111] After the terminal means acquires the data entered by the user, it converts it into JSON format using the data conversion means. The converted data will have the following format:
[0112] json
[0113] {
[0114] "preferences": "Beach Resort",
[0115] "budget": 1500
[0116] }
[0117] This data is transmitted from the terminal to the server.
[0118] The server passes the data received from the device to a generative artificial intelligence means, which uses a trained AI model to generate a travel plan based on the user's preferences and budget. The generated travel plan includes suggestions for destinations, accommodations, activities, and meals.
[0119] For example, if a user enters the criteria "I want to go to a beach resort" and "My budget is $1500," the following itinerary may be generated:
[0120] Destination: Phuket Island, Thailand
[0121] Accommodation: 5-star resort hotel
[0122] Activities: Snorkeling, boat tours, visiting local markets
[0123] Meal: Thai food at a local restaurant
[0124] The generated itinerary is sent from the server to the terminal, which then displays it to the user. Through the display means, the user can check the detailed itinerary and regenerate or modify it as necessary.
[0125] For example, a prompt can be entered in the following format:
[0126] "I want to go to a beach resort. My budget is $1,500. Please suggest a suitable itinerary."
[0127] This allows the system to provide users with the best travel plans that fit their preferences and budget, enabling faster and more accurate travel planning. It also offers multilingual support, destination cultural guides, and health and safety advice.
[0128] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0129] Step 1:
[0130] The user inputs their travel preferences and budget using the terminal. For example, the user inputs "I want to go to a beach resort" and "My budget is $1,500." This input data will proceed to the next step.
[0131] Input: Travel preferences and budget (e.g., "beach resort," "$1500")
[0132] Output: User input data
[0133] Step 2:
[0134] The terminal takes the user's input data and converts it to JSON format, for example, the following data:
[0135] json
[0136] {
[0137] "preferences": "Beach Resort",
[0138] "budget": 1500
[0139] }
[0140] The data converted to JSON format will proceed to the next step.
[0141] Input: User-entered data
[0142] Output: JSON format data
[0143] Step 3:
[0144] The device sends the data converted into JSON format to the server. Specifically, the device sends the data to the server using an HTTP POST request.
[0145] Input: JSON format data
[0146] Output: Data sent in the HTTP POST request
[0147] Step 4:
[0148] The server receives the JSON data sent from the device. It parses the received data and stores it in the necessary variables. For example, it is stored in the following variables:
[0149] python
[0150] preferences = "beach resort"
[0151] budget = 1500
[0152] The analyzed data will then be passed on to the next step.
[0153] Input: JSON data sent from the terminal
[0154] Output: Parsed data (e.g. "Beach Resort", "$1500")
[0155] Step 5:
[0156] The server inputs the analyzed data into the generative AI model and generates a travel plan. Specifically, it invokes the AI model as follows:
[0157] python
[0158] travel_plan = generate_travel_plan(preferences, budget)
[0159] The generated itinerary will then proceed to the next step.
[0160] Input: Parsed data (e.g. "Beach Resort", "$1500")
[0161] Output: Generated itinerary
[0162] Step 6:
[0163] The generative AI model generates a customized itinerary based on the user's preferences and budget, for example, a detailed itinerary like this:
[0164] Destination: Phuket Island, Thailand
[0165] Accommodation: 5-star resort hotel
[0166] Activities: Snorkeling, boat tours, visiting local markets
[0167] Meal: Thai food at a local restaurant
[0168] The generated itinerary will then proceed to the next step.
[0169] Input: Data passed to the generative AI model
[0170] Output: A detailed itinerary
[0171] Step 7:
[0172] The server converts the generated travel plan back into JSON format and sends it to the terminal as an HTTP response. For example, the following JSON data is sent:
[0173] json
[0174] {
[0175] "destination": "Phuket Island, Thailand",
[0176] "accommodation": "5-star resort hotel",
[0177] "activities": ["Snorkeling", "Boat tour", "Visit to local market"],
[0178] "meals": "Thai food at a local restaurant"
[0179] }
[0180] The transmitted data will proceed to the next step.
[0181] Input: Generated itinerary
[0182] Output: JSON formatted travel plan data
[0183] Step 8:
[0184] The device parses the JSON data received from the server and displays it in a user-friendly format through the user interface. For example, the following is displayed on the screen:
[0185] Destination: Phuket Island, Thailand
[0186] Accommodation: 5-star resort hotel
[0187] Activities: Snorkeling, boat tours, visiting local markets
[0188] Meal: Thai food at a local restaurant
[0189] This allows the user to check the details of their travel plan.
[0190] Input: JSON data received from the server
[0191] Output: The itinerary displayed in the user interface.
[0192] (Application example 1)
[0193] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0194] While traditional travel planning systems allow users to customize their travel plans based on their travel preferences and budget, it is difficult to visually experience them. This makes it difficult for users to visualize their trip, leading to inconveniences when booking or changing plans. Furthermore, the lack of multilingual support, cultural guides for travel destinations, and health and safety advice makes it difficult to increase user satisfaction.
[0195] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0196] In this invention, the server includes a generative artificial intelligence means for generating a customized travel plan based on the user's travel preferences and budget, a terminal means for transmitting data to the generative artificial intelligence means in response to a user's request, a display means for displaying the generated travel plan on a user interface, and a virtual reality means for visually simulating the trip using virtual reality technology. This allows users to virtually experience the planned trip in advance, allowing them to make reservations or changes to the trip with a concrete image in mind. Furthermore, by simultaneously providing multilingual support, a cultural guide of the travel destination, and health and safety advice, user satisfaction can be greatly improved.
[0197] "Travel preferences" are requests regarding places the user wants to visit, activities and scenery that interest them.
[0198] A "budget" is a financial limit that a user can spend on a trip.
[0199] A "generative artificial intelligence means" is an artificial intelligence model that is trained to automatically generate a travel itinerary based on user input.
[0200] The term "terminal means" refers to a device or interface for receiving user input and transmitting data to the generative artificial intelligence means. Specifically, it includes a smartphone, tablet, or computer.
[0201] "Display means" refers to a display or screen that visually presents the generated travel plan and other information to the user.
[0202] "Virtual reality devices" are systems or devices that use virtual reality technology to enable users to simulate travel experiences in a virtual environment. Specifically, they include head-mounted displays and VR glasses.
[0203] A "multilingual support function" is a function that supports different languages and allows multilingual users to use it.
[0204] "Cultural Guide" is a function that provides users with information about the history, traditions, and culture of their travel destination.
[0205] "Health and Safety Advice" is a function that provides users with information on managing their health and ensuring safety while traveling.
[0206] "Virtual reality content" means visual information or scenes that can be experienced through virtual reality means.
[0207] The "operation function" is an interface that allows users to check and change travel plan information through a virtual reality experience.
[0208] The system for realizing this application example requires the following components: generative artificial intelligence means, terminal means, display means, and virtual reality means.
[0209] System configuration
[0210] 1. Generative AI Methods
[0211] The server includes a generative artificial intelligence means for generating a travel plan based on the user's input travel preferences and budget. The artificial intelligence model is trained using an extensive dataset and is capable of providing detailed recommendations for a variety of travel destinations and activities to the user.
[0212] 2. Terminal means
[0213] The terminal receives input from the user and transmits this data to the generative artificial intelligence means, which may be a smartphone, tablet, or web application on a computer.
[0214] 3. Display means
[0215] The generated itinerary is displayed on the terminal. The user can check it and view the detailed contents of the itinerary. If necessary, the itinerary can be changed or regenerated.
[0216] 4. Virtual Reality Methods
[0217] Virtual reality solutions use virtual reality technology to visually simulate travel plans, allowing users to virtually experience the planned trip. Specifically, devices such as head-mounted displays and VR glasses are used.
[0218] Program operation explanation
[0219] User operations
[0220] Users use a smartphone or tablet to input their travel preferences (e.g., beach resorts, historical tourist spots, etc.) and budget. The input data is in the form of a form, which is then submitted by clicking the button.
[0221] Device behavior
[0222] The terminal receives the user's input, converts it into an appropriate data format such as JSON format, and transmits it to the generative artificial intelligence means. For example, if "beach resort" and "1500 dollars" are input, the information is transmitted to the generative artificial intelligence means.
[0223] Server Operation
[0224] The server receives the transmitted data and uses generative artificial intelligence means to generate a travel plan, which includes specific suggestions for accommodations, attractions, transportation, etc.
[0225] Views and Virtual Reality Experiences
[0226] The generated itinerary is provided to the user through the display means of the terminal. Furthermore, the user can visually simulate the trip using virtual reality means. For example, by wearing a head-mounted display, the user can virtually experience the scenery and activities of the travel destination.
[0227] Specific examples
[0228] For example, if a user inputs "I want to go to a beach resort" and "My budget is $1500," a generative AI solution might generate the following itinerary:
[0229] Destination: Phuket Island, Thailand
[0230] Accommodation: 5-star resort hotel
[0231] Activities: Snorkeling, boat tours, visiting local markets
[0232] Budget: $1,500
[0233] This plan is displayed on the display of the terminal and can be virtually experienced by the user using virtual reality means.
[0234] Prompt Sentence Examples
[0235] Travel preference: "Beach resort"
[0236] Budget: $1,500
[0237] Destination: "Phuket Island, Thailand"
[0238] Accommodation: "Five-star resort hotel"
[0239] Activities: "Snorkeling, boat tours, and visiting local markets"
[0240] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0241] Step 1:
[0242] User Action:
[0243] Users enter their travel preferences and budget into an input form on their smartphone or tablet. For example, they enter information like "I want to go to a beach resort" and "My budget is $1,500." This input data is sent to the device and converted into an appropriate data format, such as JSON.
[0244] Input: User-entered travel preferences and budget
[0245] Output: JSON format data in the terminal
[0246] Step 2:
[0247] Device data transmission:
[0248] The terminal converts the data received from the user into JSON format and sends it to the generative artificial intelligence means, at which point the terminal establishes communication with the server and transfers the data accurately.
[0249] Input: JSON format data converted to the terminal
[0250] Output: Data sent to the server
[0251] Step 3:
[0252] Server receives data:
[0253] The server receives the data sent from the terminal, and passes the received data to the generative artificial intelligence means.
[0254] Input: Data sent from the terminal
[0255] Output: Data to generative artificial intelligence tools
[0256] Step 4:
[0257] Generate a travel plan:
[0258] The generative artificial intelligence solution generates a travel itinerary based on the received data, using an AI model trained on a wide range of datasets to suggest suitable travel destinations and activities, including destinations, accommodations, activities, and budget.
[0259] Input: Data from the server
[0260] Output: Generated itinerary
[0261] Step 5:
[0262] Sending the generated results:
[0263] The server then transmits the generated itinerary to the terminal using an appropriate protocol to ensure data integrity.
[0264] Input: Generated itinerary
[0265] Output: Data sent to the terminal
[0266] Step 6:
[0267] View itinerary:
[0268] The terminal displays the travel plan received from the server to the user on a display. The user can review the plan and make changes or regenerate it as needed. The display includes detailed information about accommodations, tourist attractions, transportation, etc.
[0269] Input: Travel plan sent from the server
[0270] Output: The itinerary displayed to the user
[0271] Step 7:
[0272] Start your virtual reality experience:
[0273] The user wears a head-mounted display or VR glasses and virtually experiences the planned trip using virtual reality means. The virtual reality system simulates the scenery and activities of the travel destination based on the user's input.
[0274] Input: User's visual information and generated travel plan
[0275] Output: Visual data of the virtual travel experience
[0276] Through these steps, users can generate a detailed travel plan based on their travel preferences and budget, and then simulate the trip using virtual reality.
[0277] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0278] The present invention relates to a system for generating customized travel plans based on a user's travel preferences and budget, and further provides a more personalized travel experience by combining it with an emotion engine that recognizes the user's emotions. The system includes a generative artificial intelligence means, a terminal means, a display means, and an emotion engine.
[0279] System Configuration
[0280] 1. Generative AI Methods:
[0281] It is a server-side artificial intelligence model that generates travel plans based on user-entered travel preferences and budget. It is trained on an extensive dataset and is capable of providing detailed and relevant suggestions.
[0282] 2. Terminal means:
[0283] A device or interface that receives user input and transmits data to a generative artificial intelligence means. Examples include a smartphone, tablet, or web application on a computer.
[0284] 3. Display means:
[0285] A display screen for providing the generated itinerary and other useful information to the user, allowing the user to review the details of the generated itinerary.
[0286] 4. Emotion Engine:
[0287] An engine that recognizes user emotions and reflects them in the generation and adjustment of travel plans. It extracts emotional information from the user's facial expressions, voice, text input, etc., and uses it to optimize and regenerate travel plans.
[0288] System operation explanation
[0289] User Action:
[0290] The user inputs their travel preferences (e.g., beach resorts, historical tourist spots) and budget (e.g., $1,500) using a terminal. The input data is in the form of a form, which is sent by clicking it.
[0291] Terminal means operation:
[0292] The device receives the form input data, converts it to JSON format, and sends it to the server, along with the user's travel preferences, budget, and emotional data.
[0293] Server behavior:
[0294] The server receives the data sent from the device and passes it to a generative AI model, which generates a travel plan based on the input data and emotion data, including specific suggestions for accommodation, sightseeing spots, transportation, etc.
[0295] Display method behavior:
[0296] After receiving the generated itinerary from the server, it is provided to the user through a display means, allowing the user to check the detailed plan while viewing it and make changes or regenerate it as necessary.
[0297] Emotion Engine in action:
[0298] The emotion engine monitors the user's emotion data in real time and sends feedback to the generative artificial intelligence means as needed. For example, if the user expresses dissatisfaction, the emotion engine sends this information to the server and adjusts or regenerates the travel plan.
[0299] Specific examples
[0300] For example, if a user inputs "I want to go to a beach resort" and "My budget is $1500," along with a satisfied facial expression, a generative AI solution might generate the following itinerary:
[0301] Destination: Waikiki Beach, Hawaii
[0302] Accommodation: 4-star beach resort hotel
[0303] Activities: Surfing lessons, beach BBQ, local market visit
[0304] Meal: Dinner at a seafood restaurant
[0305] On the other hand, if the user shows a dissatisfied expression after inputting the information, the emotion engine feeds this information back to the server, which then uses generative artificial intelligence to regenerate the itinerary and present a more suitable plan.
[0306] In this way, the present invention provides a system that provides customized travel plans based on multiple factors such as user preferences, budget, and emotions, thereby improving travelers' satisfaction and sense of security.
[0307] The processing flow will be explained below.
[0308] Step 1:
[0309] The user enters their travel preferences and budget into a form on the terminal.
[0310] For example, a user enters "beach resort" and "$1500."
[0311] Step 2:
[0312] The user clicks the "Generate Itinerary" button.
[0313] When a click event occurs, a JavaScript event listener captures the event.
[0314] Step 3:
[0315] The terminal takes the form input data and converts it into JSON format.
[0316] The retrieved data will be in the format { "preferences": "Beach Resort", "budget": "$1500"}.
[0317] Step 4:
[0318] The terminal uses an emotion engine to recognize the user's emotions and extract emotion data.
[0319] For example, the device's camera and microphone can be used to analyze the user's facial expressions and tone of voice, generating emotional data such as "satisfied" or "dissatisfied."
[0320] Step 5:
[0321] The device sends the data converted into JSON format and the emotion data to the server as a POST request.
[0322] The destination is the / generate_plan endpoint on the server.
[0323] Step 6:
[0324] The server receives the POST request and extracts the JSON data and emotion data from the request body.
[0325] The extracted data is {"preferences": "beach resort", "budget": "$1500", "emotion": "satisfied"}.
[0326] Step 7:
[0327] Based on the extracted data, the server constructs prompts that instruct the generative artificial intelligence means to generate a travel plan.
[0328] For example, the prompt might be "Travel preference: beach resort, budget: $1500, emotion: happy."
[0329] Step 8:
[0330] The server inputs prompts to the generative artificial intelligence means to generate a travel plan.
[0331] A generative artificial intelligence solution generates itineraries using an extensive data set.
[0332] Step 9:
[0333] The server converts the generated itinerary into JSON format and sends it back to the client as a response.
[0334] For example, {"travel_plan": "Waikiki Beach, Hawaii, 4-star resort hotel, surfing lessons, beach BBQ, visit to local market, dinner at seafood restaurant"}.
[0335] Step 10:
[0336] The terminal receives the response from the server and parses the response body in JSON format.
[0337] The parsing result is {"travel_plan": "Waikiki Beach in Hawaii, a 4-star resort hotel, surfing lessons, a beach barbecue, a visit to a local market, and dinner at a seafood restaurant"}.
[0338] Step 11:
[0339] The device displays the analyzed travel plan in a specific HTML element.
[0340] For example, the displayed content might be "Waikiki Beach in Hawaii, a 4-star resort hotel, surfing lessons, a beach barbecue, a tour of a local market, and dinner at a seafood restaurant."
[0341] Step 12:
[0342] The emotion engine again detects the user's emotions when viewing the displayed itinerary.
[0343] For example, if the user shows a dissatisfied expression, the emotion engine updates the emotion data to "dissatisfied."
[0344] Step 13:
[0345] The terminal again transmits the updated emotion data to the server and requests the travel plan to be regenerated.
[0346] The server generates a different travel plan based on the new emotion data using generative artificial intelligence means.
[0347] Step 14:
[0348] The server sends the newly generated itinerary to the terminal, which displays it on its user interface.
[0349] The user reviews the new travel plans and makes a final selection.
[0350] In this way, the present invention provides a system that provides an optimal travel plan that matches the user's preferences, budget, and emotions, and allows the user to have a satisfying travel experience.
[0351] Example 2
[0352] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0353] Conventional travel planning systems only provide suggestions based on the user's travel preferences and budget, without personalizing the user's travel experiences. As a result, they often propose travel plans that are difficult for users to satisfy. Furthermore, they lack functionality for providing multilingual support, cultural guides for the destination, and health and safety advice, which can make users feel uneasy during their trips.
[0354] The specification process by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a generative artificial intelligence means for generating a customized travel plan based on the user's travel preferences and budget, a terminal means for transmitting data and emotion data from the user to the generative artificial intelligence means, a display means for displaying the generated travel plan on a user interface, and an emotion recognition means for recognizing the user's emotions and reflecting them in the generation and adjustment of the travel plan. This makes it possible to provide a more satisfying personalized travel plan that reflects the user's emotions. In addition, by providing multilingual support, a cultural guide of the travel destination, and health and safety advice, the user can enjoy their trip with peace of mind.
[0355] "Generative AI means" refers to an AI model that generates customized travel plans based on a user's travel preferences and budget.
[0356] "Terminal means" refers to a device or interface for acquiring data and emotional data from a user and transmitting it to generative artificial intelligence means.
[0357] The "display means" refers to a display screen or monitor that presents the generated travel plan on a user interface so that the user can visually confirm it.
[0358] "Emotion recognition means" refers to an engine or software that extracts emotional data from a user's facial expressions, voice, text input, etc., and reflects this in generating and adjusting travel plans.
[0359] "Multilingual support function" refers to a function that supports multiple languages and allows users to use the system in their own native language.
[0360] "Cultural guide" refers to the function of providing information about the history, customs, and tourist attractions of a travel destination.
[0361] "Health and Safety Advice" refers to the function that provides advice and information on how to maintain your health and safety while traveling.
[0362] The present invention provides a system that generates a customized travel plan based on a user's travel preferences and budget, and further recognizes the user's emotions to provide personalized suggestions. The system includes a generative artificial intelligence means, a terminal means, a display means, and an emotion recognition means.
[0363] System Configuration
[0364] Generative AI means: This refers to an artificial intelligence model built on the server side. A generative AI model (such as GPT-4 (registered trademark)) generates a customized travel plan based on the travel preferences and budget entered by the user. The generative AI model is trained using an extensive dataset and is able to provide detailed and relevant suggestions.
[0365] Terminal Means: This refers to a device or interface that receives user input and transmits data to the Generative AI Means. Specific examples include a smartphone, tablet, or web application on a computer. The Terminal Means also has the function of capturing the user's facial expressions and voice and transmitting them to a server as emotional data.
[0366] Display means: This corresponds to a display screen that provides the generated travel plan and other useful information to the user. This allows the user to check the details of the generated travel plan. For example, a smartphone display or a computer monitor is a display means.
[0367] Emotion recognition means: This corresponds to an engine that recognizes the user's emotions and reflects them in the generation and adjustment of travel plans. This emotion recognition means extracts emotional information from the user's facial expressions, voice, text input, etc., and uses this information to help optimize and regenerate travel plans. Specific examples of emotion recognition technologies include Microsoft® Azure® Face API and Google® Cloud Vision API.
[0368] Operation explanation
[0369] User operation: The user inputs their travel preferences (e.g., "I want to go to a beach resort") and budget (e.g., "1,500 dollars") using a terminal device. This input data is in the form of a form, and is sent to the server by clicking the send button. The user's real-time facial expressions and voice are also acquired as emotion data.
[0370] Operation of the terminal means: The terminal acquires the input data of the form, converts it into JSON format, and sends it to the server. For example, travel preferences, budget, and the user's emotional data (such as "happy" or "sad") are sent in JSON format. This allows the server to generate a plan based on the user's current emotional state.
[0371] Server operation: The server receives data sent from the device and passes it to the generative AI means. The generative AI model generates a travel plan based on the input data and emotional data. At this time, the generative AI model is input with a prompt statement such as: "The user is interested in beach resorts and has a budget of $1,500. Please generate a travel plan based on this." In addition, based on the emotional data, the server regenerates and adjusts the plan to increase user satisfaction.
[0372] Operation of the display means: After receiving the generated itinerary from the server, it is provided to the user through the display means. The user can view it, check the details of accommodations and activities, and make changes or regenerate it as necessary.
[0373] Operation of the emotion recognition means: The emotion recognition means monitors the user's emotion data in real time and feeds that information back to the server. For example, if the user shows a "dissatisfied" expression, the emotion recognition means sends this information to the generative artificial intelligence means, prompting the means to readjust or regenerate the travel plan.
[0374] Specific examples
[0375] For example, if a user inputs "I want to go to a beach resort" and "My budget is $1500," along with a satisfied facial expression, a generative AI solution might generate the following itinerary:
[0376] Destination: Waikiki Beach, Hawaii
[0377] Accommodation: 4-star beach resort hotel
[0378] Activities: Surfing lessons, beach BBQ, local market visit
[0379] Meal: Dinner at a seafood restaurant
[0380] On the other hand, if the user shows a dissatisfied expression after inputting the information, the emotion recognition means feeds this information back to the server, which then uses the generative artificial intelligence means to regenerate the itinerary and present a more suitable plan.
[0381] In this way, the present invention provides a system that provides customized travel plans based on multiple factors such as user preferences, budget, and emotions, thereby improving travelers' satisfaction and sense of security.
[0382] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0383] Step 1:
[0384] User enters travel preferences and budget
[0385] The user accesses a dedicated app or website for planning a trip. They enter their travel preferences (e.g., "I want to go to a beach resort") and budget (e.g., "1,500 dollars") into an input form displayed on the screen. Facial expressions and voice are also captured in real time and prepared as emotion data. Input data: Travel preferences, budget, emotion data. Output data: Input data is sent to the device.
[0386] Step 2:
[0387] The device sends input data and emotion data to the server.
[0388] The device receives the data entered by the user and formats it as needed. Specifically, it converts travel preferences and budget into JSON format, and also integrates emotional data obtained from the camera and microphone into JSON format. It then sends this to the server. Input data: User-entered data. Output data: JSON data sent to the server.
[0389] Step 3:
[0390] The server receives the data and passes it to the generative AI model
[0391] The server receives data sent from the device. This data is stored as a JSON object divided into appropriate fields. The server then passes the input data to the generative AI model as a prompt. For example, it generates a prompt such as, "The user is interested in beach resorts and has a budget of $1,500. Please generate a travel plan based on this." Input data: User input data in JSON format. Output data: Prompt passed to the generative AI model.
[0392] Step 4:
[0393] Generative AI means generate travel plans
[0394] A generative AI model (e.g., GPT-4) generates a travel plan based on the given prompt. The generated travel plan includes specific accommodations, tourist attractions, and transportation options. For example, it might suggest "a four-star hotel in Waikiki Beach, surfing lessons, a beach barbecue, etc." Input data: prompt. Output data: generated travel plan data.
[0395] Step 5:
[0396] Emotion recognition means analyzes emotional data and provides feedback
[0397] The emotion recognition means analyzes the received emotion data and determines whether it is a satisfaction or dissatisfaction. If the user's emotion is recognized as "dissatisfaction," the feedback is sent to the generative AI model, prompting the user to readjust their travel plans. Input data: Emotion data. Output data: Feedback data.
[0398] Step 6:
[0399] The server sends the generated travel plan to the terminal.
[0400] The server receives the travel plan generated by the generative artificial intelligence means and sends it to the terminal. At this time, if feedback from the emotion recognition means is reflected, a regenerated travel plan is sent. Input data: Generated travel plan data. Output data: Travel plan data sent to the terminal.
[0401] Step 7:
[0402] The device displays the travel plan to the user.
[0403] The terminal visually displays the received travel plan to the user. Accommodation information and activity details are displayed on the smartphone or computer screen. The user can view this and make further adjustments or request regeneration. Input data: Travel plan data sent to the terminal. Output data: Travel plan information displayed on the user interface.
[0404] (Application example 2)
[0405] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0406] Existing content distribution services recommend content based on a user's past viewing history and preferences, but they are unable to reflect the user's real-time emotions, which means they are unable to sufficiently improve user satisfaction. Furthermore, they are unable to re-recommend content in response to changes in the user's emotions while viewing, which makes it difficult to provide the optimal viewing experience for the user.
[0407] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0408] In this invention, the server includes a terminal means for receiving user input and transmitting data to the generative artificial intelligence means, an emotion engine means for recognizing the user's emotions in real time and reflecting them in optimizing the travel plan, and a display means for displaying the generated travel plan on a user interface, thereby enabling the recommendation of optimal content based on the user's preferences and emotions.
[0409] A "generative AI means" is an AI model that analyzes data based on a user's preferences and budget to generate optimal travel plans and content recommendations.
[0410] "Terminal means" refers to a device or interface that receives input data from a user and transmits the data to the generative artificial intelligence means. Specific examples include smartphones, tablets, and applications on computers.
[0411] The "emotion engine means" is a system that recognizes emotions in real time from the user's facial expressions, voice, text input, etc., and provides feedback to the generative artificial intelligence means.
[0412] The "display means" refers to a screen or display device for displaying the generated travel plan and content recommendation results on a user interface.
[0413] A "travel itinerary" is a detailed plan of accommodations, attractions, transportation, and other activities at a travel destination.
[0414] "Content recommendation" refers to suggesting the most suitable movies, dramas, and other viewing content based on the user's preferences and emotions.
[0415] "User interface" refers to a screen or interface through which a user can provide input data and view generated results via a terminal means.
[0416] The present invention provides a system for providing personalized travel plans and content recommendations based on a user's preferences and emotions. Specific embodiments are described below.
[0417] System Configuration
[0418] The system consists of the following main components:
[0419] 1. Generative AI tools: Using AI models trained on extensive datasets, they can create travel itineraries based on user preferences and budget, or recommend content based on viewing history.
[0420] 2. Terminal means: The device through which the user inputs, including smartphones, tablets, and applications on computers.
[0421] 3. Emotion engine means: Recognize emotions in real time from the user's facial expressions and voice, and use this to optimize travel plans and content recommendations.
[0422] 4. Display means: A display device for displaying the generated plan and recommendation results on a user interface.
[0423] Hardware and software used
[0424] Hardware:
[0425] Smartphones (camera, microphone, display), tablets, personal computers
[0426] software:
[0427] Emotion recognition engine (e.g. Microsoft Azure Face API)
[0428] Generative AI models (e.g., OpenAI (registered trademark) GPT model)
[0429] Display application (e.g., developed with Flutter or React Native)
[0430] Data processing and calculation
[0431] Terminal means role:
[0432] The terminal formats and transmits input from the user (e.g., travel preferences, budget, viewing history, etc.) to the generative artificial intelligence means, including real-time emotion data captured by the emotion engine means.
[0433] The role of generative artificial intelligence tools:
[0434] The AI model generates optimal travel plans and content recommendations based on user input and emotional data. It does this by analyzing a variety of information, including frequency of use, past trends, and emotional data, to suggest the most suitable plans and content for the user.
[0435] The role of the emotion engine means:
[0436] The emotion recognition engine collects real-time user emotion data from the camera and microphone and provides feedback to the AI model, which then uses this feedback to improve the accuracy of travel plans and content recommendations.
[0437] The role of the display means:
[0438] The generated plans and recommendations are displayed on the user interface, allowing the user to view them and make a final selection.
[0439] Specific examples
[0440] Travel plan example:
[0441] If a user inputs "I want a beach resort" and "My budget is $1,500" and looks satisfied, the generative artificial intelligence means will generate the following travel plan:
[0442] Destination: Beach resort
[0443] Accommodation: Beachfront hotel
[0444] Activities: Water sports, local market visit
[0445] Content recommendation examples:
[0446] If a user types in "I like action movies" and "I like actor A" and uses the app with a smile, the following movies will be recommended:
[0447] Movie: Action Movie 1
[0448] Movie: Action Movie 2
[0449] Movie: Action Movie 3
[0450] Prompt Sentence Examples
[0451] "Generate a list of movies based on the assumption that the user likes action movies and Actor A. In addition, make optimal suggestions based on the user's emotional data."
[0452] This enables personalized travel planning and content recommendations that respond to users' preferences and real-time emotional state.
[0453] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0454] Step 1:
[0455] The user uses a terminal to input information such as travel preferences, budget, genre of content they want to watch, and actors. The input data is collected in a form format. The input in this step is data about the user's preferences, budget, and viewing history. As an output, this information is converted into JSON format.
[0456] Step 2:
[0457] The terminal means converts the input data into JSON format and sends it to the server. In this step, the user's preferences, budget, viewing history, and emotional data acquired by the terminal means are also sent at the same time. The input is the user's data, and the output is JSON data sent to the server.
[0458] Step 3:
[0459] The server analyzes the JSON data received from the terminal means and passes it to the generative artificial intelligence means. The generative artificial intelligence means generates a travel plan and content recommendations based on the input data. The input in this step is the JSON data sent from the terminal means, and the output is the generated travel plan data and a list of content recommendations.
[0460] Step 4:
[0461] Generative AI tools analyze data based on submitted user preferences, budgets, and emotional data to generate optimal travel plans and content. The AI models used here include the OpenAI GPT model. The input is the user data to be analyzed, and the output is a list of customized travel plans and content recommendations.
[0462] Step 5:
[0463] The server receives the generated travel plan and content list and sends it to the terminal means. The input in this step is the output data from the generative AI model, which becomes the data to be sent to the terminal means. The output is the final travel plan and content list to be displayed to the user.
[0464] Step 6:
[0465] The terminal means analyzes the received data and displays it on the user interface. The input in this step is the travel plan and content list data sent from the server, and the output is the information displayed on the user interface.
[0466] Step 7:
[0467] The user checks the displayed travel plan and content list and provides emotional feedback as needed. The emotion engine recognizes this in real time and sends the feedback back to the server. The input is the user's emotional data, and the output is feedback data to the server.
[0468] Step 8:
[0469] The server receives feedback from the emotion engine means and passes it back to the generative artificial intelligence means to reanalyze the data, thereby generating a more optimized travel plan or content recommendation, which is then provided to the user again. The input is the emotion feedback data, and the output is a regenerated travel plan or content list.
[0470] This enables personalized travel planning and content recommendations that respond to users' preferences and real-time emotional state.
[0471] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0472] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0473] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0474] [Second embodiment]
[0475] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0476] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0477] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0478] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0479] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0480] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0481] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0482] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0483] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0484] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0485] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0486] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."
[0487] The present invention relates to a system for generating a customized travel plan based on a user's travel preferences and budget, the system including a generating artificial intelligence means, a terminal means, and a display means.
[0488] System Configuration
[0489] 1. Generative AI Methods:
[0490] It is a server-side artificial intelligence model that generates travel plans based on user-entered travel preferences and budget. The model is trained on an extensive dataset and is capable of providing detailed and relevant suggestions for a variety of travel destinations and travel styles.
[0491] 2. Terminal means:
[0492] Refers to a device or interface that receives user input and transmits data to a generative artificial intelligence means. Examples include a smartphone, tablet, or web application on a computer.
[0493] 3. Display means:
[0494] It includes a display screen for providing the generated itinerary and other useful information to the user, allowing the user to view the details of the generated itinerary.
[0495] System operation explanation
[0496] User Action:
[0497] The user inputs their travel preferences (e.g., beach resorts, historical tourist spots, etc.) and budget (e.g., $1,500) using a terminal. The input data is in the form of a form, which is sent to the server by clicking it.
[0498] Terminal means operation:
[0499] The terminal receives user input, converts it into JSON format, and sends it to the generative artificial intelligence means. For example, suppose a travel preference of "beach resort" and a budget of "$1,500" are input.
[0500] Server behavior:
[0501] The server receives the data sent from the device and passes it to a generative AI model, which generates a travel plan based on the input data, including specific suggestions for accommodation, tourist attractions, transportation, etc.
[0502] Display method behavior:
[0503] After receiving the generated itinerary from the server, it is provided to the user through a display means, where the user can check the detailed itinerary and make changes or regenerate it as necessary.
[0504] Specific examples
[0505] For example, if a user inputs "I want to go to a beach resort" and "My budget is $1500," a generative AI solution might generate the following itinerary:
[0506] Destination: Phuket Island, Thailand
[0507] Accommodation: 5-star resort hotel
[0508] Activities: Snorkeling, boat tours, visiting local markets
[0509] Meal: Thai food at a local restaurant
[0510] This information is displayed on the device's display, allowing the user to review the detailed plan and, if necessary, request the server to generate a new plan including additional destinations and activities.
[0511] In this way, the present invention provides a travel plan customized to the traveler's preferences and budget, and builds a system that supports the traveler so that they can enjoy their trip with peace of mind.
[0512] The processing flow will be explained below.
[0513] Step 1:
[0514] The user enters their travel preferences and budget into a form on the terminal.
[0515] As an example, a user enters "beach resort" and "$1500."
[0516] Step 2:
[0517] The user clicks the "Generate Itinerary" button.
[0518] When a click event occurs, a JavaScript event listener captures the event.
[0519] Step 3:
[0520] The terminal takes the form input data and converts it into JSON format.
[0521] The retrieved data will be in the format { "preferences": "Beach Resort", "budget": "$1500"}.
[0522] Step 4:
[0523] The terminal sends the data converted into JSON format to the server as a POST request.
[0524] The destination is the / generate_plan endpoint on the server.
[0525] Step 5:
[0526] The server receives the POST request and extracts the JSON data from the request body.
[0527] The extracted data is {"preferences": "beach resort", "budget": "$1500"}.
[0528] Step 6:
[0529] Based on the extracted data, the server constructs prompts that instruct the generative artificial intelligence means to generate a travel plan.
[0530] For example, the prompt might be "Travel preference: Beach resort, Budget: $1500."
[0531] Step 7:
[0532] The server inputs prompts to the generative artificial intelligence means to generate a travel plan.
[0533] A generative artificial intelligence solution generates itineraries using an extensive data set.
[0534] Step 8:
[0535] The server converts the generated itinerary into JSON format and sends it back to the client as a response.
[0536] For example, {"travel_plan": "Phuket Island, Thailand, 5-star resort hotel, snorkeling, boat tour, local market visit, Thai cuisine"}.
[0537] Step 9:
[0538] The terminal receives the response from the server and parses the response body in JSON format.
[0539] The parsing result is {"travel_plan": "Phuket Island, Thailand, 5-star resort hotel, snorkeling, boat tour, visit to local market, Thai cuisine"}.
[0540] Step 10:
[0541] The device displays the analyzed travel plan in a specific HTML element.
[0542] An example of the displayed content would be "Phuket Island, Thailand, 5-star resort hotel, snorkeling, boat tour, visit to local market, Thai cuisine."
[0543] Step 11:
[0544] The user checks the generated travel plan and decides on the next course of action.
[0545] For example, you can choose to accept the proposed itinerary or request a regeneration.
[0546] Example 1
[0547] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0548] Conventional travel plan generation systems have difficulty quickly and accurately providing optimal travel plans based on users' travel preferences and budgets, even when they input them. Furthermore, they lack multilingual support, cultural guides for travel destinations, and health and safety advice. This makes it difficult for users to easily find travel plans that suit their needs, making travel planning cumbersome.
[0549] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0550] In this invention, the server includes a generative artificial intelligence means for generating a customized travel plan based on a user's travel preferences and budget, a terminal means for sending data to the generative artificial intelligence means in response to a user request, a display means for displaying the generated travel plan on a user interface, a data conversion means for receiving user input data and converting it into JSON format, and a server for receiving data sent from the terminal and inputting it into the generative artificial intelligence model to generate a travel plan. This allows users to quickly and accurately obtain the optimal travel plan that suits their preferences and budget, and can also provide multilingual support, cultural guides for travel destinations, and health and safety advice.
[0551] "Generative AI means" refers to an AI model for generating customized travel plans based on a user's travel preferences and budget.
[0552] "Terminal means" refers to a device or interface that transmits data to generative artificial intelligence means in response to a request from a user.
[0553] "Display means" refers to a display or screen for displaying the generated itinerary on a user interface.
[0554] "Data conversion means" refers to the process or function that takes user input data and converts it into JSON format.
[0555] "Server" refers to a computer that receives data sent from a terminal and inputs it into a generative artificial intelligence model to generate a travel plan.
[0556] "JSON format" refers to a lightweight data interchange format for representing data as key-value pairs.
[0557] "Generative AI models" refer to machine learning algorithms and models that generate travel itineraries based on input data.
[0558] "User interface" refers to the screen or interface through which a user interacts with a system.
[0559] The present invention relates to a system for generating customized travel plans based on a user's travel preferences and budget. This system is mainly composed of a generation system artificial intelligence means, a terminal means, a display means, a data conversion means, and a server.
[0560] First, a user inputs their travel preferences and budget using a terminal (a smartphone, tablet, or web application on a computer). For example, they can input information such as "I want to go to a beach resort" and "My budget is $1,500."
[0561] After the terminal means acquires the data entered by the user, it converts it into JSON format using the data conversion means. The converted data will have the following format:
[0562] json
[0563] {
[0564] "preferences": "Beach Resort",
[0565] "budget": 1500
[0566] }
[0567] This data is transmitted from the terminal to the server.
[0568] The server passes the data received from the device to a generative artificial intelligence means, which uses a trained AI model to generate a travel plan based on the user's preferences and budget. The generated travel plan includes suggestions for destinations, accommodations, activities, and meals.
[0569] For example, if a user enters the criteria "I want to go to a beach resort" and "My budget is $1500," the following itinerary may be generated:
[0570] Destination: Phuket Island, Thailand
[0571] Accommodation: 5-star resort hotel
[0572] Activities: Snorkeling, boat tours, visiting local markets
[0573] Meal: Thai food at a local restaurant
[0574] The generated itinerary is sent from the server to the terminal, which then displays it to the user. Through the display means, the user can check the detailed itinerary and regenerate or modify it as necessary.
[0575] For example, a prompt can be entered in the following format:
[0576] "I want to go to a beach resort. My budget is $1,500. Please suggest a suitable itinerary."
[0577] This allows the system to provide users with the best travel plans that fit their preferences and budget, enabling faster and more accurate travel planning. It also offers multilingual support, destination cultural guides, and health and safety advice.
[0578] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0579] Step 1:
[0580] The user inputs their travel preferences and budget using the terminal. For example, the user inputs "I want to go to a beach resort" and "My budget is $1,500." This input data will proceed to the next step.
[0581] Input: Travel preferences and budget (e.g., "beach resort," "$1500")
[0582] Output: User input data
[0583] Step 2:
[0584] The terminal takes the user's input data and converts it to JSON format, for example, the following data:
[0585] json
[0586] {
[0587] "preferences": "Beach Resort",
[0588] "budget": 1500
[0589] }
[0590] The data converted to JSON format will proceed to the next step.
[0591] Input: User-entered data
[0592] Output: JSON format data
[0593] Step 3:
[0594] The device sends the data converted into JSON format to the server. Specifically, the device sends the data to the server using an HTTP POST request.
[0595] Input: JSON format data
[0596] Output: Data sent in the HTTP POST request
[0597] Step 4:
[0598] The server receives the JSON data sent from the device. It parses the received data and stores it in the necessary variables. For example, it is stored in the following variables:
[0599] python
[0600] preferences = "beach resort"
[0601] budget = 1500
[0602] The analyzed data will then be passed on to the next step.
[0603] Input: JSON data sent from the terminal
[0604] Output: Parsed data (e.g. "Beach Resort", "$1500")
[0605] Step 5:
[0606] The server inputs the analyzed data into the generative AI model and generates a travel plan. Specifically, it invokes the AI model as follows:
[0607] python
[0608] travel_plan = generate_travel_plan(preferences, budget)
[0609] The generated itinerary will then proceed to the next step.
[0610] Input: Parsed data (e.g. "Beach Resort", "$1500")
[0611] Output: Generated itinerary
[0612] Step 6:
[0613] The generative AI model generates a customized itinerary based on the user's preferences and budget, for example, a detailed itinerary like this:
[0614] Destination: Phuket Island, Thailand
[0615] Accommodation: 5-star resort hotel
[0616] Activities: Snorkeling, boat tours, visiting local markets
[0617] Meal: Thai food at a local restaurant
[0618] The generated itinerary will then proceed to the next step.
[0619] Input: Data passed to the generative AI model
[0620] Output: A detailed itinerary
[0621] Step 7:
[0622] The server converts the generated travel plan back into JSON format and sends it to the terminal as an HTTP response. For example, the following JSON data is sent:
[0623] json
[0624] {
[0625] "destination": "Phuket Island, Thailand",
[0626] "accommodation": "5-star resort hotel",
[0627] "activities": ["Snorkeling", "Boat tour", "Visit to local market"],
[0628] "meals": "Thai food at a local restaurant"
[0629] }
[0630] The transmitted data will proceed to the next step.
[0631] Input: Generated itinerary
[0632] Output: JSON formatted travel plan data
[0633] Step 8:
[0634] The device parses the JSON data received from the server and displays it in a user-friendly format through the user interface. For example, the following is displayed on the screen:
[0635] Destination: Phuket Island, Thailand
[0636] Accommodation: 5-star resort hotel
[0637] Activities: Snorkeling, boat tours, visiting local markets
[0638] Meal: Thai food at a local restaurant
[0639] This allows the user to check the details of their travel plan.
[0640] Input: JSON data received from the server
[0641] Output: The itinerary displayed in the user interface.
[0642] (Application example 1)
[0643] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0644] While traditional travel planning systems allow users to customize their travel plans based on their travel preferences and budget, it is difficult to visually experience them. This makes it difficult for users to visualize their trip, leading to inconveniences when booking or changing plans. Furthermore, the lack of multilingual support, cultural guides for travel destinations, and health and safety advice makes it difficult to increase user satisfaction.
[0645] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0646] In this invention, the server includes a generative artificial intelligence means for generating a customized travel plan based on the user's travel preferences and budget, a terminal means for transmitting data to the generative artificial intelligence means in response to a user's request, a display means for displaying the generated travel plan on a user interface, and a virtual reality means for visually simulating the trip using virtual reality technology. This allows users to virtually experience the planned trip in advance, allowing them to make reservations or changes to the trip with a concrete image in mind. Furthermore, by simultaneously providing multilingual support, a cultural guide of the travel destination, and health and safety advice, user satisfaction can be greatly improved.
[0647] "Travel preferences" are requests regarding places the user wants to visit, activities and scenery that interest them.
[0648] A "budget" is a financial limit that a user can spend on a trip.
[0649] A "generative artificial intelligence means" is an artificial intelligence model that is trained to automatically generate a travel itinerary based on user input.
[0650] The term "terminal means" refers to a device or interface for receiving user input and transmitting data to the generative artificial intelligence means. Specifically, it includes a smartphone, tablet, or computer.
[0651] "Display means" refers to a display or screen that visually presents the generated travel plan and other information to the user.
[0652] "Virtual reality devices" are systems or devices that use virtual reality technology to enable users to simulate travel experiences in a virtual environment. Specifically, they include head-mounted displays and VR glasses.
[0653] A "multilingual support function" is a function that supports different languages and allows multilingual users to use it.
[0654] "Cultural Guide" is a function that provides users with information about the history, traditions, and culture of their travel destination.
[0655] "Health and Safety Advice" is a function that provides users with information on managing their health and ensuring safety while traveling.
[0656] "Virtual reality content" means visual information or scenes that can be experienced through virtual reality means.
[0657] The "operation function" is an interface that allows users to check and change travel plan information through a virtual reality experience.
[0658] The system for realizing this application example requires the following components: generative artificial intelligence means, terminal means, display means, and virtual reality means.
[0659] System configuration
[0660] 1. Generative AI Methods
[0661] The server includes a generative artificial intelligence means for generating a travel plan based on the user's input travel preferences and budget. The artificial intelligence model is trained using an extensive dataset and is capable of providing detailed recommendations for a variety of travel destinations and activities to the user.
[0662] 2. Terminal means
[0663] The terminal receives input from the user and transmits this data to the generative artificial intelligence means, which may be a smartphone, tablet, or web application on a computer.
[0664] 3. Display means
[0665] The generated itinerary is displayed on the terminal. The user can check it and view the detailed contents of the itinerary. If necessary, the itinerary can be changed or regenerated.
[0666] 4. Virtual Reality Methods
[0667] Virtual reality solutions use virtual reality technology to visually simulate travel plans, allowing users to virtually experience the planned trip. Specifically, devices such as head-mounted displays and VR glasses are used.
[0668] Program operation explanation
[0669] User operations
[0670] Users use a smartphone or tablet to input their travel preferences (e.g., beach resorts, historical tourist spots, etc.) and budget. The input data is in the form of a form, which is then submitted by clicking the button.
[0671] Device behavior
[0672] The terminal receives the user's input, converts it into an appropriate data format such as JSON format, and transmits it to the generative artificial intelligence means. For example, if "beach resort" and "1500 dollars" are input, the information is transmitted to the generative artificial intelligence means.
[0673] Server Operation
[0674] The server receives the transmitted data and uses generative artificial intelligence means to generate a travel plan, which includes specific suggestions for accommodations, attractions, transportation, etc.
[0675] Views and Virtual Reality Experiences
[0676] The generated itinerary is provided to the user through the display means of the terminal. Furthermore, the user can visually simulate the trip using virtual reality means. For example, by wearing a head-mounted display, the user can virtually experience the scenery and activities of the travel destination.
[0677] Specific examples
[0678] For example, if a user inputs "I want to go to a beach resort" and "My budget is $1500," a generative AI solution might generate the following itinerary:
[0679] Destination: Phuket Island, Thailand
[0680] Accommodation: 5-star resort hotel
[0681] Activities: Snorkeling, boat tours, visiting local markets
[0682] Budget: $1,500
[0683] This plan is displayed on the display of the terminal and can be virtually experienced by the user using virtual reality means.
[0684] Prompt Sentence Examples
[0685] Travel preference: "Beach resort"
[0686] Budget: $1,500
[0687] Destination: "Phuket Island, Thailand"
[0688] Accommodation: "Five-star resort hotel"
[0689] Activities: "Snorkeling, boat tours, and visiting local markets"
[0690] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0691] Step 1:
[0692] User Action:
[0693] Users enter their travel preferences and budget into an input form on their smartphone or tablet. For example, they enter information like "I want to go to a beach resort" and "My budget is $1,500." This input data is sent to the device and converted into an appropriate data format, such as JSON.
[0694] Input: User-entered travel preferences and budget
[0695] Output: JSON format data in the terminal
[0696] Step 2:
[0697] Device data transmission:
[0698] The terminal converts the data received from the user into JSON format and sends it to the generative artificial intelligence means, at which point the terminal establishes communication with the server and transfers the data accurately.
[0699] Input: JSON format data converted to the terminal
[0700] Output: Data sent to the server
[0701] Step 3:
[0702] Server receives data:
[0703] The server receives the data sent from the terminal, and passes the received data to the generative artificial intelligence means.
[0704] Input: Data sent from the terminal
[0705] Output: Data to generative artificial intelligence tools
[0706] Step 4:
[0707] Generate a travel plan:
[0708] The generative artificial intelligence solution generates a travel itinerary based on the received data, using an AI model trained on a wide range of datasets to suggest suitable travel destinations and activities, including destinations, accommodations, activities, and budget.
[0709] Input: Data from the server
[0710] Output: Generated itinerary
[0711] Step 5:
[0712] Sending the generated results:
[0713] The server then transmits the generated itinerary to the terminal using an appropriate protocol to ensure data integrity.
[0714] Input: Generated itinerary
[0715] Output: Data sent to the terminal
[0716] Step 6:
[0717] View itinerary:
[0718] The terminal displays the travel plan received from the server to the user on a display. The user can review the plan and make changes or regenerate it as needed. The display includes detailed information about accommodations, tourist attractions, transportation, etc.
[0719] Input: Travel plan sent from the server
[0720] Output: The itinerary displayed to the user
[0721] Step 7:
[0722] Start your virtual reality experience:
[0723] The user wears a head-mounted display or VR glasses and virtually experiences the planned trip using virtual reality means. The virtual reality system simulates the scenery and activities of the travel destination based on the user's input.
[0724] Input: User's visual information and generated travel plan
[0725] Output: Visual data of the virtual travel experience
[0726] Through these steps, users can generate a detailed travel plan based on their travel preferences and budget, and then simulate the trip using virtual reality.
[0727] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[0728] The present invention relates to a system for generating customized travel plans based on a user's travel preferences and budget, and further provides a more personalized travel experience by combining it with an emotion engine that recognizes the user's emotions. The system includes a generative artificial intelligence means, a terminal means, a display means, and an emotion engine.
[0729] System Configuration
[0730] 1. Generative AI Methods:
[0731] It is a server-side artificial intelligence model that generates travel plans based on user-entered travel preferences and budget. It is trained on an extensive dataset and is capable of providing detailed and relevant suggestions.
[0732] 2. Terminal means:
[0733] A device or interface that receives user input and transmits data to a generative artificial intelligence means. Examples include a smartphone, tablet, or web application on a computer.
[0734] 3. Display means:
[0735] A display screen for providing the generated itinerary and other useful information to the user, allowing the user to review the details of the generated itinerary.
[0736] 4. Emotion Engine:
[0737] An engine that recognizes user emotions and reflects them in the generation and adjustment of travel plans. It extracts emotional information from the user's facial expressions, voice, text input, etc., and uses it to optimize and regenerate travel plans.
[0738] System operation explanation
[0739] User Action:
[0740] The user inputs their travel preferences (e.g., beach resorts, historical tourist spots) and budget (e.g., $1,500) using a terminal. The input data is in the form of a form, which is sent by clicking.
[0741] Terminal means operation:
[0742] The device receives the form input data, converts it to JSON format, and sends it to the server, along with the user's travel preferences, budget, and emotional data.
[0743] Server behavior:
[0744] The server receives the data sent from the device and passes it to a generative AI model, which generates a travel plan based on the input data and emotion data, including specific suggestions for accommodation, sightseeing spots, transportation, etc.
[0745] Display method behavior:
[0746] After receiving the generated itinerary from the server, it is provided to the user through a display means, allowing the user to check the detailed plan while viewing it and make changes or regenerate it as necessary.
[0747] Emotion Engine in action:
[0748] The emotion engine monitors the user's emotion data in real time and sends feedback to the generative artificial intelligence means as needed. For example, if the user expresses dissatisfaction, the emotion engine sends this information to the server and adjusts or regenerates the travel plan.
[0749] Specific examples
[0750] For example, if a user inputs "I want to go to a beach resort" and "My budget is $1500," along with a satisfied facial expression, a generative AI solution might generate the following itinerary:
[0751] Destination: Waikiki Beach, Hawaii
[0752] Accommodation: 4-star beach resort hotel
[0753] Activities: Surfing lessons, beach BBQ, local market visit
[0754] Meal: Dinner at a seafood restaurant
[0755] On the other hand, if the user shows a dissatisfied expression after inputting the information, the emotion engine feeds this information back to the server, which then uses generative artificial intelligence to regenerate the itinerary and present a more suitable plan.
[0756] In this way, the present invention provides a system that provides customized travel plans based on multiple factors such as user preferences, budget, and emotions, thereby improving travelers' satisfaction and sense of security.
[0757] The processing flow will be explained below.
[0758] Step 1:
[0759] The user enters their travel preferences and budget into a form on the terminal.
[0760] For example, a user enters "beach resort" and "$1500."
[0761] Step 2:
[0762] The user clicks the "Generate Itinerary" button.
[0763] When a click event occurs, a JavaScript event listener captures the event.
[0764] Step 3:
[0765] The terminal takes the form input data and converts it into JSON format.
[0766] The retrieved data will be in the format { "preferences": "Beach Resort", "budget": "$1500"}.
[0767] Step 4:
[0768] The terminal uses an emotion engine to recognize the user's emotions and extract emotion data.
[0769] For example, the device's camera and microphone can be used to analyze the user's facial expressions and tone of voice, generating emotional data such as "satisfied" or "dissatisfied."
[0770] Step 5:
[0771] The device sends the data converted into JSON format and the emotion data to the server as a POST request.
[0772] The destination is the / generate_plan endpoint on the server.
[0773] Step 6:
[0774] The server receives the POST request and extracts the JSON data and emotion data from the request body.
[0775] The extracted data is {"preferences": "beach resort", "budget": "$1500", "emotion": "satisfied"}.
[0776] Step 7:
[0777] Based on the extracted data, the server constructs prompts that instruct the generative artificial intelligence means to generate a travel plan.
[0778] For example, the prompt might be "Travel preference: beach resort, budget: $1500, emotion: happy."
[0779] Step 8:
[0780] The server inputs prompts to the generative artificial intelligence means to generate a travel plan.
[0781] A generative artificial intelligence solution generates itineraries using an extensive data set.
[0782] Step 9:
[0783] The server converts the generated itinerary into JSON format and sends it back to the client as a response.
[0784] For example, {"travel_plan": "Waikiki Beach, Hawaii, 4-star resort hotel, surfing lessons, beach BBQ, visit to local market, dinner at seafood restaurant"}.
[0785] Step 10:
[0786] The terminal receives the response from the server and parses the response body in JSON format.
[0787] The parsing result is {"travel_plan": "Waikiki Beach in Hawaii, a 4-star resort hotel, surfing lessons, a beach barbecue, a visit to a local market, and dinner at a seafood restaurant"}.
[0788] Step 11:
[0789] The device displays the analyzed travel plan in a specific HTML element.
[0790] For example, the displayed content might be "Waikiki Beach in Hawaii, a 4-star resort hotel, surfing lessons, a beach barbecue, a tour of a local market, and dinner at a seafood restaurant."
[0791] Step 12:
[0792] The emotion engine again detects the user's emotions when viewing the displayed itinerary.
[0793] For example, if the user shows a dissatisfied expression, the emotion engine updates the emotion data to "dissatisfied."
[0794] Step 13:
[0795] The terminal again transmits the updated emotion data to the server and requests the travel plan to be regenerated.
[0796] The server generates a different travel plan based on the new emotion data using generative artificial intelligence means.
[0797] Step 14:
[0798] The server sends the newly generated itinerary to the terminal, which displays it on its user interface.
[0799] The user reviews the new travel plans and makes a final selection.
[0800] In this way, the present invention provides a system that provides an optimal travel plan that matches the user's preferences, budget, and emotions, and allows the user to have a satisfying travel experience.
[0801] Example 2
[0802] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0803] Conventional travel planning systems only provide suggestions based on the user's travel preferences and budget, without personalizing the user's travel experiences. As a result, they often propose travel plans that are difficult for users to satisfy. Furthermore, they lack functionality for providing multilingual support, cultural guides for the destination, and health and safety advice, which can make users feel uneasy during their trips.
[0804] The specification process by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a generative artificial intelligence means for generating a customized travel plan based on the user's travel preferences and budget, a terminal means for transmitting data and emotion data from the user to the generative artificial intelligence means, a display means for displaying the generated travel plan on a user interface, and an emotion recognition means for recognizing the user's emotions and reflecting them in the generation and adjustment of the travel plan. This makes it possible to provide a more satisfying personalized travel plan that reflects the user's emotions. In addition, by providing multilingual support, a cultural guide of the travel destination, and health and safety advice, the user can enjoy their trip with peace of mind.
[0805] "Generative AI means" refers to an AI model that generates customized travel plans based on a user's travel preferences and budget.
[0806] "Terminal means" refers to a device or interface for acquiring data and emotional data from a user and transmitting it to generative artificial intelligence means.
[0807] The "display means" refers to a display screen or monitor that presents the generated travel plan on a user interface so that the user can visually confirm it.
[0808] "Emotion recognition means" refers to an engine or software that extracts emotional data from a user's facial expressions, voice, text input, etc., and reflects this in generating and adjusting travel plans.
[0809] "Multilingual support function" refers to a function that supports multiple languages and allows users to use the system in their own native language.
[0810] "Cultural guide" refers to the function of providing information about the history, customs, and tourist attractions of a travel destination.
[0811] "Health and Safety Advice" refers to the function that provides advice and information on how to maintain your health and safety while traveling.
[0812] The present invention provides a system that generates a customized travel plan based on a user's travel preferences and budget, and further recognizes the user's emotions to provide personalized suggestions. The system includes a generative artificial intelligence means, a terminal means, a display means, and an emotion recognition means.
[0813] System Configuration
[0814] Generative AI methods: These are server-side AI models. Generative AI models (such as GPT-4) generate customized travel plans based on user-entered travel preferences and budget. Generative AI models are trained using extensive datasets and are therefore able to provide detailed and relevant recommendations.
[0815] Terminal Means: This refers to a device or interface that receives user input and transmits data to the Generative AI Means. Specific examples include a smartphone, tablet, or web application on a computer. The Terminal Means also has the function of capturing the user's facial expressions and voice and transmitting them to a server as emotional data.
[0816] Display means: This corresponds to a display screen that provides the generated travel plan and other useful information to the user. This allows the user to check the details of the generated travel plan. For example, a smartphone display or a computer monitor is a display means.
[0817] Emotion recognition means: This corresponds to an engine that recognizes the user's emotions and reflects them in the generation and adjustment of travel plans. This emotion recognition means extracts emotional information from the user's facial expressions, voice, text input, etc., and uses this information to help optimize and regenerate travel plans. Specific examples of emotion recognition technologies include Microsoft Azure Face API and Google Cloud Vision API.
[0818] Operation explanation
[0819] User operation: The user inputs their travel preferences (e.g., "I want to go to a beach resort") and budget (e.g., "1,500 dollars") using a terminal device. This input data is in the form of a form, and is sent to the server by clicking the send button. The user's real-time facial expressions and voice are also acquired as emotion data.
[0820] Operation of the terminal means: The terminal acquires the input data of the form, converts it into JSON format, and sends it to the server. For example, travel preferences, budget, and the user's emotional data (such as "happy" or "sad") are sent in JSON format. This allows the server to generate a plan based on the user's current emotional state.
[0821] Server operation: The server receives data sent from the device and passes it to the generative AI means. The generative AI model generates a travel plan based on the input data and emotional data. At this time, the generative AI model is input with a prompt statement such as: "The user is interested in beach resorts and has a budget of $1,500. Please generate a travel plan based on this." In addition, based on the emotional data, the server regenerates and adjusts the plan to increase user satisfaction.
[0822] Operation of the display means: After receiving the generated itinerary from the server, it is provided to the user through the display means. The user can view it, check the details of accommodations and activities, and make changes or regenerate it as necessary.
[0823] Operation of the emotion recognition means: The emotion recognition means monitors the user's emotion data in real time and feeds that information back to the server. For example, if the user shows a "dissatisfied" expression, the emotion recognition means sends this information to the generative artificial intelligence means, prompting the means to readjust or regenerate the travel plan.
[0824] Specific examples
[0825] For example, if a user inputs "I want to go to a beach resort" and "My budget is $1500," along with a satisfied facial expression, a generative AI solution might generate the following itinerary:
[0826] Destination: Waikiki Beach, Hawaii
[0827] Accommodation: 4-star beach resort hotel
[0828] Activities: Surfing lessons, beach BBQ, local market visit
[0829] Meal: Dinner at a seafood restaurant
[0830] On the other hand, if the user shows a dissatisfied expression after inputting the information, the emotion recognition means feeds this information back to the server, which then uses the generative artificial intelligence means to regenerate the itinerary and present a more suitable plan.
[0831] In this way, the present invention provides a system that provides customized travel plans based on multiple factors such as user preferences, budget, and emotions, thereby improving travelers' satisfaction and sense of security.
[0832] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0833] Step 1:
[0834] User enters travel preferences and budget
[0835] The user accesses a dedicated app or website for planning a trip. They enter their travel preferences (e.g., "I want to go to a beach resort") and budget (e.g., "1,500 dollars") into an input form displayed on the screen. Facial expressions and voice are also captured in real time and prepared as emotion data. Input data: Travel preferences, budget, emotion data. Output data: Input data is sent to the device.
[0836] Step 2:
[0837] The device sends input data and emotion data to the server.
[0838] The device receives the data entered by the user and formats it as needed. Specifically, it converts travel preferences and budget into JSON format, and also integrates emotional data obtained from the camera and microphone into JSON format. It then sends this to the server. Input data: User-entered data. Output data: JSON data sent to the server.
[0839] Step 3:
[0840] The server receives the data and passes it to the generative AI model
[0841] The server receives data sent from the device. This data is stored as a JSON object divided into appropriate fields. The server then passes the input data to the generative AI model as a prompt. For example, it generates a prompt such as, "The user is interested in beach resorts and has a budget of $1,500. Please generate a travel plan based on this." Input data: User input data in JSON format. Output data: Prompt passed to the generative AI model.
[0842] Step 4:
[0843] Generative AI means generate travel plans
[0844] A generative AI model (e.g., GPT-4) generates a travel plan based on the given prompt. The generated travel plan includes specific accommodations, tourist attractions, and transportation options. For example, it might suggest "a four-star hotel in Waikiki Beach, surfing lessons, a beach barbecue, etc." Input data: prompt. Output data: generated travel plan data.
[0845] Step 5:
[0846] Emotion recognition means analyzes emotional data and provides feedback
[0847] The emotion recognition means analyzes the received emotion data and determines whether it is a satisfaction or dissatisfaction. If the user's emotion is recognized as "dissatisfaction," the feedback is sent to the generative AI model, prompting the user to readjust their travel plans. Input data: Emotion data. Output data: Feedback data.
[0848] Step 6:
[0849] The server sends the generated travel plan to the terminal.
[0850] The server receives the travel plan generated by the generative artificial intelligence means and sends it to the terminal. At this time, if feedback from the emotion recognition means is reflected, a regenerated travel plan is sent. Input data: Generated travel plan data. Output data: Travel plan data sent to the terminal.
[0851] Step 7:
[0852] The device displays the travel plan to the user.
[0853] The terminal visually displays the received travel plan to the user. Accommodation information and activity details are displayed on the smartphone or computer screen. The user can view this and make further adjustments or request regeneration. Input data: Travel plan data sent to the terminal. Output data: Travel plan information displayed on the user interface.
[0854] (Application example 2)
[0855] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0856] Existing content distribution services recommend content based on a user's past viewing history and preferences, but they are unable to reflect the user's real-time emotions, which means they are unable to sufficiently improve user satisfaction. Furthermore, they are unable to re-recommend content in response to changes in the user's emotions while viewing, which makes it difficult to provide the optimal viewing experience for the user.
[0857] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[0858] In this invention, the server includes a terminal means for receiving user input and transmitting data to the generative artificial intelligence means, an emotion engine means for recognizing the user's emotions in real time and reflecting them in optimizing the travel plan, and a display means for displaying the generated travel plan on a user interface, thereby enabling the recommendation of optimal content based on the user's preferences and emotions.
[0859] A "generative AI means" is an AI model that analyzes data based on a user's preferences and budget to generate optimal travel plans and content recommendations.
[0860] "Terminal means" refers to a device or interface that receives input data from a user and transmits the data to the generative artificial intelligence means. Specific examples include smartphones, tablets, and applications on computers.
[0861] The "emotion engine means" is a system that recognizes emotions in real time from the user's facial expressions, voice, text input, etc., and provides feedback to the generative artificial intelligence means.
[0862] The "display means" refers to a screen or display device for displaying the generated travel plan and content recommendation results on a user interface.
[0863] A "travel itinerary" is a detailed plan of accommodations, attractions, transportation, and other activities at a travel destination.
[0864] "Content recommendation" refers to suggesting the most suitable movies, dramas, and other viewing content based on the user's preferences and emotions.
[0865] "User interface" refers to a screen or interface through which a user can provide input data and view generated results via a terminal means.
[0866] The present invention provides a system for providing personalized travel plans and content recommendations based on a user's preferences and emotions. Specific embodiments are described below.
[0867] System Configuration
[0868] The system consists of the following main components:
[0869] 1. Generative AI tools: Using AI models trained on extensive datasets, they can create travel itineraries based on user preferences and budget, or recommend content based on viewing history.
[0870] 2. Terminal means: The device through which the user inputs, including smartphones, tablets, and applications on computers.
[0871] 3. Emotion engine means: Recognize emotions in real time from the user's facial expressions and voice, and use this to optimize travel plans and content recommendations.
[0872] 4. Display means: A display device for displaying the generated plan and recommendation results on a user interface.
[0873] Hardware and software used
[0874] Hardware:
[0875] Smartphones (camera, microphone, display), tablets, personal computers
[0876] software:
[0877] Emotion recognition engine (e.g. Microsoft Azure Face API)
[0878] Generative AI models (e.g., OpenAI GPT models)
[0879] Display applications (e.g., developed with Flutter or React Native)
[0880] Data processing and calculation
[0881] Terminal means role:
[0882] The terminal formats and transmits input from the user (e.g., travel preferences, budget, viewing history, etc.) to the generative artificial intelligence means, including real-time emotion data captured by the emotion engine means.
[0883] The role of generative artificial intelligence tools:
[0884] The AI model generates optimal travel plans and content recommendations based on user input and emotional data. It does this by analyzing a variety of information, including frequency of use, past trends, and emotional data, to suggest the most suitable plans and content for the user.
[0885] The role of the emotion engine means:
[0886] The emotion recognition engine collects real-time user emotion data from the camera and microphone and provides feedback to the AI model, which then uses this feedback to improve the accuracy of travel plans and content recommendations.
[0887] The role of the display means:
[0888] The generated plans and recommendations are displayed on the user interface, allowing the user to view them and make a final selection.
[0889] Specific examples
[0890] Travel plan example:
[0891] If a user inputs "I want a beach resort" and "My budget is $1,500" and looks satisfied, the generative artificial intelligence means will generate the following travel plan:
[0892] Destination: Beach resort
[0893] Accommodation: Beachfront hotel
[0894] Activities: Water sports, local market visit
[0895] Content recommendation examples:
[0896] If a user types in "I like action movies" and "I like actor A" and uses the app with a smile, the following movies will be recommended:
[0897] Movie: Action Movie 1
[0898] Movie: Action Movie 2
[0899] Movie: Action Movie 3
[0900] Prompt Sentence Examples
[0901] "Generate a list of movies based on the assumption that the user likes action movies and Actor A. In addition, make optimal suggestions based on the user's emotional data."
[0902] This enables personalized travel planning and content recommendations that respond to users' preferences and real-time emotional state.
[0903] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0904] Step 1:
[0905] The user uses a terminal to input information such as travel preferences, budget, genre of content they want to watch, and actors. The input data is collected in a form format. The input in this step is data about the user's preferences, budget, and viewing history. As an output, this information is converted into JSON format.
[0906] Step 2:
[0907] The terminal means converts the input data into JSON format and sends it to the server. In this step, the user's preferences, budget, viewing history, and emotional data acquired by the terminal means are also sent at the same time. The input is the user's data, and the output is JSON data sent to the server.
[0908] Step 3:
[0909] The server analyzes the JSON data received from the terminal means and passes it to the generative artificial intelligence means. The generative artificial intelligence means generates a travel plan and content recommendations based on the input data. The input in this step is the JSON data sent from the terminal means, and the output is the generated travel plan data and a list of content recommendations.
[0910] Step 4:
[0911] Generative AI tools analyze data based on submitted user preferences, budgets, and emotional data to generate optimal travel plans and content. The AI models used here include the OpenAI GPT model. The input is the user data to be analyzed, and the output is a list of customized travel plans and content recommendations.
[0912] Step 5:
[0913] The server receives the generated travel plan and content list and sends it to the terminal means. The input in this step is the output data from the generative AI model, which becomes the data to be sent to the terminal means. The output is the final travel plan and content list to be displayed to the user.
[0914] Step 6:
[0915] The terminal means analyzes the received data and displays it on the user interface. The input in this step is the travel plan and content list data sent from the server, and the output is the information displayed on the user interface.
[0916] Step 7:
[0917] The user checks the displayed travel plan and content list and provides emotional feedback as needed. The emotion engine recognizes this in real time and sends the feedback back to the server. The input is the user's emotional data, and the output is feedback data to the server.
[0918] Step 8:
[0919] The server receives feedback from the emotion engine means and passes it back to the generative artificial intelligence means to reanalyze the data, thereby generating a more optimized travel plan or content recommendation, which is then provided to the user again. The input is the emotion feedback data, and the output is a regenerated travel plan or content list.
[0920] This enables personalized travel planning and content recommendations that respond to users' preferences and real-time emotional state.
[0921] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0922] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0923] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[0924] [Third embodiment]
[0925] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[0926] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.
[0927] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0928] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[0929] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0930] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0931] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0932] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0933] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0934] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0935] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0936] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."
[0937] The present invention relates to a system for generating a customized travel plan based on a user's travel preferences and budget, the system including a generating artificial intelligence means, a terminal means, and a display means.
[0938] System Configuration
[0939] 1. Generative AI Methods:
[0940] It is a server-side artificial intelligence model that generates travel plans based on user-entered travel preferences and budget. The model is trained on an extensive dataset and is capable of providing detailed and relevant suggestions for a variety of travel destinations and travel styles.
[0941] 2. Terminal means:
[0942] Refers to a device or interface that receives user input and transmits data to a generative artificial intelligence means. Examples include a smartphone, tablet, or web application on a computer.
[0943] 3. Display means:
[0944] It includes a display screen for providing the generated itinerary and other useful information to the user, allowing the user to view the details of the generated itinerary.
[0945] System operation explanation
[0946] User Action:
[0947] The user inputs their travel preferences (e.g., beach resorts, historical tourist spots, etc.) and budget (e.g., $1,500) using a terminal. The input data is in the form of a form, which is sent to the server by clicking it.
[0948] Terminal means operation:
[0949] The terminal receives user input, converts it into JSON format, and sends it to the generative artificial intelligence means. For example, suppose a travel preference of "beach resort" and a budget of "$1,500" are input.
[0950] Server behavior:
[0951] The server receives the data sent from the device and passes it to a generative AI model, which generates a travel plan based on the input data, including specific suggestions for accommodation, tourist attractions, transportation, etc.
[0952] Display method behavior:
[0953] After receiving the generated itinerary from the server, it is provided to the user through a display means, where the user can check the detailed itinerary and make changes or regenerate it as necessary.
[0954] Specific examples
[0955] For example, if a user inputs "I want to go to a beach resort" and "My budget is $1500," a generative AI solution might generate the following itinerary:
[0956] Destination: Phuket Island, Thailand
[0957] Accommodation: 5-star resort hotel
[0958] Activities: Snorkeling, boat tours, visiting local markets
[0959] Meal: Thai food at a local restaurant
[0960] This information is displayed on the device's display, allowing the user to review the detailed plan and, if necessary, request the server to generate a new plan including additional destinations and activities.
[0961] In this way, the present invention provides a travel plan customized to the traveler's preferences and budget, and builds a system that supports the traveler so that they can enjoy their trip with peace of mind.
[0962] The processing flow will be explained below.
[0963] Step 1:
[0964] The user enters their travel preferences and budget into a form on the terminal.
[0965] As an example, a user enters "beach resort" and "$1500."
[0966] Step 2:
[0967] The user clicks the "Generate Itinerary" button.
[0968] When a click event occurs, a JavaScript event listener captures the event.
[0969] Step 3:
[0970] The terminal takes the form input data and converts it into JSON format.
[0971] The retrieved data will be in the format { "preferences": "Beach Resort", "budget": "$1500"}.
[0972] Step 4:
[0973] The terminal sends the data converted into JSON format to the server as a POST request.
[0974] The destination is the / generate_plan endpoint on the server.
[0975] Step 5:
[0976] The server receives the POST request and extracts the JSON data from the request body.
[0977] The extracted data is {"preferences": "beach resort", "budget": "$1500"}.
[0978] Step 6:
[0979] Based on the extracted data, the server constructs prompts that instruct the generative artificial intelligence means to generate a travel plan.
[0980] For example, the prompt might be "Travel preference: Beach resort, Budget: $1500."
[0981] Step 7:
[0982] The server inputs prompts to the generative artificial intelligence means to generate a travel plan.
[0983] A generative artificial intelligence solution generates itineraries using an extensive data set.
[0984] Step 8:
[0985] The server converts the generated itinerary into JSON format and sends it back to the client as a response.
[0986] For example, {"travel_plan": "Phuket Island, Thailand, 5-star resort hotel, snorkeling, boat tour, local market visit, Thai cuisine"}.
[0987] Step 9:
[0988] The terminal receives the response from the server and parses the response body in JSON format.
[0989] The parsing result is {"travel_plan": "Phuket Island, Thailand, 5-star resort hotel, snorkeling, boat tour, visit to local market, Thai cuisine"}.
[0990] Step 10:
[0991] The device displays the analyzed travel plan in a specific HTML element.
[0992] An example of the displayed content would be "Phuket Island, Thailand, 5-star resort hotel, snorkeling, boat tour, visit to local market, Thai cuisine."
[0993] Step 11:
[0994] The user checks the generated travel plan and decides on the next course of action.
[0995] For example, you can choose to accept the proposed itinerary or request a regeneration.
[0996] Example 1
[0997] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[0998] Conventional travel plan generation systems have difficulty quickly and accurately providing optimal travel plans based on users' travel preferences and budgets, even when they input them. Furthermore, they lack multilingual support, cultural guides for travel destinations, and health and safety advice. This makes it difficult for users to easily find travel plans that suit their needs, making travel planning cumbersome.
[0999] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1000] In this invention, the server includes a generative artificial intelligence means for generating a customized travel plan based on a user's travel preferences and budget, a terminal means for sending data to the generative artificial intelligence means in response to a user request, a display means for displaying the generated travel plan on a user interface, a data conversion means for receiving user input data and converting it into JSON format, and a server for receiving data sent from the terminal and inputting it into the generative artificial intelligence model to generate a travel plan. This allows users to quickly and accurately obtain the optimal travel plan that suits their preferences and budget, and can also provide multilingual support, cultural guides for travel destinations, and health and safety advice.
[1001] "Generative AI means" refers to an AI model for generating customized travel plans based on a user's travel preferences and budget.
[1002] "Terminal means" refers to a device or interface that transmits data to generative artificial intelligence means in response to a request from a user.
[1003] "Display means" refers to a display or screen for displaying the generated itinerary on a user interface.
[1004] "Data conversion means" refers to the process or function that takes user input data and converts it into JSON format.
[1005] "Server" refers to a computer that receives data sent from a terminal and inputs it into a generative artificial intelligence model to generate a travel plan.
[1006] "JSON format" refers to a lightweight data interchange format for representing data as key-value pairs.
[1007] "Generative AI models" refer to machine learning algorithms and models that generate travel itineraries based on input data.
[1008] "User interface" refers to the screen or interface through which a user interacts with a system.
[1009] The present invention relates to a system for generating customized travel plans based on a user's travel preferences and budget. This system is mainly composed of a generation system artificial intelligence means, a terminal means, a display means, a data conversion means, and a server.
[1010] First, a user inputs their travel preferences and budget using a terminal (a smartphone, tablet, or web application on a computer). For example, they can input information such as "I want to go to a beach resort" and "My budget is $1,500."
[1011] After the terminal means acquires the data entered by the user, it converts it into JSON format using the data conversion means. The converted data will have the following format:
[1012] json
[1013] {
[1014] "preferences": "Beach Resort",
[1015] "budget": 1500
[1016] }
[1017] This data is transmitted from the terminal to the server.
[1018] The server passes the data received from the device to a generative artificial intelligence means, which uses a trained AI model to generate a travel plan based on the user's preferences and budget. The generated travel plan includes suggestions for destinations, accommodations, activities, and meals.
[1019] For example, if a user enters the criteria "I want to go to a beach resort" and "My budget is $1500," the following itinerary may be generated:
[1020] Destination: Phuket Island, Thailand
[1021] Accommodation: 5-star resort hotel
[1022] Activities: Snorkeling, boat tours, visiting local markets
[1023] Meal: Thai food at a local restaurant
[1024] The generated itinerary is sent from the server to the terminal, which then displays it to the user. Through the display means, the user can check the detailed itinerary and regenerate or modify it as necessary.
[1025] For example, a prompt can be entered in the following format:
[1026] "I want to go to a beach resort. My budget is $1,500. Please suggest a suitable itinerary."
[1027] This allows the system to provide users with the best travel plans that fit their preferences and budget, enabling faster and more accurate travel planning. It also offers multilingual support, destination cultural guides, and health and safety advice.
[1028] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1029] Step 1:
[1030] The user inputs their travel preferences and budget using the terminal. For example, the user inputs "I want to go to a beach resort" and "My budget is $1,500." This input data will proceed to the next step.
[1031] Input: Travel preferences and budget (e.g., "beach resort," "$1500")
[1032] Output: User input data
[1033] Step 2:
[1034] The terminal takes the user's input data and converts it to JSON format, for example, the following data:
[1035] json
[1036] {
[1037] "preferences": "Beach Resort",
[1038] "budget": 1500
[1039] }
[1040] The data converted to JSON format will proceed to the next step.
[1041] Input: User-entered data
[1042] Output: JSON format data
[1043] Step 3:
[1044] The device sends the data converted into JSON format to the server. Specifically, the device sends the data to the server using an HTTP POST request.
[1045] Input: JSON format data
[1046] Output: Data sent in the HTTP POST request
[1047] Step 4:
[1048] The server receives the JSON data sent from the device. It parses the received data and stores it in the necessary variables. For example, it is stored in the following variables:
[1049] python
[1050] preferences = "beach resort"
[1051] budget = 1500
[1052] The analyzed data will then be passed on to the next step.
[1053] Input: JSON data sent from the terminal
[1054] Output: Parsed data (e.g. "Beach Resort", "$1500")
[1055] Step 5:
[1056] The server inputs the analyzed data into the generative AI model and generates a travel plan. Specifically, it invokes the AI model as follows:
[1057] python
[1058] travel_plan = generate_travel_plan(preferences, budget)
[1059] The generated itinerary will then proceed to the next step.
[1060] Input: Parsed data (e.g. "Beach Resort", "$1500")
[1061] Output: Generated itinerary
[1062] Step 6:
[1063] The generative AI model generates a customized itinerary based on the user's preferences and budget, for example, a detailed itinerary like this:
[1064] Destination: Phuket Island, Thailand
[1065] Accommodation: 5-star resort hotel
[1066] Activities: Snorkeling, boat tours, visiting local markets
[1067] Meal: Thai food at a local restaurant
[1068] The generated itinerary will then proceed to the next step.
[1069] Input: Data passed to the generative AI model
[1070] Output: A detailed itinerary
[1071] Step 7:
[1072] The server converts the generated travel plan back into JSON format and sends it to the terminal as an HTTP response. For example, the following JSON data is sent:
[1073] json
[1074] {
[1075] "destination": "Phuket Island, Thailand",
[1076] "accommodation": "5-star resort hotel",
[1077] "activities": ["Snorkeling", "Boat tour", "Visit to local market"],
[1078] "meals": "Thai food at a local restaurant"
[1079] }
[1080] The transmitted data will proceed to the next step.
[1081] Input: Generated itinerary
[1082] Output: JSON formatted travel plan data
[1083] Step 8:
[1084] The device parses the JSON data received from the server and displays it in a user-friendly format through the user interface. For example, the following is displayed on the screen:
[1085] Destination: Phuket Island, Thailand
[1086] Accommodation: 5-star resort hotel
[1087] Activities: Snorkeling, boat tours, visiting local markets
[1088] Meal: Thai food at a local restaurant
[1089] This allows the user to check the details of their travel plan.
[1090] Input: JSON data received from the server
[1091] Output: The itinerary displayed in the user interface.
[1092] (Application example 1)
[1093] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1094] While traditional travel planning systems allow users to customize their travel plans based on their travel preferences and budget, it is difficult to visually experience them. This makes it difficult for users to visualize their trip, leading to inconveniences when booking or changing plans. Furthermore, the lack of multilingual support, cultural guides for travel destinations, and health and safety advice makes it difficult to increase user satisfaction.
[1095] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1096] In this invention, the server includes a generative artificial intelligence means for generating a customized travel plan based on the user's travel preferences and budget, a terminal means for transmitting data to the generative artificial intelligence means in response to a user's request, a display means for displaying the generated travel plan on a user interface, and a virtual reality means for visually simulating the trip using virtual reality technology. This allows users to virtually experience the planned trip in advance, allowing them to make reservations or changes to the trip with a concrete image in mind. Furthermore, by simultaneously providing multilingual support, a cultural guide of the travel destination, and health and safety advice, user satisfaction can be greatly improved.
[1097] "Travel preferences" are requests regarding places the user wants to visit, activities and scenery that interest them.
[1098] A "budget" is a financial limit that a user can spend on a trip.
[1099] A "generative artificial intelligence means" is an artificial intelligence model that is trained to automatically generate a travel itinerary based on user input.
[1100] The term "terminal means" refers to a device or interface for receiving user input and transmitting data to the generative artificial intelligence means. Specifically, it includes a smartphone, tablet, or computer.
[1101] "Display means" refers to a display or screen that visually presents the generated travel plan and other information to the user.
[1102] "Virtual reality devices" are systems or devices that use virtual reality technology to enable users to simulate travel experiences in a virtual environment. Specifically, they include head-mounted displays and VR glasses.
[1103] A "multilingual support function" is a function that supports different languages and allows multilingual users to use it.
[1104] "Cultural Guide" is a function that provides users with information about the history, traditions, and culture of their travel destination.
[1105] "Health and Safety Advice" is a function that provides users with information on managing their health and ensuring safety while traveling.
[1106] "Virtual reality content" means visual information or scenes that can be experienced through virtual reality means.
[1107] The "operation function" is an interface that allows users to check and change travel plan information through a virtual reality experience.
[1108] The system for realizing this application example requires the following components: generative artificial intelligence means, terminal means, display means, and virtual reality means.
[1109] System configuration
[1110] 1. Generative AI Methods
[1111] The server includes a generative artificial intelligence means for generating a travel plan based on the user's input travel preferences and budget. The artificial intelligence model is trained using an extensive dataset and is capable of providing detailed recommendations for a variety of travel destinations and activities to the user.
[1112] 2. Terminal means
[1113] The terminal receives input from the user and transmits this data to the generative artificial intelligence means, which may be a smartphone, tablet, or web application on a computer.
[1114] 3. Display means
[1115] The generated itinerary is displayed on the terminal. The user can check it and view the detailed contents of the itinerary. If necessary, the itinerary can be changed or regenerated.
[1116] 4. Virtual Reality Methods
[1117] Virtual reality solutions use virtual reality technology to visually simulate travel plans, allowing users to virtually experience the planned trip. Specifically, devices such as head-mounted displays and VR glasses are used.
[1118] Program operation explanation
[1119] User operations
[1120] Users use a smartphone or tablet to input their travel preferences (e.g., beach resorts, historical tourist spots, etc.) and budget. The input data is in the form of a form, which is then submitted by clicking the button.
[1121] Device behavior
[1122] The terminal receives the user's input, converts it into an appropriate data format such as JSON format, and transmits it to the generative artificial intelligence means. For example, if "beach resort" and "1500 dollars" are input, the information is transmitted to the generative artificial intelligence means.
[1123] Server Operation
[1124] The server receives the transmitted data and uses generative artificial intelligence means to generate a travel plan, which includes specific suggestions for accommodations, attractions, transportation, etc.
[1125] Views and Virtual Reality Experiences
[1126] The generated itinerary is provided to the user through the display means of the terminal. Furthermore, the user can visually simulate the trip using virtual reality means. For example, by wearing a head-mounted display, the user can virtually experience the scenery and activities of the travel destination.
[1127] Specific examples
[1128] For example, if a user inputs "I want to go to a beach resort" and "My budget is $1500," a generative AI solution might generate the following itinerary:
[1129] Destination: Phuket Island, Thailand
[1130] Accommodation: 5-star resort hotel
[1131] Activities: Snorkeling, boat tours, visiting local markets
[1132] Budget: $1,500
[1133] This plan is displayed on the display of the terminal and can be virtually experienced by the user using virtual reality means.
[1134] Prompt Sentence Examples
[1135] Travel preference: "Beach resort"
[1136] Budget: $1,500
[1137] Destination: "Phuket Island, Thailand"
[1138] Accommodation: "Five-star resort hotel"
[1139] Activities: "Snorkeling, boat tours, and visiting local markets"
[1140] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1141] Step 1:
[1142] User Action:
[1143] Users enter their travel preferences and budget into an input form on their smartphone or tablet. For example, they enter information like "I want to go to a beach resort" and "My budget is $1,500." This input data is sent to the device and converted into an appropriate data format, such as JSON.
[1144] Input: User-entered travel preferences and budget
[1145] Output: JSON format data in the terminal
[1146] Step 2:
[1147] Device data transmission:
[1148] The terminal converts the data received from the user into JSON format and sends it to the generative artificial intelligence means, at which point the terminal establishes communication with the server and transfers the data accurately.
[1149] Input: JSON format data converted to the terminal
[1150] Output: Data sent to the server
[1151] Step 3:
[1152] Server receives data:
[1153] The server receives the data sent from the terminal, and passes the received data to the generative artificial intelligence means.
[1154] Input: Data sent from the terminal
[1155] Output: Data to generative artificial intelligence tools
[1156] Step 4:
[1157] Generate a travel plan:
[1158] The generative artificial intelligence solution generates a travel itinerary based on the received data, using an AI model trained on a wide range of datasets to suggest suitable travel destinations and activities, including destinations, accommodations, activities, and budget.
[1159] Input: Data from the server
[1160] Output: Generated itinerary
[1161] Step 5:
[1162] Sending the generated results:
[1163] The server then transmits the generated itinerary to the terminal using an appropriate protocol to ensure data integrity.
[1164] Input: Generated itinerary
[1165] Output: Data sent to the terminal
[1166] Step 6:
[1167] View itinerary:
[1168] The terminal displays the travel plan received from the server to the user on a display. The user can review the plan and make changes or regenerate it as needed. The display includes detailed information about accommodations, tourist attractions, transportation, etc.
[1169] Input: Travel plan sent from the server
[1170] Output: The itinerary displayed to the user
[1171] Step 7:
[1172] Start your virtual reality experience:
[1173] The user wears a head-mounted display or VR glasses and virtually experiences the planned trip using virtual reality means. The virtual reality system simulates the scenery and activities of the travel destination based on the user's input.
[1174] Input: User's visual information and generated travel plan
[1175] Output: Visual data of the virtual travel experience
[1176] Through these steps, users can generate a detailed travel plan based on their travel preferences and budget, and then simulate the trip using virtual reality.
[1177] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1178] The present invention relates to a system for generating customized travel plans based on a user's travel preferences and budget, and further provides a more personalized travel experience by combining it with an emotion engine that recognizes the user's emotions. The system includes a generative artificial intelligence means, a terminal means, a display means, and an emotion engine.
[1179] System Configuration
[1180] 1. Generative AI Methods:
[1181] It is a server-side artificial intelligence model that generates travel plans based on user-entered travel preferences and budget. It is trained on an extensive dataset and is capable of providing detailed and relevant suggestions.
[1182] 2. Terminal means:
[1183] A device or interface that receives user input and transmits data to a generative artificial intelligence means. Examples include a smartphone, tablet, or web application on a computer.
[1184] 3. Display means:
[1185] A display screen for providing the generated itinerary and other useful information to the user, allowing the user to review the details of the generated itinerary.
[1186] 4. Emotion Engine:
[1187] An engine that recognizes user emotions and reflects them in the generation and adjustment of travel plans. It extracts emotional information from the user's facial expressions, voice, text input, etc., and uses it to optimize and regenerate travel plans.
[1188] System operation explanation
[1189] User Action:
[1190] The user inputs their travel preferences (e.g., beach resorts, historical tourist spots) and budget (e.g., $1,500) using a terminal. The input data is in the form of a form, which is sent by clicking.
[1191] Terminal means operation:
[1192] The device receives the form input data, converts it to JSON format, and sends it to the server, along with the user's travel preferences, budget, and emotional data.
[1193] Server behavior:
[1194] The server receives the data sent from the device and passes it to a generative AI model, which generates a travel plan based on the input data and emotion data, including specific suggestions for accommodation, sightseeing spots, transportation, etc.
[1195] Display method behavior:
[1196] After receiving the generated itinerary from the server, it is provided to the user through a display means, allowing the user to check the detailed plan while viewing it and make changes or regenerate it as necessary.
[1197] Emotion Engine in action:
[1198] The emotion engine monitors the user's emotion data in real time and sends feedback to the generative artificial intelligence means as needed. For example, if the user expresses dissatisfaction, the emotion engine sends this information to the server and adjusts or regenerates the travel plan.
[1199] Specific examples
[1200] For example, if a user inputs "I want to go to a beach resort" and "My budget is $1500," along with a satisfied facial expression, a generative AI solution might generate the following itinerary:
[1201] Destination: Waikiki Beach, Hawaii
[1202] Accommodation: 4-star beach resort hotel
[1203] Activities: Surfing lessons, beach BBQ, local market visit
[1204] Meal: Dinner at a seafood restaurant
[1205] On the other hand, if the user shows a dissatisfied expression after inputting the information, the emotion engine feeds this information back to the server, which then uses generative artificial intelligence to regenerate the itinerary and present a more suitable plan.
[1206] In this way, the present invention provides a system that provides customized travel plans based on multiple factors such as user preferences, budget, and emotions, thereby improving travelers' satisfaction and sense of security.
[1207] The processing flow will be explained below.
[1208] Step 1:
[1209] The user enters their travel preferences and budget into a form on the terminal.
[1210] For example, a user enters "beach resort" and "$1500."
[1211] Step 2:
[1212] The user clicks the "Generate Itinerary" button.
[1213] When a click event occurs, a JavaScript event listener captures the event.
[1214] Step 3:
[1215] The terminal takes the form input data and converts it into JSON format.
[1216] The retrieved data will be in the format { "preferences": "Beach Resort", "budget": "$1500"}.
[1217] Step 4:
[1218] The terminal uses an emotion engine to recognize the user's emotions and extract emotion data.
[1219] For example, the device's camera and microphone can be used to analyze the user's facial expressions and tone of voice, generating emotional data such as "satisfied" or "dissatisfied."
[1220] Step 5:
[1221] The device sends the data converted into JSON format and the emotion data to the server as a POST request.
[1222] The destination is the / generate_plan endpoint on the server.
[1223] Step 6:
[1224] The server receives the POST request and extracts the JSON data and emotion data from the request body.
[1225] The extracted data is {"preferences": "beach resort", "budget": "$1500", "emotion": "satisfied"}.
[1226] Step 7:
[1227] Based on the extracted data, the server constructs prompts that instruct the generative artificial intelligence means to generate a travel plan.
[1228] For example, the prompt might be "Travel preference: beach resort, budget: $1500, emotion: happy."
[1229] Step 8:
[1230] The server inputs prompts to the generative artificial intelligence means to generate a travel plan.
[1231] A generative artificial intelligence solution generates itineraries using an extensive data set.
[1232] Step 9:
[1233] The server converts the generated itinerary into JSON format and sends it back to the client as a response.
[1234] For example, {"travel_plan": "Waikiki Beach, Hawaii, 4-star resort hotel, surfing lessons, beach BBQ, visit to local market, dinner at seafood restaurant"}.
[1235] Step 10:
[1236] The terminal receives the response from the server and parses the response body in JSON format.
[1237] The parsing result is {"travel_plan": "Waikiki Beach in Hawaii, a 4-star resort hotel, surfing lessons, a beach barbecue, a visit to a local market, and dinner at a seafood restaurant"}.
[1238] Step 11:
[1239] The device displays the analyzed travel plan in a specific HTML element.
[1240] For example, the displayed content might be "Waikiki Beach in Hawaii, a 4-star resort hotel, surfing lessons, a beach barbecue, a tour of a local market, and dinner at a seafood restaurant."
[1241] Step 12:
[1242] The emotion engine again detects the user's emotions when viewing the displayed itinerary.
[1243] For example, if the user shows a dissatisfied expression, the emotion engine updates the emotion data to "dissatisfied."
[1244] Step 13:
[1245] The terminal again transmits the updated emotion data to the server and requests the travel plan to be regenerated.
[1246] The server generates a different travel plan based on the new emotion data using generative artificial intelligence means.
[1247] Step 14:
[1248] The server sends the newly generated itinerary to the terminal, which displays it on its user interface.
[1249] The user reviews the new travel plans and makes a final selection.
[1250] In this way, the present invention provides a system that provides an optimal travel plan that matches the user's preferences, budget, and emotions, and allows the user to have a satisfying travel experience.
[1251] Example 2
[1252] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1253] Conventional travel planning systems only provide suggestions based on the user's travel preferences and budget, without personalizing the user's travel experiences. As a result, they often propose travel plans that are difficult for users to satisfy. Furthermore, they lack functionality for providing multilingual support, cultural guides for the destination, and health and safety advice, which can make users feel uneasy during their trips.
[1254] The specification process by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a generative artificial intelligence means for generating a customized travel plan based on the user's travel preferences and budget, a terminal means for transmitting data and emotion data from the user to the generative artificial intelligence means, a display means for displaying the generated travel plan on a user interface, and an emotion recognition means for recognizing the user's emotions and reflecting them in the generation and adjustment of the travel plan. This makes it possible to provide a more satisfying personalized travel plan that reflects the user's emotions. In addition, by providing multilingual support, a cultural guide of the travel destination, and health and safety advice, the user can enjoy their trip with peace of mind.
[1255] "Generative AI means" refers to an AI model that generates customized travel plans based on a user's travel preferences and budget.
[1256] "Terminal means" refers to a device or interface for acquiring data and emotional data from a user and transmitting it to generative artificial intelligence means.
[1257] The "display means" refers to a display screen or monitor that presents the generated travel plan on a user interface so that the user can visually confirm it.
[1258] "Emotion recognition means" refers to an engine or software that extracts emotional data from a user's facial expressions, voice, text input, etc., and reflects this in generating and adjusting travel plans.
[1259] "Multilingual support function" refers to a function that supports multiple languages and allows users to use the system in their own native language.
[1260] "Cultural guide" refers to the function of providing information about the history, customs, and tourist attractions of a travel destination.
[1261] "Health and Safety Advice" refers to the function that provides advice and information on how to maintain your health and safety while traveling.
[1262] The present invention provides a system that generates a customized travel plan based on a user's travel preferences and budget, and further recognizes the user's emotions to provide personalized suggestions. The system includes a generative artificial intelligence means, a terminal means, a display means, and an emotion recognition means.
[1263] System Configuration
[1264] Generative AI methods: These are server-side AI models. Generative AI models (such as GPT-4) generate customized travel plans based on user-entered travel preferences and budget. Generative AI models are trained using extensive datasets and are therefore able to provide detailed and relevant recommendations.
[1265] Terminal Means: This refers to a device or interface that receives user input and transmits data to the Generative AI Means. Specific examples include a smartphone, tablet, or web application on a computer. The Terminal Means also has the function of capturing the user's facial expressions and voice and transmitting them to a server as emotional data.
[1266] Display means: This corresponds to a display screen that provides the generated travel plan and other useful information to the user. This allows the user to check the details of the generated travel plan. For example, a smartphone display or a computer monitor is a display means.
[1267] Emotion recognition means: This corresponds to an engine that recognizes the user's emotions and reflects them in the generation and adjustment of travel plans. This emotion recognition means extracts emotional information from the user's facial expressions, voice, text input, etc., and uses this information to help optimize and regenerate travel plans. Specific examples of emotion recognition technologies include Microsoft Azure Face API and Google Cloud Vision API.
[1268] Operation explanation
[1269] User operation: The user inputs their travel preferences (e.g., "I want to go to a beach resort") and budget (e.g., "1,500 dollars") using a terminal device. This input data is in the form of a form, and is sent to the server by clicking the send button. The user's real-time facial expressions and voice are also acquired as emotion data.
[1270] Operation of the terminal means: The terminal acquires the input data of the form, converts it into JSON format, and sends it to the server. For example, travel preferences, budget, and the user's emotional data (such as "happy" or "sad") are sent in JSON format. This allows the server to generate a plan based on the user's current emotional state.
[1271] Server operation: The server receives data sent from the device and passes it to the generative AI means. The generative AI model generates a travel plan based on the input data and emotional data. At this time, the generative AI model is input with a prompt statement such as: "The user is interested in beach resorts and has a budget of $1,500. Please generate a travel plan based on this." In addition, based on the emotional data, the server regenerates and adjusts the plan to increase user satisfaction.
[1272] Operation of the display means: After receiving the generated itinerary from the server, it is provided to the user through the display means. The user can view it, check the details of accommodations and activities, and make changes or regenerate it as necessary.
[1273] Operation of the emotion recognition means: The emotion recognition means monitors the user's emotion data in real time and feeds that information back to the server. For example, if the user shows a "dissatisfied" expression, the emotion recognition means sends this information to the generative artificial intelligence means, prompting the means to readjust or regenerate the travel plan.
[1274] Specific examples
[1275] For example, if a user inputs "I want to go to a beach resort" and "My budget is $1500," along with a satisfied facial expression, a generative AI solution might generate the following itinerary:
[1276] Destination: Waikiki Beach, Hawaii
[1277] Accommodation: 4-star beach resort hotel
[1278] Activities: Surfing lessons, beach BBQ, local market visit
[1279] Meal: Dinner at a seafood restaurant
[1280] On the other hand, if the user shows a dissatisfied expression after inputting the information, the emotion recognition means feeds this information back to the server, which then uses the generative artificial intelligence means to regenerate the itinerary and present a more suitable plan.
[1281] In this way, the present invention provides a system that provides customized travel plans based on multiple factors such as user preferences, budget, and emotions, thereby improving travelers' satisfaction and sense of security.
[1282] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1283] Step 1:
[1284] User enters travel preferences and budget
[1285] The user accesses a dedicated app or website for planning a trip. They enter their travel preferences (e.g., "I want to go to a beach resort") and budget (e.g., "1,500 dollars") into an input form displayed on the screen. Facial expressions and voice are also captured in real time and prepared as emotion data. Input data: Travel preferences, budget, emotion data. Output data: Input data is sent to the device.
[1286] Step 2:
[1287] The device sends input data and emotion data to the server.
[1288] The device receives the data entered by the user and formats it as needed. Specifically, it converts travel preferences and budget into JSON format, and also integrates emotional data obtained from the camera and microphone into JSON format. It then sends this to the server. Input data: User-entered data. Output data: JSON data sent to the server.
[1289] Step 3:
[1290] The server receives the data and passes it to the generative AI model
[1291] The server receives data sent from the device. This data is stored as a JSON object divided into appropriate fields. The server then passes the input data to the generative AI model as a prompt. For example, it generates a prompt such as, "The user is interested in beach resorts and has a budget of $1,500. Please generate a travel plan based on this." Input data: User input data in JSON format. Output data: Prompt passed to the generative AI model.
[1292] Step 4:
[1293] Generative AI means generate travel plans
[1294] A generative AI model (e.g., GPT-4) generates a travel plan based on the given prompt. The generated travel plan includes specific accommodations, tourist attractions, and transportation options. For example, it might suggest "a four-star hotel in Waikiki Beach, surfing lessons, a beach barbecue, etc." Input data: prompt. Output data: generated travel plan data.
[1295] Step 5:
[1296] Emotion recognition means analyzes emotional data and provides feedback
[1297] The emotion recognition means analyzes the received emotion data and determines whether it is a satisfaction or dissatisfaction. If the user's emotion is recognized as "dissatisfaction," the feedback is sent to the generative AI model, prompting the user to readjust their travel plans. Input data: Emotion data. Output data: Feedback data.
[1298] Step 6:
[1299] The server sends the generated travel plan to the terminal.
[1300] The server receives the travel plan generated by the generative artificial intelligence means and sends it to the terminal. At this time, if feedback from the emotion recognition means is reflected, a regenerated travel plan is sent. Input data: Generated travel plan data. Output data: Travel plan data sent to the terminal.
[1301] Step 7:
[1302] The device displays the travel plan to the user.
[1303] The terminal visually displays the received travel plan to the user. Accommodation information and activity details are displayed on the smartphone or computer screen. The user can view this and make further adjustments or request regeneration. Input data: Travel plan data sent to the terminal. Output data: Travel plan information displayed on the user interface.
[1304] (Application example 2)
[1305] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1306] Existing content distribution services recommend content based on a user's past viewing history and preferences, but they are unable to reflect the user's real-time emotions, which means they are unable to sufficiently improve user satisfaction. Furthermore, they are unable to re-recommend content in response to changes in the user's emotions while viewing, which makes it difficult to provide the optimal viewing experience for the user.
[1307] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[1308] In this invention, the server includes a terminal means for receiving user input and transmitting data to the generative artificial intelligence means, an emotion engine means for recognizing the user's emotions in real time and reflecting them in optimizing the travel plan, and a display means for displaying the generated travel plan on a user interface, thereby enabling the recommendation of optimal content based on the user's preferences and emotions.
[1309] A "generative AI means" is an AI model that analyzes data based on a user's preferences and budget to generate optimal travel plans and content recommendations.
[1310] "Terminal means" refers to a device or interface that receives input data from a user and transmits the data to the generative artificial intelligence means. Specific examples include smartphones, tablets, and applications on computers.
[1311] The "emotion engine means" is a system that recognizes emotions in real time from the user's facial expressions, voice, text input, etc., and provides feedback to the generative artificial intelligence means.
[1312] The "display means" refers to a screen or display device for displaying the generated travel plan and content recommendation results on a user interface.
[1313] A "travel itinerary" is a detailed plan of accommodations, attractions, transportation, and other activities at a travel destination.
[1314] "Content recommendation" refers to suggesting the most suitable movies, dramas, and other viewing content based on the user's preferences and emotions.
[1315] "User interface" refers to a screen or interface through which a user can provide input data and view generated results via a terminal means.
[1316] The present invention provides a system for providing personalized travel plans and content recommendations based on a user's preferences and emotions. Specific embodiments are described below.
[1317] System Configuration
[1318] The system consists of the following main components:
[1319] 1. Generative AI tools: Using AI models trained on extensive datasets, they can create travel itineraries based on user preferences and budget, or recommend content based on viewing history.
[1320] 2. Terminal means: The device through which the user inputs, including smartphones, tablets, and applications on computers.
[1321] 3. Emotion engine means: Recognize emotions in real time from the user's facial expressions and voice, and use this to optimize travel plans and content recommendations.
[1322] 4. Display means: A display device for displaying the generated plan and recommendation results on a user interface.
[1323] Hardware and software used
[1324] Hardware:
[1325] Smartphones (camera, microphone, display), tablets, personal computers
[1326] software:
[1327] Emotion recognition engine (e.g. Microsoft Azure Face API)
[1328] Generative AI models (e.g., OpenAI GPT models)
[1329] Display applications (e.g., developed with Flutter or React Native)
[1330] Data processing and calculation
[1331] Terminal means role:
[1332] The terminal formats and transmits input from the user (e.g., travel preferences, budget, viewing history, etc.) to the generative artificial intelligence means, including real-time emotion data captured by the emotion engine means.
[1333] The role of generative artificial intelligence tools:
[1334] The AI model generates optimal travel plans and content recommendations based on user input and emotional data. It does this by analyzing a variety of information, including frequency of use, past trends, and emotional data, to suggest the most suitable plans and content for the user.
[1335] The role of the emotion engine means:
[1336] The emotion recognition engine collects real-time user emotion data from the camera and microphone and provides feedback to the AI model, which then uses this feedback to improve the accuracy of travel plans and content recommendations.
[1337] The role of the display means:
[1338] The generated plans and recommendations are displayed on the user interface, allowing the user to view them and make a final selection.
[1339] Specific examples
[1340] Travel plan example:
[1341] If a user inputs "I want a beach resort" and "My budget is $1,500" and looks satisfied, the generative artificial intelligence means will generate the following travel plan:
[1342] Destination: Beach resort
[1343] Accommodation: Beachfront hotel
[1344] Activities: Water sports, local market visit
[1345] Content recommendation examples:
[1346] If a user types in "I like action movies" and "I like actor A" and uses the app with a smile, the following movies will be recommended:
[1347] Movie: Action Movie 1
[1348] Movie: Action Movie 2
[1349] Movie: Action Movie 3
[1350] Prompt Sentence Examples
[1351] "Generate a list of movies based on the assumption that the user likes action movies and Actor A. In addition, make optimal suggestions based on the user's emotional data."
[1352] This enables personalized travel planning and content recommendations that respond to users' preferences and real-time emotional state.
[1353] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1354] Step 1:
[1355] The user uses a terminal to input information such as travel preferences, budget, genre of content they want to watch, and actors. The input data is collected in a form format. The input in this step is data about the user's preferences, budget, and viewing history. As an output, this information is converted into JSON format.
[1356] Step 2:
[1357] The terminal means converts the input data into JSON format and sends it to the server. In this step, the user's preferences, budget, viewing history, and emotional data acquired by the terminal means are also sent at the same time. The input is the user's data, and the output is JSON data sent to the server.
[1358] Step 3:
[1359] The server analyzes the JSON data received from the terminal means and passes it to the generative artificial intelligence means. The generative artificial intelligence means generates a travel plan and content recommendations based on the input data. The input in this step is the JSON data sent from the terminal means, and the output is the generated travel plan data and a list of content recommendations.
[1360] Step 4:
[1361] Generative AI tools analyze data based on submitted user preferences, budgets, and emotional data to generate optimal travel plans and content. The AI models used here include the OpenAI GPT model. The input is the user data to be analyzed, and the output is a list of customized travel plans and content recommendations.
[1362] Step 5:
[1363] The server receives the generated travel plan and content list and sends it to the terminal means. The input in this step is the output data from the generative AI model, which becomes the data to be sent to the terminal means. The output is the final travel plan and content list to be displayed to the user.
[1364] Step 6:
[1365] The terminal means analyzes the received data and displays it on the user interface. The input in this step is the travel plan and content list data sent from the server, and the output is the information displayed on the user interface.
[1366] Step 7:
[1367] The user checks the displayed travel plan and content list and provides emotional feedback as needed. The emotion engine recognizes this in real time and sends the feedback back to the server. The input is the user's emotional data, and the output is feedback data to the server.
[1368] Step 8:
[1369] The server receives feedback from the emotion engine means and passes it back to the generative artificial intelligence means to reanalyze the data, thereby generating a more optimized travel plan or content recommendation, which is then provided to the user again. The input is the emotion feedback data, and the output is a regenerated travel plan or content list.
[1370] This enables personalized travel planning and content recommendations that respond to users' preferences and real-time emotional state.
[1371] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1372] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1373] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.
[1374] [Fourth embodiment]
[1375] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.
[1376] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[1377] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1378] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.
[1379] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1380] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1381] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1382] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.
[1383] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1384] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1385] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1386] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1387] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1388] The present invention relates to a system for generating a customized travel plan based on a user's travel preferences and budget, the system including a generating artificial intelligence means, a terminal means, and a display means.
[1389] System Configuration
[1390] 1. Generative AI Methods:
[1391] It is a server-side artificial intelligence model that generates travel plans based on user-entered travel preferences and budget. The model is trained on an extensive dataset and is capable of providing detailed and relevant suggestions for a variety of travel destinations and travel styles.
[1392] 2. Terminal means:
[1393] Refers to a device or interface that receives user input and transmits data to a generative artificial intelligence means. Examples include a smartphone, tablet, or web application on a computer.
[1394] 3. Display means:
[1395] It includes a display screen for providing the generated itinerary and other useful information to the user, allowing the user to view the details of the generated itinerary.
[1396] System operation explanation
[1397] User Action:
[1398] The user inputs their travel preferences (e.g., beach resorts, historical tourist spots, etc.) and budget (e.g., $1,500) using a terminal. The input data is in the form of a form, which is sent to the server by clicking it.
[1399] Terminal means operation:
[1400] The terminal receives user input, converts it into JSON format, and sends it to the generative artificial intelligence means. For example, suppose a travel preference of "beach resort" and a budget of "$1,500" are input.
[1401] Server behavior:
[1402] The server receives the data sent from the device and passes it to a generative AI model, which generates a travel plan based on the input data, including specific suggestions for accommodation, tourist attractions, transportation, etc.
[1403] Display method behavior:
[1404] After receiving the generated itinerary from the server, it is provided to the user through a display means, where the user can check the detailed itinerary and make changes or regenerate it as necessary.
[1405] Specific examples
[1406] For example, if a user inputs "I want to go to a beach resort" and "My budget is $1500," a generative AI solution might generate the following itinerary:
[1407] Destination: Phuket Island, Thailand
[1408] Accommodation: 5-star resort hotel
[1409] Activities: Snorkeling, boat tours, visiting local markets
[1410] Meal: Thai food at a local restaurant
[1411] This information is displayed on the device's display, allowing the user to review the detailed plan and, if necessary, request the server to generate a new plan including additional destinations and activities.
[1412] In this way, the present invention provides a travel plan customized to the traveler's preferences and budget, and builds a system that supports the traveler so that they can enjoy their trip with peace of mind.
[1413] The processing flow will be explained below.
[1414] Step 1:
[1415] The user enters their travel preferences and budget into a form on the terminal.
[1416] As an example, a user enters "beach resort" and "$1500."
[1417] Step 2:
[1418] The user clicks the "Generate Itinerary" button.
[1419] When a click event occurs, a JavaScript event listener captures the event.
[1420] Step 3:
[1421] The terminal takes the form input data and converts it into JSON format.
[1422] The retrieved data will be in the format { "preferences": "Beach Resort", "budget": "$1500"}.
[1423] Step 4:
[1424] The terminal sends the data converted into JSON format to the server as a POST request.
[1425] The destination is the / generate_plan endpoint on the server.
[1426] Step 5:
[1427] The server receives the POST request and extracts the JSON data from the request body.
[1428] The extracted data is {"preferences": "beach resort", "budget": "$1500"}.
[1429] Step 6:
[1430] Based on the extracted data, the server constructs prompts that instruct the generative artificial intelligence means to generate a travel plan.
[1431] For example, the prompt might be "Travel preference: Beach resort, Budget: $1500."
[1432] Step 7:
[1433] The server inputs prompts to the generative artificial intelligence means to generate a travel plan.
[1434] A generative artificial intelligence solution generates itineraries using an extensive data set.
[1435] Step 8:
[1436] The server converts the generated itinerary into JSON format and sends it back to the client as a response.
[1437] For example, {"travel_plan": "Phuket Island, Thailand, 5-star resort hotel, snorkeling, boat tour, local market visit, Thai cuisine"}.
[1438] Step 9:
[1439] The terminal receives the response from the server and parses the response body in JSON format.
[1440] The parsing result is {"travel_plan": "Phuket Island, Thailand, 5-star resort hotel, snorkeling, boat tour, visit to local market, Thai cuisine"}.
[1441] Step 10:
[1442] The device displays the analyzed travel plan in a specific HTML element.
[1443] An example of the displayed content would be "Phuket Island, Thailand, 5-star resort hotel, snorkeling, boat tour, visit to local market, Thai cuisine."
[1444] Step 11:
[1445] The user checks the generated travel plan and decides on the next course of action.
[1446] For example, you can choose to accept the proposed itinerary or request a regeneration.
[1447] Example 1
[1448] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1449] Conventional travel plan generation systems have difficulty quickly and accurately providing optimal travel plans based on users' travel preferences and budgets, even when they input them. Furthermore, they lack multilingual support, cultural guides for travel destinations, and health and safety advice. This makes it difficult for users to easily find travel plans that suit their needs, making travel planning cumbersome.
[1450] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1451] In this invention, the server includes a generative artificial intelligence means for generating a customized travel plan based on a user's travel preferences and budget, a terminal means for sending data to the generative artificial intelligence means in response to a user request, a display means for displaying the generated travel plan on a user interface, a data conversion means for receiving user input data and converting it into JSON format, and a server for receiving data sent from the terminal and inputting it into the generative artificial intelligence model to generate a travel plan. This allows users to quickly and accurately obtain the optimal travel plan that suits their preferences and budget, and can also provide multilingual support, cultural guides for travel destinations, and health and safety advice.
[1452] "Generative AI means" refers to an AI model for generating customized travel plans based on a user's travel preferences and budget.
[1453] "Terminal means" refers to a device or interface that transmits data to generative artificial intelligence means in response to a request from a user.
[1454] "Display means" refers to a display or screen for displaying the generated itinerary on a user interface.
[1455] "Data conversion means" refers to the process or function that takes user input data and converts it into JSON format.
[1456] "Server" refers to a computer that receives data sent from a terminal and inputs it into a generative artificial intelligence model to generate a travel plan.
[1457] "JSON format" refers to a lightweight data interchange format for representing data as key-value pairs.
[1458] "Generative AI models" refer to machine learning algorithms and models that generate travel itineraries based on input data.
[1459] "User interface" refers to the screen or interface through which a user interacts with a system.
[1460] The present invention relates to a system for generating customized travel plans based on a user's travel preferences and budget. This system is mainly composed of a generation system artificial intelligence means, a terminal means, a display means, a data conversion means, and a server.
[1461] First, a user inputs their travel preferences and budget using a terminal (a smartphone, tablet, or web application on a computer). For example, they can input information such as "I want to go to a beach resort" and "My budget is $1,500."
[1462] After the terminal means acquires the data entered by the user, it converts it into JSON format using the data conversion means. The converted data will have the following format:
[1463] json
[1464] {
[1465] "preferences": "Beach Resort",
[1466] "budget": 1500
[1467] }
[1468] This data is transmitted from the terminal to the server.
[1469] The server passes the data received from the device to a generative artificial intelligence means, which uses a trained AI model to generate a travel plan based on the user's preferences and budget. The generated travel plan includes suggestions for destinations, accommodations, activities, and meals.
[1470] For example, if a user enters the criteria "I want to go to a beach resort" and "My budget is $1500," the following itinerary may be generated:
[1471] Destination: Phuket Island, Thailand
[1472] Accommodation: 5-star resort hotel
[1473] Activities: Snorkeling, boat tours, visiting local markets
[1474] Meal: Thai food at a local restaurant
[1475] The generated itinerary is sent from the server to the terminal, which then displays it to the user. Through the display means, the user can check the detailed itinerary and regenerate or modify it as necessary.
[1476] For example, a prompt can be entered in the following format:
[1477] "I want to go to a beach resort. My budget is $1,500. Please suggest a suitable itinerary."
[1478] This allows the system to provide users with the best travel plans that fit their preferences and budget, enabling faster and more accurate travel planning. It also offers multilingual support, destination cultural guides, and health and safety advice.
[1479] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1480] Step 1:
[1481] The user inputs their travel preferences and budget using the terminal. For example, the user inputs "I want to go to a beach resort" and "My budget is $1,500." This input data will proceed to the next step.
[1482] Input: Travel preferences and budget (e.g., "beach resort," "$1500")
[1483] Output: User input data
[1484] Step 2:
[1485] The terminal takes the user's input data and converts it to JSON format, for example, the following data:
[1486] json
[1487] {
[1488] "preferences": "Beach Resort",
[1489] "budget": 1500
[1490] }
[1491] The data converted to JSON format will proceed to the next step.
[1492] Input: User-entered data
[1493] Output: JSON format data
[1494] Step 3:
[1495] The device sends the data converted into JSON format to the server. Specifically, the device sends the data to the server using an HTTP POST request.
[1496] Input: JSON format data
[1497] Output: Data sent in the HTTP POST request
[1498] Step 4:
[1499] The server receives the JSON data sent from the device. It parses the received data and stores it in the necessary variables. For example, it is stored in the following variables:
[1500] python
[1501] preferences = "beach resort"
[1502] budget = 1500
[1503] The analyzed data will then be passed on to the next step.
[1504] Input: JSON data sent from the terminal
[1505] Output: Parsed data (e.g. "Beach Resort", "$1500")
[1506] Step 5:
[1507] The server inputs the analyzed data into the generative AI model and generates a travel plan. Specifically, it invokes the AI model as follows:
[1508] python
[1509] travel_plan = generate_travel_plan(preferences, budget)
[1510] The generated itinerary will then proceed to the next step.
[1511] Input: Parsed data (e.g. "Beach Resort", "$1500")
[1512] Output: Generated itinerary
[1513] Step 6:
[1514] The generative AI model generates a customized itinerary based on the user's preferences and budget, for example, a detailed itinerary like this:
[1515] Destination: Phuket Island, Thailand
[1516] Accommodation: 5-star resort hotel
[1517] Activities: Snorkeling, boat tours, visiting local markets
[1518] Meal: Thai food at a local restaurant
[1519] The generated itinerary will then proceed to the next step.
[1520] Input: Data passed to the generative AI model
[1521] Output: A detailed itinerary
[1522] Step 7:
[1523] The server converts the generated travel plan back into JSON format and sends it to the terminal as an HTTP response. For example, the following JSON data is sent:
[1524] json
[1525] {
[1526] "destination": "Phuket Island, Thailand",
[1527] "accommodation": "5-star resort hotel",
[1528] "activities": ["Snorkeling", "Boat tour", "Visit to local market"],
[1529] "meals": "Thai food at a local restaurant"
[1530] }
[1531] The transmitted data will proceed to the next step.
[1532] Input: Generated itinerary
[1533] Output: JSON formatted travel plan data
[1534] Step 8:
[1535] The device parses the JSON data received from the server and displays it in a user-friendly format through the user interface. For example, the following is displayed on the screen:
[1536] Destination: Phuket Island, Thailand
[1537] Accommodation: 5-star resort hotel
[1538] Activities: Snorkeling, boat tours, visiting local markets
[1539] Meal: Thai food at a local restaurant
[1540] This allows the user to check the details of their travel plan.
[1541] Input: JSON data received from the server
[1542] Output: The itinerary displayed in the user interface.
[1543] (Application example 1)
[1544] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1545] While traditional travel planning systems allow users to customize their travel plans based on their travel preferences and budget, it is difficult to visually experience them. This makes it difficult for users to visualize their trip, leading to inconveniences when booking or changing plans. Furthermore, the lack of multilingual support, cultural guides for travel destinations, and health and safety advice makes it difficult to increase user satisfaction.
[1546] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1547] In this invention, the server includes a generative artificial intelligence means for generating a customized travel plan based on the user's travel preferences and budget, a terminal means for transmitting data to the generative artificial intelligence means in response to a user's request, a display means for displaying the generated travel plan on a user interface, and a virtual reality means for visually simulating the trip using virtual reality technology. This allows users to virtually experience the planned trip in advance, allowing them to make reservations or changes to the trip with a concrete image in mind. Furthermore, by simultaneously providing multilingual support, a cultural guide of the travel destination, and health and safety advice, user satisfaction can be greatly improved.
[1548] "Travel preferences" are requests regarding places the user wants to visit, activities and scenery that interest them.
[1549] A "budget" is a financial limit that a user can spend on a trip.
[1550] A "generative artificial intelligence means" is an artificial intelligence model that is trained to automatically generate a travel itinerary based on user input.
[1551] The term "terminal means" refers to a device or interface for receiving user input and transmitting data to the generative artificial intelligence means. Specifically, it includes a smartphone, tablet, or computer.
[1552] "Display means" refers to a display or screen that visually presents the generated travel plan and other information to the user.
[1553] "Virtual reality devices" are systems or devices that use virtual reality technology to enable users to simulate travel experiences in a virtual environment. Specifically, they include head-mounted displays and VR glasses.
[1554] A "multilingual support function" is a function that supports different languages and allows multilingual users to use it.
[1555] "Cultural Guide" is a function that provides users with information about the history, traditions, and culture of their travel destination.
[1556] "Health and Safety Advice" is a function that provides users with information on managing their health and ensuring safety while traveling.
[1557] "Virtual reality content" means visual information or scenes that can be experienced through virtual reality means.
[1558] The "operation function" is an interface that allows users to check and change travel plan information through a virtual reality experience.
[1559] The system for realizing this application example requires the following components: generative artificial intelligence means, terminal means, display means, and virtual reality means.
[1560] System configuration
[1561] 1. Generative AI Methods
[1562] The server includes a generative artificial intelligence means for generating a travel plan based on the user's input travel preferences and budget. The artificial intelligence model is trained using an extensive dataset and is capable of providing detailed recommendations for a variety of travel destinations and activities to the user.
[1563] 2. Terminal means
[1564] The terminal receives input from the user and transmits this data to the generative artificial intelligence means, which may be a smartphone, tablet, or web application on a computer.
[1565] 3. Display means
[1566] The generated itinerary is displayed on the terminal. The user can check it and view the detailed contents of the itinerary. If necessary, the itinerary can be changed or regenerated.
[1567] 4. Virtual Reality Methods
[1568] Virtual reality solutions use virtual reality technology to visually simulate travel plans, allowing users to virtually experience the planned trip. Specifically, devices such as head-mounted displays and VR glasses are used.
[1569] Program operation explanation
[1570] User operations
[1571] Users use a smartphone or tablet to input their travel preferences (e.g., beach resorts, historical tourist spots, etc.) and budget. The input data is in the form of a form, which is then submitted by clicking the button.
[1572] Device behavior
[1573] The terminal receives the user's input, converts it into an appropriate data format such as JSON format, and transmits it to the generative artificial intelligence means. For example, if "beach resort" and "1500 dollars" are input, the information is transmitted to the generative artificial intelligence means.
[1574] Server Operation
[1575] The server receives the transmitted data and uses generative artificial intelligence means to generate a travel plan, which includes specific suggestions for accommodations, attractions, transportation, etc.
[1576] Views and Virtual Reality Experiences
[1577] The generated itinerary is provided to the user through the display means of the terminal. Furthermore, the user can visually simulate the trip using virtual reality means. For example, by wearing a head-mounted display, the user can virtually experience the scenery and activities of the travel destination.
[1578] Specific examples
[1579] For example, if a user inputs "I want to go to a beach resort" and "My budget is $1500," a generative AI solution might generate the following itinerary:
[1580] Destination: Phuket Island, Thailand
[1581] Accommodation: 5-star resort hotel
[1582] Activities: Snorkeling, boat tours, visiting local markets
[1583] Budget: $1,500
[1584] This plan is displayed on the display of the terminal and can be virtually experienced by the user using virtual reality means.
[1585] Prompt Sentence Examples
[1586] Travel preference: "Beach resort"
[1587] Budget: $1,500
[1588] Destination: "Phuket Island, Thailand"
[1589] Accommodation: "Five-star resort hotel"
[1590] Activities: "Snorkeling, boat tours, and visiting local markets"
[1591] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1592] Step 1:
[1593] User Action:
[1594] Users enter their travel preferences and budget into an input form on their smartphone or tablet. For example, they enter information like "I want to go to a beach resort" and "My budget is $1,500." This input data is sent to the device and converted into an appropriate data format, such as JSON.
[1595] Input: User-entered travel preferences and budget
[1596] Output: JSON format data in the terminal
[1597] Step 2:
[1598] Device data transmission:
[1599] The terminal converts the data received from the user into JSON format and sends it to the generative artificial intelligence means, at which point the terminal establishes communication with the server and transfers the data accurately.
[1600] Input: JSON format data converted to the terminal
[1601] Output: Data sent to the server
[1602] Step 3:
[1603] Server receives data:
[1604] The server receives the data sent from the terminal, and passes the received data to the generative artificial intelligence means.
[1605] Input: Data sent from the terminal
[1606] Output: Data to generative artificial intelligence tools
[1607] Step 4:
[1608] Generate a travel plan:
[1609] The generative artificial intelligence solution generates a travel itinerary based on the received data, using an AI model trained on a wide range of datasets to suggest suitable travel destinations and activities, including destinations, accommodations, activities, and budget.
[1610] Input: Data from the server
[1611] Output: Generated itinerary
[1612] Step 5:
[1613] Sending the generated results:
[1614] The server then transmits the generated itinerary to the terminal using an appropriate protocol to ensure data integrity.
[1615] Input: Generated itinerary
[1616] Output: Data sent to the terminal
[1617] Step 6:
[1618] View itinerary:
[1619] The terminal displays the travel plan received from the server to the user on a display. The user can review the plan and make changes or regenerate it as needed. The display includes detailed information about accommodations, tourist attractions, transportation, etc.
[1620] Input: Travel plan sent from the server
[1621] Output: The itinerary displayed to the user
[1622] Step 7:
[1623] Start your virtual reality experience:
[1624] The user wears a head-mounted display or VR glasses and virtually experiences the planned trip using virtual reality means. The virtual reality system simulates the scenery and activities of the travel destination based on the user's input.
[1625] Input: User's visual information and generated travel plan
[1626] Output: Visual data of the virtual travel experience
[1627] Through these steps, users can generate a detailed travel plan based on their travel preferences and budget, and then simulate the trip using virtual reality.
[1628] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1629] The present invention relates to a system for generating customized travel plans based on a user's travel preferences and budget, and further provides a more personalized travel experience by combining it with an emotion engine that recognizes the user's emotions. The system includes a generative artificial intelligence means, a terminal means, a display means, and an emotion engine.
[1630] System Configuration
[1631] 1. Generative AI Methods:
[1632] It is a server-side artificial intelligence model that generates travel plans based on user-entered travel preferences and budget. It is trained on an extensive dataset and is capable of providing detailed and relevant suggestions.
[1633] 2. Terminal means:
[1634] A device or interface that receives user input and transmits data to a generative artificial intelligence means. Examples include a smartphone, tablet, or web application on a computer.
[1635] 3. Display means:
[1636] A display screen for providing the generated itinerary and other useful information to the user, allowing the user to review the details of the generated itinerary.
[1637] 4. Emotion Engine:
[1638] An engine that recognizes user emotions and reflects them in the generation and adjustment of travel plans. It extracts emotional information from the user's facial expressions, voice, text input, etc., and uses it to optimize and regenerate travel plans.
[1639] System operation explanation
[1640] User Action:
[1641] The user inputs their travel preferences (e.g., beach resorts, historical tourist spots) and budget (e.g., $1,500) using a terminal. The input data is in the form of a form, which is sent by clicking.
[1642] Terminal means operation:
[1643] The device receives the form input data, converts it to JSON format, and sends it to the server, along with the user's travel preferences, budget, and emotional data.
[1644] Server behavior:
[1645] The server receives the data sent from the device and passes it to a generative AI model, which generates a travel plan based on the input data and emotion data, including specific suggestions for accommodation, sightseeing spots, transportation, etc.
[1646] Display method behavior:
[1647] After receiving the generated itinerary from the server, it is provided to the user through a display means, allowing the user to check the detailed plan while viewing it and make changes or regenerate it as necessary.
[1648] Emotion Engine in action:
[1649] The emotion engine monitors the user's emotion data in real time and sends feedback to the generative artificial intelligence means as needed. For example, if the user expresses dissatisfaction, the emotion engine sends this information to the server and adjusts or regenerates the travel plan.
[1650] Specific examples
[1651] For example, if a user inputs "I want to go to a beach resort" and "My budget is $1500," along with a satisfied facial expression, a generative AI solution might generate the following itinerary:
[1652] Destination: Waikiki Beach, Hawaii
[1653] Accommodation: 4-star beach resort hotel
[1654] Activities: Surfing lessons, beach BBQ, local market visit
[1655] Meal: Dinner at a seafood restaurant
[1656] On the other hand, if the user shows a dissatisfied expression after inputting the information, the emotion engine feeds this information back to the server, which then uses generative artificial intelligence to regenerate the itinerary and present a more suitable plan.
[1657] In this way, the present invention provides a system that provides customized travel plans based on multiple factors such as user preferences, budget, and emotions, thereby improving travelers' satisfaction and sense of security.
[1658] The processing flow will be explained below.
[1659] Step 1:
[1660] The user enters their travel preferences and budget into a form on the terminal.
[1661] For example, a user enters "beach resort" and "$1500."
[1662] Step 2:
[1663] The user clicks the "Generate Itinerary" button.
[1664] When a click event occurs, a JavaScript event listener captures the event.
[1665] Step 3:
[1666] The terminal takes the form input data and converts it into JSON format.
[1667] The retrieved data will be in the format { "preferences": "Beach Resort", "budget": "$1500"}.
[1668] Step 4:
[1669] The terminal uses an emotion engine to recognize the user's emotions and extract emotion data.
[1670] For example, the device's camera and microphone can be used to analyze the user's facial expressions and tone of voice, generating emotional data such as "satisfied" or "dissatisfied."
[1671] Step 5:
[1672] The device sends the data converted into JSON format and the emotion data to the server as a POST request.
[1673] The destination is the / generate_plan endpoint on the server.
[1674] Step 6:
[1675] The server receives the POST request and extracts the JSON data and emotion data from the request body.
[1676] The extracted data is {"preferences": "beach resort", "budget": "$1500", "emotion": "satisfied"}.
[1677] Step 7:
[1678] Based on the extracted data, the server constructs prompts that instruct the generative artificial intelligence means to generate a travel plan.
[1679] For example, the prompt might be "Travel preference: beach resort, budget: $1500, emotion: happy."
[1680] Step 8:
[1681] The server inputs prompts to the generative artificial intelligence means to generate a travel plan.
[1682] A generative artificial intelligence solution generates itineraries using an extensive data set.
[1683] Step 9:
[1684] The server converts the generated itinerary into JSON format and sends it back to the client as a response.
[1685] For example, {"travel_plan": "Waikiki Beach, Hawaii, 4-star resort hotel, surfing lessons, beach BBQ, visit to local market, dinner at seafood restaurant"}.
[1686] Step 10:
[1687] The terminal receives the response from the server and parses the response body in JSON format.
[1688] The parsing result is {"travel_plan": "Waikiki Beach in Hawaii, a 4-star resort hotel, surfing lessons, a beach barbecue, a visit to a local market, and dinner at a seafood restaurant"}.
[1689] Step 11:
[1690] The device displays the analyzed travel plan in a specific HTML element.
[1691] For example, the displayed content might be "Waikiki Beach in Hawaii, a 4-star resort hotel, surfing lessons, a beach barbecue, a tour of a local market, and dinner at a seafood restaurant."
[1692] Step 12:
[1693] The emotion engine again detects the user's emotions when viewing the displayed itinerary.
[1694] For example, if the user shows a dissatisfied expression, the emotion engine updates the emotion data to "dissatisfied."
[1695] Step 13:
[1696] The terminal again transmits the updated emotion data to the server and requests the travel plan to be regenerated.
[1697] The server generates a different travel plan based on the new emotion data using generative artificial intelligence means.
[1698] Step 14:
[1699] The server sends the newly generated itinerary to the terminal, which displays it on its user interface.
[1700] The user reviews the new travel plans and makes a final selection.
[1701] In this way, the present invention provides a system that provides an optimal travel plan that matches the user's preferences, budget, and emotions, and allows the user to have a satisfying travel experience.
[1702] Example 2
[1703] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1704] Conventional travel planning systems only provide suggestions based on the user's travel preferences and budget, without personalizing the user's travel experiences. As a result, they often propose travel plans that are difficult for users to satisfy. Furthermore, they lack functionality for providing multilingual support, cultural guides for the destination, and health and safety advice, which can make users feel uneasy during their trips.
[1705] The specification process by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes a generative artificial intelligence means for generating a customized travel plan based on the user's travel preferences and budget, a terminal means for transmitting data and emotion data from the user to the generative artificial intelligence means, a display means for displaying the generated travel plan on a user interface, and an emotion recognition means for recognizing the user's emotions and reflecting them in the generation and adjustment of the travel plan. This makes it possible to provide a more satisfying personalized travel plan that reflects the user's emotions. In addition, by providing multilingual support, a cultural guide of the travel destination, and health and safety advice, the user can enjoy their trip with peace of mind.
[1706] "Generative AI means" refers to an AI model that generates customized travel plans based on a user's travel preferences and budget.
[1707] "Terminal means" refers to a device or interface for acquiring data and emotional data from a user and transmitting it to generative artificial intelligence means.
[1708] The "display means" refers to a display screen or monitor that presents the generated travel plan on a user interface so that the user can visually confirm it.
[1709] "Emotion recognition means" refers to an engine or software that extracts emotional data from a user's facial expressions, voice, text input, etc., and reflects this in generating and adjusting travel plans.
[1710] "Multilingual support function" refers to a function that supports multiple languages and allows users to use the system in their own native language.
[1711] "Cultural guide" refers to the function of providing information about the history, customs, and tourist attractions of a travel destination.
[1712] "Health and Safety Advice" refers to the function that provides advice and information on how to maintain your health and safety while traveling.
[1713] The present invention provides a system that generates a customized travel plan based on a user's travel preferences and budget, and further recognizes the user's emotions to provide personalized suggestions. The system includes a generative artificial intelligence means, a terminal means, a display means, and an emotion recognition means.
[1714] System Configuration
[1715] Generative AI methods: These are server-side AI models. Generative AI models (such as GPT-4) generate customized travel plans based on user-entered travel preferences and budget. Generative AI models are trained using extensive datasets and are therefore able to provide detailed and relevant recommendations.
[1716] Terminal Means: This refers to a device or interface that receives user input and transmits data to the Generative AI Means. Specific examples include a smartphone, tablet, or web application on a computer. The Terminal Means also has the function of capturing the user's facial expressions and voice and transmitting them to a server as emotional data.
[1717] Display means: This corresponds to a display screen that provides the generated travel plan and other useful information to the user. This allows the user to check the details of the generated travel plan. For example, a smartphone display or a computer monitor is a display means.
[1718] Emotion recognition means: This corresponds to an engine that recognizes the user's emotions and reflects them in the generation and adjustment of travel plans. This emotion recognition means extracts emotional information from the user's facial expressions, voice, text input, etc., and uses this information to help optimize and regenerate travel plans. Specific examples of emotion recognition technologies include Microsoft Azure Face API and Google Cloud Vision API.
[1719] Operation explanation
[1720] User operation: The user inputs their travel preferences (e.g., "I want to go to a beach resort") and budget (e.g., "1,500 dollars") using a terminal device. This input data is in the form of a form, and is sent to the server by clicking the send button. The user's real-time facial expressions and voice are also acquired as emotion data.
[1721] Operation of the terminal means: The terminal acquires the input data of the form, converts it into JSON format, and sends it to the server. For example, travel preferences, budget, and the user's emotional data (such as "happy" or "sad") are sent in JSON format. This allows the server to generate a plan based on the user's current emotional state.
[1722] Server operation: The server receives data sent from the device and passes it to the generative AI means. The generative AI model generates a travel plan based on the input data and emotional data. At this time, the generative AI model is input with a prompt statement such as: "The user is interested in beach resorts and has a budget of $1,500. Please generate a travel plan based on this." In addition, based on the emotional data, the server regenerates and adjusts the plan to increase user satisfaction.
[1723] Operation of the display means: After receiving the generated itinerary from the server, it is provided to the user through the display means. The user can view it, check the details of accommodations and activities, and make changes or regenerate it as necessary.
[1724] Operation of the emotion recognition means: The emotion recognition means monitors the user's emotion data in real time and feeds that information back to the server. For example, if the user shows a "dissatisfied" expression, the emotion recognition means sends this information to the generative artificial intelligence means, prompting the means to readjust or regenerate the travel plan.
[1725] Specific examples
[1726] For example, if a user inputs "I want to go to a beach resort" and "My budget is $1500," along with a satisfied facial expression, a generative AI solution might generate the following itinerary:
[1727] Destination: Waikiki Beach, Hawaii
[1728] Accommodation: 4-star beach resort hotel
[1729] Activities: Surfing lessons, beach BBQ, local market visit
[1730] Meal: Dinner at a seafood restaurant
[1731] On the other hand, if the user shows a dissatisfied expression after inputting the information, the emotion recognition means feeds this information back to the server, which then uses the generative artificial intelligence means to regenerate the itinerary and present a more suitable plan.
[1732] In this way, the present invention provides a system that provides customized travel plans based on multiple factors such as user preferences, budget, and emotions, thereby improving travelers' satisfaction and sense of security.
[1733] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1734] Step 1:
[1735] User enters travel preferences and budget
[1736] The user accesses a dedicated app or website for planning a trip. They enter their travel preferences (e.g., "I want to go to a beach resort") and budget (e.g., "1,500 dollars") into an input form displayed on the screen. Facial expressions and voice are also captured in real time and prepared as emotion data. Input data: Travel preferences, budget, emotion data. Output data: Input data is sent to the device.
[1737] Step 2:
[1738] The device sends input data and emotion data to the server.
[1739] The device receives the data entered by the user and formats it as needed. Specifically, it converts travel preferences and budget into JSON format, and also integrates emotional data obtained from the camera and microphone into JSON format. It then sends this to the server. Input data: User-entered data. Output data: JSON data sent to the server.
[1740] Step 3:
[1741] The server receives the data and passes it to the generative AI model
[1742] The server receives data sent from the device. This data is stored as a JSON object divided into appropriate fields. The server then passes the input data to the generative AI model as a prompt. For example, it generates a prompt such as, "The user is interested in beach resorts and has a budget of $1,500. Please generate a travel plan based on this." Input data: User input data in JSON format. Output data: Prompt passed to the generative AI model.
[1743] Step 4:
[1744] Generative AI means generate travel plans
[1745] A generative AI model (e.g., GPT-4) generates a travel plan based on the given prompt. The generated travel plan includes specific accommodations, tourist attractions, and transportation options. For example, it might suggest "a four-star hotel in Waikiki Beach, surfing lessons, a beach barbecue, etc." Input data: prompt. Output data: generated travel plan data.
[1746] Step 5:
[1747] Emotion recognition means analyzes emotional data and provides feedback
[1748] The emotion recognition means analyzes the received emotion data and determines whether it is a satisfaction or dissatisfaction. If the user's emotion is recognized as "dissatisfaction," the feedback is sent to the generative AI model, prompting the user to readjust their travel plans. Input data: Emotion data. Output data: Feedback data.
[1749] Step 6:
[1750] The server sends the generated travel plan to the terminal.
[1751] The server receives the travel plan generated by the generative artificial intelligence means and sends it to the terminal. At this time, if feedback from the emotion recognition means is reflected, a regenerated travel plan is sent. Input data: Generated travel plan data. Output data: Travel plan data sent to the terminal.
[1752] Step 7:
[1753] The device displays the travel plan to the user.
[1754] The terminal visually displays the received travel plan to the user. Accommodation information and activity details are displayed on the smartphone or computer screen. The user can view this and make further adjustments or request regeneration. Input data: Travel plan data sent to the terminal. Output data: Travel plan information displayed on the user interface.
[1755] (Application example 2)
[1756] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1757] Existing content distribution services recommend content based on a user's past viewing history and preferences, but they are unable to reflect the user's real-time emotions, which means they are unable to sufficiently improve user satisfaction. Furthermore, they are unable to re-recommend content in response to changes in the user's emotions while viewing, which makes it difficult to provide the optimal viewing experience for the user.
[1758] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.
[1759] In this invention, the server includes a terminal means for receiving user input and transmitting data to the generative artificial intelligence means, an emotion engine means for recognizing the user's emotions in real time and reflecting them in optimizing the travel plan, and a display means for displaying the generated travel plan on a user interface, thereby enabling the recommendation of optimal content based on the user's preferences and emotions.
[1760] A "generative AI means" is an AI model that analyzes data based on a user's preferences and budget to generate optimal travel plans and content recommendations.
[1761] "Terminal means" refers to a device or interface that receives input data from a user and transmits the data to the generative artificial intelligence means. Specific examples include smartphones, tablets, and applications on computers.
[1762] The "emotion engine means" is a system that recognizes emotions in real time from the user's facial expressions, voice, text input, etc., and provides feedback to the generative artificial intelligence means.
[1763] The "display means" refers to a screen or display device for displaying the generated travel plan and content recommendation results on a user interface.
[1764] A "travel itinerary" is a detailed plan of accommodations, attractions, transportation, and other activities at a travel destination.
[1765] "Content recommendation" refers to suggesting the most suitable movies, dramas, and other viewing content based on the user's preferences and emotions.
[1766] "User interface" refers to a screen or interface through which a user can provide input data and view generated results via a terminal means.
[1767] The present invention provides a system for providing personalized travel plans and content recommendations based on a user's preferences and emotions. Specific embodiments are described below.
[1768] System Configuration
[1769] The system consists of the following main components:
[1770] 1. Generative AI tools: Using AI models trained on extensive datasets, they can create travel itineraries based on user preferences and budget, or recommend content based on viewing history.
[1771] 2. Terminal means: The device through which the user inputs, including smartphones, tablets, and applications on computers.
[1772] 3. Emotion engine means: Recognize emotions in real time from the user's facial expressions and voice, and use this to optimize travel plans and content recommendations.
[1773] 4. Display means: A display device for displaying the generated plan and recommendation results on a user interface.
[1774] Hardware and software used
[1775] Hardware:
[1776] Smartphones (camera, microphone, display), tablets, personal computers
[1777] software:
[1778] Emotion recognition engine (e.g. Microsoft Azure Face API)
[1779] Generative AI models (e.g., OpenAI GPT models)
[1780] Display applications (e.g., developed with Flutter or React Native)
[1781] Data processing and calculation
[1782] Terminal means role:
[1783] The terminal formats and transmits input from the user (e.g., travel preferences, budget, viewing history, etc.) to the generative artificial intelligence means, including real-time emotion data captured by the emotion engine means.
[1784] The role of generative artificial intelligence tools:
[1785] The AI model generates optimal travel plans and content recommendations based on user input and emotional data. It does this by analyzing a variety of information, including frequency of use, past trends, and emotional data, to suggest the most suitable plans and content for the user.
[1786] The role of the emotion engine means:
[1787] The emotion recognition engine collects real-time user emotion data from the camera and microphone and provides feedback to the AI model, which then uses this feedback to improve the accuracy of travel plans and content recommendations.
[1788] The role of the display means:
[1789] The generated plans and recommendations are displayed on the user interface, allowing the user to view them and make a final selection.
[1790] Specific examples
[1791] Travel plan example:
[1792] If a user inputs "I want a beach resort" and "My budget is $1,500" and looks satisfied, the generative artificial intelligence means will generate the following travel plan:
[1793] Destination: Beach resort
[1794] Accommodation: Beachfront hotel
[1795] Activities: Water sports, local market visit
[1796] Content recommendation examples:
[1797] If a user types in "I like action movies" and "I like actor A" and uses the app with a smile, the following movies will be recommended:
[1798] Movie: Action Movie 1
[1799] Movie: Action Movie 2
[1800] Movie: Action Movie 3
[1801] Prompt Sentence Examples
[1802] "Generate a list of movies based on the assumption that the user likes action movies and Actor A. In addition, make optimal suggestions based on the user's emotional data."
[1803] This enables personalized travel planning and content recommendations that respond to users' preferences and real-time emotional state.
[1804] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1805] Step 1:
[1806] The user uses a terminal to input information such as travel preferences, budget, genre of content they want to watch, and actors. The input data is collected in a form format. The input in this step is data about the user's preferences, budget, and viewing history. As an output, this information is converted into JSON format.
[1807] Step 2:
[1808] The terminal means converts the input data into JSON format and sends it to the server. In this step, the user's preferences, budget, viewing history, and emotional data acquired by the terminal means are also sent at the same time. The input is the user's data, and the output is JSON data sent to the server.
[1809] Step 3:
[1810] The server analyzes the JSON data received from the terminal means and passes it to the generative artificial intelligence means. The generative artificial intelligence means generates a travel plan and content recommendations based on the input data. The input in this step is the JSON data sent from the terminal means, and the output is the generated travel plan data and a list of content recommendations.
[1811] Step 4:
[1812] Generative AI tools analyze data based on submitted user preferences, budgets, and emotional data to generate optimal travel plans and content. The AI models used here include the OpenAI GPT model. The input is the user data to be analyzed, and the output is a list of customized travel plans and content recommendations.
[1813] Step 5:
[1814] The server receives the generated travel plan and content list and sends it to the terminal means. The input in this step is the output data from the generative AI model, which becomes the data to be sent to the terminal means. The output is the final travel plan and content list to be displayed to the user.
[1815] Step 6:
[1816] The terminal means analyzes the received data and displays it on the user interface. The input in this step is the travel plan and content list data sent from the server, and the output is the information displayed on the user interface.
[1817] Step 7:
[1818] The user checks the displayed travel plan and content list and provides emotional feedback as needed. The emotion engine recognizes this in real time and sends the feedback back to the server. The input is the user's emotional data, and the output is feedback data to the server.
[1819] Step 8:
[1820] The server receives feedback from the emotion engine means and passes it back to the generative artificial intelligence means to reanalyze the data, thereby generating a more optimized travel plan or content recommendation, which is then provided to the user again. The input is the emotion feedback data, and the output is a regenerated travel plan or content list.
[1821] This enables personalized travel planning and content recommendations that respond to users' preferences and real-time emotional state.
[1822] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.
[1823] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1824] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.
[1825] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.
[1826] FIG. 9 illustrates an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and behaviors arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.
[1827] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.
[1828] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).
[1829] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.
[1830] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."
[1831] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.
[1832] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).
[1833] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.
[1834] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.
[1835] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.
[1836] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.
[1837] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.
[1838] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.
[1839] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.
[1840] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.
[1841] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.
[1842] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.
[1843] The following is further disclosed regarding the above embodiment.
[1844] (Claim 1)
[1845] a generative artificial intelligence means for generating a customized travel itinerary based on travel preferences and budget;
[1846] a terminal means for transmitting data to the generative artificial intelligence means in response to a request from a user;
[1847] a display means for displaying the generated travel plan on a user interface;
[1848] A system including:
[1849] (Claim 2)
[1850] 10. The system of claim 1, having a multilingual capability.
[1851] (Claim 3)
[1852] 10. The system of claim 1, further comprising the functionality to provide a cultural guide and health and safety advice for a travel destination.
[1853] "Example 1"
[1854] (Claim 1)
[1855] a generative artificial intelligence means for generating a customized travel plan based on the user's travel preferences and budget;
[1856] a terminal means for transmitting data to the generative artificial intelligence means in response to a request from a user;
[1857] a display means for displaying the generated travel plan on a user interface;
[1858] A data conversion means for acquiring user input data and converting it into JSON format;
[1859] a server that receives data transmitted from the device and inputs the data into a generative artificial intelligence model to generate a travel plan;
[1860] A system including:
[1861] (Claim 2)
[1862] 10. The system of claim 1, having a multilingual capability.
[1863] (Claim 3)
[1864] 10. The system of claim 1, further comprising the functionality to provide a cultural guide and health and safety advice for a travel destination.
[1865] "Application Example 1"
[1866] (Claim 1)
[1867] a generative artificial intelligence means for generating a customized travel itinerary based on travel preferences and budget;
[1868] a terminal means for transmitting data to the generative artificial intelligence means in response to a request from a user;
[1869] a display means for displaying the generated travel plan on a user interface;
[1870] a virtual reality means for visually simulating the trip using virtual reality technology;
[1871] A system including:
[1872] (Claim 2)
[1873] 10. The system of claim 1, having a multilingual capability.
[1874] (Claim 3)
[1875] 10. The system of claim 1, further comprising the functionality to provide a cultural guide and health and safety advice for a travel destination.
[1876] (Claim 4)
[1877] 10. The system of claim 1, further comprising the capability to generate virtual reality content based on a user's travel preferences and budget.
[1878] (Claim 5)
[1879] The system of claim 1, further comprising a function for a user to view the generated travel plan information through a virtual reality experience and perform operations to make details or changes.
[1880] "Example 2: Combining Emotion Engines"
[1881] (Claim 1)
[1882] a generative artificial intelligence means for generating a customized travel plan based on the user's travel preferences and budget;
[1883] a terminal means for transmitting data and emotion data from a user to the generative artificial intelligence means;
[1884] a display means for displaying the generated travel plan on a user interface;
[1885] an emotion recognition means for recognizing the user's emotion and reflecting the emotion in generating and adjusting the travel plan;
[1886] A system including:
[1887] (Claim 2)
[1888] 10. The system of claim 1, having a multilingual capability.
[1889] (Claim 3)
[1890] 10. The system of claim 1, further comprising the functionality to provide a cultural guide and health and safety advice for a travel destination.
[1891] "Application example 2 when combining emotion engines"
[1892] (Claim 1)
[1893] a generative artificial intelligence means for generating a customized travel itinerary based on travel preferences and budget;
[1894] a terminal means for transmitting data to the generative artificial intelligence means in response to a request from a user;
[1895] an emotion engine means for recognizing a user's emotion in real time and reflecting it in optimizing the travel plan;
[1896] a display means for displaying the generated travel plan on a user interface;
[1897] A system including:
[1898] (Claim 2)
[1899] 10. The system of claim 1, having a multilingual capability.
[1900] (Claim 3)
[1901] 10. The system of claim 1, further comprising the functionality to provide a cultural guide and health and safety advice for a travel destination. [Explanation of symbols]
[1902] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>
Claims
1. a generative artificial intelligence means for generating a customized travel itinerary based on travel preferences and budget; a terminal means for transmitting data to the generative artificial intelligence means in response to a request from a user; a display means for displaying the generated travel plan on a user interface; A system including:
2. 10. The system of claim 1, further comprising a multilingual function.
3. The system of claim 1 , further comprising a function for providing a cultural guide and health and safety advice for a travel destination.
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A