system

Abstract

We provide the system. [Solution] A means of receiving destination, travel itinerary, budget, and desired activity information from the user, A means of gathering information on destinations, transportation, accommodations, and restaurants from the internet, A means of analyzing the collected information and filtering it based on the user's preferences, A means for generating a travel schedule based on filtered information, A means of aggregating and evaluating the latest reviews of selected information, A means of presenting the generated schedule and evaluation information to the user and proposing the optimal plan, A system that includes this.

Description

Technical Field

[0005] ,

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor and includes steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In modern travel planning, it is very cumbersome and time-consuming for users to manually create an optimal travel plan that meets requirements such as destinations, travel schedules, budgets, and desired activities. Furthermore, it is difficult to extract useful data from the vast amount of information and reviews scattered on the Internet and formulate an efficient schedule. Therefore, there is a need for a system that can automatically and efficiently generate travel plans based on user preferences and provide optimal proposals based on accurate review evaluations.

Means for Solving the Problems

[0005] The present invention solves the aforementioned problems through a system that includes means for receiving destination, travel itinerary, budget, and desired activity information from a user; means for collecting information on destinations, transportation, accommodation, and dining facilities from the internet; means for analyzing the collected information and filtering it based on the user's preferences; means for generating a travel schedule based on the filtered information; means for aggregating and evaluating the latest reviews of the selected information; and means for presenting the generated schedule and evaluation information to the user and proposing an optimal plan. Furthermore, by providing means for the user to finalize the travel plan and means for creating an efficient sightseeing route and meal plan based on the filtered information, it is possible to provide a customized travel plan that fully meets the user's preferences.

[0006] A "user" is an individual or group that enters their preferences and requirements when creating a travel plan.

[0007] A "destination" is a specific place or region that a user designates as their travel destination.

[0008] "Travel itinerary" refers to the period from the start date to the end date of the trip, and is specified by the user.

[0009] "Budget" refers to the maximum amount of money that can be spent on the entire trip, and it is set by the user.

[0010] "Desired activities" are specific activities or events that the user wishes to experience during their trip, as specified by the user.

[0011] "Means" refers to methods or techniques for achieving a specific objective, and in this invention, it means functions for performing various processes.

[0012] The "Internet" refers to a global network that connects computer networks around the world, and serves as a medium for gathering information.

[0013] "Destination" refers to the region that includes the places you plan to visit during your trip, and includes tourist attractions, accommodations, restaurants, etc.

[0014] "Transportation" refers to the methods of getting around during a trip, including trains, buses, airplanes, and ships.

[0015] "Accommodation facilities" refer to places where one stays overnight during a trip, and include hotels, inns, guesthouses, and other similar establishments.

[0016] "Food and beverage establishments" refer to places where travelers can enjoy meals, and include restaurants, cafes, and bars.

[0017] "Collecting information" means obtaining necessary data from the internet or other data sources.

[0018] "Information analysis" means processing and analyzing collected data to find content that matches the user's wishes and conditions.

[0019] "Filtering information" means selecting data that meets specific criteria from the analyzed data.

[0020] "Generating a travel schedule" means creating a detailed travel plan for the user based on filtered data.

[0021] "Word of mouth" refers to the evaluations and opinions of people who have visited a place or facility in the past, and includes online reviews and feedback.

[0022] "Collecting reviews" means gathering and organizing multiple scattered review pieces of information in one place.

[0023] "Evaluating" means analyzing aggregated reviews and making a quantitative or qualitative judgment about the quality and performance of a place or facility.

[0024] "Proposing the optimal plan" means presenting a travel plan that best suits the user's conditions.

[0025] "Efficient sightseeing route" refers to a route for reasonably visiting many tourist attractions while minimizing travel time.

[0026] "Meal plan" means planning in advance the timing and location of each meal during the trip.

Brief Explanation of Drawings

[0027] [Figure 1] It is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] It is a conceptual diagram showing an example of the main functions of a data processing device and a smart device according to the first embodiment. [Figure 3] It is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] It is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] It is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] It is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] It is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] It is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] It shows an emotion map to which multiple emotions are mapped. [Figure 10] It shows an emotion map to which multiple emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12]This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, which incorporates an emotion engine. [Figure 14] This is a sequence diagram showing the processing flow of the data processing system in Application Example 2, which combines an emotion engine. [Modes for carrying out the invention]

[0028] Hereinafter, an example of an embodiment of the system relating to the technology of this disclosure will be described with reference to the attached drawings.

[0029] First, let's explain the terminology used in the following explanation.

[0030] In the following embodiments, the signed processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Furthermore, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include CPU (Central Processing Unit), GPU (Graphics Processing Unit), GPGPU (General-Purpose computing on Graphics Processing Units), and APU (Accelerated Processing Unit).

[0031] In the following embodiments, signed RAM (Random Access Memory) is a memory that temporarily stores information and is used as work memory by the processor.

[0032] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.

[0033] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0034] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0035] [First Embodiment]

[0036] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0037] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0038] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0039] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0040] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0041] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0042] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0043] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0044] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0045] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0046] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0047] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0048] This invention is a system that automatically generates travel plans and proposes them to users based on the optimal schedule and user reviews. A specific embodiment of this system is described below.

[0049] Overall structure

[0050] This system consists of user terminals and a server. The user terminal, such as a smartphone or PC, provides an interface for users to input their travel preferences. The server receives user input, collects and analyzes the data, and performs the main processing of generating the optimal travel plan.

[0051] Program processing

[0052] User input

[0053] The user accesses a dedicated travel planning form using their device and enters information such as destination, travel dates, budget, and desired activities. For example, the user might enter, "I want to travel to Tokyo for 3 days. My budget is 100,000 yen, and I want to enjoy sightseeing and good food."

[0054] Data acquisition

[0055] The terminal sends user input information to the server. The server uses an API to collect information from the internet about tourist attractions, transportation options, accommodations, restaurants, and other facilities at the specified destination. Furthermore, the server also collects relevant user reviews from databases and review sites.

[0056] Data analysis and filtering

[0057] The server analyzes the collected information and filters it based on the user's budget and desired activities. For example, it selects highly-rated hotels and restaurants within the user's budget. For tourist attractions, it also considers factors such as accessibility and length of stay.

[0058] Travel Schedule Generation

[0059] The server uses filtered data to generate efficient travel schedules. For example, it might create a schedule like this: Day 1: "Tokyo Tower sightseeing and lunch at a nearby restaurant," Day 2: "Senso-ji Temple sightseeing and shopping in Ginza," Day 3: "Roppongi Hills and dinner." It also takes travel time into consideration to adjust the schedule so that users can enjoy sightseeing without difficulty.

[0060] Aggregation and evaluation of customer reviews

[0061] The server collects and analyzes the latest reviews of selected tourist destinations, hotels, and restaurants. To provide users with accurate evaluations, it extracts and organizes positive reviews and high ratings. For example, it displays evaluation points for each item, such as the cleanliness of the hotel, the taste of the restaurant's food, and the quality of service.

[0062] Proposal of the optimal plan

[0063] Based on the travel schedule generated by the server and user reviews, the system sends a suggested itinerary to the user's device. The device then displays the detailed schedule, user reviews for each facility, and an overall rating to the user. Once the user is satisfied with the suggested plan, they press the "Confirm Plan" button to complete their travel planning.

[0064] Specific example

[0065] Let's say a user selects Tokyo as their destination, sets their travel dates to "3 days starting October 10, 2023," their budget to "100,000 yen," and their desired activities to "sightseeing and good food." This information is sent from the terminal to the server, and the server performs the following series of processes.

[0066] 1. Gather information on Tokyo's tourist attractions, transportation options, hotels, and restaurants from the internet.

[0067] 2. Analyze the collected data and select highly-rated hotels and restaurants within the user's budget.

[0068] 3. Generate an efficient schedule: Day 1: "Tokyo Tower and surrounding restaurants," Day 2: "Senso-ji Temple and Ginza shopping," Day 3: "Roppongi Hills and dinner."

[0069] 4. Collect the latest reviews for each facility and organize the evaluation points.

[0070] 5. Send the generated travel plan to the device and display it to the user.

[0071] 6. Once the user is satisfied with the plan, they press the "Confirm Plan" button to complete their travel plan.

[0072] As described above, this system can automatically generate an optimal travel plan based on the user's preferences, providing the user with a convenient and useful travel plan.

[0073] The following describes the processing flow.

[0074] Step 1:

[0075] Users access a dedicated travel planning form using their device and enter information such as destination, travel dates, budget, and desired activities.

[0076] Step 2:

[0077] When the user presses the "Generate Plan" button, the device sends this information to the server.

[0078] Step 3:

[0079] The server receives information from the user and calls various APIs to collect information on tourist attractions, transportation options, accommodations, and restaurants related to the specified destination.

[0080] Step 4:

[0081] The server uses various APIs to collect destination information, transportation information, accommodation information, and dining establishment information from the internet.

[0082] Step 5:

[0083] The server analyzes the information obtained from each API and filters the data based on the user's set budget and desired activities. For example, it might select highly-rated hotels and restaurants within the budget.

[0084] Step 6:

[0085] Based on filtered data, the server automatically generates an efficient travel schedule tailored to the user's travel dates. For example, it might set "Tokyo Tower sightseeing and lunch at a nearby restaurant" for day 1, "Senso-ji Temple sightseeing and shopping in Ginza" for day 2, and "Roppongi Hills and dinner" for day 3.

[0086] Step 7:

[0087] The server collects the latest reviews from databases and review sites for selected tourist destinations, hotels, and restaurants.

[0088] Step 8:

[0089] The server analyzes the collected customer reviews, extracting and organizing highly-rated and positive reviews. For example, it displays evaluation points for each category, such as the cleanliness of a hotel, the taste of restaurant food, and the quality of service.

[0090] Step 9:

[0091] The server uses the generated travel schedule and user reviews to create a optimized travel plan and sends it to the user's device.

[0092] Step 10:

[0093] The device displays the travel plan sent from the server to the user. The user can check the detailed schedule, reviews of each facility, and the overall rating.

[0094] Step 11:

[0095] If the user is satisfied with the proposed plan, they press the "Confirm Plan" button on their device to complete their travel plan.

[0096] Through the above processing steps, this system automatically generates an optimal travel plan based on the user's preferences, providing the user with a convenient and useful travel plan.

[0097] (Example 1)

[0098] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0099] Traditional travel planning systems require users to manually gather information, analyze data, and generate schedules after entering their specific requests, which is time-consuming and labor-intensive. Furthermore, they cannot provide information that reflects the latest user reviews, making it difficult for users to create reliable travel plans. As a result, it is challenging for users to create satisfactory travel plans.

[0100] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0101] In this invention, the server includes means for receiving destination, travel itinerary, budget, and desired activity information from the user; means for collecting information on destinations, transportation, accommodations, and dining facilities from the internet; means for analyzing the collected information and filtering it based on the user's preferences; means for generating a travel schedule based on the filtered information; means for aggregating and evaluating the latest reviews of the selected information; means for presenting the generated schedule and evaluation information to the user and proposing the optimal plan; and means for generating prompt sentences based on user input using an artificial intelligence model and performing data analysis based on those prompts. This enables the user to efficiently plan their trip and realize a highly satisfying travel experience.

[0102] A "user" is an individual or group that uses the system to plan a trip.

[0103] A "terminal" is a device that a user accesses and uses to input information, and examples include smartphones and personal computers.

[0104] A "server" is a computer system used to process data sent by users and information collected from the internet.

[0105] A "destination" is a place or region that a user wants to visit when planning a trip.

[0106] "Travel itinerary" refers to information indicating the period during which a user will be traveling.

[0107] "Budget" refers to the amount of money a user can spend on travel.

[0108] "Desired activities" refer to information about the activities and experiences that users want to engage in during their trip.

[0109] The "Internet" is a system in which multiple computer networks are interconnected and used for information gathering.

[0110] "Destination" refers to the places to visit or tourist attractions on each day of the trip.

[0111] "Transportation" refers to the vehicles and methods of travel used during a trip.

[0112] "Accommodation facilities" refer to places like hotels and inns where travelers stay overnight.

[0113] A "food and beverage establishment" refers to a facility that serves meals, such as a restaurant or cafe.

[0114] "Filtering" is the process of selecting collected information based on the user's preferences and extracting only the appropriate information.

[0115] A "travel schedule" is a detailed timetable of sightseeing destinations and activities planned based on the user's travel itinerary.

[0116] "Word-of-mouth" refers to evaluations and reviews provided by past users.

[0117] An "artificial intelligence model" refers to algorithms and systems used for machine learning and data analysis.

[0118] A "prompt" is a text input that includes instructions or questions given to an artificial intelligence model.

[0119] This invention is a system that automatically generates travel plans and proposes them to users based on the optimal schedule and user reviews. The following describes how this system is specifically implemented.

[0120] Overall structure

[0121] This system consists of user terminals and a server. User terminals, such as smartphones and personal computers, provide an interface for users to input their travel preferences. The server receives the input information from users, collects and analyzes the data, and performs the main processing to generate the optimal travel plan.

[0122] Hardware and software configuration

[0123] User terminals: Smartphones, personal computers, etc.

[0124] Server: A computer system with high-performance computing resources.

[0125] APIs: Google Places API, Yelp API, TriPad(registered trademark) Visor API, etc.

[0126] Artificial intelligence models: Machine learning algorithms (e.g., GPT-3®)

[0127] Data processing and data calculation

[0128] First, the user accesses a dedicated travel planning form using their device and enters information such as destination, travel dates, budget, and desired activities. Next, the device sends the user's input information to the server. The server uses an API to collect information from the internet about tourist attractions, transportation, accommodations, and restaurants related to the specified destination. It also obtains ratings and review information from review sites.

[0129] Next, the server analyzes the collected information in detail and filters it based on the user's budget and desired activities. The filtered data is selected to best suit the user's requirements. Furthermore, the server uses the filtered data to generate an efficient travel schedule and adjust it to be manageable.

[0130] The server also aggregates and analyzes the latest reviews of selected tourist destinations, hotels, and restaurants. Positive reviews and high ratings are extracted and organized in a way that is easy for users to understand. Finally, based on the generated travel schedule and review ratings, the server sends a suggested travel plan to the user's device, which then displays it to the user.

[0131] Specific example

[0132] For example, if a user selects Tokyo as their destination, sets their travel dates to "3 days starting October 10, 2023," their budget to "100,000 yen," and their desired activities to "sightseeing and good food," the following series of processes will be performed.

[0133] Example of a prompt:

[0134] "The user is planning a trip to Tokyo. The trip dates are 3 days starting October 10, 2023, with a budget of 100,000 yen. Desired activities include sightseeing and dining. Please generate the optimal travel plan and schedule based on this information."

[0135] 1. The server uses the "Google Places API" and "Yelp API" to retrieve information on tourist attractions and restaurants in Tokyo.

[0136] 2. The server selects highly-rated hotels and restaurants within the budget and calculates the optimal order for visiting tourist attractions.

[0137] 3. The server generates an efficient schedule that includes locations such as "Tokyo Tower," "Senso-ji Temple," and "Roppongi Hills," and also takes travel and break times into consideration.

[0138] 4. The server collects reviews from TripAdvisor and Google Reviews and compiles the latest ratings for each facility.

[0139] 5. The user reviews the plan presented through their device, and if they are satisfied with the proposed travel plan, they press the "Confirm Plan" button to complete their travel plan.

[0140] As described above, this system can automatically generate an optimal travel plan based on the user's preferences, providing the user with a convenient and useful travel plan.

[0141] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0142] Step 1:

[0143] The user accesses a dedicated travel planning form using their device and enters information such as destination, travel dates, budget, and desired activities.

[0144] Input: Destination, travel dates, budget, desired activities

[0145] Output: User-entered travel preferences

[0146] Specific example: For instance, a user might input, "I want to take a 3-day trip to Tokyo. My budget is 100,000 yen, and I want to enjoy sightseeing and delicious food."

[0147] Step 2:

[0148] The terminal sends the user input information obtained in step 1 to the server.

[0149] Input: Travel preferences entered by the user

[0150] Output: User's requested information sent to the server

[0151] Specific operation: The device sends information to the server from the input form, such as "Destination: Tokyo, Travel dates: 3 days starting October 10, 2023, Budget: 100,000 yen, Desired activities: Sightseeing and dining".

[0152] Step 3:

[0153] The server uses the API to collect the necessary data based on the information received in step 2.

[0154] Input: User's desired information sent to the server

[0155] Output: Information on tourist attractions, transportation, accommodations, restaurants, etc.

[0156] Specific operation: The server uses the "Google Places API" and "Yelp API" to retrieve information on tourist attractions, restaurants, and accommodations in Tokyo. For example, it collects restaurant data for Tokyo Tower and the area around Tokyo Station.

[0157] Step 4:

[0158] The server analyzes the information collected in step 3 and filters it based on the user's budget and desired activities.

[0159] Input: Information such as tourist attractions, transportation, accommodation, and restaurants.

[0160] Output: Filtered data that matches the user's preferences.

[0161] Specific operation: The server collects information on multiple hotels, selects the highest-rated ones within the budget, and chooses tourist attractions that match the desired activities. For example, it might pick highly-rated restaurants around Tokyo Tower within the budget.

[0162] Step 5:

[0163] The server generates an efficient travel schedule based on the filtered data.

[0164] Input: Filtered data such as tourist attractions, accommodations, and restaurants.

[0165] Output: Efficient travel schedule

[0166] Specific operation: The server generates a schedule such as "Day 1: Sightseeing at Tokyo Tower and lunch at a nearby restaurant, Day 2: Sightseeing at Senso-ji Temple and shopping in Ginza, Day 3: Roppongi Hills and dinner," taking travel time into consideration.

[0167] Step 6:

[0168] The server aggregates the latest reviews of selected tourist destinations, hotels, and restaurants, and analyzes the evaluation information.

[0169] Input: Filtered data for tourist attractions, hotels, and restaurants.

[0170] Output: Customer reviews and ratings for each facility

[0171] Specific operation: The server collects the latest review information from "Tripadvisor" and "Google Reviews," calculates and displays evaluation points for each category such as "cleanliness," "taste of food," and "quality of service."

[0172] Step 7:

[0173] The server sends information to the user's device suggesting the most suitable travel plan based on the generated travel schedule and user reviews.

[0174] Input: Efficient travel schedule, customer reviews and ratings for each facility.

[0175] Output: Travel plan presented to the user

[0176] Specific action: The device displays detailed information such as "Day 1: Tokyo Tower sightseeing and nearby restaurants (review rating: 4.5)" in a user-friendly format.

[0177] Step 8:

[0178] If the user is satisfied with the proposed plan, they can confirm their travel plan by pressing the "Confirm Plan" button.

[0179] Input: Presented travel plan

[0180] Output: Confirmed travel plan

[0181] Specific action: The user clicks the "Confirm Plan" button on the device screen, and the server triggers this action to record the travel plan.

[0182] (Application Example 1)

[0183] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0184] Traditional travel planning systems had the problem of requiring users a lot of time and effort to create travel plans. In particular, the lack of features that provided real-time, up-to-date reviews and efficient sightseeing routes was a major issue, leading to inconvenience during travel.

[0185] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0186] In this invention, the server includes means for receiving destination, travel itinerary, budget, and desired activity information from the user; means for collecting information on destinations, transportation, accommodations, and dining facilities from the internet; means for analyzing the collected information and filtering it based on the user's preferences; means for generating a travel schedule based on the filtered information; means for aggregating and evaluating the latest reviews of the selected information; means for presenting the generated schedule and evaluation information to the user and proposing the optimal plan; and means for displaying review information and navigation in real time. As a result, the user can check the latest review information and efficient sightseeing routes in real time during their trip, enabling a more convenient and fulfilling travel experience.

[0187] "Means of receiving destination, travel itinerary, budget, and desired activity information from users" refers to devices or software that provide an input interface for travelers to enter their destination, travel duration, budget, and desired activities when planning their trip.

[0188] "Means for collecting information on destinations, transportation, accommodations, and restaurants from the internet" refers to technical means for obtaining data on tourist destinations, transportation, accommodations, and restaurants from multiple sources on the internet.

[0189] "Means for analyzing collected information and filtering it based on user preferences" refers to algorithms and programs that scrutinize collected data based on user-provided conditions (such as budget and activity preferences) and select appropriate options.

[0190] "Means for generating travel schedules based on filtered information" refers to software or a system for creating optimal travel itineraries based on scrutinized information.

[0191] "A means of aggregating and evaluating the latest reviews of selected information" refers to a technology that collects the latest ratings and comments on selected tourist destinations and facilities from the internet, organizes them, and displays them for users.

[0192] "A means of presenting generated schedules and evaluation information to the user and proposing the optimal plan" refers to a system that visually displays the created travel schedule and related evaluation information to the user and has the function of proposing the optimal travel plan.

[0193] "A means of displaying real-time reviews and navigation" refers to a display device or software that provides users with the latest reviews and directions in real time based on their current location while they are traveling.

[0194] This invention is a smart travel system that proposes optimal travel plans to users in real time and also provides navigation and user reviews during the trip. The embodiments of this system are described in detail below.

[0195] Overall structure

[0196] This system consists of user terminals (such as smart glasses or smartphones) and a server. The user terminals provide an interface for travelers to input and receive information, while the server handles the main processing, including data collection, analysis, plan generation, and review evaluation.

[0197] Program processing

[0198] 1. User input

[0199] Users access a dedicated travel planning form using their device and enter information such as destination, travel dates, budget, and desired activities.

[0200] For example, you might enter, "I want to take a 3-day trip to Tokyo. My budget is 100,000 yen, and I want to enjoy sightseeing and delicious food."

[0201] 2. Data Acquisition

[0202] The terminal sends this input information to the server.

[0203] The server uses an API to collect information from the internet about tourist attractions, transportation options, accommodations, restaurants, and other facilities at a specified destination. It also retrieves the latest rating information from review sites.

[0204] 3. Data Analysis and Filtering

[0205] The server analyzes the collected information and filters it based on the user's budget and desired activities.

[0206] For example, you could select highly-rated hotels and restaurants within your budget, and choose tourist attractions considering factors like accessibility and length of stay.

[0207] 4. Travel Schedule Generation

[0208] The server generates an efficient travel schedule based on the filtered information.

[0209] For example, create a schedule that includes sightseeing at "Tokyo Tower" on day 1, "Senso-ji Temple and Ginza" on day 2, and "Roppongi Hills" on day 3. Include meal plans for each day at the same time.

[0210] 5. Real-time user reviews and navigation

[0211] This system displays the latest reviews and navigation information in real time on smart glasses or smartphones while the user is traveling.

[0212] For example, it might provide directions such as, "Next stop is Tokyo Tower. Turn right and go straight," or a review of a nearby restaurant saying, "You can get really delicious sushi here!"

[0213] 6. Presentation of travel plans

[0214] The server sends the generated travel schedule and evaluation information to the terminal, presenting the user with the most suitable plan.

[0215] If the user is satisfied with the plan, they can complete their travel plan by pressing the "Confirm Plan" button.

[0216] Hardware and software used

[0217] Smart glasses (e.g., Google Glass®, Microsoft HoloLens®)

[0218] smartphone

[0219] Python

[0220] Request library (for API calls)

[0221] Specific example

[0222] When travelers are in Tokyo, their smart glasses or smartphones will display real-time instructions such as, "Next stop is Tokyo Tower. Turn right and go straight." They can also instantly check the latest reviews of nearby restaurants, such as, "You can eat really delicious sushi here!"

[0223] Examples of prompts to input into a generative AI model:

[0224] "Please propose a 3-day Tokyo trip itinerary within a budget of 100,000 yen. The plan should include sightseeing and delicious meals. The trip should begin on October 10, 2023."

[0225] This system allows travelers to receive the latest information in real time, enabling efficient and fulfilling sightseeing.

[0226] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0227] Step 1:

[0228] The user accesses a dedicated travel planning form using their device and enters information such as destination, travel dates, budget, and desired activities. This entered information is then sent to the server.

[0229] Input: Destination, travel dates, budget, desired activities

[0230] Output: Request data containing user input information

[0231] Step 2:

[0232] The server uses an API to collect information on tourist attractions, transportation options, accommodations, and restaurants at a specified destination via the internet. Furthermore, it also collects the latest relevant user reviews from review websites.

[0233] Input: User input information, data from the internet

[0234] Output: A dataset containing information on tourist attractions, transportation, accommodations, restaurants, and the latest user reviews.

[0235] Step 3:

[0236] The server analyzes the collected data and filters it based on the user's budget and desired activities. It selects highly-rated hotels and restaurants within the budget, and for tourist attractions, it also considers accessibility and length of stay.

[0237] Input: Information on tourist attractions, transportation, accommodations, restaurants, and the latest reviews.

[0238] Output: A filtered list of tourist attractions, hotels, restaurants, etc.

[0239] Step 4:

[0240] The server generates an efficient travel schedule based on filtered information. For example, it might create a schedule that includes sightseeing at "Tokyo Tower" on day 1, "Senso-ji Temple and Ginza" on day 2, and "Roppongi Hills" on day 3. It also incorporates meal plans for each day.

[0241] Input: A filtered list of tourist attractions, hotels, restaurants, etc.

[0242] Output: A plan including an efficient travel schedule and meal plan.

[0243] Step 5:

[0244] The server generates travel schedules and evaluation information, which are then sent to the user's terminal and presented to the user. The user can then review this information and finalize their plan.

[0245] Input: Plan including an efficient travel schedule and meal plan.

[0246] Output: Travel schedule and evaluation information sent to the user's terminal.

[0247] Step 6:

[0248] The device displays real-time reviews and navigation to the user while they are traveling. The user receives directions from their smart glasses or smartphone based on their current location. It also displays the latest reviews of nearby restaurants.

[0249] Input: Current location information, latest user reviews

[0250] Output: Real-time displayed navigation and user reviews

[0251] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0252] This invention is a system that automatically generates travel plans and combines them with an emotion engine that recognizes user emotions to provide the most suitable schedule and optimal suggestions based on user reviews for each individual user. Specific embodiments of this system are described below.

[0253] Overall structure

[0254] This system consists of a user terminal, a server, and an emotion engine. The user terminal, such as a smartphone or PC, provides an interface for users to input their travel preferences. The server receives user input, collects and analyzes data, and performs the main processing of generating the optimal travel plan. The emotion engine recognizes the user's emotions and adjusts the travel plan based on the results.

[0255] Program processing

[0256] User input

[0257] The user accesses a dedicated travel planning form using their device and enters information such as destination, travel dates, budget, and desired activities. For example, the user might enter, "I want to travel to Tokyo for 3 days. My budget is 100,000 yen, and I want to enjoy sightseeing and good food."

[0258] Data acquisition

[0259] The terminal sends user input information to the server. The server uses an API to collect information from the internet about tourist attractions, transportation options, accommodations, restaurants, and other facilities at the specified destination. Furthermore, the server also collects relevant user reviews from databases and review sites.

[0260] Data analysis and filtering

[0261] The server analyzes the collected information and filters the data based on the user's budget and desired activities. For example, it selects highly-rated hotels and restaurants within the user's budget. For tourist attractions, it also considers factors such as accessibility and length of stay.

[0262] Emotion recognition by an emotion engine

[0263] The emotion engine analyzes user input and past data to recognize the user's emotions in real time. For example, if a user leaves a comment such as "I'm feeling stressed" in an input form, the plan content will be adjusted based on that emotion data.

[0264] Travel Schedule Generation

[0265] The server uses filtered data to automatically generate an efficient travel schedule tailored to the user's travel dates. For example, it might set "Tokyo Tower sightseeing and lunch at a nearby restaurant" for day 1, "Senso-ji Temple sightseeing and shopping in Ginza" for day 2, and "Roppongi Hills and dinner" for day 3. It also takes travel time into consideration to adjust the schedule so that the user can enjoy sightseeing without difficulty. In addition, based on the results of the emotion engine, it adds relaxing activities and stress-reducing spots.

[0266] Aggregation and evaluation of customer reviews

[0267] The server collects and analyzes the latest reviews of selected tourist destinations, hotels, and restaurants. To provide users with accurate evaluations, it extracts and organizes positive reviews and high ratings. For example, it displays evaluation points for each item, such as the cleanliness of the hotel, the taste of the restaurant's food, and the quality of service.

[0268] Proposal of the optimal plan

[0269] Based on the travel schedule and user reviews generated by the server, the system sends a suggested itinerary to the user's device. The device then displays the detailed schedule, user reviews for each facility, and an overall rating to the user. Furthermore, based on the results of the emotion engine, it also provides suggestions that are particularly tailored to the user's emotions. Once the user is satisfied with the suggested plan, they press the "Confirm Plan" button to complete their travel planning.

[0270] Specific example

[0271] Let's say a user selects Tokyo as their destination, sets their travel dates to "3 days starting October 10, 2023," their budget to "100,000 yen," and their desired activities to "sightseeing and good food." Furthermore, if the user enters emotional information such as "I want to reduce stress," this information is sent from the device to the server, and the server performs a series of processes as follows.

[0272] 1. Gather information on Tokyo's tourist attractions, transportation options, hotels, and restaurants from the internet.

[0273] 2. Analyze the collected data and select highly-rated hotels and restaurants within the user's budget.

[0274] 3. Generate an efficient schedule such as "Tokyo Tower and relaxing restaurants in the surrounding area" on day 1, "Senso-ji Temple and Ginza shopping" on day 2, and "Roppongi Hills and a stress-relieving spa" on day 3.

[0275] 4. Collect the latest reviews for each facility and organize the evaluation points.

[0276] 5. Send the generated travel plan to the device and display it to the user.

[0277] 6. Once the user is satisfied with the plan, they press the "Confirm Plan" button to complete their travel plan.

[0278] This system can utilize the user's emotional information to provide a customized travel plan that caters to more individual needs.

[0279] The processing flow will be described below.

[0280] Step 1:

[0281] The user accesses a travel plan - dedicated form using a terminal and enters the destination, travel schedule, budget, desired activities, and emotional information. For example, the user enters "I want to travel to Tokyo for 3 days. The budget is 100,000 yen. I want to enjoy tourist attractions and delicious food. I want to relieve stress."

[0282] Step 2:

[0283] When the user presses the "Plan Generation" button, the terminal sends this information to the server.

[0284] Step 3:

[0285] The server receives the information from the user and calls various APIs to collect information on tourist attractions, transportation means, accommodation facilities, and dining facilities related to the specified destination.

[0286] Step 4:

[0287] The server uses each API to collect travel destination information, transportation means information, accommodation facility information, and dining facility information from the Internet. The server also collects relevant review information from databases and review sites.

[0288] Step 5:

[0289] The server analyzes the collected information and filters the data based on the budget and desired activities set by the user. For example, it selects high - rated hotels and restaurants within the budget and selects transportation means that are easily accessible to the destination.

[0290] Step 6:

[0291] The emotion engine analyzes user input and recognizes the user's emotional state. For example, if the user inputs "I want to reduce stress," it uses that emotional data to select relaxing tourist spots and activities.

[0292] Step 7:

[0293] The server takes the results of the emotion engine into account and automatically generates an efficient travel schedule based on the filtered data. For example, it might set "Tokyo Tower sightseeing and relaxing restaurants nearby" for day 1, "Senso-ji Temple sightseeing and shopping in Ginza" for day 2, and "Roppongi Hills and a stress-relieving spa" for day 3.

[0294] Step 8:

[0295] The server collects the latest reviews for selected tourist destinations, hotels, and restaurants from databases and review sites. It analyzes the collected review information, extracting and organizing highly-rated and positive reviews. For example, it displays evaluation points for each category, such as hotel cleanliness, restaurant food quality, and service quality.

[0296] Step 9:

[0297] The server generates travel schedules and reviews, then compiles the optimal travel plan and sends it to the user's device.

[0298] Step 10:

[0299] The device displays a travel plan sent from the server to the user. The user can view the detailed schedule, reviews of each facility, and the overall rating. For example, "Day 1 - Tokyo Tower sightseeing and a relaxing restaurant" might be displayed, along with the rating points for each facility.

[0300] Step 11:

[0301] If the user is satisfied with the proposed plan, they press the "Confirm Plan" button on their device, completing the travel plan. As a result, the user receives an optimal travel plan that also takes their emotional state into consideration.

[0302] In this way, a system that incorporates an emotion engine can create customized travel plans that are more tailored to individual needs, based on the user's emotional information.

[0303] (Example 2)

[0304] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0305] Conventional travel plan generation systems create plans without considering the user's emotional state, making it difficult to provide travel plans that meet the user's psychological needs. Furthermore, the aggregation and evaluation of user reviews are often not done properly, resulting in problems in providing the optimal travel plan for the user.

[0306] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0307] In this invention, the server includes means for receiving destination, travel itinerary, budget, and desired activity information from the user; means for collecting information on destinations, transportation, accommodations, and dining facilities from the internet; means for analyzing the collected information and filtering it based on the user's preferences; means for analyzing the user's emotional information using an emotional analysis engine; means for generating a travel schedule based on the filtered information and emotional information; means for aggregating and evaluating the latest reviews of the selected information; and means for presenting the generated schedule and evaluation information to the user and proposing an optimal plan. This makes it possible to provide a more personalized and optimal travel plan that takes into account the user's emotional state.

[0308] "User" refers to the end user who inputs the information necessary for creating a travel plan.

[0309] "Destination" refers to a specific geographical location where the user is planning a trip.

[0310] "Travel schedule" refers to the range of dates when the user starts and ends the trip.

[0311] "Budget" refers to the amount of money indicating the total expenses that the user can spend on the entire trip.

[0312] "Desired activities" refer to activities or sightseeing purposes that the user wants to experience during the trip.

[0313] "Server" refers to a computer system that receives the user's input information and performs collection, analysis, filtering, and generation of travel plans for various information.

[0314] "Sentiment analysis engine" refers to software or a service for analyzing the user's sentiment information.

[0315] "Filtering means" refers to a method in which the server selects the information collected based on the user's wishes, eliminates extra data, and extracts only the necessary information.

[0316] "Travel itinerary" refers to a specific sightseeing or stay plan created based on the user's travel schedule.

[0317] "Reviews" refer to evaluation and comment information on accommodation facilities, dining facilities, etc. provided by other users.

[0318] "Optimal plan" refers to the most suitable travel plan proposed based on the user's input information and analysis results.

[0319] This invention is a system that automatically generates travel plans and combines them with an emotion analysis engine that recognizes user emotions to provide the most suitable schedule and optimal suggestions based on user reviews for each individual user. Detailed embodiments are described below.

[0320] Overall structure

[0321] This system consists of a user terminal, a server, and an emotion analysis engine. The user terminal, such as a smartphone or PC, provides an interface for users to input their travel preferences. The server receives input information from the user, collects and analyzes the data, and performs the main processing of generating the optimal travel plan. The emotion analysis engine recognizes the user's emotions and adjusts the travel plan based on the results.

[0322] Program processing

[0323] User input

[0324] The user accesses a dedicated travel planning form using their device and enters information such as destination, travel dates, budget, desired activities, and emotional state. For example, they might enter, "I want to travel to Tokyo for 3 days starting October 10th. My budget is 100,000 yen, and I want to enjoy sightseeing and good food. I've been feeling stressed lately."

[0325] Data acquisition

[0326] The device sends user input information to the server. The server uses APIs to collect information from the internet about tourist attractions, transportation options, accommodations, restaurants, and other facilities at the specified destination. Specifically, it uses APIs such as Google Places API and TripAdvisor API.

[0327] Data analysis and filtering

[0328] The server analyzes the collected information and filters the data based on the user's budget and desired activities. It selects highly-rated hotels and restaurants within the budget, and also chooses tourist attractions considering accessibility and length of stay. This process utilizes libraries such as Python's Pandas library.

[0329] Emotion recognition by an emotion analysis engine

[0330] The emotion analysis engine analyzes user input and past data to recognize the user's emotions in real time. Using emotion analysis services from IBM Watson® and Microsoft Azure®, the plan is adjusted based on emotional data such as "feeling stressed."

[0331] Travel Schedule Generation

[0332] The server uses filtered data to automatically generate an efficient travel schedule tailored to the user's travel dates. For example, it might set "Tokyo Tower sightseeing and lunch at a nearby restaurant" for day 1, "Senso-ji Temple sightseeing and shopping in Ginza" for day 2, and "Roppongi Hills and dinner" for day 3. It also includes relaxing activities and stress-reducing spots in the schedule based on the results of an emotion analysis engine.

[0333] Aggregation and evaluation of customer reviews

[0334] The system collects the latest reviews of selected tourist destinations, hotels, and restaurants, and performs text analysis. It utilizes natural language processing techniques to extract and organize positive comments and highly-rated reviews. Python's NLTK and spaCy are used.

[0335] Proposal of the optimal plan

[0336] The server generates a travel schedule and adjusts it based on user reviews, then sends a suggested plan to the user's device. The device displays the detailed schedule of the travel plan, user reviews for each facility, and an overall rating to the user. If the user is satisfied with the suggested plan, they can press the "Confirm Plan" button to complete their travel planning.

[0337] Specific example

[0338] The user selects Tokyo as their destination, enters "3 days starting October 10, 2023" as their travel dates, "100,000 yen" as their budget, "sightseeing and good food" as their desired activities, and "I want to reduce stress" as their emotional state. This information is sent from the terminal to the server, which then performs the following processing.

[0339] 1. Gather information on Tokyo's tourist attractions, transportation options, hotels, and restaurants from the internet.

[0340] 2. Analyze the collected data and select highly-rated hotels and restaurants within the user's budget.

[0341] 3. Generate an efficient schedule such as "Tokyo Tower and relaxing restaurants in the surrounding area" on day 1, "Senso-ji Temple and Ginza shopping" on day 2, and "Roppongi Hills and stress-relieving spots" on day 3.

[0342] 4. Collect the latest reviews for each facility and organize the evaluation points.

[0343] 5. Send the generated travel plan to the device and display it to the user.

[0344] 6. Once the user is satisfied with the plan, they press the "Confirm Plan" button to complete their travel plan.

[0345] This system allows users to receive personalized travel plans based on their emotional state and specific preferences.

[0346] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0347] Step 1: User Input

[0348] The user accesses a dedicated travel planning form using their device and enters their destination, travel dates, budget, desired activities, and emotional information. For example, the user might enter, "I want to travel to Tokyo for 3 days starting October 10th. My budget is 100,000 yen, and I want to enjoy sightseeing and good food. I've been feeling stressed lately."

[0349] Input: Destination, travel dates, budget, desired activities, sentiment information

[0350] Output: User information sent from the terminal to the server

[0351] Specific action: The user opens the URL in their smartphone browser, enters information into the form, and presses the "Submit" button.

[0352] Step 2: Data Acquisition

[0353] The device sends user input information to the server. The server uses external APIs such as the Google Places API and TripAdvisor API to collect information about tourist attractions, transportation options, accommodations, and restaurants at the specified destination.

[0354] Input: User information

[0355] Output: Information on collected tourist attractions, transportation, accommodations, and restaurants.

[0356] Specific operation: The server makes an API call, receives the result in JSON format, and stores it in the database.

[0357] Step 3: Data Analysis and Filtering

[0358] The server analyzes the collected information using the Python Pandas library and filters the data based on the user's budget and desired activities. It selects highly-rated hotels and restaurants within the budget, and also chooses tourist attractions considering factors such as accessibility and length of stay.

[0359] Input: Collected information

[0360] Output: Filtered information

[0361] Specific operation: The server reads the information stored in the database, converts it to a Pandas DataFrame, and performs analysis. It deletes data that does not meet the criteria, keeping only the necessary data.

[0362] Step 4: Emotion recognition by emotion analysis engine

[0363] The sentiment analysis engine analyzes user input and past data to recognize the user's emotions in real time. The sentiment analysis engine utilizes IBM Watson and Microsoft Azure services.

[0364] Input: User sentiment information

[0365] Output: Analyzed sentiment data

[0366] Specific operation: The server sends user input data to the emotion analysis engine's API and receives the emotion recognition result.

[0367] Step 5: Generate travel schedule

[0368] The server uses filtered information and sentiment data to automatically generate an efficient travel schedule tailored to the user's travel plans. For example, it might set "Tokyo Tower sightseeing and lunch at a nearby restaurant" for day 1, "Senso-ji Temple sightseeing and shopping in Ginza" for day 2, and "Roppongi Hills and dinner" for day 3. It also adds relaxing activities based on sentiment data.

[0369] Input: Filtered information, sentiment data

[0370] Output: Generated travel schedule

[0371] Specific operation: Use Google Maps Platform to calculate travel time between tourist destinations and generate an efficient schedule using a Python script.

[0372] Step 6: Collecting and evaluating customer reviews

[0373] The system collects the latest reviews of selected tourist destinations, hotels, and restaurants, and performs text analysis using natural language processing technology. Positive comments and highly-rated reviews are then extracted and organized from the reviews.

[0374] Input: Selected facility information

[0375] Output: Organized customer reviews

[0376] Specific operation: The server uses Python's NLTK and spaCy to analyze the review data, extract evaluation points, and format them.

[0377] Step 7: Proposing the Optimal Plan

[0378] The server generates a travel schedule and adjusts it with user reviews to send the optimal plan to the user's device. The device then displays the detailed schedule, user reviews for each facility, and an overall rating to the user. The user completes the travel plan by pressing the "Confirm Plan" button.

[0379] Input: Travel schedule, customer reviews

[0380] Output: Proposal of the optimal plan, confirmation of the travel plan.

[0381] Specific operation: The server sends a web page generated with HTML and CSS to the user's terminal, and the user presses the "Confirm Plan" button via the interface.

[0382] (Application Example 2)

[0383] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0384] Current travel planning systems only consider the user's basic preferences and have the drawback of being unable to offer flexible suggestions that reflect the user's emotional state. Furthermore, the difficulty in adjusting plans based on real-time emotional changes during the trip means that it is not possible to maximize user satisfaction.

[0385] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving destination, travel itinerary, budget, desired activity information and sentiment data from the user; means for collecting information on destinations, transportation, accommodation, dining facilities and related word-of-mouth information from the internet; means for analyzing the collected information and filtering it based on the user's preferences and sentiment data; means for generating a travel schedule based on the filtered information and sentiment data, and creating an efficient sightseeing route and meal plan; means for aggregating and evaluating the latest word-of-mouth for the selected information; and means for presenting the generated schedule and evaluation information to the user and proposing an optimal plan. This makes it possible to propose flexible travel plans that reflect the user's sentiment state in real time.

[0386] "Means of receiving destination, travel itinerary, budget, desired activity information, and sentiment data from users" refers to an interface that collects information such as destination, travel itinerary, budget, desired activities, and current sentiment state as input by users planning a trip.

[0387] "Means for collecting information on destinations, transportation, accommodations, restaurants, and related reviews from the internet" refers to a system that automatically acquires information on destinations, transportation, accommodations, restaurants, and related reviews and ratings from various data sources on the internet.

[0388] "Means of analyzing collected information and filtering it based on user preferences and emotional data" refers to a method of analyzing collected data, selecting that data according to the conditions and emotional state desired by the user, and choosing information that is suitable for the user.

[0389] "A means of generating travel schedules and creating efficient sightseeing routes and meal plans based on filtered information and sentiment data" refers to a function that automatically generates optimal travel schedules, sightseeing routes, and meal plans by utilizing filtered information and user sentiment data.

[0390] "A method for aggregating and evaluating the latest reviews of selected information" refers to a method of aggregating the latest reviews and evaluations of selected tourist destinations and facilities, and evaluating their reputation and reliability.

[0391] "A means of presenting generated schedules and evaluation information to the user and proposing the optimal plan" refers to an interface that displays the generated travel schedule and evaluation information in an easy-to-understand manner for the user and proposes the optimal travel plan based on it.

[0392] "A means of adjusting travel plans in real time according to user emotion data" refers to a system that flexibly adjusts travel plans and sightseeing routes in real time based on data when a user's emotions change during a trip.

[0393] This invention will be implemented as an "in-car navigation application equipped with an emotion recognition travel planning system" to be installed in an autonomous vehicle. Specific embodiments for implementing this invention will be described below.

[0394] System Configuration

[0395] This system consists of a user terminal (a display device inside the vehicle), a server, a data collection API, and an emotion engine.

[0396] User terminal: This device has the function of collecting information entered by the user through in-car display devices and voice interfaces. This includes destination, travel itinerary, budget, desired activities, and sentiment data.

[0397] Server: Performs the main processing of data collection and analysis. It analyzes the collected data and filters it based on user preferences and sentiment data.

[0398] Data Collection APIs: APIs used to collect information on destinations, transportation, accommodations, restaurants, and related user reviews from the internet. Specific examples include tourism APIs and transportation APIs.

[0399] Emotion Engine: A system that analyzes user input information and real-time emotional fluctuations during travel to generate and adjust appropriate travel plans.

[0400] Program Processing Description

[0401] The server performs the following actions:

[0402] 1. Collecting user input: Collect destination, travel itinerary, budget, desired activity information, and sentiment data from the user's device.

[0403] 2. Data Collection: We will use a data collection API to collect data on destinations, transportation, accommodations, restaurants, and user reviews from the internet.

[0404] 3. Data Analysis and Filtering: The collected information is analyzed and filtered based on user preferences and sentiment data. For example, if a user desires relaxation, relaxing tourist destinations and accommodations will be prioritized.

[0405] 4. Travel Schedule Generation: Based on filtered information, the system generates an optimal travel schedule, efficient sightseeing routes, and meal plans.

[0406] 5. Aggregation and Evaluation of User Reviews: Aggregate the latest user reviews and evaluations for the selected information to present users with the best options.

[0407] 6. Proposal and Adjustment: Present the generated schedule and evaluation information to the user and propose the optimal plan. Furthermore, adjust the plan in real time based on the user's emotions during the trip.

[0408] Hardware / software to use

[0409] Hardware: In-vehicle display devices and voice interfaces for autonomous vehicles.

[0410] Software: Python programs, tourism APIs, emotion engines (general term)

[0411] Examples of specific cases and prompt statements

[0412] Specific example

[0413] If a user expresses a desire to travel to Tokyo and indicates that they are seeking "stress reduction," the system will gather information on relaxing tourist spots, hotels, and spas, and incorporate the highest-rated locations within their budget into a three-day schedule. Furthermore, if the user's emotional state changes during the trip—for example, if they indicate that they are "increasingly stressed"—the system will suggest new relaxing spots in real time.

[0414] Example of a prompt

[0415] "I'd like to take a 3-day trip to Tokyo starting October 10th, 2023. My budget is 100,000 yen, and I want to enjoy sightseeing and delicious food. I'm feeling stressed right now, so I'd like the app to constantly display stress-relieving spots."

[0416] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0417] Step 1:

[0418] Collection of user input

[0419] Input: User information including destination, travel dates, budget, desired activities, and sentiment data.

[0420] Operation: The user terminal collects basic information about the user's trip and their current emotional state through an input interface.

[0421] Output: The collected data is sent to the server.

[0422] Step 2:

[0423] Data collection

[0424] Input: Destination, travel dates, budget, and desired activity information submitted by the user.

[0425] Operation: The server uses a data collection API to retrieve information about destinations, transportation, accommodations, restaurants, and user reviews from the internet.

[0426] Output: The raw data obtained from the API is stored on the server.

[0427] Step 3:

[0428] Data analysis and filtering

[0429] Input: Accumulated raw data, and user preference and sentiment data.

[0430] Operation: The server analyzes the collected information and selects appropriate data based on the user's requirements and emotional state. It prioritizes highly-rated facilities and relaxing spots within the budget.

[0431] Output: A filtered dataset is generated.

[0432] Step 4:

[0433] Generating a travel schedule

[0434] Input: Filtered dataset

[0435] Operation: The server automatically generates efficient sightseeing routes and meal plans based on filtered data. It creates a schedule that allows you to comfortably visit sightseeing spots and dining locations each day.

[0436] Output: The generated travel schedule is created.

[0437] Step 5:

[0438] Aggregation and evaluation of customer reviews

[0439] Input: IDs of tourist destinations and facilities related to the generated travel schedule

[0440] Operation: The server collects the latest user reviews for selected tourist destinations and facilities and calculates their reputation and ratings.

[0441] Output: Customer review data for each facility is generated.

[0442] Step 6:

[0443] Proposal and coordination

[0444] Input: Generated travel schedule and review rating data

[0445] Operation: The server presents the user with generated schedules and evaluation information, and proposes the optimal plan. Furthermore, if the user's emotions change during the trip, it provides new suggestions in real time.

[0446] Output: The optimized travel plan after adjustments is presented to the user's terminal.

[0447] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0448] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0449] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0450] [Second Embodiment]

[0451] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0452] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0453] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0454] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0455] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0456] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0457] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0458] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0459] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0460] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0461] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0462] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0463] This invention is a system that automatically generates travel plans and proposes them to users based on the optimal schedule and user reviews. A specific embodiment of this system is described below.

[0464] Overall structure

[0465] This system consists of user terminals and a server. The user terminal, such as a smartphone or PC, provides an interface for users to input their travel preferences. The server receives user input, collects and analyzes the data, and performs the main processing of generating the optimal travel plan.

[0466] Program processing

[0467] User input

[0468] The user accesses a dedicated travel planning form using their device and enters information such as destination, travel dates, budget, and desired activities. For example, the user might enter, "I want to travel to Tokyo for 3 days. My budget is 100,000 yen, and I want to enjoy sightseeing and good food."

[0469] Data acquisition

[0470] The terminal sends user input information to the server. The server uses an API to collect information from the internet about tourist attractions, transportation options, accommodations, restaurants, and other facilities at the specified destination. Furthermore, the server also collects relevant user reviews from databases and review sites.

[0471] Data analysis and filtering

[0472] The server analyzes the collected information and filters it based on the user's budget and desired activities. For example, it selects highly-rated hotels and restaurants within the user's budget. For tourist attractions, it also considers factors such as accessibility and length of stay.

[0473] Travel Schedule Generation

[0474] The server uses filtered data to generate efficient travel schedules. For example, it might create a schedule like this: Day 1: "Tokyo Tower sightseeing and lunch at a nearby restaurant," Day 2: "Senso-ji Temple sightseeing and shopping in Ginza," Day 3: "Roppongi Hills and dinner." It also takes travel time into consideration to adjust the schedule so that users can enjoy sightseeing without difficulty.

[0475] Aggregation and evaluation of customer reviews

[0476] The server collects and analyzes the latest reviews of selected tourist destinations, hotels, and restaurants. To provide users with accurate evaluations, it extracts and organizes positive reviews and high ratings. For example, it displays evaluation points for each item, such as the cleanliness of the hotel, the taste of the restaurant's food, and the quality of service.

[0477] Proposal of the optimal plan

[0478] Based on the travel schedule generated by the server and user reviews, the system sends a suggested itinerary to the user's device. The device then displays the detailed schedule, user reviews for each facility, and an overall rating to the user. Once the user is satisfied with the suggested plan, they press the "Confirm Plan" button to complete their travel planning.

[0479] Specific example

[0480] Let's say a user selects Tokyo as their destination, sets their travel dates to "3 days starting October 10, 2023," their budget to "100,000 yen," and their desired activities to "sightseeing and good food." This information is sent from the terminal to the server, and the server performs the following series of processes.

[0481] 1. Gather information on Tokyo's tourist attractions, transportation options, hotels, and restaurants from the internet.

[0482] 2. Analyze the collected data and select highly-rated hotels and restaurants within the user's budget.

[0483] 3. Generate an efficient schedule: Day 1: "Tokyo Tower and surrounding restaurants," Day 2: "Senso-ji Temple and Ginza shopping," Day 3: "Roppongi Hills and dinner."

[0484] 4. Collect the latest reviews for each facility and organize the evaluation points.

[0485] 5. Send the generated travel plan to the device and display it to the user.

[0486] 6. Once the user is satisfied with the plan, they press the "Confirm Plan" button to complete their travel plan.

[0487] As described above, this system can automatically generate an optimal travel plan based on the user's preferences, providing the user with a convenient and useful travel plan.

[0488] The following describes the processing flow.

[0489] Step 1:

[0490] Users access a dedicated travel planning form using their device and enter information such as destination, travel dates, budget, and desired activities.

[0491] Step 2:

[0492] When the user presses the "Generate Plan" button, the device sends this information to the server.

[0493] Step 3:

[0494] The server receives information from the user and calls various APIs to collect information on tourist attractions, transportation options, accommodations, and restaurants related to the specified destination.

[0495] Step 4:

[0496] The server uses various APIs to collect destination information, transportation information, accommodation information, and dining establishment information from the internet.

[0497] Step 5:

[0498] The server analyzes the information obtained from each API and filters the data based on the user's set budget and desired activities. For example, it might select highly-rated hotels and restaurants within the budget.

[0499] Step 6:

[0500] Based on filtered data, the server automatically generates an efficient travel schedule tailored to the user's travel dates. For example, it might set "Tokyo Tower sightseeing and lunch at a nearby restaurant" for day 1, "Senso-ji Temple sightseeing and shopping in Ginza" for day 2, and "Roppongi Hills and dinner" for day 3.

[0501] Step 7:

[0502] The server collects the latest reviews from databases and review sites for selected tourist destinations, hotels, and restaurants.

[0503] Step 8:

[0504] The server analyzes the collected customer reviews, extracting and organizing highly-rated and positive reviews. For example, it displays evaluation points for each category, such as the cleanliness of a hotel, the taste of restaurant food, and the quality of service.

[0505] Step 9:

[0506] The server uses the generated travel schedule and user reviews to create a optimized travel plan and sends it to the user's device.

[0507] Step 10:

[0508] The device displays the travel plan sent from the server to the user. The user can check the detailed schedule, reviews of each facility, and the overall rating.

[0509] Step 11:

[0510] If the user is satisfied with the proposed plan, they press the "Confirm Plan" button on their device to complete their travel plan.

[0511] Through the above processing steps, this system automatically generates an optimal travel plan based on the user's preferences, providing the user with a convenient and useful travel plan.

[0512] (Example 1)

[0513] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0514] Traditional travel planning systems require users to manually gather information, analyze data, and generate schedules after entering their specific requests, which is time-consuming and labor-intensive. Furthermore, they cannot provide information that reflects the latest user reviews, making it difficult for users to create reliable travel plans. As a result, it is challenging for users to create satisfactory travel plans.

[0515] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0516] In this invention, the server includes means for receiving destination, travel itinerary, budget, and desired activity information from the user; means for collecting information on destinations, transportation, accommodations, and dining facilities from the internet; means for analyzing the collected information and filtering it based on the user's preferences; means for generating a travel schedule based on the filtered information; means for aggregating and evaluating the latest reviews of the selected information; means for presenting the generated schedule and evaluation information to the user and proposing the optimal plan; and means for generating prompt sentences based on user input using an artificial intelligence model and performing data analysis based on those prompts. This enables the user to efficiently plan their trip and realize a highly satisfying travel experience.

[0517] A "user" is an individual or group that uses the system to plan a trip.

[0518] A "terminal" is a device that a user accesses and uses to input information, and examples include smartphones and personal computers.

[0519] A "server" is a computer system used to process data sent by users and information collected from the internet.

[0520] A "destination" is a place or region that a user wants to visit when planning a trip.

[0521] "Travel itinerary" refers to information indicating the period during which a user will be traveling.

[0522] "Budget" refers to the amount of money a user can spend on travel.

[0523] "Desired activities" refer to information about the activities and experiences that users want to engage in during their trip.

[0524] The "Internet" is a system in which multiple computer networks are interconnected and used for information gathering.

[0525] "Destination" refers to the places to visit or tourist attractions on each day of the trip.

[0526] "Transportation" refers to the vehicles and methods of travel used during a trip.

[0527] "Accommodation facilities" refer to places like hotels and inns where travelers stay overnight.

[0528] A "food and beverage establishment" refers to a facility that serves meals, such as a restaurant or cafe.

[0529] "Filtering" is the process of selecting collected information based on the user's preferences and extracting only the appropriate information.

[0530] A "travel schedule" is a detailed timetable of sightseeing destinations and activities planned based on the user's travel itinerary.

[0531] "Word-of-mouth" refers to evaluations and reviews provided by past users.

[0532] An "artificial intelligence model" refers to algorithms and systems used for machine learning and data analysis.

[0533] A "prompt" is a text input that includes instructions or questions given to an artificial intelligence model.

[0534] This invention is a system that automatically generates travel plans and proposes them to users based on the optimal schedule and user reviews. The following describes how this system is specifically implemented.

[0535] Overall structure

[0536] This system consists of user terminals and a server. User terminals, such as smartphones and personal computers, provide an interface for users to input their travel preferences. The server receives the input information from users, collects and analyzes the data, and performs the main processing to generate the optimal travel plan.

[0537] Hardware and software configuration

[0538] User terminals: Smartphones, personal computers, etc.

[0539] Server: A computer system with high-performance computing resources.

[0540] API: Google Places API, Yelp API, Tripadvisor API, etc.

[0541] Artificial intelligence models: Machine learning algorithms (e.g., GPT-3)

[0542] Data processing and data calculation

[0543] First, the user accesses a dedicated travel planning form using their device and enters information such as destination, travel dates, budget, and desired activities. Next, the device sends the user's input information to the server. The server uses an API to collect information from the internet about tourist attractions, transportation, accommodations, and restaurants related to the specified destination. It also obtains ratings and review information from review sites.

[0544] Next, the server analyzes the collected information in detail and filters it based on the user's budget and desired activities. The filtered data is selected to best suit the user's requirements. Furthermore, the server uses the filtered data to generate an efficient travel schedule and adjust it to be manageable.

[0545] The server also aggregates and analyzes the latest reviews of selected tourist destinations, hotels, and restaurants. Positive reviews and high ratings are extracted and organized in a way that is easy for users to understand. Finally, based on the generated travel schedule and review ratings, the server sends a suggested travel plan to the user's device, which then displays it to the user.

[0546] Specific example

[0547] For example, if a user selects Tokyo as their destination, sets their travel dates to "3 days starting October 10, 2023," their budget to "100,000 yen," and their desired activities to "sightseeing and good food," the following series of processes will be performed.

[0548] Example of a prompt:

[0549] "The user is planning a trip to Tokyo. The trip dates are 3 days starting October 10, 2023, with a budget of 100,000 yen. Desired activities include sightseeing and dining. Please generate the optimal travel plan and schedule based on this information."

[0550] 1. The server uses the "Google Places API" and "Yelp API" to retrieve information on tourist attractions and restaurants in Tokyo.

[0551] 2. The server selects highly-rated hotels and restaurants within the budget and calculates the optimal order for visiting tourist attractions.

[0552] 3. The server generates an efficient schedule that includes locations such as "Tokyo Tower," "Senso-ji Temple," and "Roppongi Hills," and also takes travel and break times into consideration.

[0553] 4. The server collects reviews from TripAdvisor and Google Reviews and compiles the latest ratings for each facility.

[0554] 5. The user reviews the plan presented through their device, and if they are satisfied with the proposed travel plan, they press the "Confirm Plan" button to complete their travel plan.

[0555] As described above, this system can automatically generate an optimal travel plan based on the user's preferences, providing the user with a convenient and useful travel plan.

[0556] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0557] Step 1:

[0558] The user accesses a dedicated travel planning form using their device and enters information such as destination, travel dates, budget, and desired activities.

[0559] Input: Destination, travel dates, budget, desired activities

[0560] Output: User-entered travel preferences

[0561] Specific example: For instance, a user might input, "I want to take a 3-day trip to Tokyo. My budget is 100,000 yen, and I want to enjoy sightseeing and delicious food."

[0562] Step 2:

[0563] The terminal sends the user input information obtained in step 1 to the server.

[0564] Input: Travel preferences entered by the user

[0565] Output: User's requested information sent to the server

[0566] Specific operation: The device sends information to the server from the input form, such as "Destination: Tokyo, Travel dates: 3 days starting October 10, 2023, Budget: 100,000 yen, Desired activities: Sightseeing and dining".

[0567] Step 3:

[0568] The server uses the API to collect the necessary data based on the information received in step 2.

[0569] Input: User's desired information sent to the server

[0570] Output: Information on tourist attractions, transportation, accommodations, restaurants, etc.

[0571] Specific operation: The server uses the "Google Places API" and "Yelp API" to retrieve information on tourist attractions, restaurants, and accommodations in Tokyo. For example, it collects restaurant data for Tokyo Tower and the area around Tokyo Station.

[0572] Step 4:

[0573] The server analyzes the information collected in step 3 and filters it based on the user's budget and desired activities.

[0574] Input: Information such as tourist attractions, transportation, accommodation, and restaurants.

[0575] Output: Filtered data that matches the user's preferences.

[0576] Specific operation: The server collects information on multiple hotels, selects the highest-rated ones within the budget, and chooses tourist attractions that match the desired activities. For example, it might pick highly-rated restaurants around Tokyo Tower within the budget.

[0577] Step 5:

[0578] The server generates an efficient travel schedule based on the filtered data.

[0579] Input: Filtered data such as tourist attractions, accommodations, and restaurants.

[0580] Output: Efficient travel schedule

[0581] Specific operation: The server generates a schedule such as "Day 1: Sightseeing at Tokyo Tower and lunch at a nearby restaurant, Day 2: Sightseeing at Senso-ji Temple and shopping in Ginza, Day 3: Roppongi Hills and dinner," taking travel time into consideration.

[0582] Step 6:

[0583] The server aggregates the latest reviews of selected tourist destinations, hotels, and restaurants, and analyzes the evaluation information.

[0584] Input: Filtered data for tourist attractions, hotels, and restaurants.

[0585] Output: Customer reviews and ratings for each facility

[0586] Specific operation: The server collects the latest review information from "Tripadvisor" and "Google Reviews," calculates and displays evaluation points for each category such as "cleanliness," "taste of food," and "quality of service."

[0587] Step 7:

[0588] The server sends information to the user's device suggesting the most suitable travel plan based on the generated travel schedule and user reviews.

[0589] Input: Efficient travel schedule, customer reviews and ratings for each facility.

[0590] Output: Travel plan presented to the user

[0591] Specific action: The device displays detailed information such as "Day 1: Tokyo Tower sightseeing and nearby restaurants (review rating: 4.5)" in a user-friendly format.

[0592] Step 8:

[0593] If the user is satisfied with the proposed plan, they can confirm their travel plan by pressing the "Confirm Plan" button.

[0594] Input: Presented travel plan

[0595] Output: Confirmed travel plan

[0596] Specific action: The user clicks the "Confirm Plan" button on the device screen, and the server triggers this action to record the travel plan.

[0597] (Application Example 1)

[0598] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0599] Traditional travel planning systems had the problem of requiring users a lot of time and effort to create travel plans. In particular, the lack of features that provided real-time, up-to-date reviews and efficient sightseeing routes was a major issue, leading to inconvenience during travel.

[0600] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0601] In this invention, the server includes means for receiving destination, travel itinerary, budget, and desired activity information from the user; means for collecting information on destinations, transportation, accommodations, and dining facilities from the internet; means for analyzing the collected information and filtering it based on the user's preferences; means for generating a travel schedule based on the filtered information; means for aggregating and evaluating the latest reviews of the selected information; means for presenting the generated schedule and evaluation information to the user and proposing the optimal plan; and means for displaying review information and navigation in real time. As a result, the user can check the latest review information and efficient sightseeing routes in real time during their trip, enabling a more convenient and fulfilling travel experience.

[0602] "Means of receiving destination, travel itinerary, budget, and desired activity information from users" refers to devices or software that provide an input interface for travelers to enter their destination, travel duration, budget, and desired activities when planning their trip.

[0603] "Means for collecting information on destinations, transportation, accommodations, and restaurants from the internet" refers to technical means for obtaining data on tourist destinations, transportation, accommodations, and restaurants from multiple sources on the internet.

[0604] "Means for analyzing collected information and filtering it based on user preferences" refers to algorithms and programs that scrutinize collected data based on user-provided conditions (such as budget and activity preferences) and select appropriate options.

[0605] "Means for generating travel schedules based on filtered information" refers to software or a system for creating optimal travel itineraries based on scrutinized information.

[0606] "A means of aggregating and evaluating the latest reviews of selected information" refers to a technology that collects the latest ratings and comments on selected tourist destinations and facilities from the internet, organizes them, and displays them for users.

[0607] "A means of presenting generated schedules and evaluation information to the user and proposing the optimal plan" refers to a system that visually displays the created travel schedule and related evaluation information to the user and has the function of proposing the optimal travel plan.

[0608] "A means of displaying real-time reviews and navigation" refers to a display device or software that provides users with the latest reviews and directions in real time based on their current location while they are traveling.

[0609] This invention is a smart travel system that proposes optimal travel plans to users in real time and also provides navigation and user reviews during the trip. The embodiments of this system are described in detail below.

[0610] Overall structure

[0611] This system consists of user terminals (such as smart glasses or smartphones) and a server. The user terminals provide an interface for travelers to input and receive information, while the server handles the main processing, including data collection, analysis, plan generation, and review evaluation.

[0612] Program processing

[0613] 1. User input

[0614] Users access a dedicated travel planning form using their device and enter information such as destination, travel dates, budget, and desired activities.

[0615] For example, you might enter, "I want to take a 3-day trip to Tokyo. My budget is 100,000 yen, and I want to enjoy sightseeing and delicious food."

[0616] 2. Data Acquisition

[0617] The terminal sends this input information to the server.

[0618] The server uses an API to collect information from the internet about tourist attractions, transportation options, accommodations, restaurants, and other facilities at a specified destination. It also retrieves the latest rating information from review sites.

[0619] 3. Data Analysis and Filtering

[0620] The server analyzes the collected information and filters it based on the user's budget and desired activities.

[0621] For example, you could select highly-rated hotels and restaurants within your budget, and choose tourist attractions considering factors like accessibility and length of stay.

[0622] 4. Travel Schedule Generation

[0623] The server generates an efficient travel schedule based on the filtered information.

[0624] For example, create a schedule that includes sightseeing at "Tokyo Tower" on day 1, "Senso-ji Temple and Ginza" on day 2, and "Roppongi Hills" on day 3. Include meal plans for each day at the same time.

[0625] 5. Real-time user reviews and navigation

[0626] This system displays the latest reviews and navigation information in real time on smart glasses or smartphones while the user is traveling.

[0627] For example, it might provide directions such as, "Next stop is Tokyo Tower. Turn right and go straight," or a review of a nearby restaurant saying, "You can get really delicious sushi here!"

[0628] 6. Presentation of travel plans

[0629] The server sends the generated travel schedule and evaluation information to the terminal, presenting the user with the most suitable plan.

[0630] If the user is satisfied with the plan, they can complete their travel plan by pressing the "Confirm Plan" button.

[0631] Hardware and software used

[0632] Smart glasses (e.g., Google Glass, Microsoft HoloLens)

[0633] smartphone

[0634] Python

[0635] Request library (for API calls)

[0636] Specific example

[0637] When travelers are in Tokyo, their smart glasses or smartphones will display real-time instructions such as, "Next stop is Tokyo Tower. Turn right and go straight." They can also instantly check the latest reviews of nearby restaurants, such as, "You can eat really delicious sushi here!"

[0638] Examples of prompts to input into a generative AI model:

[0639] "Please propose a 3-day Tokyo trip itinerary within a budget of 100,000 yen. The plan should include sightseeing and delicious meals. The trip should begin on October 10, 2023."

[0640] This system allows travelers to receive the latest information in real time, enabling efficient and fulfilling sightseeing.

[0641] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0642] Step 1:

[0643] The user accesses a dedicated travel planning form using their device and enters information such as destination, travel dates, budget, and desired activities. This entered information is then sent to the server.

[0644] Input: Destination, travel dates, budget, desired activities

[0645] Output: Request data containing user input information

[0646] Step 2:

[0647] The server uses an API to collect information on tourist attractions, transportation options, accommodations, and restaurants at a specified destination via the internet. Furthermore, it also collects the latest relevant user reviews from review websites.

[0648] Input: User input information, data from the internet

[0649] Output: A dataset containing information on tourist attractions, transportation, accommodations, restaurants, and the latest user reviews.

[0650] Step 3:

[0651] The server analyzes the collected data and filters it based on the user's budget and desired activities. It selects highly-rated hotels and restaurants within the budget, and for tourist attractions, it also considers accessibility and length of stay.

[0652] Input: Information on tourist attractions, transportation, accommodations, restaurants, and the latest reviews.

[0653] Output: A filtered list of tourist attractions, hotels, restaurants, etc.

[0654] Step 4:

[0655] The server generates an efficient travel schedule based on filtered information. For example, it might create a schedule that includes sightseeing at "Tokyo Tower" on day 1, "Senso-ji Temple and Ginza" on day 2, and "Roppongi Hills" on day 3. It also incorporates meal plans for each day.

[0656] Input: A filtered list of tourist attractions, hotels, restaurants, etc.

[0657] Output: A plan including an efficient travel schedule and meal plan.

[0658] Step 5:

[0659] The server generates travel schedules and evaluation information, which are then sent to the user's terminal and presented to the user. The user can then review this information and finalize their plan.

[0660] Input: Plan including an efficient travel schedule and meal plan.

[0661] Output: Travel schedule and evaluation information sent to the user's terminal.

[0662] Step 6:

[0663] The device displays real-time reviews and navigation to the user while they are traveling. The user receives directions from their smart glasses or smartphone based on their current location. It also displays the latest reviews of nearby restaurants.

[0664] Input: Current location information, latest user reviews

[0665] Output: Real-time displayed navigation and user reviews

[0666] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0667] This invention is a system that automatically generates travel plans and combines them with an emotion engine that recognizes user emotions to provide the most suitable schedule and optimal suggestions based on user reviews for each individual user. Specific embodiments of this system are described below.

[0668] Overall structure

[0669] This system consists of a user terminal, a server, and an emotion engine. The user terminal, such as a smartphone or PC, provides an interface for users to input their travel preferences. The server receives user input, collects and analyzes data, and performs the main processing of generating the optimal travel plan. The emotion engine recognizes the user's emotions and adjusts the travel plan based on the results.

[0670] Program processing

[0671] User input

[0672] The user accesses a dedicated travel planning form using their device and enters information such as destination, travel dates, budget, and desired activities. For example, the user might enter, "I want to travel to Tokyo for 3 days. My budget is 100,000 yen, and I want to enjoy sightseeing and good food."

[0673] Data acquisition

[0674] The terminal sends user input information to the server. The server uses an API to collect information from the internet about tourist attractions, transportation options, accommodations, restaurants, and other facilities at the specified destination. Furthermore, the server also collects relevant user reviews from databases and review sites.

[0675] Data analysis and filtering

[0676] The server analyzes the collected information and filters the data based on the user's budget and desired activities. For example, it selects highly-rated hotels and restaurants within the user's budget. For tourist attractions, it also considers factors such as accessibility and length of stay.

[0677] Emotion recognition by an emotion engine

[0678] The emotion engine analyzes user input and past data to recognize the user's emotions in real time. For example, if a user leaves a comment such as "I'm feeling stressed" in an input form, the plan content will be adjusted based on that emotion data.

[0679] Travel Schedule Generation

[0680] The server uses filtered data to automatically generate an efficient travel schedule tailored to the user's travel dates. For example, it might set "Tokyo Tower sightseeing and lunch at a nearby restaurant" for day 1, "Senso-ji Temple sightseeing and shopping in Ginza" for day 2, and "Roppongi Hills and dinner" for day 3. It also takes travel time into consideration to adjust the schedule so that the user can enjoy sightseeing without difficulty. In addition, based on the results of the emotion engine, it adds relaxing activities and stress-reducing spots.

[0681] Aggregation and evaluation of customer reviews

[0682] The server collects and analyzes the latest reviews of selected tourist destinations, hotels, and restaurants. To provide users with accurate evaluations, it extracts and organizes positive reviews and high ratings. For example, it displays evaluation points for each item, such as the cleanliness of the hotel, the taste of the restaurant's food, and the quality of service.

[0683] Proposal of the optimal plan

[0684] Based on the travel schedule and user reviews generated by the server, the system sends a suggested itinerary to the user's device. The device then displays the detailed schedule, user reviews for each facility, and an overall rating to the user. Furthermore, based on the results of the emotion engine, it also provides suggestions that are particularly tailored to the user's emotions. Once the user is satisfied with the suggested plan, they press the "Confirm Plan" button to complete their travel planning.

[0685] Specific example

[0686] Let's say a user selects Tokyo as their destination, sets their travel dates to "3 days starting October 10, 2023," their budget to "100,000 yen," and their desired activities to "sightseeing and good food." Furthermore, if the user enters emotional information such as "I want to reduce stress," this information is sent from the device to the server, and the server performs a series of processes as follows.

[0687] 1. Gather information on Tokyo's tourist attractions, transportation options, hotels, and restaurants from the internet.

[0688] 2. Analyze the collected data and select highly-rated hotels and restaurants within the user's budget.

[0689] 3. Generate an efficient schedule such as "Tokyo Tower and relaxing restaurants in the surrounding area" on day 1, "Senso-ji Temple and Ginza shopping" on day 2, and "Roppongi Hills and a stress-relieving spa" on day 3.

[0690] 4. Collect the latest reviews for each facility and organize the evaluation points.

[0691] 5. Send the generated travel plan to the device and display it to the user.

[0692] 6. Once the user is satisfied with the plan, they press the "Confirm Plan" button to complete their travel plan.

[0693] This system can utilize user sentiment information to provide more personalized travel plans that better meet individual needs.

[0694] The following describes the processing flow.

[0695] Step 1:

[0696] The user accesses a dedicated travel planning form using their device and enters their destination, travel dates, budget, desired activities, and emotional information. For example, the user might enter, "I want to travel to Tokyo for 3 days. My budget is 100,000 yen. I want to enjoy sightseeing and good food. I want to reduce stress."

[0697] Step 2:

[0698] When the user presses the "Generate Plan" button, the device sends this information to the server.

[0699] Step 3:

[0700] The server receives information from the user and calls various APIs to collect information on tourist attractions, transportation options, accommodations, and restaurants related to the specified destination.

[0701] Step 4:

[0702] The server uses various APIs to collect destination information, transportation information, accommodation information, and dining establishment information from the internet. The server also collects relevant user reviews from databases and review sites.

[0703] Step 5:

[0704] The server analyzes the collected information and filters the data based on the user's set budget and desired activities. For example, it might select highly-rated hotels and restaurants within the budget and choose the most convenient mode of transportation to reach the destination.

[0705] Step 6:

[0706] The emotion engine analyzes user input and recognizes the user's emotional state. For example, if the user inputs "I want to reduce stress," it uses that emotional data to select relaxing tourist spots and activities.

[0707] Step 7:

[0708] The server takes the results of the emotion engine into account and automatically generates an efficient travel schedule based on the filtered data. For example, it might set "Tokyo Tower sightseeing and relaxing restaurants nearby" for day 1, "Senso-ji Temple sightseeing and shopping in Ginza" for day 2, and "Roppongi Hills and a stress-relieving spa" for day 3.

[0709] Step 8:

[0710] The server collects the latest reviews for selected tourist destinations, hotels, and restaurants from databases and review sites. It analyzes the collected review information, extracting and organizing highly-rated and positive reviews. For example, it displays evaluation points for each category, such as hotel cleanliness, restaurant food quality, and service quality.

[0711] Step 9:

[0712] The server generates travel schedules and reviews, then compiles the optimal travel plan and sends it to the user's device.

[0713] Step 10:

[0714] The device displays a travel plan sent from the server to the user. The user can view the detailed schedule, reviews of each facility, and the overall rating. For example, "Day 1 - Tokyo Tower sightseeing and a relaxing restaurant" might be displayed, along with the rating points for each facility.

[0715] Step 11:

[0716] If the user is satisfied with the proposed plan, they press the "Confirm Plan" button on their device, completing the travel plan. As a result, the user receives an optimal travel plan that also takes their emotional state into consideration.

[0717] In this way, a system that incorporates an emotion engine can create customized travel plans that are more tailored to individual needs, based on the user's emotional information.

[0718] (Example 2)

[0719] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0720] Conventional travel plan generation systems create plans without considering the user's emotional state, making it difficult to provide travel plans that meet the user's psychological needs. Furthermore, the aggregation and evaluation of user reviews are often not done properly, resulting in problems in providing the optimal travel plan for the user.

[0721] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0722] In this invention, the server includes means for receiving destination, travel itinerary, budget, and desired activity information from the user; means for collecting information on destinations, transportation, accommodations, and dining facilities from the internet; means for analyzing the collected information and filtering it based on the user's preferences; means for analyzing the user's emotional information using an emotional analysis engine; means for generating a travel schedule based on the filtered information and emotional information; means for aggregating and evaluating the latest reviews of the selected information; and means for presenting the generated schedule and evaluation information to the user and proposing an optimal plan. This makes it possible to provide a more personalized and optimal travel plan that takes into account the user's emotional state.

[0723] A "user" is an end-user who inputs the information necessary to create a travel plan.

[0724] A "destination" is a specific geographical location where the user is planning their trip.

[0725] "Travel itinerary" refers to the range of dates from which the user's trip begins to end.

[0726] "Budget" refers to the total amount of money a user can spend on their entire trip.

[0727] "Desired activities" refer to the activities and sightseeing purposes that users want to experience during their trip.

[0728] A "server" is a computer system that receives user input information and collects, analyzes, filters, and generates travel plans for various types of information.

[0729] A "sentiment analysis engine" is software or a service used to analyze a user's emotional information.

[0730] "Filtering" refers to a method in which a server selects information based on the user's preferences, eliminating unnecessary data and extracting only the necessary information.

[0731] A "travel schedule" is a detailed plan of sightseeing and accommodations created based on the user's travel itinerary.

[0732] "Reviews" refer to ratings and comments provided by other users regarding accommodations, restaurants, and other establishments.

[0733] An "optimal plan" is the most suitable travel plan proposed based on the user's input information and analysis results.

[0734] This invention is a system that automatically generates travel plans and combines them with an emotion analysis engine that recognizes user emotions to provide the most suitable schedule and optimal suggestions based on user reviews for each individual user. Detailed embodiments are described below.

[0735] Overall structure

[0736] This system consists of a user terminal, a server, and an emotion analysis engine. The user terminal, such as a smartphone or PC, provides an interface for users to input their travel preferences. The server receives input information from the user, collects and analyzes the data, and performs the main processing of generating the optimal travel plan. The emotion analysis engine recognizes the user's emotions and adjusts the travel plan based on the results.

[0737] Program processing

[0738] User input

[0739] The user accesses a dedicated travel planning form using their device and enters information such as destination, travel dates, budget, desired activities, and emotional state. For example, they might enter, "I want to travel to Tokyo for 3 days starting October 10th. My budget is 100,000 yen, and I want to enjoy sightseeing and good food. I've been feeling stressed lately."

[0740] Data acquisition

[0741] The device sends user input information to the server. The server uses APIs to collect information from the internet about tourist attractions, transportation options, accommodations, restaurants, and other facilities at the specified destination. Specifically, it uses APIs such as Google Places API and TripAdvisor API.

[0742] Data analysis and filtering

[0743] The server analyzes the collected information and filters the data based on the user's budget and desired activities. It selects highly-rated hotels and restaurants within the budget, and also chooses tourist attractions considering accessibility and length of stay. This process utilizes libraries such as Python's Pandas library.

[0744] Emotion recognition by an emotion analysis engine

[0745] The emotion analysis engine analyzes user input and past data to recognize the user's emotions in real time. Using emotion analysis services from IBM Watson and Microsoft Azure, the plan is adjusted based on emotional data such as "feeling stressed."

[0746] Travel Schedule Generation

[0747] The server uses filtered data to automatically generate an efficient travel schedule tailored to the user's travel dates. For example, it might set "Tokyo Tower sightseeing and lunch at a nearby restaurant" for day 1, "Senso-ji Temple sightseeing and shopping in Ginza" for day 2, and "Roppongi Hills and dinner" for day 3. It also includes relaxing activities and stress-reducing spots in the schedule based on the results of an emotion analysis engine.

[0748] Aggregation and evaluation of customer reviews

[0749] The system collects the latest reviews of selected tourist destinations, hotels, and restaurants, and performs text analysis. It utilizes natural language processing techniques to extract and organize positive comments and highly-rated reviews. Python's NLTK and spaCy are used.

[0750] Proposal of the optimal plan

[0751] The server generates a travel schedule and adjusts it based on user reviews, then sends a suggested plan to the user's device. The device displays the detailed schedule of the travel plan, user reviews for each facility, and an overall rating to the user. If the user is satisfied with the suggested plan, they can press the "Confirm Plan" button to complete their travel planning.

[0752] Specific example

[0753] The user selects Tokyo as their destination, enters "3 days starting October 10, 2023" as their travel dates, "100,000 yen" as their budget, "sightseeing and good food" as their desired activities, and "I want to reduce stress" as their emotional state. This information is sent from the terminal to the server, which then performs the following processing.

[0754] 1. Gather information on Tokyo's tourist attractions, transportation options, hotels, and restaurants from the internet.

[0755] 2. Analyze the collected data and select highly-rated hotels and restaurants within the user's budget.

[0756] 3. Generate an efficient schedule such as "Tokyo Tower and relaxing restaurants in the surrounding area" on day 1, "Senso-ji Temple and Ginza shopping" on day 2, and "Roppongi Hills and stress-relieving spots" on day 3.

[0757] 4. Collect the latest reviews for each facility and organize the evaluation points.

[0758] 5. Send the generated travel plan to the device and display it to the user.

[0759] 6. Once the user is satisfied with the plan, they press the "Confirm Plan" button to complete their travel plan.

[0760] This system allows users to receive personalized travel plans based on their emotional state and specific preferences.

[0761] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0762] Step 1: User Input

[0763] The user accesses a dedicated travel planning form using their device and enters their destination, travel dates, budget, desired activities, and emotional information. For example, the user might enter, "I want to travel to Tokyo for 3 days starting October 10th. My budget is 100,000 yen, and I want to enjoy sightseeing and good food. I've been feeling stressed lately."

[0764] Input: Destination, travel dates, budget, desired activities, sentiment information

[0765] Output: User information sent from the terminal to the server

[0766] Specific action: The user opens the URL in their smartphone browser, enters information into the form, and presses the "Submit" button.

[0767] Step 2: Data Acquisition

[0768] The device sends user input information to the server. The server uses external APIs such as the Google Places API and TripAdvisor API to collect information about tourist attractions, transportation options, accommodations, and restaurants at the specified destination.

[0769] Input: User information

[0770] Output: Information on collected tourist attractions, transportation, accommodations, and restaurants.

[0771] Specific operation: The server makes an API call, receives the result in JSON format, and stores it in the database.

[0772] Step 3: Data Analysis and Filtering

[0773] The server analyzes the collected information using the Python Pandas library and filters the data based on the user's budget and desired activities. It selects highly-rated hotels and restaurants within the budget, and also chooses tourist attractions considering factors such as accessibility and length of stay.

[0774] Input: Collected information

[0775] Output: Filtered information

[0776] Specific operation: The server reads the information stored in the database, converts it to a Pandas DataFrame, and performs analysis. It deletes data that does not meet the criteria, keeping only the necessary data.

[0777] Step 4: Emotion recognition by emotion analysis engine

[0778] The sentiment analysis engine analyzes user input and past data to recognize the user's emotions in real time. The sentiment analysis engine utilizes IBM Watson and Microsoft Azure services.

[0779] Input: User sentiment information

[0780] Output: Analyzed sentiment data

[0781] Specific operation: The server sends user input data to the emotion analysis engine's API and receives the emotion recognition result.

[0782] Step 5: Generate travel schedule

[0783] The server uses filtered information and sentiment data to automatically generate an efficient travel schedule tailored to the user's travel plans. For example, it might set "Tokyo Tower sightseeing and lunch at a nearby restaurant" for day 1, "Senso-ji Temple sightseeing and shopping in Ginza" for day 2, and "Roppongi Hills and dinner" for day 3. It also adds relaxing activities based on sentiment data.

[0784] Input: Filtered information, sentiment data

[0785] Output: Generated travel schedule

[0786] Specific operation: Use Google Maps Platform to calculate travel time between tourist destinations and generate an efficient schedule using a Python script.

[0787] Step 6: Collecting and evaluating customer reviews

[0788] The system collects the latest reviews of selected tourist destinations, hotels, and restaurants, and performs text analysis using natural language processing technology. Positive comments and highly-rated reviews are then extracted and organized from the reviews.

[0789] Input: Selected facility information

[0790] Output: Organized customer reviews

[0791] Specific operation: The server uses Python's NLTK and spaCy to analyze the review data, extract evaluation points, and format them.

[0792] Step 7: Proposing the Optimal Plan

[0793] The server generates a travel schedule and adjusts it with user reviews to send the optimal plan to the user's device. The device then displays the detailed schedule, user reviews for each facility, and an overall rating to the user. The user completes the travel plan by pressing the "Confirm Plan" button.

[0794] Input: Travel schedule, customer reviews

[0795] Output: Proposal of the optimal plan, confirmation of the travel plan.

[0796] Specific operation: The server sends a web page generated with HTML and CSS to the user's terminal, and the user presses the "Confirm Plan" button via the interface.

[0797] (Application Example 2)

[0798] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0799] Current travel planning systems only consider the user's basic preferences and have the drawback of being unable to offer flexible suggestions that reflect the user's emotional state. Furthermore, the difficulty in adjusting plans based on real-time emotional changes during the trip means that it is not possible to maximize user satisfaction.

[0800] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving destination, travel itinerary, budget, desired activity information and sentiment data from the user; means for collecting information on destinations, transportation, accommodation, dining facilities and related word-of-mouth information from the internet; means for analyzing the collected information and filtering it based on the user's preferences and sentiment data; means for generating a travel schedule based on the filtered information and sentiment data, and creating an efficient sightseeing route and meal plan; means for aggregating and evaluating the latest word-of-mouth for the selected information; and means for presenting the generated schedule and evaluation information to the user and proposing an optimal plan. This makes it possible to propose flexible travel plans that reflect the user's sentiment state in real time.

[0801] "Means of receiving destination, travel itinerary, budget, desired activity information, and sentiment data from users" refers to an interface that collects information such as destination, travel itinerary, budget, desired activities, and current sentiment state as input by users planning a trip.

[0802] "Means for collecting information on destinations, transportation, accommodations, restaurants, and related reviews from the internet" refers to a system that automatically acquires information on destinations, transportation, accommodations, restaurants, and related reviews and ratings from various data sources on the internet.

[0803] "Means of analyzing collected information and filtering it based on user preferences and emotional data" refers to a method of analyzing collected data, selecting that data according to the conditions and emotional state desired by the user, and choosing information that is suitable for the user.

[0804] "A means of generating travel schedules and creating efficient sightseeing routes and meal plans based on filtered information and sentiment data" refers to a function that automatically generates optimal travel schedules, sightseeing routes, and meal plans by utilizing filtered information and user sentiment data.

[0805] "A method for aggregating and evaluating the latest reviews of selected information" refers to a method of aggregating the latest reviews and evaluations of selected tourist destinations and facilities, and evaluating their reputation and reliability.

[0806] "A means of presenting generated schedules and evaluation information to the user and proposing the optimal plan" refers to an interface that displays the generated travel schedule and evaluation information in an easy-to-understand manner for the user and proposes the optimal travel plan based on it.

[0807] "A means of adjusting travel plans in real time according to user emotion data" refers to a system that flexibly adjusts travel plans and sightseeing routes in real time based on data when a user's emotions change during a trip.

[0808] This invention will be implemented as an "in-car navigation application equipped with an emotion recognition travel planning system" to be installed in an autonomous vehicle. Specific embodiments for implementing this invention will be described below.

[0809] System Configuration

[0810] This system consists of a user terminal (a display device inside the vehicle), a server, a data collection API, and an emotion engine.

[0811] User terminal: This device has the function of collecting information entered by the user through in-car display devices and voice interfaces. This includes destination, travel itinerary, budget, desired activities, and sentiment data.

[0812] Server: Performs the main processing of data collection and analysis. It analyzes the collected data and filters it based on user preferences and sentiment data.

[0813] Data Collection APIs: APIs used to collect information on destinations, transportation, accommodations, restaurants, and related user reviews from the internet. Specific examples include tourism APIs and transportation APIs.

[0814] Emotion Engine: A system that analyzes user input information and real-time emotional fluctuations during travel to generate and adjust appropriate travel plans.

[0815] Program Processing Description

[0816] The server performs the following actions:

[0817] 1. Collecting user input: Collect destination, travel itinerary, budget, desired activity information, and sentiment data from the user's device.

[0818] 2. Data Collection: We will use a data collection API to collect data on destinations, transportation, accommodations, restaurants, and user reviews from the internet.

[0819] 3. Data Analysis and Filtering: The collected information is analyzed and filtered based on user preferences and sentiment data. For example, if a user desires relaxation, relaxing tourist destinations and accommodations will be prioritized.

[0820] 4. Travel Schedule Generation: Based on filtered information, the system generates an optimal travel schedule, efficient sightseeing routes, and meal plans.

[0821] 5. Aggregation and Evaluation of User Reviews: Aggregate the latest user reviews and evaluations for the selected information to present users with the best options.

[0822] 6. Proposal and Adjustment: Present the generated schedule and evaluation information to the user and propose the optimal plan. Furthermore, adjust the plan in real time based on the user's emotions during the trip.

[0823] Hardware / software to use

[0824] Hardware: In-vehicle display devices and voice interfaces for autonomous vehicles.

[0825] Software: Python programs, tourism APIs, emotion engines (general term)

[0826] Examples of specific cases and prompt statements

[0827] Specific example

[0828] If a user expresses a desire to travel to Tokyo and indicates that they are seeking "stress reduction," the system will gather information on relaxing tourist spots, hotels, and spas, and incorporate the highest-rated locations within their budget into a three-day schedule. Furthermore, if the user's emotional state changes during the trip—for example, if they indicate that they are "increasingly stressed"—the system will suggest new relaxing spots in real time.

[0829] Example of a prompt

[0830] "I'd like to take a 3-day trip to Tokyo starting October 10th, 2023. My budget is 100,000 yen, and I want to enjoy sightseeing and delicious food. I'm feeling stressed right now, so I'd like the app to constantly display stress-relieving spots."

[0831] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0832] Step 1:

[0833] Collection of user input

[0834] Input: User information including destination, travel dates, budget, desired activities, and sentiment data.

[0835] Operation: The user terminal collects basic information about the user's trip and their current emotional state through an input interface.

[0836] Output: The collected data is sent to the server.

[0837] Step 2:

[0838] Data collection

[0839] Input: Destination, travel dates, budget, and desired activity information submitted by the user.

[0840] Operation: The server uses a data collection API to retrieve information about destinations, transportation, accommodations, restaurants, and user reviews from the internet.

[0841] Output: The raw data obtained from the API is stored on the server.

[0842] Step 3:

[0843] Data analysis and filtering

[0844] Input: Accumulated raw data, and user preference and sentiment data.

[0845] Operation: The server analyzes the collected information and selects appropriate data based on the user's requirements and emotional state. It prioritizes highly-rated facilities and relaxing spots within the budget.

[0846] Output: A filtered dataset is generated.

[0847] Step 4:

[0848] Generating a travel schedule

[0849] Input: Filtered dataset

[0850] Operation: The server automatically generates efficient sightseeing routes and meal plans based on filtered data. It creates a schedule that allows you to comfortably visit sightseeing spots and dining locations each day.

[0851] Output: The generated travel schedule is created.

[0852] Step 5:

[0853] Aggregation and evaluation of customer reviews

[0854] Input: IDs of tourist destinations and facilities related to the generated travel schedule

[0855] Operation: The server collects the latest user reviews for selected tourist destinations and facilities and calculates their reputation and ratings.

[0856] Output: Customer review data for each facility is generated.

[0857] Step 6:

[0858] Proposal and coordination

[0859] Input: Generated travel schedule and review rating data

[0860] Operation: The server presents the user with generated schedules and evaluation information, and proposes the optimal plan. Furthermore, if the user's emotions change during the trip, it provides new suggestions in real time.

[0861] Output: The optimized travel plan after adjustments is presented to the user's terminal.

[0862] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0863] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0864] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0865] [Third Embodiment]

[0866] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0867] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0868] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0869] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0870] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0871] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0872] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0873] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0874] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0875] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0876] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0877] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0878] This invention is a system that automatically generates travel plans and proposes them to users based on the optimal schedule and user reviews. A specific embodiment of this system is described below.

[0879] Overall structure

[0880] This system consists of user terminals and a server. The user terminal, such as a smartphone or PC, provides an interface for users to input their travel preferences. The server receives user input, collects and analyzes the data, and performs the main processing of generating the optimal travel plan.

[0881] Program processing

[0882] User input

[0883] The user accesses a dedicated travel planning form using their device and enters information such as destination, travel dates, budget, and desired activities. For example, the user might enter, "I want to travel to Tokyo for 3 days. My budget is 100,000 yen, and I want to enjoy sightseeing and good food."

[0884] Data acquisition

[0885] The terminal sends user input information to the server. The server uses an API to collect information from the internet about tourist attractions, transportation options, accommodations, restaurants, and other facilities at the specified destination. Furthermore, the server also collects relevant user reviews from databases and review sites.

[0886] Data analysis and filtering

[0887] The server analyzes the collected information and filters it based on the user's budget and desired activities. For example, it selects highly-rated hotels and restaurants within the user's budget. For tourist attractions, it also considers factors such as accessibility and length of stay.

[0888] Travel Schedule Generation

[0889] The server uses filtered data to generate efficient travel schedules. For example, it might create a schedule like this: Day 1: "Tokyo Tower sightseeing and lunch at a nearby restaurant," Day 2: "Senso-ji Temple sightseeing and shopping in Ginza," Day 3: "Roppongi Hills and dinner." It also takes travel time into consideration to adjust the schedule so that users can enjoy sightseeing without difficulty.

[0890] Aggregation and evaluation of customer reviews

[0891] The server collects and analyzes the latest reviews of selected tourist destinations, hotels, and restaurants. To provide users with accurate evaluations, it extracts and organizes positive reviews and high ratings. For example, it displays evaluation points for each item, such as the cleanliness of the hotel, the taste of the restaurant's food, and the quality of service.

[0892] Proposal of the optimal plan

[0893] Based on the travel schedule generated by the server and user reviews, the system sends a suggested itinerary to the user's device. The device then displays the detailed schedule, user reviews for each facility, and an overall rating to the user. Once the user is satisfied with the suggested plan, they press the "Confirm Plan" button to complete their travel planning.

[0894] Specific example

[0895] Let's say a user selects Tokyo as their destination, sets their travel dates to "3 days starting October 10, 2023," their budget to "100,000 yen," and their desired activities to "sightseeing and good food." This information is sent from the terminal to the server, and the server performs the following series of processes.

[0896] 1. Gather information on Tokyo's tourist attractions, transportation options, hotels, and restaurants from the internet.

[0897] 2. Analyze the collected data and select highly-rated hotels and restaurants within the user's budget.

[0898] 3. Generate an efficient schedule: Day 1: "Tokyo Tower and surrounding restaurants," Day 2: "Senso-ji Temple and Ginza shopping," Day 3: "Roppongi Hills and dinner."

[0899] 4. Collect the latest reviews for each facility and organize the evaluation points.

[0900] 5. Send the generated travel plan to the device and display it to the user.

[0901] 6. Once the user is satisfied with the plan, they press the "Confirm Plan" button to complete their travel plan.

[0902] As described above, this system can automatically generate an optimal travel plan based on the user's preferences, providing the user with a convenient and useful travel plan.

[0903] The following describes the processing flow.

[0904] Step 1:

[0905] Users access a dedicated travel planning form using their device and enter information such as destination, travel dates, budget, and desired activities.

[0906] Step 2:

[0907] When the user presses the "Generate Plan" button, the device sends this information to the server.

[0908] Step 3:

[0909] The server receives information from the user and calls various APIs to collect information on tourist attractions, transportation options, accommodations, and restaurants related to the specified destination.

[0910] Step 4:

[0911] The server uses various APIs to collect destination information, transportation information, accommodation information, and dining establishment information from the internet.

[0912] Step 5:

[0913] The server analyzes the information obtained from each API and filters the data based on the user's set budget and desired activities. For example, it might select highly-rated hotels and restaurants within the budget.

[0914] Step 6:

[0915] Based on filtered data, the server automatically generates an efficient travel schedule tailored to the user's travel dates. For example, it might set "Tokyo Tower sightseeing and lunch at a nearby restaurant" for day 1, "Senso-ji Temple sightseeing and shopping in Ginza" for day 2, and "Roppongi Hills and dinner" for day 3.

[0916] Step 7:

[0917] The server collects the latest reviews from databases and review sites for selected tourist destinations, hotels, and restaurants.

[0918] Step 8:

[0919] The server analyzes the collected customer reviews, extracting and organizing highly-rated and positive reviews. For example, it displays evaluation points for each category, such as the cleanliness of a hotel, the taste of restaurant food, and the quality of service.

[0920] Step 9:

[0921] The server uses the generated travel schedule and user reviews to create a optimized travel plan and sends it to the user's device.

[0922] Step 10:

[0923] The device displays the travel plan sent from the server to the user. The user can check the detailed schedule, reviews of each facility, and the overall rating.

[0924] Step 11:

[0925] If the user is satisfied with the proposed plan, they press the "Confirm Plan" button on their device to complete their travel plan.

[0926] Through the above processing steps, this system automatically generates an optimal travel plan based on the user's preferences, providing the user with a convenient and useful travel plan.

[0927] (Example 1)

[0928] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0929] Traditional travel planning systems require users to manually gather information, analyze data, and generate schedules after entering their specific requests, which is time-consuming and labor-intensive. Furthermore, they cannot provide information that reflects the latest user reviews, making it difficult for users to create reliable travel plans. As a result, it is challenging for users to create satisfactory travel plans.

[0930] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0931] In this invention, the server includes means for receiving destination, travel itinerary, budget, and desired activity information from the user; means for collecting information on destinations, transportation, accommodations, and dining facilities from the internet; means for analyzing the collected information and filtering it based on the user's preferences; means for generating a travel schedule based on the filtered information; means for aggregating and evaluating the latest reviews of the selected information; means for presenting the generated schedule and evaluation information to the user and proposing the optimal plan; and means for generating prompt sentences based on user input using an artificial intelligence model and performing data analysis based on those prompts. This enables the user to efficiently plan their trip and realize a highly satisfying travel experience.

[0932] A "user" is an individual or group that uses the system to plan a trip.

[0933] A "terminal" is a device that a user accesses and uses to input information, and examples include smartphones and personal computers.

[0934] A "server" is a computer system used to process data sent by users and information collected from the internet.

[0935] A "destination" is a place or region that a user wants to visit when planning a trip.

[0936] "Travel itinerary" refers to information indicating the period during which a user will be traveling.

[0937] "Budget" refers to the amount of money a user can spend on travel.

[0938] "Desired activities" refer to information about the activities and experiences that users want to engage in during their trip.

[0939] The "Internet" is a system in which multiple computer networks are interconnected and used for information gathering.

[0940] "Destination" refers to the places to visit or tourist attractions on each day of the trip.

[0941] "Transportation" refers to the vehicles and methods of travel used during a trip.

[0942] "Accommodation facilities" refer to places like hotels and inns where travelers stay overnight.

[0943] A "food and beverage establishment" refers to a facility that serves meals, such as a restaurant or cafe.

[0944] "Filtering" is the process of selecting collected information based on the user's preferences and extracting only the appropriate information.

[0945] A "travel schedule" is a detailed timetable of sightseeing destinations and activities planned based on the user's travel itinerary.

[0946] "Word-of-mouth" refers to evaluations and reviews provided by past users.

[0947] An "artificial intelligence model" refers to algorithms and systems used for machine learning and data analysis.

[0948] A "prompt" is a text input that includes instructions or questions given to an artificial intelligence model.

[0949] This invention is a system that automatically generates travel plans and proposes them to users based on the optimal schedule and user reviews. The following describes how this system is specifically implemented.

[0950] Overall structure

[0951] This system consists of user terminals and a server. User terminals, such as smartphones and personal computers, provide an interface for users to input their travel preferences. The server receives the input information from users, collects and analyzes the data, and performs the main processing to generate the optimal travel plan.

[0952] Hardware and software configuration

[0953] User terminals: Smartphones, personal computers, etc.

[0954] Server: A computer system with high-performance computing resources.

[0955] API: Google Places API, Yelp API, Tripadvisor API, etc.

[0956] Artificial intelligence models: Machine learning algorithms (e.g., GPT-3)

[0957] Data processing and data calculation

[0958] First, the user accesses a dedicated travel planning form using their device and enters information such as destination, travel dates, budget, and desired activities. Next, the device sends the user's input information to the server. The server uses an API to collect information from the internet about tourist attractions, transportation, accommodations, and restaurants related to the specified destination. It also obtains ratings and review information from review sites.

[0959] Next, the server analyzes the collected information in detail and filters it based on the user's budget and desired activities. The filtered data is selected to best suit the user's requirements. Furthermore, the server uses the filtered data to generate an efficient travel schedule and adjust it to be manageable.

[0960] The server also aggregates and analyzes the latest reviews of selected tourist destinations, hotels, and restaurants. Positive reviews and high ratings are extracted and organized in a way that is easy for users to understand. Finally, based on the generated travel schedule and review ratings, the server sends a suggested travel plan to the user's device, which then displays it to the user.

[0961] Specific example

[0962] For example, if a user selects Tokyo as their destination, sets their travel dates to "3 days starting October 10, 2023," their budget to "100,000 yen," and their desired activities to "sightseeing and good food," the following series of processes will be performed.

[0963] Example of a prompt:

[0964] "The user is planning a trip to Tokyo. The trip dates are 3 days starting October 10, 2023, with a budget of 100,000 yen. Desired activities include sightseeing and dining. Please generate the optimal travel plan and schedule based on this information."

[0965] 1. The server uses the "Google Places API" and "Yelp API" to retrieve information on tourist attractions and restaurants in Tokyo.

[0966] 2. The server selects highly-rated hotels and restaurants within the budget and calculates the optimal order for visiting tourist attractions.

[0967] 3. The server generates an efficient schedule that includes locations such as "Tokyo Tower," "Senso-ji Temple," and "Roppongi Hills," and also takes travel and break times into consideration.

[0968] 4. The server collects reviews from TripAdvisor and Google Reviews and compiles the latest ratings for each facility.

[0969] 5. The user reviews the plan presented through their device, and if they are satisfied with the proposed travel plan, they press the "Confirm Plan" button to complete their travel plan.

[0970] As described above, this system can automatically generate an optimal travel plan based on the user's preferences, providing the user with a convenient and useful travel plan.

[0971] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0972] Step 1:

[0973] The user accesses a dedicated travel planning form using their device and enters information such as destination, travel dates, budget, and desired activities.

[0974] Input: Destination, travel dates, budget, desired activities

[0975] Output: User-entered travel preferences

[0976] Specific example: For instance, a user might input, "I want to take a 3-day trip to Tokyo. My budget is 100,000 yen, and I want to enjoy sightseeing and delicious food."

[0977] Step 2:

[0978] The terminal sends the user input information obtained in step 1 to the server.

[0979] Input: Travel preferences entered by the user

[0980] Output: User's requested information sent to the server

[0981] Specific operation: The device sends information to the server from the input form, such as "Destination: Tokyo, Travel dates: 3 days starting October 10, 2023, Budget: 100,000 yen, Desired activities: Sightseeing and dining".

[0982] Step 3:

[0983] The server uses the API to collect the necessary data based on the information received in step 2.

[0984] Input: User's desired information sent to the server

[0985] Output: Information on tourist attractions, transportation, accommodations, restaurants, etc.

[0986] Specific operation: The server uses the "Google Places API" and "Yelp API" to retrieve information on tourist attractions, restaurants, and accommodations in Tokyo. For example, it collects restaurant data for Tokyo Tower and the area around Tokyo Station.

[0987] Step 4:

[0988] The server analyzes the information collected in step 3 and filters it based on the user's budget and desired activities.

[0989] Input: Information such as tourist attractions, transportation, accommodation, and restaurants.

[0990] Output: Filtered data that matches the user's preferences.

[0991] Specific operation: The server collects information on multiple hotels, selects the highest-rated ones within the budget, and chooses tourist attractions that match the desired activities. For example, it might pick highly-rated restaurants around Tokyo Tower within the budget.

[0992] Step 5:

[0993] The server generates an efficient travel schedule based on the filtered data.

[0994] Input: Filtered data such as tourist attractions, accommodations, and restaurants.

[0995] Output: Efficient travel schedule

[0996] Specific operation: The server generates a schedule such as "Day 1: Sightseeing at Tokyo Tower and lunch at a nearby restaurant, Day 2: Sightseeing at Senso-ji Temple and shopping in Ginza, Day 3: Roppongi Hills and dinner," taking travel time into consideration.

[0997] Step 6:

[0998] The server aggregates the latest reviews of selected tourist destinations, hotels, and restaurants, and analyzes the evaluation information.

[0999] Input: Filtered data for tourist attractions, hotels, and restaurants.

[1000] Output: Customer reviews and ratings for each facility

[1001] Specific operation: The server collects the latest review information from "Tripadvisor" and "Google Reviews," calculates and displays evaluation points for each category such as "cleanliness," "taste of food," and "quality of service."

[1002] Step 7:

[1003] The server sends information to the user's device suggesting the most suitable travel plan based on the generated travel schedule and user reviews.

[1004] Input: Efficient travel schedule, customer reviews and ratings for each facility.

[1005] Output: Travel plan presented to the user

[1006] Specific action: The device displays detailed information such as "Day 1: Tokyo Tower sightseeing and nearby restaurants (review rating: 4.5)" in a user-friendly format.

[1007] Step 8:

[1008] If the user is satisfied with the proposed plan, they can confirm their travel plan by pressing the "Confirm Plan" button.

[1009] Input: Presented travel plan

[1010] Output: Confirmed travel plan

[1011] Specific action: The user clicks the "Confirm Plan" button on the device screen, and the server triggers this action to record the travel plan.

[1012] (Application Example 1)

[1013] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1014] Traditional travel planning systems had the problem of requiring users a lot of time and effort to create travel plans. In particular, the lack of features that provided real-time, up-to-date reviews and efficient sightseeing routes was a major issue, leading to inconvenience during travel.

[1015] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1016] In this invention, the server includes means for receiving destination, travel itinerary, budget, and desired activity information from the user; means for collecting information on destinations, transportation, accommodations, and dining facilities from the internet; means for analyzing the collected information and filtering it based on the user's preferences; means for generating a travel schedule based on the filtered information; means for aggregating and evaluating the latest reviews of the selected information; means for presenting the generated schedule and evaluation information to the user and proposing the optimal plan; and means for displaying review information and navigation in real time. As a result, the user can check the latest review information and efficient sightseeing routes in real time during their trip, enabling a more convenient and fulfilling travel experience.

[1017] "Means of receiving destination, travel itinerary, budget, and desired activity information from users" refers to devices or software that provide an input interface for travelers to enter their destination, travel duration, budget, and desired activities when planning their trip.

[1018] "Means for collecting information on destinations, transportation, accommodations, and restaurants from the internet" refers to technical means for obtaining data on tourist destinations, transportation, accommodations, and restaurants from multiple sources on the internet.

[1019] "Means for analyzing collected information and filtering it based on user preferences" refers to algorithms and programs that scrutinize collected data based on user-provided conditions (such as budget and activity preferences) and select appropriate options.

[1020] "Means for generating travel schedules based on filtered information" refers to software or a system for creating optimal travel itineraries based on scrutinized information.

[1021] "A means of aggregating and evaluating the latest reviews of selected information" refers to a technology that collects the latest ratings and comments on selected tourist destinations and facilities from the internet, organizes them, and displays them for users.

[1022] "A means of presenting generated schedules and evaluation information to the user and proposing the optimal plan" refers to a system that visually displays the created travel schedule and related evaluation information to the user and has the function of proposing the optimal travel plan.

[1023] "A means of displaying real-time reviews and navigation" refers to a display device or software that provides users with the latest reviews and directions in real time based on their current location while they are traveling.

[1024] This invention is a smart travel system that proposes optimal travel plans to users in real time and also provides navigation and user reviews during the trip. The embodiments of this system are described in detail below.

[1025] Overall structure

[1026] This system consists of user terminals (such as smart glasses or smartphones) and a server. The user terminals provide an interface for travelers to input and receive information, while the server handles the main processing, including data collection, analysis, plan generation, and review evaluation.

[1027] Program processing

[1028] 1. User input

[1029] Users access a dedicated travel planning form using their device and enter information such as destination, travel dates, budget, and desired activities.

[1030] For example, you might enter, "I want to take a 3-day trip to Tokyo. My budget is 100,000 yen, and I want to enjoy sightseeing and delicious food."

[1031] 2. Data Acquisition

[1032] The terminal sends this input information to the server.

[1033] The server uses an API to collect information from the internet about tourist attractions, transportation options, accommodations, restaurants, and other facilities at a specified destination. It also retrieves the latest rating information from review sites.

[1034] 3. Data Analysis and Filtering

[1035] The server analyzes the collected information and filters it based on the user's budget and desired activities.

[1036] For example, you could select highly-rated hotels and restaurants within your budget, and choose tourist attractions considering factors like accessibility and length of stay.

[1037] 4. Travel Schedule Generation

[1038] The server generates an efficient travel schedule based on the filtered information.

[1039] For example, create a schedule that includes sightseeing at "Tokyo Tower" on day 1, "Senso-ji Temple and Ginza" on day 2, and "Roppongi Hills" on day 3. Include meal plans for each day at the same time.

[1040] 5. Real-time user reviews and navigation

[1041] This system displays the latest reviews and navigation information in real time on smart glasses or smartphones while the user is traveling.

[1042] For example, it might provide directions such as, "Next stop is Tokyo Tower. Turn right and go straight," or a review of a nearby restaurant saying, "You can get really delicious sushi here!"

[1043] 6. Presentation of travel plans

[1044] The server sends the generated travel schedule and evaluation information to the terminal, presenting the user with the most suitable plan.

[1045] If the user is satisfied with the plan, they can complete their travel plan by pressing the "Confirm Plan" button.

[1046] Hardware and software used

[1047] Smart glasses (e.g., Google Glass, Microsoft HoloLens)

[1048] smartphone

[1049] Python

[1050] Request library (for API calls)

[1051] Specific example

[1052] When travelers are in Tokyo, their smart glasses or smartphones will display real-time instructions such as, "Next stop is Tokyo Tower. Turn right and go straight." They can also instantly check the latest reviews of nearby restaurants, such as, "You can eat really delicious sushi here!"

[1053] Examples of prompts to input into a generative AI model:

[1054] "Please propose a 3-day Tokyo trip itinerary within a budget of 100,000 yen. The plan should include sightseeing and delicious meals. The trip should begin on October 10, 2023."

[1055] This system allows travelers to receive the latest information in real time, enabling efficient and fulfilling sightseeing.

[1056] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1057] Step 1:

[1058] The user accesses a dedicated travel planning form using their device and enters information such as destination, travel dates, budget, and desired activities. This entered information is then sent to the server.

[1059] Input: Destination, travel dates, budget, desired activities

[1060] Output: Request data containing user input information

[1061] Step 2:

[1062] The server uses an API to collect information on tourist attractions, transportation options, accommodations, and restaurants at a specified destination via the internet. Furthermore, it also collects the latest relevant user reviews from review websites.

[1063] Input: User input information, data from the internet

[1064] Output: A dataset containing information on tourist attractions, transportation, accommodations, restaurants, and the latest user reviews.

[1065] Step 3:

[1066] The server analyzes the collected data and filters it based on the user's budget and desired activities. It selects highly-rated hotels and restaurants within the budget, and for tourist attractions, it also considers accessibility and length of stay.

[1067] Input: Information on tourist attractions, transportation, accommodations, restaurants, and the latest reviews.

[1068] Output: A filtered list of tourist attractions, hotels, restaurants, etc.

[1069] Step 4:

[1070] The server generates an efficient travel schedule based on filtered information. For example, it might create a schedule that includes sightseeing at "Tokyo Tower" on day 1, "Senso-ji Temple and Ginza" on day 2, and "Roppongi Hills" on day 3. It also incorporates meal plans for each day.

[1071] Input: A filtered list of tourist attractions, hotels, restaurants, etc.

[1072] Output: A plan including an efficient travel schedule and meal plan.

[1073] Step 5:

[1074] The server generates travel schedules and evaluation information, which are then sent to the user's terminal and presented to the user. The user can then review this information and finalize their plan.

[1075] Input: Plan including an efficient travel schedule and meal plan.

[1076] Output: Travel schedule and evaluation information sent to the user's terminal.

[1077] Step 6:

[1078] The device displays real-time reviews and navigation to the user while they are traveling. The user receives directions from their smart glasses or smartphone based on their current location. It also displays the latest reviews of nearby restaurants.

[1079] Input: Current location information, latest user reviews

[1080] Output: Real-time displayed navigation and user reviews

[1081] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1082] This invention is a system that automatically generates travel plans and combines them with an emotion engine that recognizes user emotions to provide the most suitable schedule and optimal suggestions based on user reviews for each individual user. Specific embodiments of this system are described below.

[1083] Overall structure

[1084] This system consists of a user terminal, a server, and an emotion engine. The user terminal, such as a smartphone or PC, provides an interface for users to input their travel preferences. The server receives user input, collects and analyzes data, and performs the main processing of generating the optimal travel plan. The emotion engine recognizes the user's emotions and adjusts the travel plan based on the results.

[1085] Program processing

[1086] User input

[1087] The user accesses a dedicated travel planning form using their device and enters information such as destination, travel dates, budget, and desired activities. For example, the user might enter, "I want to travel to Tokyo for 3 days. My budget is 100,000 yen, and I want to enjoy sightseeing and good food."

[1088] Data acquisition

[1089] The terminal sends user input information to the server. The server uses an API to collect information from the internet about tourist attractions, transportation options, accommodations, restaurants, and other facilities at the specified destination. Furthermore, the server also collects relevant user reviews from databases and review sites.

[1090] Data analysis and filtering

[1091] The server analyzes the collected information and filters the data based on the user's budget and desired activities. For example, it selects highly-rated hotels and restaurants within the user's budget. For tourist attractions, it also considers factors such as accessibility and length of stay.

[1092] Emotion recognition by an emotion engine

[1093] The emotion engine analyzes user input and past data to recognize the user's emotions in real time. For example, if a user leaves a comment such as "I'm feeling stressed" in an input form, the plan content will be adjusted based on that emotion data.

[1094] Travel Schedule Generation

[1095] The server uses filtered data to automatically generate an efficient travel schedule tailored to the user's travel dates. For example, it might set "Tokyo Tower sightseeing and lunch at a nearby restaurant" for day 1, "Senso-ji Temple sightseeing and shopping in Ginza" for day 2, and "Roppongi Hills and dinner" for day 3. It also takes travel time into consideration to adjust the schedule so that the user can enjoy sightseeing without difficulty. In addition, based on the results of the emotion engine, it adds relaxing activities and stress-reducing spots.

[1096] Aggregation and evaluation of customer reviews

[1097] The server collects and analyzes the latest reviews of selected tourist destinations, hotels, and restaurants. To provide users with accurate evaluations, it extracts and organizes positive reviews and high ratings. For example, it displays evaluation points for each item, such as the cleanliness of the hotel, the taste of the restaurant's food, and the quality of service.

[1098] Proposal of the optimal plan

[1099] Based on the travel schedule and user reviews generated by the server, the system sends a suggested itinerary to the user's device. The device then displays the detailed schedule, user reviews for each facility, and an overall rating to the user. Furthermore, based on the results of the emotion engine, it also provides suggestions that are particularly tailored to the user's emotions. Once the user is satisfied with the suggested plan, they press the "Confirm Plan" button to complete their travel planning.

[1100] Specific example

[1101] Let's say a user selects Tokyo as their destination, sets their travel dates to "3 days starting October 10, 2023," their budget to "100,000 yen," and their desired activities to "sightseeing and good food." Furthermore, if the user enters emotional information such as "I want to reduce stress," this information is sent from the device to the server, and the server performs a series of processes as follows.

[1102] 1. Gather information on Tokyo's tourist attractions, transportation options, hotels, and restaurants from the internet.

[1103] 2. Analyze the collected data and select highly-rated hotels and restaurants within the user's budget.

[1104] 3. Generate an efficient schedule such as "Tokyo Tower and relaxing restaurants in the surrounding area" on day 1, "Senso-ji Temple and Ginza shopping" on day 2, and "Roppongi Hills and a stress-relieving spa" on day 3.

[1105] 4. Collect the latest reviews for each facility and organize the evaluation points.

[1106] 5. Send the generated travel plan to the device and display it to the user.

[1107] 6. Once the user is satisfied with the plan, they press the "Confirm Plan" button to complete their travel plan.

[1108] This system can utilize user sentiment information to provide more personalized travel plans that better meet individual needs.

[1109] The following describes the processing flow.

[1110] Step 1:

[1111] The user accesses a dedicated travel planning form using their device and enters their destination, travel dates, budget, desired activities, and emotional information. For example, the user might enter, "I want to travel to Tokyo for 3 days. My budget is 100,000 yen. I want to enjoy sightseeing and good food. I want to reduce stress."

[1112] Step 2:

[1113] When the user presses the "Generate Plan" button, the device sends this information to the server.

[1114] Step 3:

[1115] The server receives information from the user and calls various APIs to collect information on tourist attractions, transportation options, accommodations, and restaurants related to the specified destination.

[1116] Step 4:

[1117] The server uses various APIs to collect destination information, transportation information, accommodation information, and dining establishment information from the internet. The server also collects relevant user reviews from databases and review sites.

[1118] Step 5:

[1119] The server analyzes the collected information and filters the data based on the user's set budget and desired activities. For example, it might select highly-rated hotels and restaurants within the budget and choose the most convenient mode of transportation to reach the destination.

[1120] Step 6:

[1121] The emotion engine analyzes user input and recognizes the user's emotional state. For example, if the user inputs "I want to reduce stress," it uses that emotional data to select relaxing tourist spots and activities.

[1122] Step 7:

[1123] The server takes the results of the emotion engine into account and automatically generates an efficient travel schedule based on the filtered data. For example, it might set "Tokyo Tower sightseeing and relaxing restaurants nearby" for day 1, "Senso-ji Temple sightseeing and shopping in Ginza" for day 2, and "Roppongi Hills and a stress-relieving spa" for day 3.

[1124] Step 8:

[1125] The server collects the latest reviews for selected tourist destinations, hotels, and restaurants from databases and review sites. It analyzes the collected review information, extracting and organizing highly-rated and positive reviews. For example, it displays evaluation points for each category, such as hotel cleanliness, restaurant food quality, and service quality.

[1126] Step 9:

[1127] The server generates travel schedules and reviews, then compiles the optimal travel plan and sends it to the user's device.

[1128] Step 10:

[1129] The device displays a travel plan sent from the server to the user. The user can view the detailed schedule, reviews of each facility, and the overall rating. For example, "Day 1 - Tokyo Tower sightseeing and a relaxing restaurant" might be displayed, along with the rating points for each facility.

[1130] Step 11:

[1131] If the user is satisfied with the proposed plan, they press the "Confirm Plan" button on their device, completing the travel plan. As a result, the user receives an optimal travel plan that also takes their emotional state into consideration.

[1132] In this way, a system that incorporates an emotion engine can create customized travel plans that are more tailored to individual needs, based on the user's emotional information.

[1133] (Example 2)

[1134] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1135] Conventional travel plan generation systems create plans without considering the user's emotional state, making it difficult to provide travel plans that meet the user's psychological needs. Furthermore, the aggregation and evaluation of user reviews are often not done properly, resulting in problems in providing the optimal travel plan for the user.

[1136] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1137] In this invention, the server includes means for receiving destination, travel itinerary, budget, and desired activity information from the user; means for collecting information on destinations, transportation, accommodations, and dining facilities from the internet; means for analyzing the collected information and filtering it based on the user's preferences; means for analyzing the user's emotional information using an emotional analysis engine; means for generating a travel schedule based on the filtered information and emotional information; means for aggregating and evaluating the latest reviews of the selected information; and means for presenting the generated schedule and evaluation information to the user and proposing an optimal plan. This makes it possible to provide a more personalized and optimal travel plan that takes into account the user's emotional state.

[1138] A "user" is an end-user who inputs the information necessary to create a travel plan.

[1139] A "destination" is a specific geographical location where the user is planning their trip.

[1140] "Travel itinerary" refers to the range of dates from which the user's trip begins to end.

[1141] "Budget" refers to the total amount of money a user can spend on their entire trip.

[1142] "Desired activities" refer to the activities and sightseeing purposes that users want to experience during their trip.

[1143] A "server" is a computer system that receives user input information and collects, analyzes, filters, and generates travel plans for various types of information.

[1144] A "sentiment analysis engine" is software or a service used to analyze a user's emotional information.

[1145] "Filtering" refers to a method in which a server selects information based on the user's preferences, eliminating unnecessary data and extracting only the necessary information.

[1146] A "travel schedule" is a detailed plan of sightseeing and accommodations created based on the user's travel itinerary.

[1147] "Reviews" refer to ratings and comments provided by other users regarding accommodations, restaurants, and other establishments.

[1148] An "optimal plan" is the most suitable travel plan proposed based on the user's input information and analysis results.

[1149] This invention is a system that automatically generates travel plans and combines them with an emotion analysis engine that recognizes user emotions to provide the most suitable schedule and optimal suggestions based on user reviews for each individual user. Detailed embodiments are described below.

[1150] Overall structure

[1151] This system consists of a user terminal, a server, and an emotion analysis engine. The user terminal, such as a smartphone or PC, provides an interface for users to input their travel preferences. The server receives input information from the user, collects and analyzes the data, and performs the main processing of generating the optimal travel plan. The emotion analysis engine recognizes the user's emotions and adjusts the travel plan based on the results.

[1152] Program processing

[1153] User input

[1154] The user accesses a dedicated travel planning form using their device and enters information such as destination, travel dates, budget, desired activities, and emotional state. For example, they might enter, "I want to travel to Tokyo for 3 days starting October 10th. My budget is 100,000 yen, and I want to enjoy sightseeing and good food. I've been feeling stressed lately."

[1155] Data acquisition

[1156] The device sends user input information to the server. The server uses APIs to collect information from the internet about tourist attractions, transportation options, accommodations, restaurants, and other facilities at the specified destination. Specifically, it uses APIs such as Google Places API and TripAdvisor API.

[1157] Data analysis and filtering

[1158] The server analyzes the collected information and filters the data based on the user's budget and desired activities. It selects highly-rated hotels and restaurants within the budget, and also chooses tourist attractions considering accessibility and length of stay. This process utilizes libraries such as Python's Pandas library.

[1159] Emotion recognition by an emotion analysis engine

[1160] The emotion analysis engine analyzes user input and past data to recognize the user's emotions in real time. Using emotion analysis services from IBM Watson and Microsoft Azure, the plan is adjusted based on emotional data such as "feeling stressed."

[1161] Travel Schedule Generation

[1162] The server uses filtered data to automatically generate an efficient travel schedule tailored to the user's travel dates. For example, it might set "Tokyo Tower sightseeing and lunch at a nearby restaurant" for day 1, "Senso-ji Temple sightseeing and shopping in Ginza" for day 2, and "Roppongi Hills and dinner" for day 3. It also includes relaxing activities and stress-reducing spots in the schedule based on the results of an emotion analysis engine.

[1163] Aggregation and evaluation of customer reviews

[1164] The system collects the latest reviews of selected tourist destinations, hotels, and restaurants, and performs text analysis. It utilizes natural language processing techniques to extract and organize positive comments and highly-rated reviews. Python's NLTK and spaCy are used.

[1165] Proposal of the optimal plan

[1166] The server generates a travel schedule and adjusts it based on user reviews, then sends a suggested plan to the user's device. The device displays the detailed schedule of the travel plan, user reviews for each facility, and an overall rating to the user. If the user is satisfied with the suggested plan, they can press the "Confirm Plan" button to complete their travel planning.

[1167] Specific example

[1168] The user selects Tokyo as their destination, enters "3 days starting October 10, 2023" as their travel dates, "100,000 yen" as their budget, "sightseeing and good food" as their desired activities, and "I want to reduce stress" as their emotional state. This information is sent from the terminal to the server, which then performs the following processing.

[1169] 1. Gather information on Tokyo's tourist attractions, transportation options, hotels, and restaurants from the internet.

[1170] 2. Analyze the collected data and select highly-rated hotels and restaurants within the user's budget.

[1171] 3. Generate an efficient schedule such as "Tokyo Tower and relaxing restaurants in the surrounding area" on day 1, "Senso-ji Temple and Ginza shopping" on day 2, and "Roppongi Hills and stress-relieving spots" on day 3.

[1172] 4. Collect the latest reviews for each facility and organize the evaluation points.

[1173] 5. Send the generated travel plan to the device and display it to the user.

[1174] 6. Once the user is satisfied with the plan, they press the "Confirm Plan" button to complete their travel plan.

[1175] This system allows users to receive personalized travel plans based on their emotional state and specific preferences.

[1176] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1177] Step 1: User Input

[1178] The user accesses a dedicated travel planning form using their device and enters their destination, travel dates, budget, desired activities, and emotional information. For example, the user might enter, "I want to travel to Tokyo for 3 days starting October 10th. My budget is 100,000 yen, and I want to enjoy sightseeing and good food. I've been feeling stressed lately."

[1179] Input: Destination, travel dates, budget, desired activities, sentiment information

[1180] Output: User information sent from the terminal to the server

[1181] Specific action: The user opens the URL in their smartphone browser, enters information into the form, and presses the "Submit" button.

[1182] Step 2: Data Acquisition

[1183] The device sends user input information to the server. The server uses external APIs such as the Google Places API and TripAdvisor API to collect information about tourist attractions, transportation options, accommodations, and restaurants at the specified destination.

[1184] Input: User information

[1185] Output: Information on collected tourist attractions, transportation, accommodations, and restaurants.

[1186] Specific operation: The server makes an API call, receives the result in JSON format, and stores it in the database.

[1187] Step 3: Data Analysis and Filtering

[1188] The server analyzes the collected information using the Python Pandas library and filters the data based on the user's budget and desired activities. It selects highly-rated hotels and restaurants within the budget, and also chooses tourist attractions considering factors such as accessibility and length of stay.

[1189] Input: Collected information

[1190] Output: Filtered information

[1191] Specific operation: The server reads the information stored in the database, converts it to a Pandas DataFrame, and performs analysis. It deletes data that does not meet the criteria, keeping only the necessary data.

[1192] Step 4: Emotion recognition by emotion analysis engine

[1193] The sentiment analysis engine analyzes user input and past data to recognize the user's emotions in real time. The sentiment analysis engine utilizes IBM Watson and Microsoft Azure services.

[1194] Input: User sentiment information

[1195] Output: Analyzed sentiment data

[1196] Specific operation: The server sends user input data to the emotion analysis engine's API and receives the emotion recognition result.

[1197] Step 5: Generate travel schedule

[1198] The server uses filtered information and sentiment data to automatically generate an efficient travel schedule tailored to the user's travel plans. For example, it might set "Tokyo Tower sightseeing and lunch at a nearby restaurant" for day 1, "Senso-ji Temple sightseeing and shopping in Ginza" for day 2, and "Roppongi Hills and dinner" for day 3. It also adds relaxing activities based on sentiment data.

[1199] Input: Filtered information, sentiment data

[1200] Output: Generated travel schedule

[1201] Specific operation: Use Google Maps Platform to calculate travel time between tourist destinations and generate an efficient schedule using a Python script.

[1202] Step 6: Collecting and evaluating customer reviews

[1203] The system collects the latest reviews of selected tourist destinations, hotels, and restaurants, and performs text analysis using natural language processing technology. Positive comments and highly-rated reviews are then extracted and organized from the reviews.

[1204] Input: Selected facility information

[1205] Output: Organized customer reviews

[1206] Specific operation: The server uses Python's NLTK and spaCy to analyze the review data, extract evaluation points, and format them.

[1207] Step 7: Proposing the Optimal Plan

[1208] The server generates a travel schedule and adjusts it with user reviews to send the optimal plan to the user's device. The device then displays the detailed schedule, user reviews for each facility, and an overall rating to the user. The user completes the travel plan by pressing the "Confirm Plan" button.

[1209] Input: Travel schedule, customer reviews

[1210] Output: Proposal of the optimal plan, confirmation of the travel plan.

[1211] Specific operation: The server sends a web page generated with HTML and CSS to the user's terminal, and the user presses the "Confirm Plan" button via the interface.

[1212] (Application Example 2)

[1213] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1214] Current travel planning systems only consider the user's basic preferences and have the drawback of being unable to offer flexible suggestions that reflect the user's emotional state. Furthermore, the difficulty in adjusting plans based on real-time emotional changes during the trip means that it is not possible to maximize user satisfaction.

[1215] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving destination, travel itinerary, budget, desired activity information and sentiment data from the user; means for collecting information on destinations, transportation, accommodation, dining facilities and related word-of-mouth information from the internet; means for analyzing the collected information and filtering it based on the user's preferences and sentiment data; means for generating a travel schedule based on the filtered information and sentiment data, and creating an efficient sightseeing route and meal plan; means for aggregating and evaluating the latest word-of-mouth for the selected information; and means for presenting the generated schedule and evaluation information to the user and proposing an optimal plan. This makes it possible to propose flexible travel plans that reflect the user's sentiment state in real time.

[1216] "Means of receiving destination, travel itinerary, budget, desired activity information, and sentiment data from users" refers to an interface that collects information such as destination, travel itinerary, budget, desired activities, and current sentiment state as input by users planning a trip.

[1217] "Means for collecting information on destinations, transportation, accommodations, restaurants, and related reviews from the internet" refers to a system that automatically acquires information on destinations, transportation, accommodations, restaurants, and related reviews and ratings from various data sources on the internet.

[1218] "Means of analyzing collected information and filtering it based on user preferences and emotional data" refers to a method of analyzing collected data, selecting that data according to the conditions and emotional state desired by the user, and choosing information that is suitable for the user.

[1219] "A means of generating travel schedules and creating efficient sightseeing routes and meal plans based on filtered information and sentiment data" refers to a function that automatically generates optimal travel schedules, sightseeing routes, and meal plans by utilizing filtered information and user sentiment data.

[1220] "A method for aggregating and evaluating the latest reviews of selected information" refers to a method of aggregating the latest reviews and evaluations of selected tourist destinations and facilities, and evaluating their reputation and reliability.

[1221] "A means of presenting generated schedules and evaluation information to the user and proposing the optimal plan" refers to an interface that displays the generated travel schedule and evaluation information in an easy-to-understand manner for the user and proposes the optimal travel plan based on it.

[1222] "A means of adjusting travel plans in real time according to user emotion data" refers to a system that flexibly adjusts travel plans and sightseeing routes in real time based on data when a user's emotions change during a trip.

[1223] This invention will be implemented as an "in-car navigation application equipped with an emotion recognition travel planning system" to be installed in an autonomous vehicle. Specific embodiments for implementing this invention will be described below.

[1224] System Configuration

[1225] This system consists of a user terminal (a display device inside the vehicle), a server, a data collection API, and an emotion engine.

[1226] User terminal: This device has the function of collecting information entered by the user through in-car display devices and voice interfaces. This includes destination, travel itinerary, budget, desired activities, and sentiment data.

[1227] Server: Performs the main processing of data collection and analysis. It analyzes the collected data and filters it based on user preferences and sentiment data.

[1228] Data Collection APIs: APIs used to collect information on destinations, transportation, accommodations, restaurants, and related user reviews from the internet. Specific examples include tourism APIs and transportation APIs.

[1229] Emotion Engine: A system that analyzes user input information and real-time emotional fluctuations during travel to generate and adjust appropriate travel plans.

[1230] Program Processing Description

[1231] The server performs the following actions:

[1232] 1. Collecting user input: Collect destination, travel itinerary, budget, desired activity information, and sentiment data from the user's device.

[1233] 2. Data Collection: We will use a data collection API to collect data on destinations, transportation, accommodations, restaurants, and user reviews from the internet.

[1234] 3. Data Analysis and Filtering: The collected information is analyzed and filtered based on user preferences and sentiment data. For example, if a user desires relaxation, relaxing tourist destinations and accommodations will be prioritized.

[1235] 4. Travel Schedule Generation: Based on filtered information, the system generates an optimal travel schedule, efficient sightseeing routes, and meal plans.

[1236] 5. Aggregation and Evaluation of User Reviews: Aggregate the latest user reviews and evaluations for the selected information to present users with the best options.

[1237] 6. Proposal and Adjustment: Present the generated schedule and evaluation information to the user and propose the optimal plan. Furthermore, adjust the plan in real time based on the user's emotions during the trip.

[1238] Hardware / software to use

[1239] Hardware: In-vehicle display devices and voice interfaces for autonomous vehicles.

[1240] Software: Python programs, tourism APIs, emotion engines (general term)

[1241] Examples of specific cases and prompt statements

[1242] Specific example

[1243] If a user expresses a desire to travel to Tokyo and indicates that they are seeking "stress reduction," the system will gather information on relaxing tourist spots, hotels, and spas, and incorporate the highest-rated locations within their budget into a three-day schedule. Furthermore, if the user's emotional state changes during the trip—for example, if they indicate that they are "increasingly stressed"—the system will suggest new relaxing spots in real time.

[1244] Example of a prompt

[1245] "I'd like to take a 3-day trip to Tokyo starting October 10th, 2023. My budget is 100,000 yen, and I want to enjoy sightseeing and delicious food. I'm feeling stressed right now, so I'd like the app to constantly display stress-relieving spots."

[1246] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1247] Step 1:

[1248] Collection of user input

[1249] Input: User information including destination, travel dates, budget, desired activities, and sentiment data.

[1250] Operation: The user terminal collects basic information about the user's trip and their current emotional state through an input interface.

[1251] Output: The collected data is sent to the server.

[1252] Step 2:

[1253] Data collection

[1254] Input: Destination, travel dates, budget, and desired activity information submitted by the user.

[1255] Operation: The server uses a data collection API to retrieve information about destinations, transportation, accommodations, restaurants, and user reviews from the internet.

[1256] Output: The raw data obtained from the API is stored on the server.

[1257] Step 3:

[1258] Data analysis and filtering

[1259] Input: Accumulated raw data, and user preference and sentiment data.

[1260] Operation: The server analyzes the collected information and selects appropriate data based on the user's requirements and emotional state. It prioritizes highly-rated facilities and relaxing spots within the budget.

[1261] Output: A filtered dataset is generated.

[1262] Step 4:

[1263] Generating a travel schedule

[1264] Input: Filtered dataset

[1265] Operation: The server automatically generates efficient sightseeing routes and meal plans based on filtered data. It creates a schedule that allows you to comfortably visit sightseeing spots and dining locations each day.

[1266] Output: The generated travel schedule is created.

[1267] Step 5:

[1268] Aggregation and evaluation of customer reviews

[1269] Input: IDs of tourist destinations and facilities related to the generated travel schedule

[1270] Operation: The server collects the latest user reviews for selected tourist destinations and facilities and calculates their reputation and ratings.

[1271] Output: Customer review data for each facility is generated.

[1272] Step 6:

[1273] Proposal and coordination

[1274] Input: Generated travel schedule and review rating data

[1275] Operation: The server presents the user with generated schedules and evaluation information, and proposes the optimal plan. Furthermore, if the user's emotions change during the trip, it provides new suggestions in real time.

[1276] Output: The optimized travel plan after adjustments is presented to the user's terminal.

[1277] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1278] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1279] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[1280] [Fourth Embodiment]

[1281] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[1282] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1283] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1284] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[1285] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1286] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1287] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1288] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[1289] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1290] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1291] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1292] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1293] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1294] This invention is a system that automatically generates travel plans and proposes them to users based on the optimal schedule and user reviews. A specific embodiment of this system is described below.

[1295] Overall structure

[1296] This system consists of user terminals and a server. The user terminal, such as a smartphone or PC, provides an interface for users to input their travel preferences. The server receives user input, collects and analyzes the data, and performs the main processing of generating the optimal travel plan.

[1297] Program processing

[1298] User input

[1299] The user accesses a dedicated travel planning form using their device and enters information such as destination, travel dates, budget, and desired activities. For example, the user might enter, "I want to travel to Tokyo for 3 days. My budget is 100,000 yen, and I want to enjoy sightseeing and good food."

[1300] Data acquisition

[1301] The terminal sends user input information to the server. The server uses an API to collect information from the internet about tourist attractions, transportation options, accommodations, restaurants, and other facilities at the specified destination. Furthermore, the server also collects relevant user reviews from databases and review sites.

[1302] Data analysis and filtering

[1303] The server analyzes the collected information and filters it based on the user's budget and desired activities. For example, it selects highly-rated hotels and restaurants within the user's budget. For tourist attractions, it also considers factors such as accessibility and length of stay.

[1304] Travel Schedule Generation

[1305] The server uses filtered data to generate efficient travel schedules. For example, it might create a schedule like this: Day 1: "Tokyo Tower sightseeing and lunch at a nearby restaurant," Day 2: "Senso-ji Temple sightseeing and shopping in Ginza," Day 3: "Roppongi Hills and dinner." It also takes travel time into consideration to adjust the schedule so that users can enjoy sightseeing without difficulty.

[1306] Aggregation and evaluation of customer reviews

[1307] The server collects and analyzes the latest reviews of selected tourist destinations, hotels, and restaurants. To provide users with accurate evaluations, it extracts and organizes positive reviews and high ratings. For example, it displays evaluation points for each item, such as the cleanliness of the hotel, the taste of the restaurant's food, and the quality of service.

[1308] Proposal of the optimal plan

[1309] Based on the travel schedule generated by the server and user reviews, the system sends a suggested itinerary to the user's device. The device then displays the detailed schedule, user reviews for each facility, and an overall rating to the user. Once the user is satisfied with the suggested plan, they press the "Confirm Plan" button to complete their travel planning.

[1310] Specific example

[1311] Let's say a user selects Tokyo as their destination, sets their travel dates to "3 days starting October 10, 2023," their budget to "100,000 yen," and their desired activities to "sightseeing and good food." This information is sent from the terminal to the server, and the server performs the following series of processes.

[1312] 1. Gather information on Tokyo's tourist attractions, transportation options, hotels, and restaurants from the internet.

[1313] 2. Analyze the collected data and select highly-rated hotels and restaurants within the user's budget.

[1314] 3. Generate an efficient schedule: Day 1: "Tokyo Tower and surrounding restaurants," Day 2: "Senso-ji Temple and Ginza shopping," Day 3: "Roppongi Hills and dinner."

[1315] 4. Collect the latest reviews for each facility and organize the evaluation points.

[1316] 5. Send the generated travel plan to the device and display it to the user.

[1317] 6. Once the user is satisfied with the plan, they press the "Confirm Plan" button to complete their travel plan.

[1318] As described above, this system can automatically generate an optimal travel plan based on the user's preferences, providing the user with a convenient and useful travel plan.

[1319] The following describes the processing flow.

[1320] Step 1:

[1321] Users access a dedicated travel planning form using their device and enter information such as destination, travel dates, budget, and desired activities.

[1322] Step 2:

[1323] When the user presses the "Generate Plan" button, the device sends this information to the server.

[1324] Step 3:

[1325] The server receives information from the user and calls various APIs to collect information on tourist attractions, transportation options, accommodations, and restaurants related to the specified destination.

[1326] Step 4:

[1327] The server uses various APIs to collect destination information, transportation information, accommodation information, and dining establishment information from the internet.

[1328] Step 5:

[1329] The server analyzes the information obtained from each API and filters the data based on the user's set budget and desired activities. For example, it might select highly-rated hotels and restaurants within the budget.

[1330] Step 6:

[1331] Based on filtered data, the server automatically generates an efficient travel schedule tailored to the user's travel dates. For example, it might set "Tokyo Tower sightseeing and lunch at a nearby restaurant" for day 1, "Senso-ji Temple sightseeing and shopping in Ginza" for day 2, and "Roppongi Hills and dinner" for day 3.

[1332] Step 7:

[1333] The server collects the latest reviews from databases and review sites for selected tourist destinations, hotels, and restaurants.

[1334] Step 8:

[1335] The server analyzes the collected customer reviews, extracting and organizing highly-rated and positive reviews. For example, it displays evaluation points for each category, such as the cleanliness of a hotel, the taste of restaurant food, and the quality of service.

[1336] Step 9:

[1337] The server uses the generated travel schedule and user reviews to create a optimized travel plan and sends it to the user's device.

[1338] Step 10:

[1339] The device displays the travel plan sent from the server to the user. The user can check the detailed schedule, reviews of each facility, and the overall rating.

[1340] Step 11:

[1341] If the user is satisfied with the proposed plan, they press the "Confirm Plan" button on their device to complete their travel plan.

[1342] Through the above processing steps, this system automatically generates an optimal travel plan based on the user's preferences, providing the user with a convenient and useful travel plan.

[1343] (Example 1)

[1344] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1345] Traditional travel planning systems require users to manually gather information, analyze data, and generate schedules after entering their specific requests, which is time-consuming and labor-intensive. Furthermore, they cannot provide information that reflects the latest user reviews, making it difficult for users to create reliable travel plans. As a result, it is challenging for users to create satisfactory travel plans.

[1346] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1347] In this invention, the server includes means for receiving destination, travel itinerary, budget, and desired activity information from the user; means for collecting information on destinations, transportation, accommodations, and dining facilities from the internet; means for analyzing the collected information and filtering it based on the user's preferences; means for generating a travel schedule based on the filtered information; means for aggregating and evaluating the latest reviews of the selected information; means for presenting the generated schedule and evaluation information to the user and proposing the optimal plan; and means for generating prompt sentences based on user input using an artificial intelligence model and performing data analysis based on those prompts. This enables the user to efficiently plan their trip and realize a highly satisfying travel experience.

[1348] A "user" is an individual or group that uses the system to plan a trip.

[1349] A "terminal" is a device that a user accesses and uses to input information, and examples include smartphones and personal computers.

[1350] A "server" is a computer system used to process data sent by users and information collected from the internet.

[1351] A "destination" is a place or region that a user wants to visit when planning a trip.

[1352] "Travel itinerary" refers to information indicating the period during which a user will be traveling.

[1353] "Budget" refers to the amount of money a user can spend on travel.

[1354] "Desired activities" refer to information about the activities and experiences that users want to engage in during their trip.

[1355] The "Internet" is a system in which multiple computer networks are interconnected and used for information gathering.

[1356] "Destination" refers to the places to visit or tourist attractions on each day of the trip.

[1357] "Transportation" refers to the vehicles and methods of travel used during a trip.

[1358] "Accommodation facilities" refer to places like hotels and inns where travelers stay overnight.

[1359] A "food and beverage establishment" refers to a facility that serves meals, such as a restaurant or cafe.

[1360] "Filtering" is the process of selecting collected information based on the user's preferences and extracting only the appropriate information.

[1361] A "travel schedule" is a detailed timetable of sightseeing destinations and activities planned based on the user's travel itinerary.

[1362] "Word-of-mouth" refers to evaluations and reviews provided by past users.

[1363] An "artificial intelligence model" refers to algorithms and systems used for machine learning and data analysis.

[1364] A "prompt" is a text input that includes instructions or questions given to an artificial intelligence model.

[1365] This invention is a system that automatically generates travel plans and proposes them to users based on the optimal schedule and user reviews. The following describes how this system is specifically implemented.

[1366] Overall structure

[1367] This system consists of user terminals and a server. User terminals, such as smartphones and personal computers, provide an interface for users to input their travel preferences. The server receives the input information from users, collects and analyzes the data, and performs the main processing to generate the optimal travel plan.

[1368] Hardware and software configuration

[1369] User terminals: Smartphones, personal computers, etc.

[1370] Server: A computer system with high-performance computing resources.

[1371] API: Google Places API, Yelp API, Tripadvisor API, etc.

[1372] Artificial intelligence models: Machine learning algorithms (e.g., GPT-3)

[1373] Data processing and data calculation

[1374] First, the user accesses a dedicated travel planning form using their device and enters information such as destination, travel dates, budget, and desired activities. Next, the device sends the user's input information to the server. The server uses an API to collect information from the internet about tourist attractions, transportation, accommodations, and restaurants related to the specified destination. It also obtains ratings and review information from review sites.

[1375] Next, the server analyzes the collected information in detail and filters it based on the user's budget and desired activities. The filtered data is selected to best suit the user's requirements. Furthermore, the server uses the filtered data to generate an efficient travel schedule and adjust it to be manageable.

[1376] The server also aggregates and analyzes the latest reviews of selected tourist destinations, hotels, and restaurants. Positive reviews and high ratings are extracted and organized in a way that is easy for users to understand. Finally, based on the generated travel schedule and review ratings, the server sends a suggested travel plan to the user's device, which then displays it to the user.

[1377] Specific example

[1378] For example, if a user selects Tokyo as their destination, sets their travel dates to "3 days starting October 10, 2023," their budget to "100,000 yen," and their desired activities to "sightseeing and good food," the following series of processes will be performed.

[1379] Example of a prompt:

[1380] "The user is planning a trip to Tokyo. The trip dates are 3 days starting October 10, 2023, with a budget of 100,000 yen. Desired activities include sightseeing and dining. Please generate the optimal travel plan and schedule based on this information."

[1381] 1. The server uses the "Google Places API" and "Yelp API" to retrieve information on tourist attractions and restaurants in Tokyo.

[1382] 2. The server selects highly-rated hotels and restaurants within the budget and calculates the optimal order for visiting tourist attractions.

[1383] 3. The server generates an efficient schedule that includes locations such as "Tokyo Tower," "Senso-ji Temple," and "Roppongi Hills," and also takes travel and break times into consideration.

[1384] 4. The server collects reviews from TripAdvisor and Google Reviews and compiles the latest ratings for each facility.

[1385] 5. The user reviews the plan presented through their device, and if they are satisfied with the proposed travel plan, they press the "Confirm Plan" button to complete their travel plan.

[1386] As described above, this system can automatically generate an optimal travel plan based on the user's preferences, providing the user with a convenient and useful travel plan.

[1387] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1388] Step 1:

[1389] The user accesses a dedicated travel planning form using their device and enters information such as destination, travel dates, budget, and desired activities.

[1390] Input: Destination, travel dates, budget, desired activities

[1391] Output: User-entered travel preferences

[1392] Specific example: For instance, a user might input, "I want to take a 3-day trip to Tokyo. My budget is 100,000 yen, and I want to enjoy sightseeing and delicious food."

[1393] Step 2:

[1394] The terminal sends the user input information obtained in step 1 to the server.

[1395] Input: Travel preferences entered by the user

[1396] Output: User's requested information sent to the server

[1397] Specific operation: The device sends information to the server from the input form, such as "Destination: Tokyo, Travel dates: 3 days starting October 10, 2023, Budget: 100,000 yen, Desired activities: Sightseeing and dining".

[1398] Step 3:

[1399] The server uses the API to collect the necessary data based on the information received in step 2.

[1400] Input: User's desired information sent to the server

[1401] Output: Information on tourist attractions, transportation, accommodations, restaurants, etc.

[1402] Specific operation: The server uses the "Google Places API" and "Yelp API" to retrieve information on tourist attractions, restaurants, and accommodations in Tokyo. For example, it collects restaurant data for Tokyo Tower and the area around Tokyo Station.

[1403] Step 4:

[1404] The server analyzes the information collected in step 3 and filters it based on the user's budget and desired activities.

[1405] Input: Information such as tourist attractions, transportation, accommodation, and restaurants.

[1406] Output: Filtered data that matches the user's preferences.

[1407] Specific operation: The server collects information on multiple hotels, selects the highest-rated ones within the budget, and chooses tourist attractions that match the desired activities. For example, it might pick highly-rated restaurants around Tokyo Tower within the budget.

[1408] Step 5:

[1409] The server generates an efficient travel schedule based on the filtered data.

[1410] Input: Filtered data such as tourist attractions, accommodations, and restaurants.

[1411] Output: Efficient travel schedule

[1412] Specific operation: The server generates a schedule such as "Day 1: Sightseeing at Tokyo Tower and lunch at a nearby restaurant, Day 2: Sightseeing at Senso-ji Temple and shopping in Ginza, Day 3: Roppongi Hills and dinner," taking travel time into consideration.

[1413] Step 6:

[1414] The server aggregates the latest reviews of selected tourist destinations, hotels, and restaurants, and analyzes the evaluation information.

[1415] Input: Filtered data for tourist attractions, hotels, and restaurants.

[1416] Output: Customer reviews and ratings for each facility

[1417] Specific operation: The server collects the latest review information from "Tripadvisor" and "Google Reviews," calculates and displays evaluation points for each category such as "cleanliness," "taste of food," and "quality of service."

[1418] Step 7:

[1419] The server sends information to the user's device suggesting the most suitable travel plan based on the generated travel schedule and user reviews.

[1420] Input: Efficient travel schedule, customer reviews and ratings for each facility.

[1421] Output: Travel plan presented to the user

[1422] Specific action: The device displays detailed information such as "Day 1: Tokyo Tower sightseeing and nearby restaurants (review rating: 4.5)" in a user-friendly format.

[1423] Step 8:

[1424] If the user is satisfied with the proposed plan, they can confirm their travel plan by pressing the "Confirm Plan" button.

[1425] Input: Presented travel plan

[1426] Output: Confirmed travel plan

[1427] Specific action: The user clicks the "Confirm Plan" button on the device screen, and the server triggers this action to record the travel plan.

[1428] (Application Example 1)

[1429] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1430] Traditional travel planning systems had the problem of requiring users a lot of time and effort to create travel plans. In particular, the lack of features that provided real-time, up-to-date reviews and efficient sightseeing routes was a major issue, leading to inconvenience during travel.

[1431] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1432] In this invention, the server includes means for receiving destination, travel itinerary, budget, and desired activity information from the user; means for collecting information on destinations, transportation, accommodations, and dining facilities from the internet; means for analyzing the collected information and filtering it based on the user's preferences; means for generating a travel schedule based on the filtered information; means for aggregating and evaluating the latest reviews of the selected information; means for presenting the generated schedule and evaluation information to the user and proposing the optimal plan; and means for displaying review information and navigation in real time. As a result, the user can check the latest review information and efficient sightseeing routes in real time during their trip, enabling a more convenient and fulfilling travel experience.

[1433] "Means of receiving destination, travel itinerary, budget, and desired activity information from users" refers to devices or software that provide an input interface for travelers to enter their destination, travel duration, budget, and desired activities when planning their trip.

[1434] "Means for collecting information on destinations, transportation, accommodations, and restaurants from the internet" refers to technical means for obtaining data on tourist destinations, transportation, accommodations, and restaurants from multiple sources on the internet.

[1435] "Means for analyzing collected information and filtering it based on user preferences" refers to algorithms and programs that scrutinize collected data based on user-provided conditions (such as budget and activity preferences) and select appropriate options.

[1436] "Means for generating travel schedules based on filtered information" refers to software or a system for creating optimal travel itineraries based on scrutinized information.

[1437] "A means of aggregating and evaluating the latest reviews of selected information" refers to a technology that collects the latest ratings and comments on selected tourist destinations and facilities from the internet, organizes them, and displays them for users.

[1438] "A means of presenting generated schedules and evaluation information to the user and proposing the optimal plan" refers to a system that visually displays the created travel schedule and related evaluation information to the user and has the function of proposing the optimal travel plan.

[1439] "A means of displaying real-time reviews and navigation" refers to a display device or software that provides users with the latest reviews and directions in real time based on their current location while they are traveling.

[1440] This invention is a smart travel system that proposes optimal travel plans to users in real time and also provides navigation and user reviews during the trip. The embodiments of this system are described in detail below.

[1441] Overall structure

[1442] This system consists of user terminals (such as smart glasses or smartphones) and a server. The user terminals provide an interface for travelers to input and receive information, while the server handles the main processing, including data collection, analysis, plan generation, and review evaluation.

[1443] Program processing

[1444] 1. User input

[1445] Users access a dedicated travel planning form using their device and enter information such as destination, travel dates, budget, and desired activities.

[1446] For example, you might enter, "I want to take a 3-day trip to Tokyo. My budget is 100,000 yen, and I want to enjoy sightseeing and delicious food."

[1447] 2. Data Acquisition

[1448] The terminal sends this input information to the server.

[1449] The server uses an API to collect information from the internet about tourist attractions, transportation options, accommodations, restaurants, and other facilities at a specified destination. It also retrieves the latest rating information from review sites.

[1450] 3. Data Analysis and Filtering

[1451] The server analyzes the collected information and filters it based on the user's budget and desired activities.

[1452] For example, you could select highly-rated hotels and restaurants within your budget, and choose tourist attractions considering factors like accessibility and length of stay.

[1453] 4. Travel Schedule Generation

[1454] The server generates an efficient travel schedule based on the filtered information.

[1455] For example, create a schedule that includes sightseeing at "Tokyo Tower" on day 1, "Senso-ji Temple and Ginza" on day 2, and "Roppongi Hills" on day 3. Include meal plans for each day at the same time.

[1456] 5. Real-time user reviews and navigation

[1457] This system displays the latest reviews and navigation information in real time on smart glasses or smartphones while the user is traveling.

[1458] For example, it might provide directions such as, "Next stop is Tokyo Tower. Turn right and go straight," or a review of a nearby restaurant saying, "You can get really delicious sushi here!"

[1459] 6. Presentation of travel plans

[1460] The server sends the generated travel schedule and evaluation information to the terminal, presenting the user with the most suitable plan.

[1461] If the user is satisfied with the plan, they can complete their travel plan by pressing the "Confirm Plan" button.

[1462] Hardware and software used

[1463] Smart glasses (e.g., Google Glass, Microsoft HoloLens)

[1464] smartphone

[1465] Python

[1466] Request library (for API calls)

[1467] Specific example

[1468] When travelers are in Tokyo, their smart glasses or smartphones will display real-time instructions such as, "Next stop is Tokyo Tower. Turn right and go straight." They can also instantly check the latest reviews of nearby restaurants, such as, "You can eat really delicious sushi here!"

[1469] Examples of prompts to input into a generative AI model:

[1470] "Please propose a 3-day Tokyo trip itinerary within a budget of 100,000 yen. The plan should include sightseeing and delicious meals. The trip should begin on October 10, 2023."

[1471] This system allows travelers to receive the latest information in real time, enabling efficient and fulfilling sightseeing.

[1472] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1473] Step 1:

[1474] The user accesses a dedicated travel planning form using their device and enters information such as destination, travel dates, budget, and desired activities. This entered information is then sent to the server.

[1475] Input: Destination, travel dates, budget, desired activities

[1476] Output: Request data containing user input information

[1477] Step 2:

[1478] The server uses an API to collect information on tourist attractions, transportation options, accommodations, and restaurants at a specified destination via the internet. Furthermore, it also collects the latest relevant user reviews from review websites.

[1479] Input: User input information, data from the internet

[1480] Output: A dataset containing information on tourist attractions, transportation, accommodations, restaurants, and the latest user reviews.

[1481] Step 3:

[1482] The server analyzes the collected data and filters it based on the user's budget and desired activities. It selects highly-rated hotels and restaurants within the budget, and for tourist attractions, it also considers accessibility and length of stay.

[1483] Input: Information on tourist attractions, transportation, accommodations, restaurants, and the latest reviews.

[1484] Output: A filtered list of tourist attractions, hotels, restaurants, etc.

[1485] Step 4:

[1486] The server generates an efficient travel schedule based on filtered information. For example, it might create a schedule that includes sightseeing at "Tokyo Tower" on day 1, "Senso-ji Temple and Ginza" on day 2, and "Roppongi Hills" on day 3. It also incorporates meal plans for each day.

[1487] Input: A filtered list of tourist attractions, hotels, restaurants, etc.

[1488] Output: A plan including an efficient travel schedule and meal plan.

[1489] Step 5:

[1490] The server generates travel schedules and evaluation information, which are then sent to the user's terminal and presented to the user. The user can then review this information and finalize their plan.

[1491] Input: Plan including an efficient travel schedule and meal plan.

[1492] Output: Travel schedule and evaluation information sent to the user's terminal.

[1493] Step 6:

[1494] The device displays real-time reviews and navigation to the user while they are traveling. The user receives directions from their smart glasses or smartphone based on their current location. It also displays the latest reviews of nearby restaurants.

[1495] Input: Current location information, latest user reviews

[1496] Output: Real-time displayed navigation and user reviews

[1497] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1498] This invention is a system that automatically generates travel plans and combines them with an emotion engine that recognizes user emotions to provide the most suitable schedule and optimal suggestions based on user reviews for each individual user. Specific embodiments of this system are described below.

[1499] Overall structure

[1500] This system consists of a user terminal, a server, and an emotion engine. The user terminal, such as a smartphone or PC, provides an interface for users to input their travel preferences. The server receives user input, collects and analyzes data, and performs the main processing of generating the optimal travel plan. The emotion engine recognizes the user's emotions and adjusts the travel plan based on the results.

[1501] Program processing

[1502] User input

[1503] The user accesses a dedicated travel planning form using their device and enters information such as destination, travel dates, budget, and desired activities. For example, the user might enter, "I want to travel to Tokyo for 3 days. My budget is 100,000 yen, and I want to enjoy sightseeing and good food."

[1504] Data acquisition

[1505] The terminal sends user input information to the server. The server uses an API to collect information from the internet about tourist attractions, transportation options, accommodations, restaurants, and other facilities at the specified destination. Furthermore, the server also collects relevant user reviews from databases and review sites.

[1506] Data analysis and filtering

[1507] The server analyzes the collected information and filters the data based on the user's budget and desired activities. For example, it selects highly-rated hotels and restaurants within the user's budget. For tourist attractions, it also considers factors such as accessibility and length of stay.

[1508] Emotion recognition by an emotion engine

[1509] The emotion engine analyzes user input and past data to recognize the user's emotions in real time. For example, if a user leaves a comment such as "I'm feeling stressed" in an input form, the plan content will be adjusted based on that emotion data.

[1510] Travel Schedule Generation

[1511] The server uses filtered data to automatically generate an efficient travel schedule tailored to the user's travel dates. For example, it might set "Tokyo Tower sightseeing and lunch at a nearby restaurant" for day 1, "Senso-ji Temple sightseeing and shopping in Ginza" for day 2, and "Roppongi Hills and dinner" for day 3. It also takes travel time into consideration to adjust the schedule so that the user can enjoy sightseeing without difficulty. In addition, based on the results of the emotion engine, it adds relaxing activities and stress-reducing spots.

[1512] Aggregation and evaluation of customer reviews

[1513] The server collects and analyzes the latest reviews of selected tourist destinations, hotels, and restaurants. To provide users with accurate evaluations, it extracts and organizes positive reviews and high ratings. For example, it displays evaluation points for each item, such as the cleanliness of the hotel, the taste of the restaurant's food, and the quality of service.

[1514] Proposal of the optimal plan

[1515] Based on the travel schedule and user reviews generated by the server, the system sends a suggested itinerary to the user's device. The device then displays the detailed schedule, user reviews for each facility, and an overall rating to the user. Furthermore, based on the results of the emotion engine, it also provides suggestions that are particularly tailored to the user's emotions. Once the user is satisfied with the suggested plan, they press the "Confirm Plan" button to complete their travel planning.

[1516] Specific example

[1517] Let's say a user selects Tokyo as their destination, sets their travel dates to "3 days starting October 10, 2023," their budget to "100,000 yen," and their desired activities to "sightseeing and good food." Furthermore, if the user enters emotional information such as "I want to reduce stress," this information is sent from the device to the server, and the server performs a series of processes as follows.

[1518] 1. Gather information on Tokyo's tourist attractions, transportation options, hotels, and restaurants from the internet.

[1519] 2. Analyze the collected data and select highly-rated hotels and restaurants within the user's budget.

[1520] 3. Generate an efficient schedule such as "Tokyo Tower and relaxing restaurants in the surrounding area" on day 1, "Senso-ji Temple and Ginza shopping" on day 2, and "Roppongi Hills and a stress-relieving spa" on day 3.

[1521] 4. Collect the latest reviews for each facility and organize the evaluation points.

[1522] 5. Send the generated travel plan to the device and display it to the user.

[1523] 6. Once the user is satisfied with the plan, they press the "Confirm Plan" button to complete their travel plan.

[1524] This system can utilize user sentiment information to provide more personalized travel plans that better meet individual needs.

[1525] The following describes the processing flow.

[1526] Step 1:

[1527] The user accesses a dedicated travel planning form using their device and enters their destination, travel dates, budget, desired activities, and emotional information. For example, the user might enter, "I want to travel to Tokyo for 3 days. My budget is 100,000 yen. I want to enjoy sightseeing and good food. I want to reduce stress."

[1528] Step 2:

[1529] When the user presses the "Generate Plan" button, the device sends this information to the server.

[1530] Step 3:

[1531] The server receives information from the user and calls various APIs to collect information on tourist attractions, transportation options, accommodations, and restaurants related to the specified destination.

[1532] Step 4:

[1533] The server uses various APIs to collect destination information, transportation information, accommodation information, and dining establishment information from the internet. The server also collects relevant user reviews from databases and review sites.

[1534] Step 5:

[1535] The server analyzes the collected information and filters the data based on the user's set budget and desired activities. For example, it might select highly-rated hotels and restaurants within the budget and choose the most convenient mode of transportation to reach the destination.

[1536] Step 6:

[1537] The emotion engine analyzes user input and recognizes the user's emotional state. For example, if the user inputs "I want to reduce stress," it uses that emotional data to select relaxing tourist spots and activities.

[1538] Step 7:

[1539] The server takes the results of the emotion engine into account and automatically generates an efficient travel schedule based on the filtered data. For example, it might set "Tokyo Tower sightseeing and relaxing restaurants nearby" for day 1, "Senso-ji Temple sightseeing and shopping in Ginza" for day 2, and "Roppongi Hills and a stress-relieving spa" for day 3.

[1540] Step 8:

[1541] The server collects the latest reviews for selected tourist destinations, hotels, and restaurants from databases and review sites. It analyzes the collected review information, extracting and organizing highly-rated and positive reviews. For example, it displays evaluation points for each category, such as hotel cleanliness, restaurant food quality, and service quality.

[1542] Step 9:

[1543] The server generates travel schedules and reviews, then compiles the optimal travel plan and sends it to the user's device.

[1544] Step 10:

[1545] The device displays a travel plan sent from the server to the user. The user can view the detailed schedule, reviews of each facility, and the overall rating. For example, "Day 1 - Tokyo Tower sightseeing and a relaxing restaurant" might be displayed, along with the rating points for each facility.

[1546] Step 11:

[1547] If the user is satisfied with the proposed plan, they press the "Confirm Plan" button on their device, completing the travel plan. As a result, the user receives an optimal travel plan that also takes their emotional state into consideration.

[1548] In this way, a system that incorporates an emotion engine can create customized travel plans that are more tailored to individual needs, based on the user's emotional information.

[1549] (Example 2)

[1550] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1551] Conventional travel plan generation systems create plans without considering the user's emotional state, making it difficult to provide travel plans that meet the user's psychological needs. Furthermore, the aggregation and evaluation of user reviews are often not done properly, resulting in problems in providing the optimal travel plan for the user.

[1552] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1553] In this invention, the server includes means for receiving destination, travel itinerary, budget, and desired activity information from the user; means for collecting information on destinations, transportation, accommodations, and dining facilities from the internet; means for analyzing the collected information and filtering it based on the user's preferences; means for analyzing the user's emotional information using an emotional analysis engine; means for generating a travel schedule based on the filtered information and emotional information; means for aggregating and evaluating the latest reviews of the selected information; and means for presenting the generated schedule and evaluation information to the user and proposing an optimal plan. This makes it possible to provide a more personalized and optimal travel plan that takes into account the user's emotional state.

[1554] A "user" is an end-user who inputs the information necessary to create a travel plan.

[1555] A "destination" is a specific geographical location where the user is planning their trip.

[1556] "Travel itinerary" refers to the range of dates from which the user's trip begins to end.

[1557] "Budget" refers to the total amount of money a user can spend on their entire trip.

[1558] "Desired activities" refer to the activities and sightseeing purposes that users want to experience during their trip.

[1559] A "server" is a computer system that receives user input information and collects, analyzes, filters, and generates travel plans for various types of information.

[1560] A "sentiment analysis engine" is software or a service used to analyze a user's emotional information.

[1561] "Filtering" refers to a method in which a server selects information based on the user's preferences, eliminating unnecessary data and extracting only the necessary information.

[1562] A "travel schedule" is a detailed plan of sightseeing and accommodations created based on the user's travel itinerary.

[1563] "Reviews" refer to ratings and comments provided by other users regarding accommodations, restaurants, and other establishments.

[1564] An "optimal plan" is the most suitable travel plan proposed based on the user's input information and analysis results.

[1565] This invention is a system that automatically generates travel plans and combines them with an emotion analysis engine that recognizes user emotions to provide the most suitable schedule and optimal suggestions based on user reviews for each individual user. Detailed embodiments are described below.

[1566] Overall structure

[1567] This system consists of a user terminal, a server, and an emotion analysis engine. The user terminal, such as a smartphone or PC, provides an interface for users to input their travel preferences. The server receives input information from the user, collects and analyzes the data, and performs the main processing of generating the optimal travel plan. The emotion analysis engine recognizes the user's emotions and adjusts the travel plan based on the results.

[1568] Program processing

[1569] User input

[1570] The user accesses a dedicated travel planning form using their device and enters information such as destination, travel dates, budget, desired activities, and emotional state. For example, they might enter, "I want to travel to Tokyo for 3 days starting October 10th. My budget is 100,000 yen, and I want to enjoy sightseeing and good food. I've been feeling stressed lately."

[1571] Data acquisition

[1572] The device sends user input information to the server. The server uses APIs to collect information from the internet about tourist attractions, transportation options, accommodations, restaurants, and other facilities at the specified destination. Specifically, it uses APIs such as Google Places API and TripAdvisor API.

[1573] Data analysis and filtering

[1574] The server analyzes the collected information and filters the data based on the user's budget and desired activities. It selects highly-rated hotels and restaurants within the budget, and also chooses tourist attractions considering accessibility and length of stay. This process utilizes libraries such as Python's Pandas library.

[1575] Emotion recognition by an emotion analysis engine

[1576] The emotion analysis engine analyzes user input and past data to recognize the user's emotions in real time. Using emotion analysis services from IBM Watson and Microsoft Azure, the plan is adjusted based on emotional data such as "feeling stressed."

[1577] Travel Schedule Generation

[1578] The server uses filtered data to automatically generate an efficient travel schedule tailored to the user's travel dates. For example, it might set "Tokyo Tower sightseeing and lunch at a nearby restaurant" for day 1, "Senso-ji Temple sightseeing and shopping in Ginza" for day 2, and "Roppongi Hills and dinner" for day 3. It also includes relaxing activities and stress-reducing spots in the schedule based on the results of an emotion analysis engine.

[1579] Aggregation and evaluation of customer reviews

[1580] The system collects the latest reviews of selected tourist destinations, hotels, and restaurants, and performs text analysis. It utilizes natural language processing techniques to extract and organize positive comments and highly-rated reviews. Python's NLTK and spaCy are used.

[1581] Proposal of the optimal plan

[1582] The server generates a travel schedule and adjusts it based on user reviews, then sends a suggested plan to the user's device. The device displays the detailed schedule of the travel plan, user reviews for each facility, and an overall rating to the user. If the user is satisfied with the suggested plan, they can press the "Confirm Plan" button to complete their travel planning.

[1583] Specific example

[1584] The user selects Tokyo as their destination, enters "3 days starting October 10, 2023" as their travel dates, "100,000 yen" as their budget, "sightseeing and good food" as their desired activities, and "I want to reduce stress" as their emotional state. This information is sent from the terminal to the server, which then performs the following processing.

[1585] 1. Gather information on Tokyo's tourist attractions, transportation options, hotels, and restaurants from the internet.

[1586] 2. Analyze the collected data and select highly-rated hotels and restaurants within the user's budget.

[1587] 3. Generate an efficient schedule such as "Tokyo Tower and relaxing restaurants in the surrounding area" on day 1, "Senso-ji Temple and Ginza shopping" on day 2, and "Roppongi Hills and stress-relieving spots" on day 3.

[1588] 4. Collect the latest reviews for each facility and organize the evaluation points.

[1589] 5. Send the generated travel plan to the device and display it to the user.

[1590] 6. Once the user is satisfied with the plan, they press the "Confirm Plan" button to complete their travel plan.

[1591] This system allows users to receive personalized travel plans based on their emotional state and specific preferences.

[1592] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1593] Step 1: User Input

[1594] The user accesses a dedicated travel planning form using their device and enters their destination, travel dates, budget, desired activities, and emotional information. For example, the user might enter, "I want to travel to Tokyo for 3 days starting October 10th. My budget is 100,000 yen, and I want to enjoy sightseeing and good food. I've been feeling stressed lately."

[1595] Input: Destination, travel dates, budget, desired activities, sentiment information

[1596] Output: User information sent from the terminal to the server

[1597] Specific action: The user opens the URL in their smartphone browser, enters information into the form, and presses the "Submit" button.

[1598] Step 2: Data Acquisition

[1599] The device sends user input information to the server. The server uses external APIs such as the Google Places API and TripAdvisor API to collect information about tourist attractions, transportation options, accommodations, and restaurants at the specified destination.

[1600] Input: User information

[1601] Output: Information on collected tourist attractions, transportation, accommodations, and restaurants.

[1602] Specific operation: The server makes an API call, receives the result in JSON format, and stores it in the database.

[1603] Step 3: Data Analysis and Filtering

[1604] The server analyzes the collected information using the Python Pandas library and filters the data based on the user's budget and desired activities. It selects highly-rated hotels and restaurants within the budget, and also chooses tourist attractions considering factors such as accessibility and length of stay.

[1605] Input: Collected information

[1606] Output: Filtered information

[1607] Specific operation: The server reads the information stored in the database, converts it to a Pandas DataFrame, and performs analysis. It deletes data that does not meet the criteria, keeping only the necessary data.

[1608] Step 4: Emotion recognition by emotion analysis engine

[1609] The sentiment analysis engine analyzes user input and past data to recognize the user's emotions in real time. The sentiment analysis engine utilizes IBM Watson and Microsoft Azure services.

[1610] Input: User sentiment information

[1611] Output: Analyzed sentiment data

[1612] Specific operation: The server sends user input data to the emotion analysis engine's API and receives the emotion recognition result.

[1613] Step 5: Generate travel schedule

[1614] The server uses filtered information and sentiment data to automatically generate an efficient travel schedule tailored to the user's travel plans. For example, it might set "Tokyo Tower sightseeing and lunch at a nearby restaurant" for day 1, "Senso-ji Temple sightseeing and shopping in Ginza" for day 2, and "Roppongi Hills and dinner" for day 3. It also adds relaxing activities based on sentiment data.

[1615] Input: Filtered information, sentiment data

[1616] Output: Generated travel schedule

[1617] Specific operation: Use Google Maps Platform to calculate travel time between tourist destinations and generate an efficient schedule using a Python script.

[1618] Step 6: Collecting and evaluating customer reviews

[1619] The system collects the latest reviews of selected tourist destinations, hotels, and restaurants, and performs text analysis using natural language processing technology. Positive comments and highly-rated reviews are then extracted and organized from the reviews.

[1620] Input: Selected facility information

[1621] Output: Organized customer reviews

[1622] Specific operation: The server uses Python's NLTK and spaCy to analyze the review data, extract evaluation points, and format them.

[1623] Step 7: Proposing the Optimal Plan

[1624] The server generates a travel schedule and adjusts it with user reviews to send the optimal plan to the user's device. The device then displays the detailed schedule, user reviews for each facility, and an overall rating to the user. The user completes the travel plan by pressing the "Confirm Plan" button.

[1625] Input: Travel schedule, customer reviews

[1626] Output: Proposal of the optimal plan, confirmation of the travel plan.

[1627] Specific operation: The server sends a web page generated with HTML and CSS to the user's terminal, and the user presses the "Confirm Plan" button via the interface.

[1628] (Application Example 2)

[1629] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1630] Current travel planning systems only consider the user's basic preferences and have the drawback of being unable to offer flexible suggestions that reflect the user's emotional state. Furthermore, the difficulty in adjusting plans based on real-time emotional changes during the trip means that it is not possible to maximize user satisfaction.

[1631] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving destination, travel itinerary, budget, desired activity information and sentiment data from the user; means for collecting information on destinations, transportation, accommodation, dining facilities and related word-of-mouth information from the internet; means for analyzing the collected information and filtering it based on the user's preferences and sentiment data; means for generating a travel schedule based on the filtered information and sentiment data, and creating an efficient sightseeing route and meal plan; means for aggregating and evaluating the latest word-of-mouth for the selected information; and means for presenting the generated schedule and evaluation information to the user and proposing an optimal plan. This makes it possible to propose flexible travel plans that reflect the user's sentiment state in real time.

[1632] "Means of receiving destination, travel itinerary, budget, desired activity information, and sentiment data from users" refers to an interface that collects information such as destination, travel itinerary, budget, desired activities, and current sentiment state as input by users planning a trip.

[1633] "Means for collecting information on destinations, transportation, accommodations, restaurants, and related reviews from the internet" refers to a system that automatically acquires information on destinations, transportation, accommodations, restaurants, and related reviews and ratings from various data sources on the internet.

[1634] "Means of analyzing collected information and filtering it based on user preferences and emotional data" refers to a method of analyzing collected data, selecting that data according to the conditions and emotional state desired by the user, and choosing information that is suitable for the user.

[1635] "A means of generating travel schedules and creating efficient sightseeing routes and meal plans based on filtered information and sentiment data" refers to a function that automatically generates optimal travel schedules, sightseeing routes, and meal plans by utilizing filtered information and user sentiment data.

[1636] "A method for aggregating and evaluating the latest reviews of selected information" refers to a method of aggregating the latest reviews and evaluations of selected tourist destinations and facilities, and evaluating their reputation and reliability.

[1637] "A means of presenting generated schedules and evaluation information to the user and proposing the optimal plan" refers to an interface that displays the generated travel schedule and evaluation information in an easy-to-understand manner for the user and proposes the optimal travel plan based on it.

[1638] "A means of adjusting travel plans in real time according to user emotion data" refers to a system that flexibly adjusts travel plans and sightseeing routes in real time based on data when a user's emotions change during a trip.

[1639] This invention will be implemented as an "in-car navigation application equipped with an emotion recognition travel planning system" to be installed in an autonomous vehicle. Specific embodiments for implementing this invention will be described below.

[1640] System Configuration

[1641] This system consists of a user terminal (a display device inside the vehicle), a server, a data collection API, and an emotion engine.

[1642] User terminal: This device has the function of collecting information entered by the user through in-car display devices and voice interfaces. This includes destination, travel itinerary, budget, desired activities, and sentiment data.

[1643] Server: Performs the main processing of data collection and analysis. It analyzes the collected data and filters it based on user preferences and sentiment data.

[1644] Data Collection APIs: APIs used to collect information on destinations, transportation, accommodations, restaurants, and related user reviews from the internet. Specific examples include tourism APIs and transportation APIs.

[1645] Emotion Engine: A system that analyzes user input information and real-time emotional fluctuations during travel to generate and adjust appropriate travel plans.

[1646] Program Processing Description

[1647] The server performs the following actions:

[1648] 1. Collecting user input: Collect destination, travel itinerary, budget, desired activity information, and sentiment data from the user's device.

[1649] 2. Data Collection: We will use a data collection API to collect data on destinations, transportation, accommodations, restaurants, and user reviews from the internet.

[1650] 3. Data Analysis and Filtering: The collected information is analyzed and filtered based on user preferences and sentiment data. For example, if a user desires relaxation, relaxing tourist destinations and accommodations will be prioritized.

[1651] 4. Travel Schedule Generation: Based on filtered information, the system generates an optimal travel schedule, efficient sightseeing routes, and meal plans.

[1652] 5. Aggregation and Evaluation of User Reviews: Aggregate the latest user reviews and evaluations for the selected information to present users with the best options.

[1653] 6. Proposal and Adjustment: Present the generated schedule and evaluation information to the user and propose the optimal plan. Furthermore, adjust the plan in real time based on the user's emotions during the trip.

[1654] Hardware / software to use

[1655] Hardware: In-vehicle display devices and voice interfaces for autonomous vehicles.

[1656] Software: Python programs, tourism APIs, emotion engines (general term)

[1657] Examples of specific cases and prompt statements

[1658] Specific example

[1659] If a user expresses a desire to travel to Tokyo and indicates that they are seeking "stress reduction," the system will gather information on relaxing tourist spots, hotels, and spas, and incorporate the highest-rated locations within their budget into a three-day schedule. Furthermore, if the user's emotional state changes during the trip—for example, if they indicate that they are "increasingly stressed"—the system will suggest new relaxing spots in real time.

[1660] Example of a prompt

[1661] "I'd like to take a 3-day trip to Tokyo starting October 10th, 2023. My budget is 100,000 yen, and I want to enjoy sightseeing and delicious food. I'm feeling stressed right now, so I'd like the app to constantly display stress-relieving spots."

[1662] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1663] Step 1:

[1664] Collection of user input

[1665] Input: User information including destination, travel dates, budget, desired activities, and sentiment data.

[1666] Operation: The user terminal collects basic information about the user's trip and their current emotional state through an input interface.

[1667] Output: The collected data is sent to the server.

[1668] Step 2:

[1669] Data collection

[1670] Input: Destination, travel dates, budget, and desired activity information submitted by the user.

[1671] Operation: The server uses a data collection API to retrieve information about destinations, transportation, accommodations, restaurants, and user reviews from the internet.

[1672] Output: The raw data obtained from the API is stored on the server.

[1673] Step 3:

[1674] Data analysis and filtering

[1675] Input: Accumulated raw data, and user preference and sentiment data.

[1676] Operation: The server analyzes the collected information and selects appropriate data based on the user's requirements and emotional state. It prioritizes highly-rated facilities and relaxing spots within the budget.

[1677] Output: A filtered dataset is generated.

[1678] Step 4:

[1679] Generating a travel schedule

[1680] Input: Filtered dataset

[1681] Operation: The server automatically generates efficient sightseeing routes and meal plans based on filtered data. It creates a schedule that allows you to comfortably visit sightseeing spots and dining locations each day.

[1682] Output: The generated travel schedule is created.

[1683] Step 5:

[1684] Aggregation and evaluation of customer reviews

[1685] Input: IDs of tourist destinations and facilities related to the generated travel schedule

[1686] Operation: The server collects the latest user reviews for selected tourist destinations and facilities and calculates their reputation and ratings.

[1687] Output: Customer review data for each facility is generated.

[1688] Step 6:

[1689] Proposal and coordination

[1690] Input: Generated travel schedule and review rating data

[1691] Operation: The server presents the user with generated schedules and evaluation information, and proposes the optimal plan. Furthermore, if the user's emotions change during the trip, it provides new suggestions in real time.

[1692] Output: The optimized travel plan after adjustments is presented to the user's terminal.

[1693] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1694] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1695] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[1696] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1697] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[1698] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[1699] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[1700] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[1701] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[1702] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[1703] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[1704] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[1705] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[1706] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1707] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[1708] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[1709] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[1710] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[1711] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[1712] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[1713] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[1714] The following is further disclosed regarding the embodiments described above.

[1715] (Claim 1)

[1716] A means of receiving information from users regarding destinations, travel dates, budgets, and desired activities,

[1717] A means of gathering information on destinations, transportation, accommodations, and restaurants from the internet,

[1718] A means of analyzing the collected information and filtering it based on the user's preferences,

[1719] A means for generating a travel schedule based on filtered information,

[1720] A means of aggregating and evaluating the latest reviews of selected information,

[1721] A means of presenting the generated schedule and evaluation information to the user and proposing the optimal plan,

[1722] A system that includes this.

[1723] (Claim 2)

[1724] The system according to claim 1, comprising means for the user to finalize a travel plan.

[1725] (Claim 3)

[1726] The system according to claim 1, comprising means for creating an efficient sightseeing route and meal plan based on filtered information.

[1727] "Example 1"

[1728] (Claim 1)

[1729] A means of receiving information from users regarding destinations, travel dates, budgets, and desired activities,

[1730] A means of gathering information on destinations, transportation, accommodations, and restaurants from the internet,

[1731] A means of analyzing the collected information and filtering it based on the user's preferences,

[1732] A means for generating a travel schedule based on filtered information,

[1733] A means of aggregating and evaluating the latest reviews of selected information,

[1734] A means of presenting the generated schedule and evaluation information to the user and proposing the optimal plan,

[1735] A means of generating prompt sentences based on user input using an artificial intelligence model and performing data analysis based on those prompts,

[1736] A system that includes this.

[1737] (Claim 2)

[1738] The system according to claim 1, comprising means for the user to finalize a travel plan.

[1739] (Claim 3)

[1740] The system according to claim 1, comprising means for creating an efficient sightseeing route and meal plan based on filtered information.

[1741] "Application Example 1"

[1742] (Claim 1)

[1743] A means of receiving information from users regarding destinations, travel dates, budgets, and desired activities,

[1744] A means of gathering information on destinations, transportation, accommodations, and restaurants from the internet,

[1745] A means of analyzing the collected information and filtering it based on the user's preferences,

[1746] A means for generating a travel schedule based on filtered information,

[1747] A means of aggregating and evaluating the latest reviews of selected information,

[1748] A means of presenting the generated schedule and evaluation information to the user and proposing the optimal plan,

[1749] A means of displaying user reviews and navigation in real time,

[1750] A system that includes this.

[1751] (Claim 2)

[1752] The system according to claim 1, comprising means for the user to finalize a travel plan.

[1753] (Claim 3)

[1754] The system according to claim 1, comprising means for creating an efficient sightseeing route and meal plan based on filtered information.

[1755] "Example 2 of combining an emotion engine"

[1756] (Claim 1)

[1757] A means of receiving information from users regarding destinations, travel dates, budgets, and desired activities,

[1758] A means of gathering information on destinations, transportation, accommodations, and restaurants from the internet,

[1759] A means of analyzing the collected information and filtering it based on the user's preferences,

[1760] A means of analyzing user emotional information using an emotion analysis engine,

[1761] Means for generating a travel schedule based on filtered information and emotional information,

[1762] A means of aggregating and evaluating the latest reviews of selected information,

[1763] A means of presenting the generated schedule and evaluation information to the user and proposing the optimal plan,

[1764] A system that includes this.

[1765] (Claim 2)

[1766] The system according to claim 1, comprising means for the user to finalize a travel plan.

[1767] (Claim 3)

[1768] The system according to claim 1, comprising means for creating an efficient sightseeing route and meal plan based on filtered information and user sentiment information.

[1769] "Application example 2 when combining with an emotional engine"

[1770] (Claim 1)

[1771] A means of receiving destination, travel itinerary, budget, desired activity information, and sentiment data from users,

[1772] A means of collecting information on destinations, transportation, accommodations, restaurants, and related reviews from the internet,

[1773] A means of analyzing the collected information and filtering it based on user preferences and sentiment data,

[1774] A means for generating travel schedules based on filtered information and sentiment data, and for creating efficient sightseeing routes and meal plans,

[1775] A means of aggregating and evaluating the latest reviews of selected information,

[1776] A means of presenting the generated schedule and evaluation information to the user and proposing the optimal plan,

[1777] A system that includes this.

[1778] (Claim 2)

[1779] The system according to claim 1, comprising means for the user to finalize a travel plan.

[1780] (Claim 3)

[1781] The system according to claim 1, comprising means for adjusting a travel plan in real time according to the user's emotional data. [Explanation of symbols]

[1782] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means of receiving information from users regarding destinations, travel dates, budgets, and desired activities, A means of gathering information on destinations, transportation, accommodations, and restaurants from the internet, A means of analyzing the collected information and filtering it based on the user's preferences, A means for generating a travel schedule based on filtered information, A means of aggregating and evaluating the latest reviews of selected information, A means of presenting the generated schedule and evaluation information to the user and proposing the optimal plan, A system that includes this.

2. The system according to claim 1, comprising means for the user to finalize a travel plan.

3. The system according to claim 1, comprising means for creating an efficient sightseeing route and meal plan based on filtered information.

Images