System

Abstract

A system is provided.SOLUTION: A system comprising: means for receiving a travel search condition from a user and extracting data such as a corresponding sightseeing spot, accommodation, and transportation from a database; means for arranging the corresponding data in a ranking form and transmitting the data to a user terminal; means for storing an item selected by the user and generating a bookmark; means for calculating detailed information such as travel time, transportation, and total cost based on the bookmark information; and means for displaying the bookmark information and the detailed information to the user.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Existing travel planning methods require users to search for information about their destinations on multiple platforms, which is time-consuming and laborious. It's particularly difficult to obtain information about tourist attractions, accommodations, and transportation options all in one place and efficiently plan your trip. Other issues include users being unable to obtain the information they need in real time while traveling, and post-trip feedback not being utilized to improve the quality of their travel plans. [Means for solving the problem]

[0005] The present invention provides a system including: means for receiving travel search criteria from a user and extracting data on relevant tourist spots, accommodations, transportation options, etc. from a database; means for ranking the relevant data and sending it to the user's terminal; means for saving the user's selected items and generating a bookmark; means for calculating detailed information such as the required travel time, transportation options, and total cost based on the bookmark information; and means for displaying the bookmark information and detailed information to the user. The system further includes means for providing navigation functions from the current location to the next destination based on the bookmark information, and means for monitoring changes in traffic and weather conditions in real time and notifying the user's terminal of emergency information. The system also provides means for receiving user feedback and ratings, storing them in a database, and utilizing them to improve the quality of future search results. This allows users to efficiently plan their trips and obtain necessary information in real time. Furthermore, the system can incorporate user feedback to improve the quality of future travel plans.

[0006] "User" means an individual or organization that uses the system to make travel plans or search for tourist information.

[0007] "Search conditions" are information input by the user regarding the travel destination and travel contents, such as location, budget, and schedule.

[0008] "Tourist attractions" are famous places and landmarks that are the focus of tourism in a travel destination.

[0009] "Accommodation" refers to facilities such as hotels, inns, and private lodgings where people can stay during their trip.

[0010] "Transportation" refers to the means of transportation used during a trip, including trains, buses, taxis, rental cars, etc.

[0011] A "database" is an electronic data storage system in which relevant information about tourist attractions, accommodations, transportation options, etc. is accumulated and managed.

[0012] A "query" is a search command for extracting specific information from a database.

[0013] A "bookmark" is a travel planner that compiles information on tourist spots, accommodations, and transportation options selected by the user.

[0014] "Ranking format" is a format in which data is ranked based on specified criteria and displayed in an organized manner that is easy for users to view.

[0015] The "navigation function" is a function that presents the optimal route from the user's current location to their destination.

[0016] "Real-time notification" is a function that notifies users of changes in traffic information and weather conditions in real time.

[0017] "Ratings" refer to the scores and comments that users give to tourist attractions and accommodations at their travel destinations.

[0018] "Feedback" refers to opinions and impressions collected from users, and is information used to improve the system and increase data accuracy. [Brief explanation of the drawings]

[0019] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0020] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0021] First, the terms used in the following description will be explained.

[0022] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0023] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0024] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0025] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0026] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0027] [First embodiment]

[0028] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0029] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0030] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0031] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0032] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0033] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0034] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0035] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0036] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0037] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0038] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0039] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0040] The present invention provides a system that allows users to efficiently plan their trips. This system allows users to search for travel destination information in bulk, display it in a ranking format, and easily create travel plans. It also provides information in real time and collects feedback after the trip.

[0041] Program processing flow

[0042] 1. Initial settings and data integration

[0043] server

[0044] The server sends requests to various APIs to obtain tourist information, accommodation data, and transportation data.

[0045] For example, a tourist information API can be used to retrieve information about tourist attractions in a specific area and store it in a database, including the spot name, location, rating, and photos.

[0046] 2. Search function based on user requests

[0047] Terminal

[0048] The terminal allows the user to input search criteria (e.g., location, budget, dates, etc.) for tourist spots and accommodations through a user interface.

[0049] For example, if a user enters conditions such as "Kyoto," "3 days," "budget 50,000 yen," and "tourist category: temples," the device will send this to the server.

[0050] server

[0051] The server creates a query in the database based on the received search criteria and extracts the relevant data.

[0052] The extracted data is ranked based on user ratings and popularity and sent to the device.

[0053] 3. Creating and managing travel plans

[0054] Terminal

[0055] The terminal displays the search results received from the server in a list format.

[0056] It provides users with the ability to select items of interest and add them to their bookmarks.

[0057] User

[0058] For example, a user selects "Kinkaku-ji Temple" and "Kiyomizu-dera Temple" from the search results and adds them to the bookmarks.

[0059] server

[0060] The server stores the information added to the bookmark in a database and calculates details such as the required travel time, transportation means, and total cost.

[0061] The calculated details are sent to the terminal, which displays them to the user.

[0062] 4. Travel support

[0063] Terminal

[0064] The device provides navigation from the current location to the next destination based on the bookmark information.

[0065] Uses the GPS function to obtain your current location and display the optimal route to your destination.

[0066] server

[0067] The server monitors traffic information and changes in weather conditions in real time, and if an abnormality occurs, it sends the information to the device via push notification.

[0068] Terminal

[0069] For example, if there is information about a public transport delay, the device will notify the user of that information and suggest an appropriate detour route.

[0070] 5. After-sales feedback

[0071] Terminal

[0072] The terminal provides an interface to collect feedback and ratings from users after the trip is completed.

[0073] User

[0074] Users enter ratings and comments about each spot and accommodation.

[0075] server

[0076] The server stores the received ratings and comments in a database and uses them to improve the quality of search results the next time.

[0077] For example, based on user ratings, the next time the app displays more highly rated spots and facilities.

[0078] In this way, users can efficiently plan their trips, obtain necessary information in real time, and incorporate post-trip feedback, improving the user experience and encouraging long-term usage.

[0079] The processing flow will be explained below.

[0080] Program processing flow

[0081] 1. Initial settings and data integration

[0082] Step 1:

[0083] The server sends requests to various APIs to obtain tourist information, accommodation data, and transportation data.

[0084] Step 2:

[0085] The server stores the acquired data in a database, including tourist spot names, locations, ratings, photos, etc.

[0086] Step 3:

[0087] The server periodically calls the API to update the database with new data and updates.

[0088] 2. Search function based on user requests

[0089] Step 4:

[0090] The terminal allows the user to input search criteria (e.g., location, budget, dates, etc.) for tourist spots and accommodations through a user interface.

[0091] Step 5:

[0092] When a user enters search criteria and presses the search button, the terminal sends the criteria to the server.

[0093] Step 6:

[0094] The server generates a query to the database based on the received search criteria.

[0095] Step 7:

[0096] The server executes the query and extracts relevant tourist attraction and accommodation entries.

[0097] Step 8:

[0098] The server ranks the extracted entries based on popularity and ratings.

[0099] Step 9:

[0100] The server transmits the ranked search results to the terminal.

[0101] Step 10:

[0102] The terminal displays the search results received from the server to the user, who then selects a spot of interest from the displayed list.

[0103] 3. Creating and managing travel plans

[0104] Step 11:

[0105] Users can add selected items from the search results to their bookmarks.

[0106] Step 12:

[0107] The terminal transmits the information added to the bookmark to the server.

[0108] Step 13:

[0109] The server stores the information added to the bookmark in a database.

[0110] Step 14:

[0111] The server calculates detailed information such as the required travel time, transportation method, and total cost based on the bookmark information.

[0112] Step 15:

[0113] The server sends the calculated details to the terminal.

[0114] Step 16:

[0115] The device displays the bookmark information and calculated details to the user.

[0116] 4. Travel support

[0117] Step 17:

[0118] The user's device provides navigation from the current location to the next destination based on the bookmark information.

[0119] Step 18:

[0120] Uses the device's GPS function to obtain your current location and display the optimal route to your destination.

[0121] Step 19:

[0122] The server monitors traffic information and changes in weather conditions in real time.

[0123] Step 20:

[0124] If an abnormality occurs, the server sends the information to the device via push notification.

[0125] Step 21:

[0126] The device notifies the user of the emergency information received from the server and prompts them to take appropriate action.

[0127] 5. After-sales feedback

[0128] Step 22:

[0129] The terminal provides an interface to collect feedback and ratings from users after the trip is completed.

[0130] Step 23:

[0131] Users enter ratings and comments about each tourist spot and accommodation.

[0132] Step 24:

[0133] The terminal transmits the collected ratings and comments to the server.

[0134] Step 25:

[0135] The server stores the received ratings and comments in a database.

[0136] Step 26:

[0137] The server uses the stored feedback to adjust the algorithm it uses to improve the quality of search results next time.

[0138] Example 1

[0139] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0140] When planning a trip, users must individually research information on numerous tourist spots, accommodations, and transportation options, which is time-consuming and laborious. It is also difficult to provide real-time information and effectively utilize post-trip feedback. These issues need to be resolved.

[0141] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0142] In this invention, the server includes means for receiving travel search conditions from a user and extracting data such as relevant location information, accommodation information, and transportation information from a database, means for sorting the relevant data in order of priority and sending it to the user terminal, means for saving the items selected by the user and generating a travel plan, means for calculating detailed information such as the required travel time, transportation means, and total cost based on the travel plan information, and means for displaying the travel plan information and detailed information to the user. This enables users to efficiently plan their travels, makes it easier to obtain necessary information in real time, and effectively utilizes feedback after the trip.

[0143] "Travel search conditions" refer to detailed information such as the user's desired travel destination, duration, budget, and category of visits.

[0144] "Location information" refers to information about tourist attractions, famous places, and facilities, including their locations, addresses, ratings, and photos.

[0145] "Accommodation information" refers to information about accommodation facilities such as hotels, inns, and guesthouses, including room types, prices, ratings, and locations.

[0146] "Transportation information" refers to information about means of transportation such as trains, buses, taxis, rental cars, and airplanes.

[0147] A "database" refers to a structured collection of information that allows a system to store and retrieve information.

[0148] "Sort by highest priority" refers to sorting search results based on user ratings, popularity, etc.

[0149] "User terminal" refers to a device such as a computer, smartphone, or tablet that a user uses to enter information and receive results.

[0150] "Travel Plan" means a schedule or itinerary created based on the attractions, accommodations and transportation selected by the User.

[0151] "Travel time" refers to the time it takes to get from one point to another.

[0152] "Total Cost" refers to the total amount of all charges incurred during the trip.

[0153] "Route guidance function" refers to a function that provides the optimal route from the current location to the next destination.

[0154] "Traffic conditions" refers to information regarding the operation status and congestion of roads and public transportation.

[0155] "Weather conditions" refers to current weather information such as weather, temperature, and precipitation.

[0156] "Emergency information" refers to information of a high degree of urgency, such as traffic delays or weather-related crises.

[0157] "Feedback" refers to ratings, comments and opinions about travel destinations and accommodations provided by Users.

[0158] The present invention relates to a system that enables users to efficiently plan their travels. The system helps users easily search for information about travel destinations and effectively create travel plans. Specific functions included in the present invention include search, planning, navigation, real-time information provision, and feedback collection.

[0159] Hardware and Software

[0160] The main components of the system are the server, terminal (user device), and database. The server processes large amounts of data and sends requests to the API, so a high-performance cloud computing environment (e.g., Amazon Web Services or Google Cloud Platform) is used. The terminal is the device operated by the user, such as a smartphone, tablet, or PC. The software consists of a front end (user interface) and a back end (data processing and API integration), with React Native or Flutter used for the front end and Node.js or Python for the back end.

[0161] Data processing and calculation

[0162] 1. Initial settings and data integration

[0163] The server sends requests to various APIs to obtain tourist information, accommodation data, and transportation data. For example, a tourist information API is used to obtain information about tourist attractions in a specific area and store it in a database.

[0164] 2. Search function based on user requests

[0165] The device allows users to input search criteria for tourist attractions and accommodations through a user interface. This information is sent from the device to a server, which then queries a database to extract relevant data and sends the results back to the device.

[0166] 3. Creating and managing travel plans

[0167] The terminal displays the search results received from the server in a list format and provides a function to add the items selected by the user to a bookmark. The server calculates details such as travel time, transportation means, and total cost based on the information added to the bookmark, and sends them to the terminal for display to the user.

[0168] 4. Travel support

[0169] The device provides navigation from the current location to the next destination based on the bookmark information. It uses the GPS function to obtain the current location and displays the optimal route using the Google Maps API. The server monitors changes in traffic and weather conditions in real time, and if any abnormalities occur, it sends a push notification to the device.

[0170] 5. After-sales feedback

[0171] The device provides an interface to collect user feedback and ratings after the trip. Users enter their ratings for each spot and accommodation, and the data is sent to a server and stored in a database. This information is used to improve the quality of search results for future trips.

[0172] Examples and prompts

[0173] For example, a user launches the app on their smartphone and enters the following criteria: "Kyoto," "3 days," "budget of 50,000 yen," and "temple." Based on this, the server searches the database and returns suitable tourist spots and accommodations to the device. A list of results is displayed, and the user selects "Kinkaku-ji Temple" and "Kiyomizu-dera Temple" and adds them to their bookmarks. During the trip, the smartphone uses GPS to obtain the user's current location and navigates to the next destination. After the trip, the app prompts the user to enter feedback, and the user enters a rating for each spot.

[0174] Example prompt sentence:

[0175] 1. Initial setup: The system uses the API required to search for tourist spots based on the conditions "Kyoto," "3 days," "budget of 50,000 yen," and "tourism category: temples," and retrieves the data and stores it in a database.

[0176] 2. Search: Search for tourist spots using criteria such as, "I'm planning a three-day trip to Kyoto. My budget is 50,000 yen and I want to visit temples."

[0177] 3. Travel Plan: Create a travel plan by typing, "I want to visit Kinkakuji Temple and Kiyomizudera Temple. Add this to my bookmarks."

[0178] 4. Navigation: Ask, "What is the best route from my current location to Kinkakuji Temple?"

[0179] 5. Feedback: "Please rate Kinkaku-ji Temple. Add your comments."

[0180] As described above, this system provides users with a series of processes to efficiently plan their trips, and also allows them to obtain necessary information in real time, as well as effectively collect and utilize post-trip feedback.

[0181] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0182] Step 1:

[0183] Initial settings and data integration

[0184] The server sends requests to various APIs to obtain tourist information, accommodation data, and transportation data. Specifically, it creates API requests in JSON format and sends them to each information provider site. The input is the API request URL and authentication information, and the output is a JSON response containing tourist attraction information, accommodation data, and transportation data. The received data is parsed on the server side and inserted into a database. This process is executed by an automated scheduler, for example, at 2:00 AM every day.

[0185] Step 2:

[0186] Search function based on user requests

[0187] Terminal processing:

[0188] The device allows the user to input search criteria for tourist spots and accommodations through a user interface. Specifically, the user enters criteria such as "Kyoto," "3 days," "budget of 50,000 yen," and "temple" into the search form and clicks the "Search" button. The input is the search criteria entered by the user, and the output is an API request to the server. The device converts the search criteria into JSON format and sends it to the server.

[0189] Server-side processing:

[0190] The server executes SQL queries on the database based on the received search criteria and extracts data on relevant tourist attractions and accommodations. The input is JSON data of the search criteria sent by the user, and the output is a dataset extracted based on the relevant criteria. The extracted data is sorted in a ranking format based on user ratings and popularity, and is sent back to the device in JSON format.

[0191] Step 3:

[0192] Create and manage your travel plans

[0193] Terminal processing:

[0194] The terminal displays the search results received from the server in list format. The input is the JSON data of the search results sent from the server, and the output is the list-format search results displayed on the user interface. Specifically, when the user views the detailed information of each spot and clicks the "Add to bookmarks" button, the information is added to the bookmarks.

[0195] Server-side processing:

[0196] The server calculates details such as travel time, transportation method, and total cost based on the information added to the bookmark, and sends them to the device. Specifically, it uses the Google Maps API to calculate travel time between each spot, and calculates the total cost by adding up the entrance fees and accommodation costs of the spots. The input is the data of the spots and accommodations added to the bookmark, and the output is JSON data containing the calculated details. These details are displayed to the user on the device.

[0197] Step 4:

[0198] Travel support

[0199] Terminal processing:

[0200] The device provides navigation from the current location to the next destination based on the bookmark information. It obtains the current location using the GPS function and sends a request to the Google Maps API to display the optimal route. The input is the GPS information of the current location and the data of the next destination, and the output is the optimal route obtained from the Google Maps API.

[0201] Server-side processing:

[0202] The server monitors fluctuations in traffic and weather conditions in real time, and if an abnormality occurs, it sends that information to the device via push notification. Specifically, it checks the transport API and weather information API at regular intervals, and if an abnormality is detected, it promptly sends a push notification. The input is the response data of the traffic and weather information API, and the output is the data used to send the push notification.

[0203] Step 5:

[0204] After-sales feedback

[0205] Terminal processing:

[0206] The terminal provides an interface to collect feedback and ratings from users after the trip. Specifically, a pop-up is automatically displayed after the trip ends, prompting the user to "Please provide feedback on this trip." The input is the rating and comments entered by the user, and the output is the feedback data sent to the server.

[0207] Server-side processing:

[0208] The server stores the received ratings and comments in a database and uses them to improve the quality of the next search results. Specifically, it analyzes the rating data and updates the ranking of each spot in real time based on the rating points. The input is the user's ratings and comments, and the output is the updated rating data.

[0209] (Application example 1)

[0210] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0211] Conventional travel planning systems require users to collect and analyze information themselves, which requires time and effort to create a trip plan. Furthermore, they lack real-time travel support and post-trip feedback, making it difficult to improve the user's travel experience. Furthermore, there is a lack of systems that allow users to efficiently create trip plans in virtual stores, so there is a need to improve the user experience.

[0212] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0213] In this invention, the server includes means for receiving travel search criteria from a user and extracting data on relevant tourist attractions, accommodations, transportation, etc. from a database, means for ranking the relevant data and sending it to the user's terminal, means for saving the items selected by the user and generating a bookmark, means for calculating detailed information such as the required travel time, transportation, and total cost based on the bookmark information, means for displaying the bookmark information and detailed information to the user, means for collecting and saving feedback from the user and using it to improve the quality of future search results, and means for providing a virtual guide application, thereby enabling users to efficiently plan their trips, obtain necessary information in real time, and incorporate post-trip feedback.

[0214] "Travel search conditions from users" are various requirements and desired information entered by users in order to extract relevant information from databases of tourist attractions, accommodations, transportation options, etc.

[0215] "Relevant data" refers to information on tourist attractions, accommodation, transportation, etc. extracted from the database based on the user's travel search criteria.

[0216] "Ranking" is a method of ranking extracted data based on user ratings and popularity and displaying it in list format.

[0217] "Means for transmitting to user terminal" refers to the function by which the server transmits the aligned data to the device used by the user via communication.

[0218] "User-selected items" are attractions and accommodations that a user has selected from the provided list as being of interest to them and to add to their travel plans.

[0219] "Means for generating bookmarks" is a function that creates a list (bookmark) that summarizes the details of a travel plan based on the items selected by the user.

[0220] "Travel time, transportation mode, and total cost" are factors used to calculate the travel time, transportation mode, and total cost of the trip based on the user's travel plans.

[0221] "Bookmark information and detailed information" refers to the items selected by the user as part of the travel plan, as well as specific detailed information about those items, such as travel time, transportation means, and total cost.

[0222] "User feedback" refers to ratings and comments on tourist spots and accommodations provided by users after their trip.

[0223] A "virtual guide application" is application software that allows users to use functions such as travel planning, real-time navigation, and feedback collection through smart devices.

[0224] A "generative AI model" is an artificial intelligence system that uses machine learning algorithms to optimize tourist spot rankings and travel plans based on user search criteria.

[0225] A "prompt" is an instruction or search keyword that enables a generative AI model to derive appropriate results based on user input.

[0226] The embodiment of the present invention is a system that provides a virtual guide application for efficiently planning a trip. The main components of the system and their specific functions will be described below.

[0227] System Components

[0228] 1. Server

[0229] Data extraction function: The server sends requests to various APIs to obtain tourist information, accommodation data, and transportation data. For example, a tourist information API is used to obtain information about tourist attractions in a specific area and store it in a database. This information includes the spot name, location, rating, photos, etc.

[0230] Search and ranking function: The server creates a query in the database based on the travel search criteria received from the user, extracts the relevant data, sorts the extracted data in a ranking format based on user ratings and popularity, and sends it to the user's device.

[0231] Calculation and display function: The server adds the user's selected items to the bookmarks and calculates detailed information such as the required travel time, transportation means, total cost, etc. The calculated detailed information is sent to the user's terminal, which then displays it to the user.

[0232] Feedback collection function: The server receives feedback and ratings from users, stores them in a database, and uses them to improve the quality of search results next time.

[0233] 2. User Device

[0234] Interface function: The device allows the user to input search criteria for tourist spots and accommodations through the user interface. For example, if the user inputs criteria such as "Kyoto," "3 days," "budget 50,000 yen," and "tourism category: temples," the device sends this to the server.

[0235] Navigation function: Provides navigation from the current location to the next destination based on bookmark information. Uses GPS to obtain the current location and displays the optimal route to the destination.

[0236] Real-time information provision function: When traffic information or changes in weather conditions are sent from the server in real time, the device will provide that information to the user via push notification and suggest appropriate detour routes.

[0237] 3. Users

[0238] Entering search criteria: Users enter their travel criteria (e.g., location, budget, dates, etc.) through the interface.

[0239] Selection from a list: The search results received from the server are displayed in a list format, and the user can select tourist attractions and accommodations that interest them and add them to their bookmarks.

[0240] Providing feedback: After completing a trip, users can leave ratings and comments about each attraction and accommodation.

[0241] Hardware and software used

[0242] Hardware: User devices such as smartphones and smart glasses, and cloud servers

[0243] Software: Flask, requests library, GPS function

[0244] Specific examples

[0245] Assume that User A is planning a three-day trip to Kyoto. Their budget is 50,000 yen, and they are interested in "temples." When User A enters their search criteria into the app, the app retrieves information about Kyoto's temples from a tourist information API. The app displays a ranking of the top spots (e.g., "Kinkaku-ji Temple" and "Kiyomizu-dera Temple") based on user ratings. User A selects "Kinkaku-ji Temple" and "Kiyomizu-dera Temple" and adds them to their bookmarks. The app calculates the total cost and travel time required, and displays these to the user. The app also navigates User A during the trip, providing real-time information such as traffic delays. After the trip is over, User A leaves ratings and comments on tourist spots and accommodations through the app.

[0246] Prompt Sentence Examples

[0247] "I'm planning a three-day trip to Kyoto. My budget is 50,000 yen, and I'm interested in temples. Please suggest an app that will help me search for tourist spots, display rankings, and help me create a trip plan. I'd also like navigation and real-time information during my trip, and collect feedback after my trip."

[0248] As described above, by using this system, users can efficiently plan their trips, obtain necessary information in real time, and incorporate feedback after the trip.

[0249] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0250] Step 1:

[0251] Description: User enters travel search criteria, including, for example, location, budget, dates, and category of sightseeing (e.g., temples).

[0252] Specific operation: The user enters conditions such as "Kyoto," "3 days," "budget 50,000 yen," and "tourist category: temples" through an application on a smartphone or smart glasses.

[0253] Input: User's travel criteria (location, budget, dates, category).

[0254] Output: The entered travel conditions are saved on the terminal and sent to the server.

[0255] Step 2:

[0256] Description: The server queries a database based on the received travel search criteria to extract relevant attraction, accommodation, and transportation data.

[0257] Specific operation: Uses the tourist information API to obtain tourist spot information for a specific area (e.g., Kyoto) and save it in a database.

[0258] Input: User's travel requirements.

[0259] Output: Data on relevant attractions, accommodation and transportation options.

[0260] Step 3:

[0261] Description: The server sorts the extracted data into a ranking format based on user ratings and popularity, and sends it to the user's device.

[0262] Specific operation: The data obtained from the API is sorted by user rating and then ranked. The ranking results are then sent to the user's device.

[0263] Input: Extracted tourist attraction, accommodation, and transportation data.

[0264] Output: Data sorted into ranking format.

[0265] Step 4:

[0266] Description: The user can view the search results received from the server in a list format, select items of interest and add them to their bookmarks.

[0267] Specific operation: Select an item of interest such as "Kinkaku-ji Temple" or "Kiyomizu-dera Temple" from the list of tourist spots and accommodations displayed on the device and add it to your bookmarks.

[0268] Input: Data sorted into ranking format.

[0269] Output: A list of attractions and accommodations selected by the user.

[0270] Step 5:

[0271] Description: The server calculates details such as travel time, transportation means, and total cost based on the information added to the bookmark.

[0272] Specific operation: Based on the tourist attractions and accommodations added to the bookmarks, the travel route is calculated, and the means of transportation to be used, their costs, and total travel time are calculated.

[0273] Input: Information about attractions and accommodations added to bookmarks.

[0274] Output: Detailed information such as required travel time, transportation mode, and total cost.

[0275] Step 6:

[0276] Description: The server sends the calculated details to the user terminal, which displays them to the user.

[0277] Specific operation: Send detailed information to the user terminal, and the terminal displays the information through the user interface.

[0278] Input: Details such as required travel time, mode of transportation, and total cost.

[0279] Output: Detailed information about the trip plan displayed on the user's device.

[0280] Step 7:

[0281] Description: During the trip, the device provides navigation based on bookmark information and receives real-time information from the server to notify the user.

[0282] Specific operation: Uses GPS to obtain current location and displays the optimal route to the next destination. If there is a public transport delay, the user will be notified via push notification and an alternative route will be suggested.

[0283] Input: Bookmark information, real-time traffic information.

[0284] Output: Navigation instructions, emergency push notifications, and alternative route suggestions.

[0285] Step 8:

[0286] Description: After completing a trip, users enter their feedback and ratings, which are collected by the server and stored in a database.

[0287] What it does: Users enter ratings and comments for attractions and accommodations, and the server stores that information in a database. It uses this information to improve search results the next time.

[0288] Input: User feedback and ratings.

[0289] Output: Feedback information stored in a database.

[0290] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0291] The present invention provides a system that allows users to efficiently plan their trips. This system incorporates an emotion engine that recognizes the user's emotions and reflects them in suggesting travel destinations and customizing the plan. Specific program processing of the system and its implementation are described below.

[0292] Program processing flow

[0293] 1. Initial settings and data integration

[0294] server

[0295] The server sends requests to various APIs to obtain tourist information, accommodation data, and transportation data.

[0296] The acquired data is stored in a database, including tourist spot names, locations, ratings, photos, etc.

[0297] 2. Search function based on user requests

[0298] Terminal

[0299] The terminal allows the user to input search criteria (e.g., location, budget, dates, etc.) for tourist spots and accommodations through a user interface.

[0300] When a user enters search criteria and presses the search button, the terminal sends the criteria to the server.

[0301] server

[0302] The server generates a query to the database based on the received search criteria.

[0303] Run the query to extract relevant attraction and accommodation entries.

[0304] The extracted entries are ranked based on user ratings and popularity.

[0305] Send ranked search results to your device.

[0306] Terminal

[0307] The terminal displays the search results received from the server to the user, who then selects a spot of interest from the displayed list.

[0308] 3. Utilizing the Emotion Engine

[0309] Terminal

[0310] When users enter travel search criteria, they also enter their emotions at the time (for example, through text input or facial expression recognition).

[0311] The terminal transmits the input emotion data to the emotion engine.

[0312] server

[0313] The server's emotion engine analyzes the received emotion data and recommends tourist spots and activities accordingly.

[0314] For example, if a user inputs the emotion "I want to relax," relaxation facilities and quiet tourist spots will be displayed preferentially.

[0315] 4. Creating and managing travel plans

[0316] Terminal

[0317] Users can add selected items from the search results to their bookmarks.

[0318] The terminal transmits the information added to the bookmark and the emotion data to the server.

[0319] server

[0320] The server stores the information added to the bookmark in a database and calculates details such as the required travel time, transportation means, and total cost.

[0321] The calculated details are sent to the terminal, which displays them to the user.

[0322] It provides customized suggestions by taking into account the bookmark content as well as the user's past ratings and sentiment data.

[0323] 5. Travel support

[0324] Terminal

[0325] The device provides navigation from the current location to the next destination based on the bookmark information.

[0326] Uses the GPS function to obtain your current location and display the optimal route to your destination.

[0327] server

[0328] It monitors changes in traffic information and weather conditions in real time, and if an abnormality occurs, the information is sent to the device via push notification.

[0329] The device notifies the user of the emergency information received from the server and prompts them to take appropriate action.

[0330] 6. After-sales feedback

[0331] Terminal

[0332] Provide an interface to collect user feedback and ratings after the trip is completed.

[0333] User

[0334] Enter your ratings and comments about each tourist attraction and accommodation.

[0335] server

[0336] The collected ratings and comments are stored in a database and used to improve the quality of search results next time.

[0337] Specific examples

[0338] For example, if a user selects "Kyoto" as a travel destination and enters emotions such as "relaxation" or "a desire to experience nature" as search criteria, the emotion engine will analyze these emotions and prioritize suggestions such as the bamboo forest path or the tranquil temples of Ohara. Furthermore, if a user frequently records the emotion "fun" during their trip, that emotional data will be used to suggest more activities and entertainment facilities for the next trip.

[0339] In this way, by utilizing the emotion engine, it is possible to provide optimal travel plans based on the user's emotions. It is also possible to further personalize the next proposal based on feedback during and after the trip.

[0340] The processing flow will be explained below.

[0341] Program processing flow

[0342] 1. Initial settings and data integration

[0343] Step 1:

[0344] The server sends requests to various APIs to obtain tourist information, accommodation data, and transportation data.

[0345] Step 2:

[0346] The server stores the acquired data in a database by category, including tourist spot names, locations, ratings, photos, etc.

[0347] Step 3:

[0348] The server periodically calls the API to update the database with new data and updates.

[0349] 2. Search function based on user requests

[0350] Step 4:

[0351] The terminal allows the user to input search criteria (e.g., location, budget, dates, etc.) for tourist spots and accommodations through a user interface.

[0352] Step 5:

[0353] When a user enters search criteria and presses the search button, the terminal sends the criteria to the server.

[0354] Step 6:

[0355] The server generates a query to the database based on the received search criteria.

[0356] Step 7:

[0357] The server executes the query and extracts relevant tourist attraction and accommodation entries.

[0358] Step 8:

[0359] The server ranks the extracted entries based on popularity and ratings.

[0360] Step 9:

[0361] The server transmits the ranked search results to the terminal.

[0362] Step 10:

[0363] The terminal displays the search results received from the server to the user, who then selects a spot of interest from the displayed list.

[0364] 3. Utilizing the Emotion Engine

[0365] Step 11:

[0366] When users enter search criteria, the device also prompts them to enter their emotional data, which is acquired through text input and real-time facial recognition.

[0367] Step 12:

[0368] The terminal transmits the input emotion data to the emotion engine of the server.

[0369] Step 13:

[0370] The server's emotion engine analyzes the received emotion data and recommends tourist spots and activities accordingly.

[0371] Step 14:

[0372] The server then sends the results of its recommendations for the most suitable tourist spots and activities to the user based on the emotion engine to the terminal.

[0373] 4. Creating and managing travel plans

[0374] Step 15:

[0375] Users can add selected items from the search results to their bookmarks.

[0376] Step 16:

[0377] The terminal transmits the information added to the bookmark to the server.

[0378] Step 17:

[0379] The server stores the information added to the bookmark in a database and calculates details such as the required travel time, transportation means, and total cost.

[0380] Step 18:

[0381] The server sends the calculated details to the terminal, which displays them to the user.

[0382] Step 19:

[0383] The server takes into account the bookmark content as well as the user's past ratings and sentiment data to provide customized suggestions.

[0384] 5. Travel support

[0385] Step 20:

[0386] The device provides navigation from the current location to the next destination based on the bookmark information.

[0387] Step 21:

[0388] Uses the device's GPS function to obtain your current location and display the optimal route to your destination.

[0389] Step 22:

[0390] The server monitors traffic information and changes in weather conditions in real time.

[0391] Step 23:

[0392] If an abnormality occurs, the server sends the information to the device via push notification.

[0393] Step 24:

[0394] The device notifies the user of the emergency information received from the server and prompts them to take appropriate action.

[0395] 6. After-sales feedback

[0396] Step 25:

[0397] The terminal provides an interface to collect feedback and ratings from users after the trip is completed.

[0398] Step 26:

[0399] Users enter ratings and comments about each tourist spot and accommodation.

[0400] Step 27:

[0401] The terminal transmits the collected ratings and comments to the server.

[0402] Step 28:

[0403] The server stores the received ratings and comments in a database.

[0404] Step 29:

[0405] The server uses the stored feedback to adjust the algorithm it uses to improve the quality of search results next time.

[0406] Specific examples

[0407] For example, if a user selects "Kyoto" as a travel destination and enters emotions such as "relaxation" or "a desire to experience nature" as search criteria, the emotion engine will analyze these emotions and prioritize suggestions such as the bamboo forest path or the tranquil temples of Ohara. Furthermore, if a user frequently records the emotion "fun" during their trip, that emotional data will be used to suggest more activities and entertainment facilities for the next trip.

[0408] In this way, by utilizing the emotion engine, it is possible to provide optimal travel plans based on the user's emotions, and further personalize the next suggestions based on feedback during and after the trip.

[0409] Example 2

[0410] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0411] Conventional travel planning systems lacked suggestions based on user emotions and intuition, making it difficult to provide optimal travel plans for individual users. They also lacked the functionality to respond to real-time traffic information and weather conditions. This resulted in problems that reduced user satisfaction and the quality of the travel experience.

[0412] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0413] In this invention, the server includes means for receiving travel search conditions from a user and extracting data on relevant tourist destinations, accommodations, means of transportation, etc. from a database, means for ranking the relevant data and sending it to the user terminal, means for saving the items selected by the user and generating a bookmark, means for calculating detailed information such as the required travel time, means of transportation, and total cost based on the bookmark information, means for displaying the bookmark information and detailed information to the user, and means for receiving user emotion data and making suggestions based on the emotion. This makes it possible to provide optimal travel plans based on the user's emotions and intuition, and to provide travel support based on real-time information.

[0414] "Receive travel search conditions from the user" refers to the operation in which the system collects information such as travel destination, budget, and schedule provided by the user.

[0415] "Data on tourist attractions, accommodation, transportation, etc." refers to specific information on tourist attractions, accommodation options, transportation, etc. related to travel.

[0416] "Extracting from a database" refers to the act of searching and retrieving relevant information from a database based on specific conditions.

[0417] "Ranking and sending to user's device" refers to sorting search results based on user ratings and popularity, and transferring the list to the user's device.

[0418] "Saving the items selected by the user and generating a bookmark" refers to the action of saving information such as the travel destination and accommodation selected by the user, and creating a document summarizing the travel plan based on that information.

[0419] "Calculating detailed information such as required travel time, transportation means, and total cost based on bookmark information" refers to the process of calculating travel time, transportation means to choose, and total travel costs based on information about tourist attractions and accommodations listed in the bookmark.

[0420] "Displaying bookmark information and detailed information to the user" refers to the action of presenting the calculated and organized details of the travel plan to the user in an easy-to-read format.

[0421] "Receive the user's emotional data and make suggestions based on the emotion" refers to the process of obtaining the emotional information entered by the user (e.g., wanting to relax, wanting to have fun, etc.) and recommending an appropriate travel plan based on that information.

[0422] "Providing a navigation function from the current location to the next destination based on bookmark information" refers to the operation of guiding the user on how to get from their current location to their destination by referring to the information contained in the bookmark.

[0423] "Monitoring changes in travel information and weather conditions in real time and notifying the user of emergency information" means constantly checking the latest travel status and weather information, and immediately contacting the user's device if any abnormalities occur.

[0424] "Receive user feedback and ratings, store them in a database, and use them to improve the quality of search results in the future" refers to the action of collecting reviews and ratings provided by users after their trip, storing them in a database to help improve search results in the future.

[0425] The present invention is a system that allows users to efficiently plan their trips. This system incorporates an emotion engine that recognizes the user's emotions and reflects them in suggesting travel destinations and customizing the plan. Specific program processing and embodiments of the system are described below.

[0426] Initial settings and data integration

[0427] server

[0428] The server sends requests to multiple external APIs (e.g., tourist destination information API and hotel reservation API) to obtain tourist information, accommodation data, and transportation data.

[0429] The acquired data includes tourist spot names, locations, ratings, photos, etc., and is stored in a database (e.g., a MySQL database).

[0430] Search function based on user requests

[0431] Terminal

[0432] Users use an interface to input search criteria such as travel destination, budget, dates, number of people, etc. For example, they can input criteria such as "I want to travel to Kyoto in March, with a budget of 50,000 yen or less."

[0433] server

[0434] The server creates a query to the database based on the received search criteria and extracts data on relevant tourist destinations and accommodations, for example, using a MySQL query.

[0435] The extracted data is sorted into a ranking format based on user ratings and popularity and sent to the device.

[0436] Terminal

[0437] The terminal displays the search results received from the server in a ranked format to the user, who can then select spots of interest from the list.

[0438] Utilizing the Emotion Engine

[0439] Terminal

[0440] When users enter their travel search criteria, they also input their emotions (e.g., "I want to relax") via text input and facial expression recognition.

[0441] server

[0442] The server's emotion engine analyzes the received emotion data and recommends tourist spots and activities according to that emotion. For example, if the user inputs "I want to relax," it will prioritize relaxation facilities and quiet tourist spots.

[0443] Create and manage your travel plans

[0444] Terminal

[0445] Users can add selected items from the search results to their "bookmarks," which are tentative schedules that summarize their travel plans.

[0446] server

[0447] The server stores the information added to the bookmark in a database and calculates travel time, transportation methods, and total costs as needed, for example using the Google Maps API to calculate travel time.

[0448] The calculation results are sent to the terminal and displayed to the user.

[0449] Travel support

[0450] Terminal

[0451] The device provides navigation from the current location to the next destination based on the bookmark information, using the GPS function to obtain the current location and display the optimal route.

[0452] server

[0453] Traffic information and changes in weather conditions are monitored in real time, and if any abnormalities occur, push notifications are sent to the device.

[0454] The device will notify the user of the received emergency information and prompt them to take appropriate action.

[0455] After-sales feedback

[0456] Terminal

[0457] After completing the trip, users have an interface to enter feedback and ratings.

[0458] User

[0459] Enter your ratings and comments about each tourist attraction and accommodation.

[0460] server

[0461] The collected ratings and comments are stored in a database and used to improve the quality of search results next time.

[0462] Specific examples

[0463] For example, if a user selects "Kyoto" as a travel destination and enters emotions such as "relaxation" or "a desire to experience nature" as search criteria, the emotion engine will analyze this emotion and prioritize suggestions for the bamboo forest path or the tranquil temples of Ohara. Also, if the user frequently records "fun" during their trip, that emotional data will be used to suggest more activities and entertainment facilities for their next trip.

[0464] Example prompts to input to the generative AI model

[0465] If I choose "Kyoto" as my travel destination and input emotions such as "relaxation" and "wanting to feel nature," what tourist spots would you recommend?

[0466] In this way, the system of the present invention aims to provide an optimal travel plan that takes into account the user's emotional data and improve user satisfaction.

[0467] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0468] Program processing flow and specific steps

[0469] Step 1: Initial setup and data integration

[0470] The server sends requests to multiple external APIs to obtain tourist information, accommodation data, and transportation data. For example, it can send requests to a tourist attraction information API or a hotel reservation API. Input: Data request from external API. Output: Tourist attraction information, accommodation list, transportation data. Specific operation: Obtain tourist attraction names, locations, photos, etc. and save them in a MySQL database.

[0471] Step 2: Search function based on user requests

[0472] The terminal displays an interface for the user to input search criteria such as travel destination, budget, dates, number of people, etc. For example, the user inputs criteria such as "I want to travel to Kyoto in March, with a budget of 50,000 yen or less." Input: Search criteria from the user. Output: List of searched tourist spots and accommodations. Specific operation: The entered search criteria are sent from the terminal to the server by pressing the search button.

[0473] Step 3: Creating and Executing a Database Query

[0474] The server creates a query to the database based on the received search criteria. For example, it creates a MySQL query to extract information on relevant tourist attractions and accommodations. Input: Search criteria. Output: List of search results. Specific operation: Executes a database query to obtain information on tourist attractions and accommodations.

[0475] Step 4: Sort and submit search results

[0476] The server sorts the extracted data into a ranking format based on user ratings and popularity, and sends it to the terminal. Input: Search result data. Output: Search results sorted in ranking format. Specific operation: Ranking is performed based on rating scores and number of reservations, and the sorted data is sent to the terminal.

[0477] Step 5: Viewing search results

[0478] The device displays the search results received from the server to the user, allowing the user to select spots of interest. For example, "Kiyomizu-dera Temple" or "Nijo Castle" are displayed. Input: Sorted search results. Output: List of tourist spots displayed to the user. Specific operation: Displayed in ranking format, allowing the user to check details.

[0479] Step 6: Enter and submit emotion data

[0480] The device provides an interface that allows users to input their emotions at the time they enter travel search criteria. For example, they can input emotions such as "I want to relax." Input: Emotional data from the user. Output: Emotional data sent to the server. Specific operations: The emotion input field is displayed, and the entered data is transferred to the server.

[0481] Step 7: Analyze sentiment data and make recommendations

[0482] The server uses an emotion engine to analyze the received emotion data and recommends tourist spots and activities accordingly. For example, if the emotion is "I want to relax," it will prioritize relaxation facilities and quiet tourist spots. Input: User emotion data. Output: Recommendation of tourist spots based on emotion. Specific operation: Analyzes the emotion data, generates an appropriate recommendation list, and sends it to the device.

[0483] Step 8: Add information to your bookmarks

[0484] The device adds the items the user selects from the search results to the "bookmarks." Input: Tourist attractions and accommodations selected by the user. Output: Updates the bookmark. Specific operations: Adds the selected information to the bookmarks and sends the contents to the server.

[0485] Step 9: Save and calculate bookmark information

[0486] The server saves the information added to the bookmark in a database and calculates the required travel time, transportation means, and total cost. For example, it calculates travel time using the Google Maps API. Input: Bookmark information. Output: Calculated travel time, transportation means, and total cost. Specific operation: Calculates travel time and transportation means options and displays them to the user.

[0487] Step 10: Navigate while traveling

[0488] The device provides navigation from the current location to the next destination based on the bookmark information. For example, it uses the GPS function to obtain the current location and uses Google Maps to present the optimal route. Input: Bookmarks and current location. Output: Navigation information. Specific operation: Obtaining the current location and displaying route guidance.

[0489] Step 11: Real-time information notification

[0490] The server monitors changes in traffic information and weather conditions in real time, and sends push notifications to the device if any abnormalities occur. Input: Real-time information. Output: Emergency information notification. Specific operation: Monitors changes in traffic information and weather, and sends alerts as necessary.

[0491] Step 12: Gathering after-sales feedback

[0492] The device provides an interface to collect feedback and ratings from users after the trip. Input: User ratings and feedback. Output: Saving of rating data. Specific operation: The ratings entered by the user are sent to the server and stored in a database. They are used to make suggestions for the next trip.

[0493] (Application example 2)

[0494] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0495] Conventional travel planning systems do not provide a way for users to select destinations, accommodations, restaurants, etc. based on their emotions or moods. This makes it difficult for users to select appropriate destinations and services that match their emotions at the time, resulting in lower trip satisfaction. Furthermore, meal suggestions during a trip do not reflect the user's emotions and are time-consuming and cumbersome.

[0496] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving travel search conditions from a user and extracting data on relevant tourist spots, accommodations, transportation methods, etc. from a database; means for ranking the relevant data and sending it to the user terminal; means for saving the items selected by the user and generating a bookmark; means for calculating detailed information such as the required travel time, transportation method, and total cost based on the bookmark information; means for displaying the bookmark information and detailed information to the user; means for inputting user emotion data, analyzing the data, and recommending relevant tourist spots and accommodations based on the analysis results in accordance with the user's emotion; means for recommending restaurants and dishes based on the emotion data; and means for adjusting the recommended restaurants and dishes based on the user's emotion data. This allows the user to receive optimal travel plans and meal suggestions tailored to their emotions and mood.

[0497] "Travel search conditions" are information that indicates the user's criteria and preferences for tourist spots, accommodations, transportation, etc. related to the trip.

[0498] "Tourist attractions" are places and facilities that tourists visit for sightseeing and experiences.

[0499] "Accommodation facilities" are facilities for travelers to stay temporarily, and include hotels, inns, and guesthouses.

[0500] "Transportation" refers to the method or vehicle used by travelers to travel to their destination, including trains, buses, taxis, airplanes, etc.

[0501] A "database" is a system or structure for efficiently storing, retrieving, and updating large amounts of data.

[0502] A "ranking format" is a way of ranking things based on certain criteria.

[0503] A "user terminal" is a device that a user operates to access the system, and includes smartphones, tablets, and personal computers.

[0504] A "bookmark" is a collection of information about a travel plan, including tourist spots, travel time, transportation options, and costs.

[0505] "Emotional data" is information that represents a user's emotions and mood, and is collected through text input, facial expression recognition, etc.

[0506] The "emotion engine" is a system that analyzes users' emotional data and reflects the results in travel plans and meal suggestions.

[0507] "Restaurant" means a food and beverage establishment that serves meals.

[0508] "Food" means the food or dishes served in a restaurant or dining establishment.

[0509] An "endorsement" is a recommendation or suggestion based on specific criteria.

[0510] "Data analysis" is the process of analyzing collected data to find specific patterns and trends.

[0511] This invention is a system that allows users to efficiently plan their trips, and its main feature is the use of an emotion engine. This system is composed of a server and a user terminal. Specific processing procedures and embodiments of this system are described below.

[0512] 1. Initial settings and data integration

[0513] The server sends requests to various APIs to obtain tourist information, accommodation data, and transportation data. The obtained data is stored in a database. This data includes tourist spot names, locations, ratings, photos, etc. It is expected that external tourist information APIs will be used to obtain specific tourist information.

[0514] 2. Search function based on user requests

[0515] The user device allows the user to input search criteria for tourist attractions and accommodations (e.g., location, budget, dates, etc.) through a user interface. When the user inputs the search criteria and presses the search button, the device sends the criteria to the server. The server creates a query to the database based on the received search criteria. It executes this query and extracts entries for relevant tourist attractions and accommodations. The extracted entries are ranked based on user ratings and popularity and sent from the server to the device. The device displays the search results received from the server to the user.

[0516] 3. Utilizing the Emotion Engine

[0517] When users enter travel search criteria, they also input their emotions at that time (for example, through text input or facial expression recognition). The user's device sends the input emotion data to the emotion engine. The server's emotion engine analyzes the received emotion data and recommends tourist spots and activities accordingly. This analysis can use a generative AI model. For example, if a user inputs the emotion "I want to relax," relaxation facilities and quiet tourist spots will be displayed preferentially.

[0518] 4. Creating and managing travel plans

[0519] The user adds the selected item from the search results to a "bookmark." The user's device sends the information added to the bookmark and emotional data to the server. The server stores the information added to the bookmark in a database and calculates detailed information such as the required travel time, transportation method, and total cost. The server sends the calculated detailed information to the device, which displays it to the user. The server provides customized suggestions by taking into account the bookmark content as well as the user's past ratings and emotional data.

[0520] 5. Travel support

[0521] The user's device provides navigation from the current location to the next destination based on the bookmark information. It uses the GPS function to obtain the current location and displays the optimal route to the destination. The server monitors traffic information and changes in weather conditions in real time, and if an abnormality occurs, sends that information to the user's device via push notification. The device notifies the user of the emergency information received from the server and encourages appropriate action.

[0522] 6. After-sales feedback

[0523] After the trip is over, feedback and ratings from users are collected via their devices. Users enter ratings and comments about each tourist spot and accommodation. The server stores the collected ratings and comments in a database and uses them to improve the quality of search results in the future. Emotional data is also used in this feedback process, allowing the system to make more accurate suggestions based on the user's emotions in future trips.

[0524] Examples of specific examples and prompts

[0525] For example, if a user selects "Kyoto" as a travel destination and enters emotions such as "relaxation" or "want to feel nature" as search criteria, the emotion engine will analyze this emotion and prioritize suggestions such as bamboo forest paths and tranquil temples. Also, if a user frequently records the emotion "fun" during their trip, that emotional data will be used to suggest more activities and entertainment facilities for their next trip.

[0526] Example prompts for generative AI models

[0527] Prompts for parsing in the emotion engine:

[0528] "A user types in 'I want to relax.' Suggest the best attractions and accommodations based on this sentiment."

[0529] Food delivery app prompt:

[0530] "A user types, 'I want to relax.' Suggest the best restaurants and dishes based on this emotion."

[0531] The above is a detailed description of the embodiment of the present invention, which makes it possible to propose travel plans and services customized according to the user's emotions.

[0532] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0533] Step 1:

[0534] The user terminal allows the user to input travel search criteria (e.g., location, budget, dates, etc.) and their current emotions (e.g., wanting to relax, wanting to feel energized, etc.) through a user interface. The user inputs these search criteria and emotions and presses the search button. The input data is packetized in the form of travel search criteria and emotion data and sent to the server. Input: travel search criteria, emotion data. Output: data packet.

[0535] Step 2:

[0536] The server creates a query to the database based on the search criteria and emotion data received from the user. This query is an instruction to retrieve entries from the tourist attraction, accommodation, and transportation databases that match the user's search criteria. When the query is executed, the corresponding data entries are retrieved. Input: Search criteria, emotion data. Output: Corresponding data entries.

[0537] Step 3:

[0538] The server ranks the extracted data entries based on user ratings and popularity. The ranking is done by an algorithm and arranged in an order optimized for the user's search criteria and sentiment data. This ranked data is sent to the user's device. Input: Extracted data entries. Output: Ranked data.

[0539] Step 4:

[0540] The user device displays the ranked data received from the server to the user. The user selects tourist spots and accommodations that interest them from the displayed list. This selected data is added to a "bookmark." The device sends the information and emotion data added to the bookmark to the server. Input: Ranked data. Output: Selected data.

[0541] Step 5:

[0542] The server stores the information added to the bookmark in a database and calculates detailed information such as the required travel time, transportation method, and total cost based on this information. The calculated detailed information is sent to the user's device. Input: Bookmark information, emotion data. Output: Detailed information on travel time, transportation method, and total cost.

[0543] Step 6:

[0544] The user terminal displays the detailed information received from the server to the user. The user makes a detailed travel plan based on this information. Input: Detailed information. Output: Travel plan displayed to the user.

[0545] Step 7:

[0546] The server uses GPS to obtain the user's current location while traveling and provides navigation to the next destination based on bookmark information. It also monitors traffic information and weather condition changes in real time and notifies the user of emergency information. Input: Current location, traffic information, weather conditions. Output: Navigation, emergency information notification.

[0547] Step 8:

[0548] After the trip is over, the user device provides an interface to receive feedback and ratings from the user. The user enters ratings and comments about each tourist spot and accommodation. This feedback data is sent to the server and stored in a database to improve the quality of search results next time. Input: Feedback, rating data. Output: Feedback data stored in the database.

[0549] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0550] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0551] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0552] [Second embodiment]

[0553] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0554] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0555] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0556] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0557] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0558] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0559] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0560] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0561] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0562] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0563] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0564] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0565] The present invention provides a system that allows users to efficiently plan their trips. This system allows users to search for travel destination information in bulk, display it in a ranking format, and easily create travel plans. It also provides information in real time and collects feedback after the trip.

[0566] Program processing flow

[0567] 1. Initial settings and data integration

[0568] server

[0569] The server sends requests to various APIs to obtain tourist information, accommodation data, and transportation data.

[0570] For example, a tourist information API can be used to retrieve information about tourist attractions in a specific area and store it in a database, including the spot name, location, rating, and photos.

[0571] 2. Search function based on user requests

[0572] Terminal

[0573] The terminal allows the user to input search criteria (e.g., location, budget, dates, etc.) for tourist spots and accommodations through a user interface.

[0574] For example, if a user enters conditions such as "Kyoto," "3 days," "budget 50,000 yen," and "tourist category: temples," the device will send this to the server.

[0575] server

[0576] The server creates a query in the database based on the received search criteria and extracts the relevant data.

[0577] The extracted data is ranked based on user ratings and popularity and sent to the device.

[0578] 3. Creating and managing travel plans

[0579] Terminal

[0580] The terminal displays the search results received from the server in a list format.

[0581] It provides users with the ability to select items of interest and add them to their bookmarks.

[0582] User

[0583] For example, a user selects "Kinkaku-ji Temple" and "Kiyomizu-dera Temple" from the search results and adds them to the bookmarks.

[0584] server

[0585] The server stores the information added to the bookmark in a database and calculates details such as the required travel time, transportation means, and total cost.

[0586] The calculated details are sent to the terminal, which displays them to the user.

[0587] 4. Travel support

[0588] Terminal

[0589] The device provides navigation from the current location to the next destination based on the bookmark information.

[0590] Uses the GPS function to obtain your current location and display the optimal route to your destination.

[0591] server

[0592] The server monitors traffic information and changes in weather conditions in real time, and if an abnormality occurs, it sends the information to the device via push notification.

[0593] Terminal

[0594] For example, if there is information about a public transport delay, the device will notify the user of that information and suggest an appropriate detour route.

[0595] 5. After-sales feedback

[0596] Terminal

[0597] The terminal provides an interface to collect feedback and ratings from users after the trip is completed.

[0598] User

[0599] Users enter ratings and comments about each spot and accommodation.

[0600] server

[0601] The server stores the received ratings and comments in a database and uses them to improve the quality of search results the next time.

[0602] For example, based on user ratings, the next time the app displays more highly rated spots and facilities.

[0603] In this way, users can efficiently plan their trips, obtain necessary information in real time, and incorporate post-trip feedback, improving the user experience and encouraging long-term usage.

[0604] The processing flow will be explained below.

[0605] Program processing flow

[0606] 1. Initial settings and data integration

[0607] Step 1:

[0608] The server sends requests to various APIs to obtain tourist information, accommodation data, and transportation data.

[0609] Step 2:

[0610] The server stores the acquired data in a database, including tourist spot names, locations, ratings, photos, etc.

[0611] Step 3:

[0612] The server periodically calls the API to update the database with new data and updates.

[0613] 2. Search function based on user requests

[0614] Step 4:

[0615] The terminal allows the user to input search criteria (e.g., location, budget, dates, etc.) for tourist spots and accommodations through a user interface.

[0616] Step 5:

[0617] When a user enters search criteria and presses the search button, the terminal sends the criteria to the server.

[0618] Step 6:

[0619] The server generates a query to the database based on the received search criteria.

[0620] Step 7:

[0621] The server executes the query and extracts relevant tourist attraction and accommodation entries.

[0622] Step 8:

[0623] The server ranks the extracted entries based on popularity and ratings.

[0624] Step 9:

[0625] The server transmits the ranked search results to the terminal.

[0626] Step 10:

[0627] The terminal displays the search results received from the server to the user, who then selects a spot of interest from the displayed list.

[0628] 3. Creating and managing travel plans

[0629] Step 11:

[0630] Users can add selected items from the search results to their bookmarks.

[0631] Step 12:

[0632] The terminal transmits the information added to the bookmark to the server.

[0633] Step 13:

[0634] The server stores the information added to the bookmark in a database.

[0635] Step 14:

[0636] The server calculates detailed information such as the required travel time, transportation method, and total cost based on the bookmark information.

[0637] Step 15:

[0638] The server sends the calculated details to the terminal.

[0639] Step 16:

[0640] The device displays the bookmark information and calculated details to the user.

[0641] 4. Travel support

[0642] Step 17:

[0643] The user's device provides navigation from the current location to the next destination based on the bookmark information.

[0644] Step 18:

[0645] Uses the device's GPS function to obtain your current location and display the optimal route to your destination.

[0646] Step 19:

[0647] The server monitors traffic information and changes in weather conditions in real time.

[0648] Step 20:

[0649] If an abnormality occurs, the server sends the information to the device via push notification.

[0650] Step 21:

[0651] The device notifies the user of the emergency information received from the server and prompts them to take appropriate action.

[0652] 5. After-sales feedback

[0653] Step 22:

[0654] The terminal provides an interface to collect feedback and ratings from users after the trip is completed.

[0655] Step 23:

[0656] Users enter ratings and comments about each tourist spot and accommodation.

[0657] Step 24:

[0658] The terminal transmits the collected ratings and comments to the server.

[0659] Step 25:

[0660] The server stores the received ratings and comments in a database.

[0661] Step 26:

[0662] The server uses the stored feedback to adjust the algorithm it uses to improve the quality of search results next time.

[0663] Example 1

[0664] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0665] When planning a trip, users must individually research information on numerous tourist spots, accommodations, and transportation options, which is time-consuming and laborious. It is also difficult to provide real-time information and effectively utilize post-trip feedback. These issues need to be resolved.

[0666] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0667] In this invention, the server includes means for receiving travel search conditions from a user and extracting data such as relevant location information, accommodation information, and transportation information from a database, means for sorting the relevant data in order of priority and sending it to the user terminal, means for saving the items selected by the user and generating a travel plan, means for calculating detailed information such as the required travel time, transportation means, and total cost based on the travel plan information, and means for displaying the travel plan information and detailed information to the user. This enables users to efficiently plan their travels, makes it easier to obtain necessary information in real time, and effectively utilizes feedback after the trip.

[0668] "Travel search conditions" refer to detailed information such as the user's desired travel destination, duration, budget, and category of visits.

[0669] "Location information" refers to information about tourist attractions, famous places, and facilities, including their locations, addresses, ratings, and photos.

[0670] "Accommodation information" refers to information about accommodation facilities such as hotels, inns, and guesthouses, including room types, prices, ratings, and locations.

[0671] "Transportation information" refers to information about means of transportation such as trains, buses, taxis, rental cars, and airplanes.

[0672] A "database" refers to a structured collection of information that allows a system to store and retrieve information.

[0673] "Sort by highest priority" refers to sorting search results based on user ratings, popularity, etc.

[0674] "User terminal" refers to a device such as a computer, smartphone, or tablet that a user uses to enter information and receive results.

[0675] "Travel Plan" means a schedule or itinerary created based on the attractions, accommodations and transportation selected by the User.

[0676] "Travel time" refers to the time it takes to get from one point to another.

[0677] "Total Cost" refers to the total amount of all charges incurred during the trip.

[0678] "Route guidance function" refers to a function that provides the optimal route from the current location to the next destination.

[0679] "Traffic conditions" refers to information regarding the operation status and congestion of roads and public transportation.

[0680] "Weather conditions" refers to current weather information such as weather, temperature, and precipitation.

[0681] "Emergency information" refers to information of a high degree of urgency, such as traffic delays or weather-related crises.

[0682] "Feedback" refers to ratings, comments and opinions about travel destinations and accommodations provided by Users.

[0683] The present invention relates to a system that enables users to efficiently plan their travels. The system helps users easily search for information about travel destinations and effectively create travel plans. Specific functions included in the present invention include search, planning, navigation, real-time information provision, and feedback collection.

[0684] Hardware and Software

[0685] The main components of the system are the server, terminal (user device), and database. The server processes large amounts of data and sends requests to the API, so a high-performance cloud computing environment (e.g., Amazon Web Services or Google Cloud Platform) is used. The terminal is the device operated by the user, such as a smartphone, tablet, or PC. The software consists of a front end (user interface) and a back end (data processing and API integration), with React Native or Flutter used for the front end and Node.js or Python for the back end.

[0686] Data processing and calculation

[0687] 1. Initial settings and data integration

[0688] The server sends requests to various APIs to obtain tourist information, accommodation data, and transportation data. For example, a tourist information API is used to obtain information about tourist attractions in a specific area and store it in a database.

[0689] 2. Search function based on user requests

[0690] The device allows users to input search criteria for tourist attractions and accommodations through a user interface. This information is sent from the device to a server, which then queries a database to extract relevant data and sends the results back to the device.

[0691] 3. Creating and managing travel plans

[0692] The terminal displays the search results received from the server in a list format and provides a function to add the items selected by the user to a bookmark. The server calculates details such as travel time, transportation means, and total cost based on the information added to the bookmark, and sends them to the terminal for display to the user.

[0693] 4. Travel support

[0694] The device provides navigation from the current location to the next destination based on the bookmark information. It uses the GPS function to obtain the current location and displays the optimal route using the Google Maps API. The server monitors changes in traffic and weather conditions in real time, and if any abnormalities occur, it sends a push notification to the device.

[0695] 5. After-sales feedback

[0696] The device provides an interface to collect user feedback and ratings after the trip. Users enter their ratings for each spot and accommodation, and the data is sent to a server and stored in a database. This information is used to improve the quality of search results for future trips.

[0697] Examples and prompts

[0698] For example, a user launches the app on their smartphone and enters the following criteria: "Kyoto," "3 days," "budget of 50,000 yen," and "temple." Based on this, the server searches the database and returns suitable tourist spots and accommodations to the device. A list of results is displayed, and the user selects "Kinkaku-ji Temple" and "Kiyomizu-dera Temple" and adds them to their bookmarks. During the trip, the smartphone uses GPS to obtain the user's current location and navigates to the next destination. After the trip, the app prompts the user to enter feedback, and the user enters a rating for each spot.

[0699] Example prompt sentence:

[0700] 1. Initial setup: The system uses the API required to search for tourist spots based on the conditions "Kyoto," "3 days," "budget of 50,000 yen," and "tourism category: temples," and retrieves the data and stores it in a database.

[0701] 2. Search: Search for tourist spots using criteria such as, "I'm planning a three-day trip to Kyoto. My budget is 50,000 yen and I want to visit temples."

[0702] 3. Travel Plan: Create a travel plan by typing, "I want to visit Kinkakuji Temple and Kiyomizudera Temple. Add this to my bookmarks."

[0703] 4. Navigation: Ask, "What is the best route from my current location to Kinkakuji Temple?"

[0704] 5. Feedback: "Please rate Kinkaku-ji Temple. Add your comments."

[0705] As described above, this system provides users with a series of processes to efficiently plan their trips, and also allows them to obtain necessary information in real time, as well as effectively collect and utilize post-trip feedback.

[0706] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0707] Step 1:

[0708] Initial settings and data integration

[0709] The server sends requests to various APIs to obtain tourist information, accommodation data, and transportation data. Specifically, it creates API requests in JSON format and sends them to each information provider site. The input is the API request URL and authentication information, and the output is a JSON response containing tourist attraction information, accommodation data, and transportation data. The received data is parsed on the server side and inserted into a database. This process is executed by an automated scheduler, for example, at 2:00 AM every day.

[0710] Step 2:

[0711] Search function based on user requests

[0712] Terminal processing:

[0713] The device allows the user to input search criteria for tourist spots and accommodations through a user interface. Specifically, the user enters criteria such as "Kyoto," "3 days," "budget of 50,000 yen," and "temple" into the search form and clicks the "Search" button. The input is the search criteria entered by the user, and the output is an API request to the server. The device converts the search criteria into JSON format and sends it to the server.

[0714] Server-side processing:

[0715] The server executes SQL queries on the database based on the received search criteria and extracts data on relevant tourist attractions and accommodations. The input is JSON data of the search criteria sent by the user, and the output is a dataset extracted based on the relevant criteria. The extracted data is sorted in a ranking format based on user ratings and popularity, and is sent back to the device in JSON format.

[0716] Step 3:

[0717] Create and manage your travel plans

[0718] Terminal processing:

[0719] The terminal displays the search results received from the server in list format. The input is the JSON data of the search results sent from the server, and the output is the list-format search results displayed on the user interface. Specifically, when the user views the detailed information of each spot and clicks the "Add to bookmarks" button, the information is added to the bookmarks.

[0720] Server-side processing:

[0721] The server calculates details such as travel time, transportation method, and total cost based on the information added to the bookmark, and sends them to the device. Specifically, it uses the Google Maps API to calculate travel time between each spot, and calculates the total cost by adding up the entrance fees and accommodation costs of the spots. The input is the data of the spots and accommodations added to the bookmark, and the output is JSON data containing the calculated details. These details are displayed to the user on the device.

[0722] Step 4:

[0723] Travel support

[0724] Terminal processing:

[0725] The device provides navigation from the current location to the next destination based on the bookmark information. It obtains the current location using the GPS function and sends a request to the Google Maps API to display the optimal route. The input is the GPS information of the current location and the data of the next destination, and the output is the optimal route obtained from the Google Maps API.

[0726] Server-side processing:

[0727] The server monitors fluctuations in traffic and weather conditions in real time, and if an abnormality occurs, it sends that information to the device via push notification. Specifically, it checks the transport API and weather information API at regular intervals, and if an abnormality is detected, it promptly sends a push notification. The input is the response data of the traffic and weather information API, and the output is the data used to send the push notification.

[0728] Step 5:

[0729] After-sales feedback

[0730] Terminal processing:

[0731] The terminal provides an interface to collect feedback and ratings from users after the trip. Specifically, a pop-up is automatically displayed after the trip ends, prompting the user to "Please provide feedback on this trip." The input is the rating and comments entered by the user, and the output is the feedback data sent to the server.

[0732] Server-side processing:

[0733] The server stores the received ratings and comments in a database and uses them to improve the quality of the next search results. Specifically, it analyzes the rating data and updates the ranking of each spot in real time based on the rating points. The input is the user's ratings and comments, and the output is the updated rating data.

[0734] (Application example 1)

[0735] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0736] Conventional travel planning systems require users to collect and analyze information themselves, which requires time and effort to create a trip plan. Furthermore, they lack real-time travel support and post-trip feedback, making it difficult to improve the user's travel experience. Furthermore, there is a lack of systems that allow users to efficiently create trip plans in virtual stores, so there is a need to improve the user experience.

[0737] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0738] In this invention, the server includes means for receiving travel search criteria from a user and extracting data on relevant tourist attractions, accommodations, transportation, etc. from a database, means for ranking the relevant data and sending it to the user's terminal, means for saving the items selected by the user and generating a bookmark, means for calculating detailed information such as the required travel time, transportation, and total cost based on the bookmark information, means for displaying the bookmark information and detailed information to the user, means for collecting and saving feedback from the user and using it to improve the quality of future search results, and means for providing a virtual guide application, thereby enabling users to efficiently plan their trips, obtain necessary information in real time, and incorporate post-trip feedback.

[0739] "Travel search conditions from users" are various requirements and desired information entered by users in order to extract relevant information from databases of tourist attractions, accommodations, transportation options, etc.

[0740] "Relevant data" refers to information on tourist attractions, accommodation, transportation, etc. extracted from the database based on the user's travel search criteria.

[0741] "Ranking" is a method of ranking extracted data based on user ratings and popularity and displaying it in list format.

[0742] "Means for transmitting to user terminal" refers to the function by which the server transmits the aligned data to the device used by the user via communication.

[0743] "User-selected items" are attractions and accommodations that a user has selected from the provided list as being of interest to them and to add to their travel plans.

[0744] "Means for generating bookmarks" is a function that creates a list (bookmark) that summarizes the details of a travel plan based on the items selected by the user.

[0745] "Travel time, transportation mode, and total cost" are factors used to calculate the travel time, transportation mode, and total cost of the trip based on the user's travel plans.

[0746] "Bookmark information and detailed information" refers to the items selected by the user as part of the travel plan, as well as specific detailed information about those items, such as travel time, transportation means, and total cost.

[0747] "User feedback" refers to ratings and comments on tourist spots and accommodations provided by users after their trip.

[0748] A "virtual guide application" is application software that allows users to use functions such as travel planning, real-time navigation, and feedback collection through smart devices.

[0749] A "generative AI model" is an artificial intelligence system that uses machine learning algorithms to optimize tourist spot rankings and travel plans based on user search criteria.

[0750] A "prompt" is an instruction or search keyword that enables a generative AI model to derive appropriate results based on user input.

[0751] The embodiment of the present invention is a system that provides a virtual guide application for efficiently planning a trip. The main components of the system and their specific functions will be described below.

[0752] System Components

[0753] 1. Server

[0754] Data extraction function: The server sends requests to various APIs to obtain tourist information, accommodation data, and transportation data. For example, a tourist information API is used to obtain information about tourist attractions in a specific area and store it in a database. This information includes the spot name, location, rating, photos, etc.

[0755] Search and ranking function: The server creates a query in the database based on the travel search criteria received from the user, extracts the relevant data, sorts the extracted data in a ranking format based on user ratings and popularity, and sends it to the user's device.

[0756] Calculation and display function: The server adds the user's selected items to the bookmarks and calculates detailed information such as the required travel time, transportation means, total cost, etc. The calculated detailed information is sent to the user's terminal, which then displays it to the user.

[0757] Feedback collection function: The server receives feedback and ratings from users, stores them in a database, and uses them to improve the quality of search results next time.

[0758] 2. User Device

[0759] Interface function: The device allows the user to input search criteria for tourist spots and accommodations through the user interface. For example, if the user inputs criteria such as "Kyoto," "3 days," "budget 50,000 yen," and "tourism category: temples," the device sends this to the server.

[0760] Navigation function: Provides navigation from the current location to the next destination based on bookmark information. Uses GPS to obtain the current location and displays the optimal route to the destination.

[0761] Real-time information provision function: When traffic information or changes in weather conditions are sent from the server in real time, the device will provide that information to the user via push notification and suggest appropriate detour routes.

[0762] 3. Users

[0763] Entering search criteria: Users enter their travel criteria (e.g., location, budget, dates, etc.) through the interface.

[0764] Selection from a list: The search results received from the server are displayed in a list format, and the user can select tourist attractions and accommodations that interest them and add them to their bookmarks.

[0765] Providing feedback: After completing a trip, users can leave ratings and comments about each attraction and accommodation.

[0766] Hardware and software used

[0767] Hardware: User devices such as smartphones and smart glasses, and cloud servers

[0768] Software: Flask, requests library, GPS function

[0769] Specific examples

[0770] Assume that User A is planning a three-day trip to Kyoto. Their budget is 50,000 yen, and they are interested in "temples." When User A enters their search criteria into the app, the app retrieves information about Kyoto's temples from a tourist information API. The app displays a ranking of the top spots (e.g., "Kinkaku-ji Temple" and "Kiyomizu-dera Temple") based on user ratings. User A selects "Kinkaku-ji Temple" and "Kiyomizu-dera Temple" and adds them to their bookmarks. The app calculates the total cost and travel time required, and displays these to the user. The app also navigates User A during the trip, providing real-time information such as traffic delays. After the trip is over, User A leaves ratings and comments on tourist spots and accommodations through the app.

[0771] Prompt Sentence Examples

[0772] "I'm planning a three-day trip to Kyoto. My budget is 50,000 yen, and I'm interested in temples. Please suggest an app that will help me search for tourist spots, display rankings, and help me create a trip plan. I'd also like navigation and real-time information during my trip, and collect feedback after my trip."

[0773] As described above, by using this system, users can efficiently plan their trips, obtain necessary information in real time, and incorporate feedback after the trip.

[0774] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0775] Step 1:

[0776] Description: User enters travel search criteria, including, for example, location, budget, dates, and category of sightseeing (e.g., temples).

[0777] Specific operation: The user enters conditions such as "Kyoto," "3 days," "budget 50,000 yen," and "tourist category: temples" through an application on a smartphone or smart glasses.

[0778] Input: User's travel criteria (location, budget, dates, category).

[0779] Output: The entered travel conditions are saved on the terminal and sent to the server.

[0780] Step 2:

[0781] Description: The server queries a database based on the received travel search criteria to extract relevant attraction, accommodation, and transportation data.

[0782] Specific operation: Uses the tourist information API to obtain tourist spot information for a specific area (e.g., Kyoto) and save it in a database.

[0783] Input: User's travel requirements.

[0784] Output: Data on relevant attractions, accommodation and transportation options.

[0785] Step 3:

[0786] Description: The server sorts the extracted data into a ranking format based on user ratings and popularity, and sends it to the user's device.

[0787] Specific operation: The data obtained from the API is sorted by user rating and then ranked. The ranking results are then sent to the user's device.

[0788] Input: Extracted tourist attraction, accommodation, and transportation data.

[0789] Output: Data sorted into ranking format.

[0790] Step 4:

[0791] Description: The user can view the search results received from the server in a list format, select items of interest and add them to their bookmarks.

[0792] Specific operation: Select an item of interest such as "Kinkaku-ji Temple" or "Kiyomizu-dera Temple" from the list of tourist spots and accommodations displayed on the device and add it to your bookmarks.

[0793] Input: Data sorted into ranking format.

[0794] Output: A list of attractions and accommodations selected by the user.

[0795] Step 5:

[0796] Description: The server calculates details such as travel time, transportation means, and total cost based on the information added to the bookmark.

[0797] Specific operation: Based on the tourist attractions and accommodations added to the bookmarks, the travel route is calculated, and the means of transportation to be used, their costs, and total travel time are calculated.

[0798] Input: Information about attractions and accommodations added to bookmarks.

[0799] Output: Detailed information such as required travel time, transportation mode, and total cost.

[0800] Step 6:

[0801] Description: The server sends the calculated details to the user terminal, which displays them to the user.

[0802] Specific operation: Send detailed information to the user terminal, and the terminal displays the information through the user interface.

[0803] Input: Details such as required travel time, mode of transportation, and total cost.

[0804] Output: Detailed information about the trip plan displayed on the user's device.

[0805] Step 7:

[0806] Description: During the trip, the device provides navigation based on bookmark information and receives real-time information from the server to notify the user.

[0807] Specific operation: Uses GPS to obtain current location and displays the optimal route to the next destination. If there is a public transport delay, the user will be notified via push notification and an alternative route will be suggested.

[0808] Input: Bookmark information, real-time traffic information.

[0809] Output: Navigation instructions, emergency push notifications, and alternative route suggestions.

[0810] Step 8:

[0811] Description: After completing a trip, users enter their feedback and ratings, which are collected by the server and stored in a database.

[0812] What it does: Users enter ratings and comments for attractions and accommodations, and the server stores that information in a database. It uses this information to improve search results the next time.

[0813] Input: User feedback and ratings.

[0814] Output: Feedback information stored in a database.

[0815] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0816] The present invention provides a system that allows users to efficiently plan their trips. This system incorporates an emotion engine that recognizes the user's emotions and reflects them in suggesting travel destinations and customizing the plan. Specific program processing of the system and its implementation are described below.

[0817] Program processing flow

[0818] 1. Initial settings and data integration

[0819] server

[0820] The server sends requests to various APIs to obtain tourist information, accommodation data, and transportation data.

[0821] The acquired data is stored in a database, including tourist spot names, locations, ratings, photos, etc.

[0822] 2. Search function based on user requests

[0823] Terminal

[0824] The terminal allows the user to input search criteria (e.g., location, budget, dates, etc.) for tourist spots and accommodations through a user interface.

[0825] When a user enters search criteria and presses the search button, the terminal sends the criteria to the server.

[0826] server

[0827] The server generates a query to the database based on the received search criteria.

[0828] Run the query to extract relevant attraction and accommodation entries.

[0829] The extracted entries are ranked based on user ratings and popularity.

[0830] Send ranked search results to your device.

[0831] Terminal

[0832] The terminal displays the search results received from the server to the user, who then selects a spot of interest from the displayed list.

[0833] 3. Utilizing the Emotion Engine

[0834] Terminal

[0835] When users enter travel search criteria, they also enter their emotions at the time (for example, through text input or facial expression recognition).

[0836] The terminal transmits the input emotion data to the emotion engine.

[0837] server

[0838] The server's emotion engine analyzes the received emotion data and recommends tourist spots and activities accordingly.

[0839] For example, if a user inputs the emotion "I want to relax," relaxation facilities and quiet tourist spots will be displayed preferentially.

[0840] 4. Creating and managing travel plans

[0841] Terminal

[0842] Users can add selected items from the search results to their bookmarks.

[0843] The terminal transmits the information added to the bookmark and the emotion data to the server.

[0844] server

[0845] The server stores the information added to the bookmark in a database and calculates details such as the required travel time, transportation means, and total cost.

[0846] The calculated details are sent to the terminal, which displays them to the user.

[0847] It provides customized suggestions by taking into account the bookmark content as well as the user's past ratings and sentiment data.

[0848] 5. Travel support

[0849] Terminal

[0850] The device provides navigation from the current location to the next destination based on the bookmark information.

[0851] Uses the GPS function to obtain your current location and display the optimal route to your destination.

[0852] server

[0853] It monitors changes in traffic information and weather conditions in real time, and if an abnormality occurs, the information is sent to the device via push notification.

[0854] The device notifies the user of the emergency information received from the server and prompts them to take appropriate action.

[0855] 6. After-sales feedback

[0856] Terminal

[0857] Provide an interface to collect user feedback and ratings after the trip is completed.

[0858] User

[0859] Enter your ratings and comments about each tourist attraction and accommodation.

[0860] server

[0861] The collected ratings and comments are stored in a database and used to improve the quality of search results next time.

[0862] Specific examples

[0863] For example, if a user selects "Kyoto" as a travel destination and enters emotions such as "relaxation" or "a desire to experience nature" as search criteria, the emotion engine will analyze these emotions and prioritize suggestions such as the bamboo forest path or the tranquil temples of Ohara. Furthermore, if a user frequently records the emotion "fun" during their trip, that emotional data will be used to suggest more activities and entertainment facilities for the next trip.

[0864] In this way, by utilizing the emotion engine, it is possible to provide optimal travel plans based on the user's emotions. It is also possible to further personalize the next proposal based on feedback during and after the trip.

[0865] The processing flow will be explained below.

[0866] Program processing flow

[0867] 1. Initial settings and data integration

[0868] Step 1:

[0869] The server sends requests to various APIs to obtain tourist information, accommodation data, and transportation data.

[0870] Step 2:

[0871] The server stores the acquired data in a database by category, including tourist spot names, locations, ratings, photos, etc.

[0872] Step 3:

[0873] The server periodically calls the API to update the database with new data and updates.

[0874] 2. Search function based on user requests

[0875] Step 4:

[0876] The terminal allows the user to input search criteria (e.g., location, budget, dates, etc.) for tourist spots and accommodations through a user interface.

[0877] Step 5:

[0878] When a user enters search criteria and presses the search button, the terminal sends the criteria to the server.

[0879] Step 6:

[0880] The server generates a query to the database based on the received search criteria.

[0881] Step 7:

[0882] The server executes the query and extracts relevant tourist attraction and accommodation entries.

[0883] Step 8:

[0884] The server ranks the extracted entries based on popularity and ratings.

[0885] Step 9:

[0886] The server transmits the ranked search results to the terminal.

[0887] Step 10:

[0888] The terminal displays the search results received from the server to the user, who then selects a spot of interest from the displayed list.

[0889] 3. Utilizing the Emotion Engine

[0890] Step 11:

[0891] When users enter search criteria, the device also prompts them to enter their emotional data, which is acquired through text input and real-time facial recognition.

[0892] Step 12:

[0893] The terminal transmits the input emotion data to the emotion engine of the server.

[0894] Step 13:

[0895] The server's emotion engine analyzes the received emotion data and recommends tourist spots and activities accordingly.

[0896] Step 14:

[0897] The server then sends the results of its recommendations for the most suitable tourist spots and activities to the user based on the emotion engine to the terminal.

[0898] 4. Creating and managing travel plans

[0899] Step 15:

[0900] Users can add selected items from the search results to their bookmarks.

[0901] Step 16:

[0902] The terminal transmits the information added to the bookmark to the server.

[0903] Step 17:

[0904] The server stores the information added to the bookmark in a database and calculates details such as the required travel time, transportation means, and total cost.

[0905] Step 18:

[0906] The server sends the calculated details to the terminal, which displays them to the user.

[0907] Step 19:

[0908] The server takes into account the bookmark content as well as the user's past ratings and sentiment data to provide customized suggestions.

[0909] 5. Travel support

[0910] Step 20:

[0911] The device provides navigation from the current location to the next destination based on the bookmark information.

[0912] Step 21:

[0913] Uses the device's GPS function to obtain your current location and display the optimal route to your destination.

[0914] Step 22:

[0915] The server monitors traffic information and changes in weather conditions in real time.

[0916] Step 23:

[0917] If an abnormality occurs, the server sends the information to the device via push notification.

[0918] Step 24:

[0919] The device notifies the user of the emergency information received from the server and prompts them to take appropriate action.

[0920] 6. After-sales feedback

[0921] Step 25:

[0922] The terminal provides an interface to collect feedback and ratings from users after the trip is completed.

[0923] Step 26:

[0924] Users enter ratings and comments about each tourist spot and accommodation.

[0925] Step 27:

[0926] The terminal transmits the collected ratings and comments to the server.

[0927] Step 28:

[0928] The server stores the received ratings and comments in a database.

[0929] Step 29:

[0930] The server uses the stored feedback to adjust the algorithm it uses to improve the quality of search results next time.

[0931] Specific examples

[0932] For example, if a user selects "Kyoto" as a travel destination and enters emotions such as "relaxation" or "a desire to experience nature" as search criteria, the emotion engine will analyze these emotions and prioritize suggestions such as the bamboo forest path or the tranquil temples of Ohara. Furthermore, if a user frequently records the emotion "fun" during their trip, that emotional data will be used to suggest more activities and entertainment facilities for the next trip.

[0933] In this way, by utilizing the emotion engine, it is possible to provide optimal travel plans based on the user's emotions, and further personalize the next suggestions based on feedback during and after the trip.

[0934] Example 2

[0935] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0936] Conventional travel planning systems lacked suggestions based on user emotions and intuition, making it difficult to provide optimal travel plans for individual users. They also lacked the functionality to respond to real-time traffic information and weather conditions. This resulted in problems that reduced user satisfaction and the quality of the travel experience.

[0937] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0938] In this invention, the server includes means for receiving travel search conditions from a user and extracting data on relevant tourist destinations, accommodations, means of transportation, etc. from a database, means for ranking the relevant data and sending it to the user terminal, means for saving the items selected by the user and generating a bookmark, means for calculating detailed information such as the required travel time, means of transportation, and total cost based on the bookmark information, means for displaying the bookmark information and detailed information to the user, and means for receiving user emotion data and making suggestions based on the emotion. This makes it possible to provide optimal travel plans based on the user's emotions and intuition, and to provide travel support based on real-time information.

[0939] "Receive travel search conditions from the user" refers to the operation in which the system collects information such as travel destination, budget, and schedule provided by the user.

[0940] "Data on tourist attractions, accommodation, transportation, etc." refers to specific information on tourist attractions, accommodation options, transportation, etc. related to travel.

[0941] "Extracting from a database" refers to the act of searching and retrieving relevant information from a database based on specific conditions.

[0942] "Ranking and sending to user's device" refers to sorting search results based on user ratings and popularity, and transferring the list to the user's device.

[0943] "Saving the items selected by the user and generating a bookmark" refers to the action of saving information such as the travel destination and accommodation selected by the user, and creating a document summarizing the travel plan based on that information.

[0944] "Calculating detailed information such as required travel time, transportation means, and total cost based on bookmark information" refers to the process of calculating travel time, transportation means to choose, and total travel costs based on information about tourist attractions and accommodations listed in the bookmark.

[0945] "Displaying bookmark information and detailed information to the user" refers to the action of presenting the calculated and organized details of the travel plan to the user in an easy-to-read format.

[0946] "Receive the user's emotional data and make suggestions based on the emotion" refers to the process of obtaining the emotional information entered by the user (e.g., wanting to relax, wanting to have fun, etc.) and recommending an appropriate travel plan based on that information.

[0947] "Providing a navigation function from the current location to the next destination based on bookmark information" refers to the operation of guiding the user on how to get from their current location to their destination by referring to the information contained in the bookmark.

[0948] "Monitoring changes in travel information and weather conditions in real time and notifying the user of emergency information" means constantly checking the latest travel status and weather information, and immediately contacting the user's device if any abnormalities occur.

[0949] "Receive user feedback and ratings, store them in a database, and use them to improve the quality of search results in the future" refers to the action of collecting reviews and ratings provided by users after their trip, storing them in a database to help improve search results in the future.

[0950] The present invention is a system that allows users to efficiently plan their trips. This system incorporates an emotion engine that recognizes the user's emotions and reflects them in suggesting travel destinations and customizing the plan. Specific program processing and embodiments of the system are described below.

[0951] Initial settings and data integration

[0952] server

[0953] The server sends requests to multiple external APIs (e.g., tourist destination information API and hotel reservation API) to obtain tourist information, accommodation data, and transportation data.

[0954] The acquired data includes tourist spot names, locations, ratings, photos, etc., and is stored in a database (e.g., a MySQL database).

[0955] Search function based on user requests

[0956] Terminal

[0957] Users use an interface to input search criteria such as travel destination, budget, dates, number of people, etc. For example, they can input criteria such as "I want to travel to Kyoto in March, with a budget of 50,000 yen or less."

[0958] server

[0959] The server creates a query to the database based on the received search criteria and extracts data on relevant tourist destinations and accommodations, for example, using a MySQL query.

[0960] The extracted data is sorted into a ranking format based on user ratings and popularity and sent to the device.

[0961] Terminal

[0962] The terminal displays the search results received from the server in a ranked format to the user, who can then select spots of interest from the list.

[0963] Utilizing the Emotion Engine

[0964] Terminal

[0965] When users enter their travel search criteria, they also input their emotions (e.g., "I want to relax") via text input and facial expression recognition.

[0966] server

[0967] The server's emotion engine analyzes the received emotion data and recommends tourist spots and activities according to that emotion. For example, if the user inputs "I want to relax," it will prioritize relaxation facilities and quiet tourist spots.

[0968] Create and manage your travel plans

[0969] Terminal

[0970] Users can add selected items from the search results to their "bookmarks," which are tentative schedules that summarize their travel plans.

[0971] server

[0972] The server stores the information added to the bookmark in a database and calculates travel time, transportation methods, and total costs as needed, for example using the Google Maps API to calculate travel time.

[0973] The calculation results are sent to the terminal and displayed to the user.

[0974] Travel support

[0975] Terminal

[0976] The device provides navigation from the current location to the next destination based on the bookmark information, using the GPS function to obtain the current location and display the optimal route.

[0977] server

[0978] Traffic information and changes in weather conditions are monitored in real time, and if any abnormalities occur, push notifications are sent to the device.

[0979] The device will notify the user of the received emergency information and prompt them to take appropriate action.

[0980] After-sales feedback

[0981] Terminal

[0982] After completing the trip, users have an interface to enter feedback and ratings.

[0983] User

[0984] Enter your ratings and comments about each tourist attraction and accommodation.

[0985] server

[0986] The collected ratings and comments are stored in a database and used to improve the quality of search results next time.

[0987] Specific examples

[0988] For example, if a user selects "Kyoto" as a travel destination and enters emotions such as "relaxation" or "a desire to experience nature" as search criteria, the emotion engine will analyze this emotion and prioritize suggestions for the bamboo forest path or the tranquil temples of Ohara. Also, if the user frequently records "fun" during their trip, that emotional data will be used to suggest more activities and entertainment facilities for their next trip.

[0989] Example prompts to input to the generative AI model

[0990] If I choose "Kyoto" as my travel destination and input emotions such as "relaxation" and "wanting to feel nature," what tourist spots would you recommend?

[0991] In this way, the system of the present invention aims to provide an optimal travel plan that takes into account the user's emotional data and improve user satisfaction.

[0992] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0993] Program processing flow and specific steps

[0994] Step 1: Initial setup and data integration

[0995] The server sends requests to multiple external APIs to obtain tourist information, accommodation data, and transportation data. For example, it can send requests to a tourist attraction information API or a hotel reservation API. Input: Data request from external API. Output: Tourist attraction information, accommodation list, transportation data. Specific operation: Obtain tourist attraction names, locations, photos, etc. and save them in a MySQL database.

[0996] Step 2: Search function based on user requests

[0997] The terminal displays an interface for the user to input search criteria such as travel destination, budget, dates, number of people, etc. For example, the user inputs criteria such as "I want to travel to Kyoto in March, with a budget of 50,000 yen or less." Input: Search criteria from the user. Output: List of searched tourist spots and accommodations. Specific operation: The entered search criteria are sent from the terminal to the server by pressing the search button.

[0998] Step 3: Creating and Executing a Database Query

[0999] The server creates a query to the database based on the received search criteria. For example, it creates a MySQL query to extract information on relevant tourist attractions and accommodations. Input: Search criteria. Output: List of search results. Specific operation: Executes a database query to obtain information on tourist attractions and accommodations.

[1000] Step 4: Sort and submit search results

[1001] The server sorts the extracted data into a ranking format based on user ratings and popularity, and sends it to the terminal. Input: Search result data. Output: Search results sorted in ranking format. Specific operation: Ranking is performed based on rating scores and number of reservations, and the sorted data is sent to the terminal.

[1002] Step 5: Viewing search results

[1003] The device displays the search results received from the server to the user, allowing the user to select spots of interest. For example, "Kiyomizu-dera Temple" or "Nijo Castle" are displayed. Input: Sorted search results. Output: List of tourist spots displayed to the user. Specific operation: Displayed in ranking format, allowing the user to check details.

[1004] Step 6: Enter and submit emotion data

[1005] The device provides an interface that allows users to input their emotions at the time they enter travel search criteria. For example, they can input emotions such as "I want to relax." Input: Emotional data from the user. Output: Emotional data sent to the server. Specific operations: The emotion input field is displayed, and the entered data is transferred to the server.

[1006] Step 7: Analyze sentiment data and make recommendations

[1007] The server uses an emotion engine to analyze the received emotion data and recommends tourist spots and activities accordingly. For example, if the emotion is "I want to relax," it will prioritize relaxation facilities and quiet tourist spots. Input: User emotion data. Output: Recommendation of tourist spots based on emotion. Specific operation: Analyzes the emotion data, generates an appropriate recommendation list, and sends it to the device.

[1008] Step 8: Add information to your bookmarks

[1009] The device adds the items the user selects from the search results to the "bookmarks." Input: Tourist attractions and accommodations selected by the user. Output: Updates the bookmark. Specific operations: Adds the selected information to the bookmarks and sends the contents to the server.

[1010] Step 9: Save and calculate bookmark information

[1011] The server saves the information added to the bookmark in a database and calculates the required travel time, transportation means, and total cost. For example, it calculates travel time using the Google Maps API. Input: Bookmark information. Output: Calculated travel time, transportation means, and total cost. Specific operation: Calculates travel time and transportation means options and displays them to the user.

[1012] Step 10: Navigate while traveling

[1013] The device provides navigation from the current location to the next destination based on the bookmark information. For example, it uses the GPS function to obtain the current location and uses Google Maps to present the optimal route. Input: Bookmarks and current location. Output: Navigation information. Specific operation: Obtaining the current location and displaying route guidance.

[1014] Step 11: Real-time information notification

[1015] The server monitors changes in traffic information and weather conditions in real time, and sends push notifications to the device if any abnormalities occur. Input: Real-time information. Output: Emergency information notification. Specific operation: Monitors changes in traffic information and weather, and sends alerts as necessary.

[1016] Step 12: Gathering after-sales feedback

[1017] The device provides an interface to collect feedback and ratings from users after the trip. Input: User ratings and feedback. Output: Saving of rating data. Specific operation: The ratings entered by the user are sent to the server and stored in a database. They are used to make suggestions for the next trip.

[1018] (Application example 2)

[1019] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1020] Conventional travel planning systems do not provide a way for users to select destinations, accommodations, restaurants, etc. based on their emotions or moods. This makes it difficult for users to select appropriate destinations and services that match their emotions at the time, resulting in lower trip satisfaction. Furthermore, meal suggestions during a trip do not reflect the user's emotions and are time-consuming and cumbersome.

[1021] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving travel search conditions from a user and extracting data on relevant tourist spots, accommodations, transportation methods, etc. from a database; means for ranking the relevant data and sending it to the user terminal; means for saving the items selected by the user and generating a bookmark; means for calculating detailed information such as the required travel time, transportation method, and total cost based on the bookmark information; means for displaying the bookmark information and detailed information to the user; means for inputting user emotion data, analyzing the data, and recommending relevant tourist spots and accommodations based on the analysis results in accordance with the user's emotion; means for recommending restaurants and dishes based on the emotion data; and means for adjusting the recommended restaurants and dishes based on the user's emotion data. This allows the user to receive optimal travel plans and meal suggestions tailored to their emotions and mood.

[1022] "Travel search conditions" are information that indicates the user's criteria and preferences for tourist spots, accommodations, transportation, etc. related to the trip.

[1023] "Tourist attractions" are places and facilities that tourists visit for sightseeing and experiences.

[1024] "Accommodation facilities" are facilities for travelers to stay temporarily, and include hotels, inns, and guesthouses.

[1025] "Transportation" refers to the method or vehicle used by travelers to travel to their destination, including trains, buses, taxis, airplanes, etc.

[1026] A "database" is a system or structure for efficiently storing, retrieving, and updating large amounts of data.

[1027] A "ranking format" is a way of ranking things based on certain criteria.

[1028] A "user terminal" is a device that a user operates to access the system, and includes smartphones, tablets, and personal computers.

[1029] A "bookmark" is a collection of information about a travel plan, including tourist spots, travel time, transportation options, and costs.

[1030] "Emotional data" is information that represents a user's emotions and mood, and is collected through text input, facial expression recognition, etc.

[1031] The "emotion engine" is a system that analyzes users' emotional data and reflects the results in travel plans and meal suggestions.

[1032] "Restaurant" means a food and beverage establishment that serves meals.

[1033] "Food" means the food or dishes served in a restaurant or dining establishment.

[1034] An "endorsement" is a recommendation or suggestion based on specific criteria.

[1035] "Data analysis" is the process of analyzing collected data to find specific patterns and trends.

[1036] This invention is a system that allows users to efficiently plan their trips, and its main feature is the use of an emotion engine. This system is composed of a server and a user terminal. Specific processing procedures and embodiments of this system are described below.

[1037] 1. Initial settings and data integration

[1038] The server sends requests to various APIs to obtain tourist information, accommodation data, and transportation data. The obtained data is stored in a database. This data includes tourist spot names, locations, ratings, photos, etc. It is expected that external tourist information APIs will be used to obtain specific tourist information.

[1039] 2. Search function based on user requests

[1040] The user device allows the user to input search criteria for tourist attractions and accommodations (e.g., location, budget, dates, etc.) through a user interface. When the user inputs the search criteria and presses the search button, the device sends the criteria to the server. The server creates a query to the database based on the received search criteria. It executes this query and extracts entries for relevant tourist attractions and accommodations. The extracted entries are ranked based on user ratings and popularity and sent from the server to the device. The device displays the search results received from the server to the user.

[1041] 3. Utilizing the Emotion Engine

[1042] When users enter travel search criteria, they also input their emotions at that time (for example, through text input or facial expression recognition). The user's device sends the input emotion data to the emotion engine. The server's emotion engine analyzes the received emotion data and recommends tourist spots and activities accordingly. This analysis can use a generative AI model. For example, if a user inputs the emotion "I want to relax," relaxation facilities and quiet tourist spots will be displayed preferentially.

[1043] 4. Creating and managing travel plans

[1044] The user adds the selected item from the search results to a "bookmark." The user's device sends the information added to the bookmark and emotional data to the server. The server stores the information added to the bookmark in a database and calculates detailed information such as the required travel time, transportation method, and total cost. The server sends the calculated detailed information to the device, which displays it to the user. The server provides customized suggestions by taking into account the bookmark content as well as the user's past ratings and emotional data.

[1045] 5. Travel support

[1046] The user's device provides navigation from the current location to the next destination based on the bookmark information. It uses the GPS function to obtain the current location and displays the optimal route to the destination. The server monitors traffic information and changes in weather conditions in real time, and if an abnormality occurs, sends that information to the user's device via push notification. The device notifies the user of the emergency information received from the server and encourages appropriate action.

[1047] 6. After-sales feedback

[1048] After the trip is over, feedback and ratings from users are collected via their devices. Users enter ratings and comments about each tourist spot and accommodation. The server stores the collected ratings and comments in a database and uses them to improve the quality of search results in the future. Emotional data is also used in this feedback process, allowing the system to make more accurate suggestions based on the user's emotions in future trips.

[1049] Examples of specific examples and prompts

[1050] For example, if a user selects "Kyoto" as a travel destination and enters emotions such as "relaxation" or "want to feel nature" as search criteria, the emotion engine will analyze this emotion and prioritize suggestions such as bamboo forest paths and tranquil temples. Also, if a user frequently records the emotion "fun" during their trip, that emotional data will be used to suggest more activities and entertainment facilities for their next trip.

[1051] Example prompts for generative AI models

[1052] Prompts for parsing in the emotion engine:

[1053] "A user types in 'I want to relax.' Suggest the best attractions and accommodations based on this sentiment."

[1054] Food delivery app prompt:

[1055] "A user types, 'I want to relax.' Suggest the best restaurants and dishes based on this emotion."

[1056] The above is a detailed description of the embodiment of the present invention, which makes it possible to propose travel plans and services customized according to the user's emotions.

[1057] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1058] Step 1:

[1059] The user terminal allows the user to input travel search criteria (e.g., location, budget, dates, etc.) and their current emotions (e.g., wanting to relax, wanting to feel energized, etc.) through a user interface. The user inputs these search criteria and emotions and presses the search button. The input data is packetized in the form of travel search criteria and emotion data and sent to the server. Input: travel search criteria, emotion data. Output: data packet.

[1060] Step 2:

[1061] The server creates a query to the database based on the search criteria and emotion data received from the user. This query is an instruction to retrieve entries from the tourist attraction, accommodation, and transportation databases that match the user's search criteria. When the query is executed, the corresponding data entries are retrieved. Input: Search criteria, emotion data. Output: Corresponding data entries.

[1062] Step 3:

[1063] The server ranks the extracted data entries based on user ratings and popularity. The ranking is done by an algorithm and arranged in an order optimized for the user's search criteria and sentiment data. This ranked data is sent to the user's device. Input: Extracted data entries. Output: Ranked data.

[1064] Step 4:

[1065] The user device displays the ranked data received from the server to the user. The user selects tourist spots and accommodations that interest them from the displayed list. This selected data is added to a "bookmark." The device sends the information and emotion data added to the bookmark to the server. Input: Ranked data. Output: Selected data.

[1066] Step 5:

[1067] The server stores the information added to the bookmark in a database and calculates detailed information such as the required travel time, transportation method, and total cost based on this information. The calculated detailed information is sent to the user's device. Input: Bookmark information, emotion data. Output: Detailed information on travel time, transportation method, and total cost.

[1068] Step 6:

[1069] The user terminal displays the detailed information received from the server to the user. The user makes a detailed travel plan based on this information. Input: Detailed information. Output: Travel plan displayed to the user.

[1070] Step 7:

[1071] The server uses GPS to obtain the user's current location while traveling and provides navigation to the next destination based on bookmark information. It also monitors traffic information and weather condition changes in real time and notifies the user of emergency information. Input: Current location, traffic information, weather conditions. Output: Navigation, emergency information notification.

[1072] Step 8:

[1073] After the trip is over, the user device provides an interface to receive feedback and ratings from the user. The user enters ratings and comments about each tourist spot and accommodation. This feedback data is sent to the server and stored in a database to improve the quality of search results next time. Input: Feedback, rating data. Output: Feedback data stored in the database.

[1074] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1075] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1076] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1077] [Third embodiment]

[1078] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1079] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1080] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1081] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1082] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1083] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1084] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1085] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1086] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1087] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1088] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1089] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1090] The present invention provides a system that allows users to efficiently plan their trips. This system allows users to search for travel destination information in bulk, display it in a ranking format, and easily create travel plans. It also provides information in real time and collects feedback after the trip.

[1091] Program processing flow

[1092] 1. Initial settings and data integration

[1093] server

[1094] The server sends requests to various APIs to obtain tourist information, accommodation data, and transportation data.

[1095] For example, a tourist information API can be used to retrieve information about tourist attractions in a specific area and store it in a database, including the spot name, location, rating, and photos.

[1096] 2. Search function based on user requests

[1097] Terminal

[1098] The terminal allows the user to input search criteria (e.g., location, budget, dates, etc.) for tourist spots and accommodations through a user interface.

[1099] For example, if a user enters conditions such as "Kyoto," "3 days," "budget 50,000 yen," and "tourist category: temples," the device will send this to the server.

[1100] server

[1101] The server creates a query in the database based on the received search criteria and extracts the relevant data.

[1102] The extracted data is ranked based on user ratings and popularity and sent to the device.

[1103] 3. Creating and managing travel plans

[1104] Terminal

[1105] The terminal displays the search results received from the server in a list format.

[1106] It provides users with the ability to select items of interest and add them to their bookmarks.

[1107] User

[1108] For example, a user selects "Kinkaku-ji Temple" and "Kiyomizu-dera Temple" from the search results and adds them to the bookmarks.

[1109] server

[1110] The server stores the information added to the bookmark in a database and calculates details such as the required travel time, transportation means, and total cost.

[1111] The calculated details are sent to the terminal, which displays them to the user.

[1112] 4. Travel support

[1113] Terminal

[1114] The device provides navigation from the current location to the next destination based on the bookmark information.

[1115] Uses the GPS function to obtain your current location and display the optimal route to your destination.

[1116] server

[1117] The server monitors traffic information and changes in weather conditions in real time, and if an abnormality occurs, it sends the information to the device via push notification.

[1118] Terminal

[1119] For example, if there is information about a public transport delay, the device will notify the user of that information and suggest an appropriate detour route.

[1120] 5. After-sales feedback

[1121] Terminal

[1122] The terminal provides an interface to collect feedback and ratings from users after the trip is completed.

[1123] User

[1124] Users enter ratings and comments about each spot and accommodation.

[1125] server

[1126] The server stores the received ratings and comments in a database and uses them to improve the quality of search results the next time.

[1127] For example, based on user ratings, the next time the app displays more highly rated spots and facilities.

[1128] In this way, users can efficiently plan their trips, obtain necessary information in real time, and incorporate post-trip feedback, improving the user experience and encouraging long-term usage.

[1129] The processing flow will be explained below.

[1130] Program processing flow

[1131] 1. Initial settings and data integration

[1132] Step 1:

[1133] The server sends requests to various APIs to obtain tourist information, accommodation data, and transportation data.

[1134] Step 2:

[1135] The server stores the acquired data in a database, including tourist spot names, locations, ratings, photos, etc.

[1136] Step 3:

[1137] The server periodically calls the API to update the database with new data and updates.

[1138] 2. Search function based on user requests

[1139] Step 4:

[1140] The terminal allows the user to input search criteria (e.g., location, budget, dates, etc.) for tourist spots and accommodations through a user interface.

[1141] Step 5:

[1142] When a user enters search criteria and presses the search button, the terminal sends the criteria to the server.

[1143] Step 6:

[1144] The server generates a query to the database based on the received search criteria.

[1145] Step 7:

[1146] The server executes the query and extracts relevant tourist attraction and accommodation entries.

[1147] Step 8:

[1148] The server ranks the extracted entries based on popularity and ratings.

[1149] Step 9:

[1150] The server transmits the ranked search results to the terminal.

[1151] Step 10:

[1152] The terminal displays the search results received from the server to the user, who then selects a spot of interest from the displayed list.

[1153] 3. Creating and managing travel plans

[1154] Step 11:

[1155] Users can add selected items from the search results to their bookmarks.

[1156] Step 12:

[1157] The terminal transmits the information added to the bookmark to the server.

[1158] Step 13:

[1159] The server stores the information added to the bookmark in a database.

[1160] Step 14:

[1161] The server calculates detailed information such as the required travel time, transportation method, and total cost based on the bookmark information.

[1162] Step 15:

[1163] The server sends the calculated details to the terminal.

[1164] Step 16:

[1165] The device displays the bookmark information and calculated details to the user.

[1166] 4. Travel support

[1167] Step 17:

[1168] The user's device provides navigation from the current location to the next destination based on the bookmark information.

[1169] Step 18:

[1170] Uses the device's GPS function to obtain your current location and display the optimal route to your destination.

[1171] Step 19:

[1172] The server monitors traffic information and changes in weather conditions in real time.

[1173] Step 20:

[1174] If an abnormality occurs, the server sends the information to the device via push notification.

[1175] Step 21:

[1176] The device notifies the user of the emergency information received from the server and prompts them to take appropriate action.

[1177] 5. After-sales feedback

[1178] Step 22:

[1179] The terminal provides an interface to collect feedback and ratings from users after the trip is completed.

[1180] Step 23:

[1181] Users enter ratings and comments about each tourist spot and accommodation.

[1182] Step 24:

[1183] The terminal transmits the collected ratings and comments to the server.

[1184] Step 25:

[1185] The server stores the received ratings and comments in a database.

[1186] Step 26:

[1187] The server uses the stored feedback to adjust the algorithm it uses to improve the quality of search results next time.

[1188] Example 1

[1189] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1190] When planning a trip, users must individually research information on numerous tourist spots, accommodations, and transportation options, which is time-consuming and laborious. It is also difficult to provide real-time information and effectively utilize post-trip feedback. These issues need to be resolved.

[1191] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1192] In this invention, the server includes means for receiving travel search conditions from a user and extracting data such as relevant location information, accommodation information, and transportation information from a database, means for sorting the relevant data in order of priority and sending it to the user terminal, means for saving the items selected by the user and generating a travel plan, means for calculating detailed information such as the required travel time, transportation means, and total cost based on the travel plan information, and means for displaying the travel plan information and detailed information to the user. This enables users to efficiently plan their travels, makes it easier to obtain necessary information in real time, and effectively utilizes feedback after the trip.

[1193] "Travel search conditions" refer to detailed information such as the user's desired travel destination, duration, budget, and category of visits.

[1194] "Location information" refers to information about tourist attractions, famous places, and facilities, including their locations, addresses, ratings, and photos.

[1195] "Accommodation information" refers to information about accommodation facilities such as hotels, inns, and guesthouses, including room types, prices, ratings, and locations.

[1196] "Transportation information" refers to information about means of transportation such as trains, buses, taxis, rental cars, and airplanes.

[1197] A "database" refers to a structured collection of information that allows a system to store and retrieve information.

[1198] "Sort by highest priority" refers to sorting search results based on user ratings, popularity, etc.

[1199] "User terminal" refers to a device such as a computer, smartphone, or tablet that a user uses to enter information and receive results.

[1200] "Travel Plan" means a schedule or itinerary created based on the attractions, accommodations and transportation selected by the User.

[1201] "Travel time" refers to the time it takes to get from one point to another.

[1202] "Total Cost" refers to the total amount of all charges incurred during the trip.

[1203] "Route guidance function" refers to a function that provides the optimal route from the current location to the next destination.

[1204] "Traffic conditions" refers to information regarding the operation status and congestion of roads and public transportation.

[1205] "Weather conditions" refers to current weather information such as weather, temperature, and precipitation.

[1206] "Emergency information" refers to information of a high degree of urgency, such as traffic delays or weather-related crises.

[1207] "Feedback" refers to ratings, comments and opinions about travel destinations and accommodations provided by Users.

[1208] The present invention relates to a system that enables users to efficiently plan their travels. The system helps users easily search for information about travel destinations and effectively create travel plans. Specific functions included in the present invention include search, planning, navigation, real-time information provision, and feedback collection.

[1209] Hardware and Software

[1210] The main components of the system are the server, terminal (user device), and database. The server processes large amounts of data and sends requests to the API, so a high-performance cloud computing environment (e.g., Amazon Web Services or Google Cloud Platform) is used. The terminal is the device operated by the user, such as a smartphone, tablet, or PC. The software consists of a front end (user interface) and a back end (data processing and API integration), with React Native or Flutter used for the front end and Node.js or Python for the back end.

[1211] Data processing and calculation

[1212] 1. Initial settings and data integration

[1213] The server sends requests to various APIs to obtain tourist information, accommodation data, and transportation data. For example, a tourist information API is used to obtain information about tourist attractions in a specific area and store it in a database.

[1214] 2. Search function based on user requests

[1215] The device allows users to input search criteria for tourist attractions and accommodations through a user interface. This information is sent from the device to a server, which then queries a database to extract relevant data and sends the results back to the device.

[1216] 3. Creating and managing travel plans

[1217] The terminal displays the search results received from the server in a list format and provides a function to add the items selected by the user to a bookmark. The server calculates details such as travel time, transportation means, and total cost based on the information added to the bookmark, and sends them to the terminal for display to the user.

[1218] 4. Travel support

[1219] The device provides navigation from the current location to the next destination based on the bookmark information. It uses the GPS function to obtain the current location and displays the optimal route using the Google Maps API. The server monitors changes in traffic and weather conditions in real time, and if any abnormalities occur, it sends a push notification to the device.

[1220] 5. After-sales feedback

[1221] The device provides an interface to collect user feedback and ratings after the trip. Users enter their ratings for each spot and accommodation, and the data is sent to a server and stored in a database. This information is used to improve the quality of search results for future trips.

[1222] Examples and prompts

[1223] For example, a user launches the app on their smartphone and enters the following criteria: "Kyoto," "3 days," "budget of 50,000 yen," and "temple." Based on this, the server searches the database and returns suitable tourist spots and accommodations to the device. A list of results is displayed, and the user selects "Kinkaku-ji Temple" and "Kiyomizu-dera Temple" and adds them to their bookmarks. During the trip, the smartphone uses GPS to obtain the user's current location and navigates to the next destination. After the trip, the app prompts the user to enter feedback, and the user enters a rating for each spot.

[1224] Example prompt sentence:

[1225] 1. Initial setup: The system uses the API required to search for tourist spots based on the conditions "Kyoto," "3 days," "budget of 50,000 yen," and "tourism category: temples," and retrieves the data and stores it in a database.

[1226] 2. Search: Search for tourist spots using criteria such as, "I'm planning a three-day trip to Kyoto. My budget is 50,000 yen and I want to visit temples."

[1227] 3. Travel Plan: Create a travel plan by typing, "I want to visit Kinkakuji Temple and Kiyomizudera Temple. Add this to my bookmarks."

[1228] 4. Navigation: Ask, "What is the best route from my current location to Kinkakuji Temple?"

[1229] 5. Feedback: "Please rate Kinkaku-ji Temple. Add your comments."

[1230] As described above, this system provides users with a series of processes to efficiently plan their trips, and also allows them to obtain necessary information in real time, as well as effectively collect and utilize post-trip feedback.

[1231] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1232] Step 1:

[1233] Initial settings and data integration

[1234] The server sends requests to various APIs to obtain tourist information, accommodation data, and transportation data. Specifically, it creates API requests in JSON format and sends them to each information provider site. The input is the API request URL and authentication information, and the output is a JSON response containing tourist attraction information, accommodation data, and transportation data. The received data is parsed on the server side and inserted into a database. This process is executed by an automated scheduler, for example, at 2:00 AM every day.

[1235] Step 2:

[1236] Search function based on user requests

[1237] Terminal processing:

[1238] The device allows the user to input search criteria for tourist spots and accommodations through a user interface. Specifically, the user enters criteria such as "Kyoto," "3 days," "budget of 50,000 yen," and "temple" into the search form and clicks the "Search" button. The input is the search criteria entered by the user, and the output is an API request to the server. The device converts the search criteria into JSON format and sends it to the server.

[1239] Server-side processing:

[1240] The server executes SQL queries on the database based on the received search criteria and extracts data on relevant tourist attractions and accommodations. The input is JSON data of the search criteria sent by the user, and the output is a dataset extracted based on the relevant criteria. The extracted data is sorted in a ranking format based on user ratings and popularity, and is sent back to the device in JSON format.

[1241] Step 3:

[1242] Create and manage your travel plans

[1243] Terminal processing:

[1244] The terminal displays the search results received from the server in list format. The input is the JSON data of the search results sent from the server, and the output is the list-format search results displayed on the user interface. Specifically, when the user views the detailed information of each spot and clicks the "Add to bookmarks" button, the information is added to the bookmarks.

[1245] Server-side processing:

[1246] The server calculates details such as travel time, transportation method, and total cost based on the information added to the bookmark, and sends them to the device. Specifically, it uses the Google Maps API to calculate travel time between each spot, and calculates the total cost by adding up the entrance fees and accommodation costs of the spots. The input is the data of the spots and accommodations added to the bookmark, and the output is JSON data containing the calculated details. These details are displayed to the user on the device.

[1247] Step 4:

[1248] Travel support

[1249] Terminal processing:

[1250] The device provides navigation from the current location to the next destination based on the bookmark information. It obtains the current location using the GPS function and sends a request to the Google Maps API to display the optimal route. The input is the GPS information of the current location and the data of the next destination, and the output is the optimal route obtained from the Google Maps API.

[1251] Server-side processing:

[1252] The server monitors fluctuations in traffic and weather conditions in real time, and if an abnormality occurs, it sends that information to the device via push notification. Specifically, it checks the transport API and weather information API at regular intervals, and if an abnormality is detected, it promptly sends a push notification. The input is the response data of the traffic and weather information API, and the output is the data used to send the push notification.

[1253] Step 5:

[1254] After-sales feedback

[1255] Terminal processing:

[1256] The terminal provides an interface to collect feedback and ratings from users after the trip. Specifically, a pop-up is automatically displayed after the trip ends, prompting the user to "Please provide feedback on this trip." The input is the rating and comments entered by the user, and the output is the feedback data sent to the server.

[1257] Server-side processing:

[1258] The server stores the received ratings and comments in a database and uses them to improve the quality of the next search results. Specifically, it analyzes the rating data and updates the ranking of each spot in real time based on the rating points. The input is the user's ratings and comments, and the output is the updated rating data.

[1259] (Application example 1)

[1260] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1261] Conventional travel planning systems require users to collect and analyze information themselves, which requires time and effort to create a trip plan. Furthermore, they lack real-time travel support and post-trip feedback, making it difficult to improve the user's travel experience. Furthermore, there is a lack of systems that allow users to efficiently create trip plans in virtual stores, so there is a need to improve the user experience.

[1262] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1263] In this invention, the server includes means for receiving travel search criteria from a user and extracting data on relevant tourist attractions, accommodations, transportation, etc. from a database, means for ranking the relevant data and sending it to the user's terminal, means for saving the items selected by the user and generating a bookmark, means for calculating detailed information such as the required travel time, transportation, and total cost based on the bookmark information, means for displaying the bookmark information and detailed information to the user, means for collecting and saving feedback from the user and using it to improve the quality of future search results, and means for providing a virtual guide application, thereby enabling users to efficiently plan their trips, obtain necessary information in real time, and incorporate post-trip feedback.

[1264] "Travel search conditions from users" are various requirements and desired information entered by users in order to extract relevant information from databases of tourist attractions, accommodations, transportation options, etc.

[1265] "Relevant data" refers to information on tourist attractions, accommodation, transportation, etc. extracted from the database based on the user's travel search criteria.

[1266] "Ranking" is a method of ranking extracted data based on user ratings and popularity and displaying it in list format.

[1267] "Means for transmitting to user terminal" refers to the function by which the server transmits the aligned data to the device used by the user via communication.

[1268] "User-selected items" are attractions and accommodations that a user has selected from the provided list as being of interest to them and to add to their travel plans.

[1269] "Means for generating bookmarks" is a function that creates a list (bookmark) that summarizes the details of a travel plan based on the items selected by the user.

[1270] "Travel time, transportation mode, and total cost" are factors used to calculate the travel time, transportation mode, and total cost of the trip based on the user's travel plans.

[1271] "Bookmark information and detailed information" refers to the items selected by the user as part of the travel plan, as well as specific detailed information about those items, such as travel time, transportation means, and total cost.

[1272] "User feedback" refers to ratings and comments on tourist spots and accommodations provided by users after their trip.

[1273] A "virtual guide application" is application software that allows users to use functions such as travel planning, real-time navigation, and feedback collection through smart devices.

[1274] A "generative AI model" is an artificial intelligence system that uses machine learning algorithms to optimize tourist spot rankings and travel plans based on user search criteria.

[1275] A "prompt" is an instruction or search keyword that enables a generative AI model to derive appropriate results based on user input.

[1276] The embodiment of the present invention is a system that provides a virtual guide application for efficiently planning a trip. The main components of the system and their specific functions will be described below.

[1277] System Components

[1278] 1. Server

[1279] Data extraction function: The server sends requests to various APIs to obtain tourist information, accommodation data, and transportation data. For example, a tourist information API is used to obtain information about tourist attractions in a specific area and store it in a database. This information includes the spot name, location, rating, photos, etc.

[1280] Search and ranking function: The server creates a query in the database based on the travel search criteria received from the user, extracts the relevant data, sorts the extracted data in a ranking format based on user ratings and popularity, and sends it to the user's device.

[1281] Calculation and display function: The server adds the user's selected items to the bookmarks and calculates detailed information such as the required travel time, transportation means, total cost, etc. The calculated detailed information is sent to the user's terminal, which then displays it to the user.

[1282] Feedback collection function: The server receives feedback and ratings from users, stores them in a database, and uses them to improve the quality of search results next time.

[1283] 2. User Device

[1284] Interface function: The device allows the user to input search criteria for tourist spots and accommodations through the user interface. For example, if the user inputs criteria such as "Kyoto," "3 days," "budget 50,000 yen," and "tourism category: temples," the device sends this to the server.

[1285] Navigation function: Provides navigation from the current location to the next destination based on bookmark information. Uses GPS to obtain the current location and displays the optimal route to the destination.

[1286] Real-time information provision function: When traffic information or changes in weather conditions are sent from the server in real time, the device will provide that information to the user via push notification and suggest appropriate detour routes.

[1287] 3. Users

[1288] Entering search criteria: Users enter their travel criteria (e.g., location, budget, dates, etc.) through the interface.

[1289] Selection from a list: The search results received from the server are displayed in a list format, and the user can select tourist attractions and accommodations that interest them and add them to their bookmarks.

[1290] Providing feedback: After completing a trip, users can leave ratings and comments about each attraction and accommodation.

[1291] Hardware and software used

[1292] Hardware: User devices such as smartphones and smart glasses, and cloud servers

[1293] Software: Flask, requests library, GPS function

[1294] Specific examples

[1295] Assume that User A is planning a three-day trip to Kyoto. Their budget is 50,000 yen, and they are interested in "temples." When User A enters their search criteria into the app, the app retrieves information about Kyoto's temples from a tourist information API. The app displays a ranking of the top spots (e.g., "Kinkaku-ji Temple" and "Kiyomizu-dera Temple") based on user ratings. User A selects "Kinkaku-ji Temple" and "Kiyomizu-dera Temple" and adds them to their bookmarks. The app calculates the total cost and travel time required, and displays these to the user. The app also navigates User A during the trip, providing real-time information such as traffic delays. After the trip is over, User A leaves ratings and comments on tourist spots and accommodations through the app.

[1296] Prompt Sentence Examples

[1297] "I'm planning a three-day trip to Kyoto. My budget is 50,000 yen, and I'm interested in temples. Please suggest an app that will help me search for tourist spots, display rankings, and help me create a trip plan. I'd also like navigation and real-time information during my trip, and collect feedback after my trip."

[1298] As described above, by using this system, users can efficiently plan their trips, obtain necessary information in real time, and incorporate feedback after the trip.

[1299] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1300] Step 1:

[1301] Description: User enters travel search criteria, including, for example, location, budget, dates, and category of sightseeing (e.g., temples).

[1302] Specific operation: The user enters conditions such as "Kyoto," "3 days," "budget 50,000 yen," and "tourist category: temples" through an application on a smartphone or smart glasses.

[1303] Input: User's travel criteria (location, budget, dates, category).

[1304] Output: The entered travel conditions are saved on the terminal and sent to the server.

[1305] Step 2:

[1306] Description: The server queries a database based on the received travel search criteria to extract relevant attraction, accommodation, and transportation data.

[1307] Specific operation: Uses the tourist information API to obtain tourist spot information for a specific area (e.g., Kyoto) and save it in a database.

[1308] Input: User's travel requirements.

[1309] Output: Data on relevant attractions, accommodation and transportation options.

[1310] Step 3:

[1311] Description: The server sorts the extracted data into a ranking format based on user ratings and popularity, and sends it to the user's device.

[1312] Specific operation: The data obtained from the API is sorted by user rating and then ranked. The ranking results are then sent to the user's device.

[1313] Input: Extracted tourist attraction, accommodation, and transportation data.

[1314] Output: Data sorted into ranking format.

[1315] Step 4:

[1316] Description: The user can view the search results received from the server in a list format, select items of interest and add them to their bookmarks.

[1317] Specific operation: Select an item of interest such as "Kinkaku-ji Temple" or "Kiyomizu-dera Temple" from the list of tourist spots and accommodations displayed on the device and add it to your bookmarks.

[1318] Input: Data sorted into ranking format.

[1319] Output: A list of attractions and accommodations selected by the user.

[1320] Step 5:

[1321] Description: The server calculates details such as travel time, transportation means, and total cost based on the information added to the bookmark.

[1322] Specific operation: Based on the tourist attractions and accommodations added to the bookmarks, the travel route is calculated, and the means of transportation to be used, their costs, and total travel time are calculated.

[1323] Input: Information about attractions and accommodations added to bookmarks.

[1324] Output: Detailed information such as required travel time, transportation mode, and total cost.

[1325] Step 6:

[1326] Description: The server sends the calculated details to the user terminal, which displays them to the user.

[1327] Specific operation: Send detailed information to the user terminal, and the terminal displays the information through the user interface.

[1328] Input: Details such as required travel time, mode of transportation, and total cost.

[1329] Output: Detailed information about the trip plan displayed on the user's device.

[1330] Step 7:

[1331] Description: During the trip, the device provides navigation based on bookmark information and receives real-time information from the server to notify the user.

[1332] Specific operation: Uses GPS to obtain current location and displays the optimal route to the next destination. If there is a public transport delay, the user will be notified via push notification and an alternative route will be suggested.

[1333] Input: Bookmark information, real-time traffic information.

[1334] Output: Navigation instructions, emergency push notifications, and alternative route suggestions.

[1335] Step 8:

[1336] Description: After completing a trip, users enter their feedback and ratings, which are collected by the server and stored in a database.

[1337] What it does: Users enter ratings and comments for attractions and accommodations, and the server stores that information in a database. It uses this information to improve search results the next time.

[1338] Input: User feedback and ratings.

[1339] Output: Feedback information stored in a database.

[1340] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1341] The present invention provides a system that allows users to efficiently plan their trips. This system incorporates an emotion engine that recognizes the user's emotions and reflects them in suggesting travel destinations and customizing the plan. Specific program processing of the system and its implementation are described below.

[1342] Program processing flow

[1343] 1. Initial settings and data integration

[1344] server

[1345] The server sends requests to various APIs to obtain tourist information, accommodation data, and transportation data.

[1346] The acquired data is stored in a database, including tourist spot names, locations, ratings, photos, etc.

[1347] 2. Search function based on user requests

[1348] Terminal

[1349] The terminal allows the user to input search criteria (e.g., location, budget, dates, etc.) for tourist spots and accommodations through a user interface.

[1350] When a user enters search criteria and presses the search button, the terminal sends the criteria to the server.

[1351] server

[1352] The server generates a query to the database based on the received search criteria.

[1353] Run the query to extract relevant attraction and accommodation entries.

[1354] The extracted entries are ranked based on user ratings and popularity.

[1355] Send ranked search results to your device.

[1356] Terminal

[1357] The terminal displays the search results received from the server to the user, who then selects a spot of interest from the displayed list.

[1358] 3. Utilizing the Emotion Engine

[1359] Terminal

[1360] When users enter travel search criteria, they also enter their emotions at the time (for example, through text input or facial expression recognition).

[1361] The terminal transmits the input emotion data to the emotion engine.

[1362] server

[1363] The server's emotion engine analyzes the received emotion data and recommends tourist spots and activities accordingly.

[1364] For example, if a user inputs the emotion "I want to relax," relaxation facilities and quiet tourist spots will be displayed preferentially.

[1365] 4. Creating and managing travel plans

[1366] Terminal

[1367] Users can add selected items from the search results to their bookmarks.

[1368] The terminal transmits the information added to the bookmark and the emotion data to the server.

[1369] server

[1370] The server stores the information added to the bookmark in a database and calculates details such as the required travel time, transportation means, and total cost.

[1371] The calculated details are sent to the terminal, which displays them to the user.

[1372] It provides customized suggestions by taking into account the bookmark content as well as the user's past ratings and sentiment data.

[1373] 5. Travel support

[1374] Terminal

[1375] The device provides navigation from the current location to the next destination based on the bookmark information.

[1376] Uses the GPS function to obtain your current location and display the optimal route to your destination.

[1377] server

[1378] It monitors changes in traffic information and weather conditions in real time, and if an abnormality occurs, the information is sent to the device via push notification.

[1379] The device notifies the user of the emergency information received from the server and prompts them to take appropriate action.

[1380] 6. After-sales feedback

[1381] Terminal

[1382] Provide an interface to collect user feedback and ratings after the trip is completed.

[1383] User

[1384] Enter your ratings and comments about each tourist attraction and accommodation.

[1385] server

[1386] The collected ratings and comments are stored in a database and used to improve the quality of search results next time.

[1387] Specific examples

[1388] For example, if a user selects "Kyoto" as a travel destination and enters emotions such as "relaxation" or "a desire to experience nature" as search criteria, the emotion engine will analyze these emotions and prioritize suggestions such as the bamboo forest path or the tranquil temples of Ohara. Furthermore, if a user frequently records the emotion "fun" during their trip, that emotional data will be used to suggest more activities and entertainment facilities for the next trip.

[1389] In this way, by utilizing the emotion engine, it is possible to provide optimal travel plans based on the user's emotions. It is also possible to further personalize the next proposal based on feedback during and after the trip.

[1390] The processing flow will be explained below.

[1391] Program processing flow

[1392] 1. Initial settings and data integration

[1393] Step 1:

[1394] The server sends requests to various APIs to obtain tourist information, accommodation data, and transportation data.

[1395] Step 2:

[1396] The server stores the acquired data in a database by category, including tourist spot names, locations, ratings, photos, etc.

[1397] Step 3:

[1398] The server periodically calls the API to update the database with new data and updates.

[1399] 2. Search function based on user requests

[1400] Step 4:

[1401] The terminal allows the user to input search criteria (e.g., location, budget, dates, etc.) for tourist spots and accommodations through a user interface.

[1402] Step 5:

[1403] When a user enters search criteria and presses the search button, the terminal sends the criteria to the server.

[1404] Step 6:

[1405] The server generates a query to the database based on the received search criteria.

[1406] Step 7:

[1407] The server executes the query and extracts relevant tourist attraction and accommodation entries.

[1408] Step 8:

[1409] The server ranks the extracted entries based on popularity and ratings.

[1410] Step 9:

[1411] The server transmits the ranked search results to the terminal.

[1412] Step 10:

[1413] The terminal displays the search results received from the server to the user, who then selects a spot of interest from the displayed list.

[1414] 3. Utilizing the Emotion Engine

[1415] Step 11:

[1416] When users enter search criteria, the device also prompts them to enter their emotional data, which is acquired through text input and real-time facial recognition.

[1417] Step 12:

[1418] The terminal transmits the input emotion data to the emotion engine of the server.

[1419] Step 13:

[1420] The server's emotion engine analyzes the received emotion data and recommends tourist spots and activities accordingly.

[1421] Step 14:

[1422] The server then sends the results of its recommendations for the most suitable tourist spots and activities to the user based on the emotion engine to the terminal.

[1423] 4. Creating and managing travel plans

[1424] Step 15:

[1425] Users can add selected items from the search results to their bookmarks.

[1426] Step 16:

[1427] The terminal transmits the information added to the bookmark to the server.

[1428] Step 17:

[1429] The server stores the information added to the bookmark in a database and calculates details such as the required travel time, transportation means, and total cost.

[1430] Step 18:

[1431] The server sends the calculated details to the terminal, which displays them to the user.

[1432] Step 19:

[1433] The server takes into account the bookmark content as well as the user's past ratings and sentiment data to provide customized suggestions.

[1434] 5. Travel support

[1435] Step 20:

[1436] The device provides navigation from the current location to the next destination based on the bookmark information.

[1437] Step 21:

[1438] Uses the device's GPS function to obtain your current location and display the optimal route to your destination.

[1439] Step 22:

[1440] The server monitors traffic information and changes in weather conditions in real time.

[1441] Step 23:

[1442] If an abnormality occurs, the server sends the information to the device via push notification.

[1443] Step 24:

[1444] The device notifies the user of the emergency information received from the server and prompts them to take appropriate action.

[1445] 6. After-sales feedback

[1446] Step 25:

[1447] The terminal provides an interface to collect feedback and ratings from users after the trip is completed.

[1448] Step 26:

[1449] Users enter ratings and comments about each tourist spot and accommodation.

[1450] Step 27:

[1451] The terminal transmits the collected ratings and comments to the server.

[1452] Step 28:

[1453] The server stores the received ratings and comments in a database.

[1454] Step 29:

[1455] The server uses the stored feedback to adjust the algorithm it uses to improve the quality of search results next time.

[1456] Specific examples

[1457] For example, if a user selects "Kyoto" as a travel destination and enters emotions such as "relaxation" or "a desire to experience nature" as search criteria, the emotion engine will analyze these emotions and prioritize suggestions such as the bamboo forest path or the tranquil temples of Ohara. Furthermore, if a user frequently records the emotion "fun" during their trip, that emotional data will be used to suggest more activities and entertainment facilities for the next trip.

[1458] In this way, by utilizing the emotion engine, it is possible to provide optimal travel plans based on the user's emotions, and further personalize the next suggestions based on feedback during and after the trip.

[1459] Example 2

[1460] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1461] Conventional travel planning systems lacked suggestions based on user emotions and intuition, making it difficult to provide optimal travel plans for individual users. They also lacked the functionality to respond to real-time traffic information and weather conditions. This resulted in problems that reduced user satisfaction and the quality of the travel experience.

[1462] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1463] In this invention, the server includes means for receiving travel search conditions from a user and extracting data on relevant tourist destinations, accommodations, means of transportation, etc. from a database, means for ranking the relevant data and sending it to the user terminal, means for saving the items selected by the user and generating a bookmark, means for calculating detailed information such as the required travel time, means of transportation, and total cost based on the bookmark information, means for displaying the bookmark information and detailed information to the user, and means for receiving user emotion data and making suggestions based on the emotion. This makes it possible to provide optimal travel plans based on the user's emotions and intuition, and to provide travel support based on real-time information.

[1464] "Receive travel search conditions from the user" refers to the operation in which the system collects information such as travel destination, budget, and schedule provided by the user.

[1465] "Data on tourist attractions, accommodation, transportation, etc." refers to specific information on tourist attractions, accommodation options, transportation, etc. related to travel.

[1466] "Extracting from a database" refers to the act of searching and retrieving relevant information from a database based on specific conditions.

[1467] "Ranking and sending to user's device" refers to sorting search results based on user ratings and popularity, and transferring the list to the user's device.

[1468] "Saving the items selected by the user and generating a bookmark" refers to the action of saving information such as the travel destination and accommodation selected by the user, and creating a document summarizing the travel plan based on that information.

[1469] "Calculating detailed information such as required travel time, transportation means, and total cost based on bookmark information" refers to the process of calculating travel time, transportation means to choose, and total travel costs based on information about tourist attractions and accommodations listed in the bookmark.

[1470] "Displaying bookmark information and detailed information to the user" refers to the action of presenting the calculated and organized details of the travel plan to the user in an easy-to-read format.

[1471] "Receive the user's emotional data and make suggestions based on the emotion" refers to the process of obtaining the emotional information entered by the user (e.g., wanting to relax, wanting to have fun, etc.) and recommending an appropriate travel plan based on that information.

[1472] "Providing a navigation function from the current location to the next destination based on bookmark information" refers to the operation of guiding the user on how to get from their current location to their destination by referring to the information contained in the bookmark.

[1473] "Monitoring changes in travel information and weather conditions in real time and notifying the user of emergency information" means constantly checking the latest travel status and weather information, and immediately contacting the user's device if any abnormalities occur.

[1474] "Receive user feedback and ratings, store them in a database, and use them to improve the quality of search results in the future" refers to the action of collecting reviews and ratings provided by users after their trip, storing them in a database to help improve search results in the future.

[1475] The present invention is a system that allows users to efficiently plan their trips. This system incorporates an emotion engine that recognizes the user's emotions and reflects them in suggesting travel destinations and customizing the plan. Specific program processing and embodiments of the system are described below.

[1476] Initial settings and data integration

[1477] server

[1478] The server sends requests to multiple external APIs (e.g., tourist destination information API and hotel reservation API) to obtain tourist information, accommodation data, and transportation data.

[1479] The acquired data includes tourist spot names, locations, ratings, photos, etc., and is stored in a database (e.g., a MySQL database).

[1480] Search function based on user requests

[1481] Terminal

[1482] Users use an interface to input search criteria such as travel destination, budget, dates, number of people, etc. For example, they can input criteria such as "I want to travel to Kyoto in March, with a budget of 50,000 yen or less."

[1483] server

[1484] The server creates a query to the database based on the received search criteria and extracts data on relevant tourist destinations and accommodations, for example, using a MySQL query.

[1485] The extracted data is sorted into a ranking format based on user ratings and popularity and sent to the device.

[1486] Terminal

[1487] The terminal displays the search results received from the server in a ranked format to the user, who can then select spots of interest from the list.

[1488] Utilizing the Emotion Engine

[1489] Terminal

[1490] When users enter their travel search criteria, they also input their emotions (e.g., "I want to relax") via text input and facial expression recognition.

[1491] server

[1492] The server's emotion engine analyzes the received emotion data and recommends tourist spots and activities according to that emotion. For example, if the user inputs "I want to relax," it will prioritize relaxation facilities and quiet tourist spots.

[1493] Create and manage your travel plans

[1494] Terminal

[1495] Users can add selected items from the search results to their "bookmarks," which are tentative schedules that summarize their travel plans.

[1496] server

[1497] The server stores the information added to the bookmark in a database and calculates travel time, transportation methods, and total costs as needed, for example using the Google Maps API to calculate travel time.

[1498] The calculation results are sent to the terminal and displayed to the user.

[1499] Travel support

[1500] Terminal

[1501] The device provides navigation from the current location to the next destination based on the bookmark information, using the GPS function to obtain the current location and display the optimal route.

[1502] server

[1503] Traffic information and changes in weather conditions are monitored in real time, and if any abnormalities occur, push notifications are sent to the device.

[1504] The device will notify the user of the received emergency information and prompt them to take appropriate action.

[1505] After-sales feedback

[1506] Terminal

[1507] After completing the trip, users have an interface to enter feedback and ratings.

[1508] User

[1509] Enter your ratings and comments about each tourist attraction and accommodation.

[1510] server

[1511] The collected ratings and comments are stored in a database and used to improve the quality of search results next time.

[1512] Specific examples

[1513] For example, if a user selects "Kyoto" as a travel destination and enters emotions such as "relaxation" or "a desire to experience nature" as search criteria, the emotion engine will analyze this emotion and prioritize suggestions for the bamboo forest path or the tranquil temples of Ohara. Also, if the user frequently records "fun" during their trip, that emotional data will be used to suggest more activities and entertainment facilities for their next trip.

[1514] Example prompts to input to the generative AI model

[1515] If I choose "Kyoto" as my travel destination and input emotions such as "relaxation" and "wanting to feel nature," what tourist spots would you recommend?

[1516] In this way, the system of the present invention aims to provide an optimal travel plan that takes into account the user's emotional data and improve user satisfaction.

[1517] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1518] Program processing flow and specific steps

[1519] Step 1: Initial setup and data integration

[1520] The server sends requests to multiple external APIs to obtain tourist information, accommodation data, and transportation data. For example, it can send requests to a tourist attraction information API or a hotel reservation API. Input: Data request from external API. Output: Tourist attraction information, accommodation list, transportation data. Specific operation: Obtain tourist attraction names, locations, photos, etc. and save them in a MySQL database.

[1521] Step 2: Search function based on user requests

[1522] The terminal displays an interface for the user to input search criteria such as travel destination, budget, dates, number of people, etc. For example, the user inputs criteria such as "I want to travel to Kyoto in March, with a budget of 50,000 yen or less." Input: Search criteria from the user. Output: List of searched tourist spots and accommodations. Specific operation: The entered search criteria are sent from the terminal to the server by pressing the search button.

[1523] Step 3: Creating and Executing a Database Query

[1524] The server creates a query to the database based on the received search criteria. For example, it creates a MySQL query to extract information on relevant tourist attractions and accommodations. Input: Search criteria. Output: List of search results. Specific operation: Executes a database query to obtain information on tourist attractions and accommodations.

[1525] Step 4: Sort and submit search results

[1526] The server sorts the extracted data into a ranking format based on user ratings and popularity, and sends it to the terminal. Input: Search result data. Output: Search results sorted in ranking format. Specific operation: Ranking is performed based on rating scores and number of reservations, and the sorted data is sent to the terminal.

[1527] Step 5: Viewing search results

[1528] The device displays the search results received from the server to the user, allowing the user to select spots of interest. For example, "Kiyomizu-dera Temple" or "Nijo Castle" are displayed. Input: Sorted search results. Output: List of tourist spots displayed to the user. Specific operation: Displayed in ranking format, allowing the user to check details.

[1529] Step 6: Enter and submit emotion data

[1530] The device provides an interface that allows users to input their emotions at the time they enter travel search criteria. For example, they can input emotions such as "I want to relax." Input: Emotional data from the user. Output: Emotional data sent to the server. Specific operations: The emotion input field is displayed, and the entered data is transferred to the server.

[1531] Step 7: Analyze sentiment data and make recommendations

[1532] The server uses an emotion engine to analyze the received emotion data and recommends tourist spots and activities accordingly. For example, if the emotion is "I want to relax," it will prioritize relaxation facilities and quiet tourist spots. Input: User emotion data. Output: Recommendation of tourist spots based on emotion. Specific operation: Analyzes the emotion data, generates an appropriate recommendation list, and sends it to the device.

[1533] Step 8: Add information to your bookmarks

[1534] The device adds the items the user selects from the search results to the "bookmarks." Input: Tourist attractions and accommodations selected by the user. Output: Updates the bookmark. Specific operations: Adds the selected information to the bookmarks and sends the contents to the server.

[1535] Step 9: Save and calculate bookmark information

[1536] The server saves the information added to the bookmark in a database and calculates the required travel time, transportation means, and total cost. For example, it calculates travel time using the Google Maps API. Input: Bookmark information. Output: Calculated travel time, transportation means, and total cost. Specific operation: Calculates travel time and transportation means options and displays them to the user.

[1537] Step 10: Navigate while traveling

[1538] The device provides navigation from the current location to the next destination based on the bookmark information. For example, it uses the GPS function to obtain the current location and uses Google Maps to present the optimal route. Input: Bookmarks and current location. Output: Navigation information. Specific operation: Obtaining the current location and displaying route guidance.

[1539] Step 11: Real-time information notification

[1540] The server monitors changes in traffic information and weather conditions in real time, and sends push notifications to the device if any abnormalities occur. Input: Real-time information. Output: Emergency information notification. Specific operation: Monitors changes in traffic information and weather, and sends alerts as necessary.

[1541] Step 12: Gathering after-sales feedback

[1542] The device provides an interface to collect feedback and ratings from users after the trip. Input: User ratings and feedback. Output: Saving of rating data. Specific operation: The ratings entered by the user are sent to the server and stored in a database. They are used to make suggestions for the next trip.

[1543] (Application example 2)

[1544] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1545] Conventional travel planning systems do not provide a way for users to select destinations, accommodations, restaurants, etc. based on their emotions or moods. This makes it difficult for users to select appropriate destinations and services that match their emotions at the time, resulting in lower trip satisfaction. Furthermore, meal suggestions during a trip do not reflect the user's emotions and are time-consuming and cumbersome.

[1546] The identification process by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving travel search conditions from a user and extracting data on relevant tourist spots, accommodations, transportation methods, etc. from a database; means for ranking the relevant data and sending it to the user terminal; means for saving the items selected by the user and generating a bookmark; means for calculating detailed information such as the required travel time, transportation method, and total cost based on the bookmark information; means for displaying the bookmark information and detailed information to the user; means for inputting user emotion data, analyzing the data, and recommending relevant tourist spots and accommodations based on the analysis results in accordance with the user's emotion; means for recommending restaurants and dishes based on the emotion data; and means for adjusting the recommended restaurants and dishes based on the user's emotion data. This allows the user to receive optimal travel plans and meal suggestions tailored to their emotions and mood.

[1547] "Travel search conditions" are information that indicates the user's criteria and preferences for tourist spots, accommodations, transportation, etc. related to the trip.

[1548] "Tourist attractions" are places and facilities that tourists visit for sightseeing and experiences.

[1549] "Accommodation facilities" are facilities for travelers to stay temporarily, and include hotels, inns, and guesthouses.

[1550] "Transportation" refers to the method or vehicle used by travelers to travel to their destination, including trains, buses, taxis, airplanes, etc.

[1551] A "database" is a system or structure for efficiently storing, retrieving, and updating large amounts of data.

[1552] A "ranking format" is a way of ranking things based on certain criteria.

[1553] A "user terminal" is a device that a user operates to access the system, and includes smartphones, tablets, and personal computers.

[1554] A "bookmark" is a collection of information about a travel plan, including tourist spots, travel time, transportation options, and costs.

[1555] "Emotional data" is information that represents a user's emotions and mood, and is collected through text input, facial expression recognition, etc.

[1556] The "emotion engine" is a system that analyzes users' emotional data and reflects the results in travel plans and meal suggestions.

[1557] "Restaurant" means a food and beverage establishment that serves meals.

[1558] "Food" means the food or dishes served in a restaurant or dining establishment.

[1559] An "endorsement" is a recommendation or suggestion based on specific criteria.

[1560] "Data analysis" is the process of analyzing collected data to find specific patterns and trends.

[1561] This invention is a system that allows users to efficiently plan their trips, and its main feature is the use of an emotion engine. This system is composed of a server and a user terminal. Specific processing procedures and embodiments of this system are described below.

[1562] 1. Initial settings and data integration

[1563] The server sends requests to various APIs to obtain tourist information, accommodation data, and transportation data. The obtained data is stored in a database. This data includes tourist spot names, locations, ratings, photos, etc. It is expected that external tourist information APIs will be used to obtain specific tourist information.

[1564] 2. Search function based on user requests

[1565] The user device allows the user to input search criteria for tourist attractions and accommodations (e.g., location, budget, dates, etc.) through a user interface. When the user inputs the search criteria and presses the search button, the device sends the criteria to the server. The server creates a query to the database based on the received search criteria. It executes this query and extracts entries for relevant tourist attractions and accommodations. The extracted entries are ranked based on user ratings and popularity and sent from the server to the device. The device displays the search results received from the server to the user.

[1566] 3. Utilizing the Emotion Engine

[1567] When users enter travel search criteria, they also input their emotions at that time (for example, through text input or facial expression recognition). The user's device sends the input emotion data to the emotion engine. The server's emotion engine analyzes the received emotion data and recommends tourist spots and activities accordingly. This analysis can use a generative AI model. For example, if a user inputs the emotion "I want to relax," relaxation facilities and quiet tourist spots will be displayed preferentially.

[1568] 4. Creating and managing travel plans

[1569] The user adds the selected item from the search results to a "bookmark." The user's device sends the information added to the bookmark and emotional data to the server. The server stores the information added to the bookmark in a database and calculates detailed information such as the required travel time, transportation method, and total cost. The server sends the calculated detailed information to the device, which displays it to the user. The server provides customized suggestions by taking into account the bookmark content as well as the user's past ratings and emotional data.

[1570] 5. Travel support

[1571] The user's device provides navigation from the current location to the next destination based on the bookmark information. It uses the GPS function to obtain the current location and displays the optimal route to the destination. The server monitors traffic information and changes in weather conditions in real time, and if an abnormality occurs, sends that information to the user's device via push notification. The device notifies the user of the emergency information received from the server and encourages appropriate action.

[1572] 6. After-sales feedback

[1573] After the trip is over, feedback and ratings from users are collected via their devices. Users enter ratings and comments about each tourist spot and accommodation. The server stores the collected ratings and comments in a database and uses them to improve the quality of search results in the future. Emotional data is also used in this feedback process, allowing the system to make more accurate suggestions based on the user's emotions in future trips.

[1574] Examples of specific examples and prompts

[1575] For example, if a user selects "Kyoto" as a travel destination and enters emotions such as "relaxation" or "want to feel nature" as search criteria, the emotion engine will analyze this emotion and prioritize suggestions such as bamboo forest paths and tranquil temples. Also, if a user frequently records the emotion "fun" during their trip, that emotional data will be used to suggest more activities and entertainment facilities for their next trip.

[1576] Example prompts for generative AI models

[1577] Prompts for parsing in the emotion engine:

[1578] "A user types in 'I want to relax.' Suggest the best attractions and accommodations based on this sentiment."

[1579] Food delivery app prompt:

[1580] "A user types, 'I want to relax.' Suggest the best restaurants and dishes based on this emotion."

[1581] The above is a detailed description of the embodiment of the present invention, which makes it possible to propose travel plans and services customized according to the user's emotions.

[1582] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1583] Step 1:

[1584] The user terminal allows the user to input travel search criteria (e.g., location, budget, dates, etc.) and their current emotions (e.g., wanting to relax, wanting to feel energized, etc.) through a user interface. The user inputs these search criteria and emotions and presses the search button. The input data is packetized in the form of travel search criteria and emotion data and sent to the server. Input: travel search criteria, emotion data. Output: data packet.

[1585] Step 2:

[1586] The server creates a query to the database based on the search criteria and emotion data received from the user. This query is an instruction to retrieve entries from the tourist attraction, accommodation, and transportation databases that match the user's search criteria. When the query is executed, the corresponding data entries are retrieved. Input: Search criteria, emotion data. Output: Corresponding data entries.

[1587] Step 3:

[1588] The server ranks the extracted data entries based on user ratings and popularity. The ranking is done by an algorithm and arranged in an order optimized for the user's search criteria and sentiment data. This ranked data is sent to the user's device. Input: Extracted data entries. Output: Ranked data.

[1589] Step 4:

[1590] The user device displays the ranked data received from the server to the user. The user selects tourist spots and accommodations that interest them from the displayed list. This selected data is added to a "bookmark." The device sends the information and emotion data added to the bookmark to the server. Input: Ranked data. Output: Selected data.

[1591] Step 5:

[1592] The server stores the information added to the bookmark in a database and calculates detailed information such as the required travel time, transportation method, and total cost based on this information. The calculated detailed information is sent to the user's device. Input: Bookmark information, emotion data. Output: Detailed information on travel time, transportation method, and total cost.

[1593] Step 6:

[1594] The user terminal displays the detailed information received from the server to the user. The user makes a detailed travel plan based on this information. Input: Detailed information. Output: Travel plan displayed to the user.

[1595] Step 7:

[1596] The server uses GPS to obtain the user's current location while traveling and provides navigation to the next destination based on bookmark information. It also monitors traffic information and weather condition changes in real time and notifies the user of emergency information. Input: Current location, traffic information, weather conditions. Output: Navigation, emergency information notification.

[1597] Step 8:

[1598] After the trip is over, the user device provides an interface to receive feedback and ratings from the user. The user enters ratings and comments about each tourist spot and accommodation. This feedback data is sent to the server and stored in a database to improve the quality of search results next time. Input: Feedback, rating data. Output: Feedback data stored in the database.

[1599] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1600] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1601] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1602] [Fourth embodiment]

[1603] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1604] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1605] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1606] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1607] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1608] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1609] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1610] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1611] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1612] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1613] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1614] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1615] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1616] The present invention provides a system that allows users to efficiently plan their trips. This system allows users to search for travel destination information in bulk, display it in a ranking format, and easily create travel plans. It also provides information in real time and collects feedback after the trip.

[1617] Program processing flow

[1618] 1. Initial settings and data integration

[1619] server

[1620] The server sends requests to various APIs to obtain tourist information, accommodation data, and transportation data.

[1621] For example, a tourist information API can be used to retrieve information about tourist attractions in a specific area and store it in a database, including the spot name, location, rating, and photos.

[1622] 2. Search function based on user requests

[1623] Terminal

[1624] The terminal allows the user to input search criteria (e.g., location, budget, dates, etc.) for tourist spots and accommodations through a user interface.

[1625] For example, if a user enters conditions such as "Kyoto," "3 days," "budget 50,000 yen," and "tourist category: temples," the device will send this to the server.

[1626] server

[1627] The server creates a query in the database based on the received search criteria and extracts the relevant data.

[1628] The extracted data is ranked based on user ratings and popularity and sent to the device.

[1629] 3. Creating and managing travel plans

[1630] Terminal

[1631] The terminal displays the search results received from the server in a list format.

[1632] It provides users with the ability to select items of interest and add them to their bookmarks.

[1633] User

[1634] For example, a user selects "Kinkaku-ji Temple" and "Kiyomizu-dera Temple" from the search results and adds them to the bookmarks.

[1635] server

[1636] The server stores the information added to the bookmark in a database and calculates details such as the required travel time, transportation means, and total cost.

[1637] The calculated details are sent to the terminal, which displays them to the user.

[1638] 4. Travel support

[1639] Terminal

[1640] The device provides navigation from the current location to the next destination based on the bookmark information.

[1641] Uses the GPS function to obtain your current location and display the optimal route to your destination.

[1642] server

[1643] The server monitors traffic information and changes in weather conditions in real time, and if an abnormality occurs, it sends the information to the device via push notification.

[1644] Terminal

[1645] For example, if there is information about a public transport delay, the device will notify the user of that information and suggest an appropriate detour route.

[1646] 5. After-sales feedback

[1647] Terminal

[1648] The terminal provides an interface to collect feedback and ratings from users after the trip is completed.

[1649] User

[1650] Users enter ratings and comments about each spot and accommodation.

[1651] server

[1652] The server stores the received ratings and comments in a database and uses them to improve the quality of search results the next time.

[1653] For example, based on user ratings, the next time the app displays more highly rated spots and facilities.

[1654] In this way, users can efficiently plan their trips, obtain necessary information in real time, and incorporate post-trip feedback, improving the user experience and encouraging long-term usage.

[1655] The processing flow will be explained below.

[1656] Program processing flow

[1657] 1. Initial settings and data integration

[1658] Step 1:

[1659] The server sends requests to various APIs to obtain tourist information, accommodation data, and transportation data.

[1660] Step 2:

[1661] The server stores the acquired data in a database, including tourist spot names, locations, ratings, photos, etc.

[1662] Step 3:

[1663] The server periodically calls the API to update the database with new data and updates.

[1664] 2. Search function based on user requests

[1665] Step 4:

[1666] The terminal allows the user to input search criteria (e.g., location, budget, dates, etc.) for tourist spots and accommodations through a user interface.

[1667] Step 5:

[1668] When a user enters search criteria and presses the search button, the terminal sends the criteria to the server.

[1669] Step 6:

[1670] The server generates a query to the database based on the received search criteria.

[1671] Step 7:

[1672] The server executes the query and extracts relevant tourist attraction and accommodation entries.

[1673] Step 8:

[1674] The server ranks the extracted entries based on popularity and ratings.

[1675] Step 9:

[1676] The server transmits the ranked search results to the terminal.

[1677] Step 10:

[1678] The terminal displays the search results received from the server to the user, who then selects a spot of interest from the displayed list.

[1679] 3. Creating and managing travel plans

[1680] Step 11:

[1681] Users can add selected items from the search results to their bookmarks.

[1682] Step 12:

[1683] The terminal transmits the information added to the bookmark to the server.

[1684] Step 13:

[1685] The server stores the information added to the bookmark in a database.

[1686] Step 14:

[1687] The server calculates detailed information such as the required travel time, transportation method, and total cost based on the bookmark information.

[1688] Step 15:

[1689] The server sends the calculated details to the terminal.

[1690] Step 16:

[1691] The device displays the bookmark information and calculated details to the user.

[1692] 4. Travel support

[1693] Step 17:

[1694] The user's device provides navigation from the current location to the next destination based on the bookmark information.

[1695] Step 18:

[1696] Uses the device's GPS function to obtain your current location and display the optimal route to your destination.

[1697] Step 19:

[1698] The server monitors traffic information and changes in weather conditions in real time.

[1699] Step 20:

[1700] If an abnormality occurs, the server sends the information to the device via push notification.

[1701] Step 21:

[1702] The device notifies the user of the emergency information received from the server and prompts them to take appropriate action.

[1703] 5. After-sales feedback

[1704] Step 22:

[1705] The terminal provides an interface to collect feedback and ratings from users after the trip is completed.

[1706] Step 23:

[1707] Users enter ratings and comments about each tourist spot and accommodation.

[1708] Step 24:

[1709] The terminal transmits the collected ratings and comments to the server.

[1710] Step 25:

[1711] The server stores the received ratings and comments in a database.

[1712] Step 26:

[1713] The server uses the stored feedback to adjust the algorithm it uses to improve the quality of search results next time.

[1714] Example 1

[1715] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1716] When planning a trip, users must individually research information on numerous tourist spots, accommodations, and transportation options, which is time-consuming and laborious. It is also difficult to provide real-time information and effectively utilize post-trip feedback. These issues need to be resolved.

[1717] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1718] In this invention, the server includes means for receiving travel search conditions from a user and extracting data such as relevant location information, accommodation information, and transportation information from a database, means for sorting the relevant data in order of priority and sending it to the user terminal, means for saving the items selected by the user and generating a travel plan, means for calculating detailed information such as the required travel time, transportation means, and total cost based on the travel plan information, and means for displaying the travel plan information and detailed information to the user. This enables users to efficiently plan their travels, makes it easier to obtain necessary information in real time, and effectively utilizes feedback after the trip.

[1719] "Travel search conditions" refer to detailed information such as the user's desired travel destination, duration, budget, and category of visits.

[1720] "Location information" refers to information about tourist attractions, famous places, and facilities, including their locations, addresses, ratings, and photos.

[1721] "Accommodation information" refers to information about accommodation facilities such as hotels, inns, and guesthouses, including room types, prices, ratings, and locations.

[1722] "Transportation information" refers to information about means of transportation such as trains, buses, taxis, rental cars, and airplanes.

[1723] A "database" refers to a structured collection of information that allows a system to store and retrieve information.

[1724] "Sort by highest priority" refers to sorting search results based on user ratings, popularity, etc.

[1725] "User terminal" refers to a device such as a computer, smartphone, or tablet that a user uses to enter information and receive results.

[1726] "Travel Plan" means a schedule or itinerary created based on the attractions, accommodations and transportation selected by the User.

[1727] "Travel time" refers to the time it takes to get from one point to another.

[1728] "Total Cost" refers to the total amount of all charges incurred during the trip.

[1729] "Route guidance function" refers to a function that provides the optimal route from the current location to the next destination.

[1730] "Traffic conditions" refers to information regarding the operation status and congestion of roads and public transportation.

[1731] "Weather conditions" refers to current weather information such as weather, temperature, and precipitation.

[1732] "Emergency information" refers to information of a high degree of urgency, such as traffic delays or weather-related crises.

[1733] "Feedback" refers to ratings, comments and opinions about travel destinations and accommodations provided by Users.

[1734] The present invention relates to a system that enables users to efficiently plan their travels. The system helps users easily search for information about travel destinations and effectively create travel plans. Specific functions included in the present invention include search, planning, navigation, real-time information provision, and feedback collection.

[1735] Hardware and Software

[1736] The main components of the system are the server, terminal (user device), and database. The server processes large amounts of data and sends requests to the API, so a high-performance cloud computing environment (e.g., Amazon Web Services or Google Cloud Platform) is used. The terminal is the device operated by the user, such as a smartphone, tablet, or PC. The software consists of a front end (user interface) and a back end (data processing and API integration), with React Native or Flutter used for the front end and Node.js or Python for the back end.

[1737] Data processing and calculation

[1738] 1. Initial settings and data integration

[1739] The server sends requests to various APIs to obtain tourist information, accommodation data, and transportation data. For example, a tourist information API is used to obtain information about tourist attractions in a specific area and store it in a database.

[1740] 2. Search function based on user requests

[1741] The device allows users to input search criteria for tourist attractions and accommodations through a user interface. This information is sent from the device to a server, which then queries a database to extract relevant data and sends the results back to the device.

[1742] 3. Creating and managing travel plans

[1743] The terminal displays the search results received from the server in a list format and provides a function to add the items selected by the user to a bookmark. The server calculates details such as travel time, transportation means, and total cost based on the information added to the bookmark, and sends them to the terminal for display to the user.

[1744] 4. Travel support

[1745] The device provides navigation from the current location to the next destination based on the bookmark information. It uses the GPS function to obtain the current location and displays the optimal route using the Google Maps API. The server monitors changes in traffic and weather conditions in real time, and if any abnormalities occur, it sends a push notification to the device.

[1746] 5. After-sales feedback

[1747] The device provides an interface to collect user feedback and ratings after the trip. Users enter their ratings for each spot and accommodation, and the data is sent to a server and stored in a database. This information is used to improve the quality of search results for future trips.

[1748] Examples and prompts

[1749] For example, a user launches the app on their smartphone and enters the following criteria: "Kyoto," "3 days," "budget of 50,000 yen," and "temple." Based on this, the server searches the database and returns suitable tourist spots and accommodations to the device. A list of results is displayed, and the user selects "Kinkaku-ji Temple" and "Kiyomizu-dera Temple" and adds them to their bookmarks. During the trip, the smartphone uses GPS to obtain the user's current location and navigates to the next destination. After the trip, the app prompts the user to enter feedback, and the user enters a rating for each spot.

[1750] Example prompt sentence:

[1751] 1. Initial setup: The system uses the API required to search for tourist spots based on the conditions "Kyoto," "3 days," "budget of 50,000 yen," and "tourism category: temples," and retrieves the data and stores it in a database.

[1752] 2. Search: Search for tourist spots using criteria such as, "I'm planning a three-day trip to Kyoto. My budget is 50,000 yen and I want to visit temples."

[1753] 3. Travel Plan: Create a travel plan by typing, "I want to visit Kinkakuji Temple and Kiyomizudera Temple. Add this to my bookmarks."

[1754] 4. Navigation: Ask, "What is the best route from my current location to Kinkakuji Temple?"

[1755] 5. Feedback: "Please rate Kinkaku-ji Temple. Add your comments."

[1756] As described above, this system provides users with a series of processes to efficiently plan their trips, and also allows them to obtain necessary information in real time, as well as effectively collect and utilize post-trip feedback.

[1757] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1758] Step 1:

[1759] Initial settings and data integration

[1760] The server sends requests to various APIs to obtain tourist information, accommodation data, and transportation data. Specifically, it creates API requests in JSON format and sends them to each information provider site. The input is the API request URL and authentication information, and the output is a JSON response containing tourist attraction information, accommodation data, and transportation data. The received data is parsed on the server side and inserted into a database. This process is executed by an automated scheduler, for example, at 2:00 AM every day.

[1761] Step 2:

[1762] Search function based on user requests

[1763] Terminal processing:

[1764] The device allows the user to input search criteria for tourist spots and accommodations through a user interface. Specifically, the user enters criteria such as "Kyoto," "3 days," "budget of 50,000 yen," and "temple" into the search form and clicks the "Search" button. The input is the search criteria entered by the user, and the output is an API request to the server. The device converts the search criteria into JSON format and sends it to the server.

[1765] Server-side processing:

[1766] The server executes SQL queries on the database based on the received search criteria and extracts data on relevant tourist attractions and accommodations. The input is JSON data of the search criteria sent by the user, and the output is a dataset extracted based on the relevant criteria. The extracted data is sorted in a ranking format based on user ratings and popularity, and is sent back to the device in JSON format.

[1767] Step 3:

[1768] Create and manage your travel plans

[1769] Terminal processing:

[1770] The terminal displays the search results received from the server in list format. The input is the JSON data of the search results sent from the server, and the output is the list-format search results displayed on the user interface. Specifically, when the user views the detailed information of each spot and clicks the "Add to bookmarks" button, the information is added to the bookmarks.

[1771] Server-side processing:

[1772] The server calculates details such as travel time, transportation method, and total cost based on the information added to the bookmark, and sends them to the device. Specifically, it uses the Google Maps API to calculate travel time between each spot, and calculates the total cost by adding up the entrance fees and accommodation costs of the spots. The input is the data of the spots and accommodations added to the bookmark, and the output is JSON data containing the calculated details. These details are displayed to the user on the device.

[1773] Step 4:

[1774] Travel support

[1775] Terminal processing:

[1776] The device provides navigation from the current location to the next destination based on the bookmark information. It obtains the current location using the GPS function and sends a request to the Google Maps API to display the optimal route. The input is the GPS information of the current location and the data of the next destination, and the output is the optimal route obtained from the Google Maps API.

[1777] Server-side processing:

[1778] The server monitors fluctuations in traffic and weather conditions in real time, and if an abnormality occurs, it sends that information to the device via push notification. Specifically, it checks the transport API and weather information API at regular intervals, and if an abnormality is detected, it promptly sends a push notification. The input is the response data of the traffic and weather information API, and the output is the data used to send the push notification.

[1779] Step 5:

[1780] After-sales feedback

[1781] Terminal processing:

[1782] The terminal provides an interface to collect feedback and ratings from users after the trip. Specifically, a pop-up is automatically displayed after the trip ends, prompting the user to "Please provide feedback on this trip." The input is the rating and comments entered by the user, and the output is the feedback data sent to the server.

[1783] Server-side processing:

[1784] The server stores the received ratings and comments in a database and uses them to improve the quality of the next search results. Specifically, it analyzes the rating data and updates the ranking of each spot in real time based on the rating points. The input is the user's ratings and comments, and the output is the updated rating data.

[1785] (Application example 1)

[1786] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1787] Conventional travel planning systems require users to collect and analyze information themselves, which requires time and effort to create a trip plan. Furthermore, they lack real-time travel support and post-trip feedback, making it difficult to improve the user's travel experience. Furthermore, there is a lack of systems that allow users to efficiently create trip plans in virtual stores, so there is a need to improve the user experience.

[1788] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1789] In this invention, the server includes means for receiving travel search criteria from a user and extracting data on relevant tourist attractions, accommodations, transportation, etc. from a database, means for ranking the relevant data and sending it to the user's terminal, means for saving the items selected by the user and generating a bookmark, means for calculating detailed information such as the required travel time, transportation, and total cost based on the bookmark information, means for displaying the bookmark information and detailed information to the user, means for collecting and saving feedback from the user and using it to improve the quality of future search results, and means for providing a virtual guide application, thereby enabling users to efficiently plan their trips, obtain necessary information in real time, and incorporate post-trip feedback.

[1790] "Travel search conditions from users" are various requirements and desired information entered by users in order to extract relevant information from databases of tourist attractions, accommodations, transportation options, etc.

[1791] "Relevant data" refers to information on tourist attractions, accommodation, transportation, etc. extracted from the database based on the user's travel search criteria.

[1792] "Ranking" is a method of ranking extracted data based on user ratings and popularity and displaying it in list format.

[1793] "Means for transmitting to user terminal" refers to the function by which the server transmits the aligned data to the device used by the user via communication.

[1794] "User-selected items" are attractions and accommodations that a user has selected from the provided list as being of interest to them and to add to their travel plans.

[1795] "Means for generating bookmarks" is a function that creates a list (bookmark) that summarizes the details of a travel plan based on the items selected by the user.

[1796] "Travel time, transportation mode, and total cost" are factors used to calculate the travel time, transportation mode, and total cost of the trip based on the user's travel plans.

[1797] "Bookmark information and detailed information" refers to the items selected by the user as part of the travel plan, as well as specific detailed information about those items, such as travel time, transportation means, and total cost.

[1798] "User feedback" refers to ratings and comments on tourist spots and accommodations provided by users after their trip.

[1799] A "virtual guide application" is application software that allows users to use functions such as travel planning, real-time navigation, and feedback collection through smart devices.

[1800] A "generative AI model" is an artificial intelligence system that uses machine learning algorithms to optimize tourist spot rankings and travel plans based on user search criteria.

[1801] A "prompt" is an instruction or search keyword that enables a generative AI model to derive appropriate results based on user input.

[1802] The embodiment of the present invention is a system that provides a virtual guide application for efficiently planning a trip. The main components of the system and their specific functions will be described below.

[1803] System Components

[1804] 1. Server

[1805] Data extraction function: The server sends requests to various APIs to obtain tourist information, accommodation data, and transportation data. For example, a tourist information API is used to obtain information about tourist attractions in a specific area and store it in a database. This information includes the spot name, location, rating, photos, etc.

[1806] Search and ranking function: The server creates a query in the database based on the travel search criteria received from the user, extracts the relevant data, sorts the extracted data in a ranking format based on user ratings and popularity, and sends it to the user's device.

[1807] Calculation and display function: The server adds the user's selected items to the bookmarks and calculates detailed information such as the required travel time, transportation means, total cost, etc. The calculated detailed information is sent to the user's terminal, which then displays it to the user.

[1808] Feedback collection function: The server receives feedback and ratings from users, stores them in a database, and uses them to improve the quality of search results next time.

[1809] 2. User Device

[1810] Interface function: The device allows the user to input search criteria for tourist spots and accommodations through the user interface. For example, if the user inputs criteria such as "Kyoto," "3 days," "budget 50,000 yen," and "tourism category: temples," the device sends this to the server.

[1811] Navigation function: Provides navigation from the current location to the next destination based on bookmark information. Uses GPS to obtain the current location and displays the optimal route to the destination.

[1812] Real-time information provision function: When traffic information or changes in weather conditions are sent from the server in real time, the device will provide that information to the user via push notification and suggest appropriate detour routes.

[1813] 3. Users

[1814] Entering search criteria: Users enter their travel criteria (e.g., location, budget, dates, etc.) through the interface.

[1815] Selection from a list: The search results received from the server are displayed in a list format, and the user can select tourist attractions and accommodations that interest them and add them to their bookmarks.

[1816] Providing feedback: After completing a trip, users can leave ratings and comments about each attraction and accommodation.

[1817] Hardware and software used

[1818] Hardware: User devices such as smartphones and smart glasses, and cloud servers

[1819] Software: Flask, requests library, GPS function

[1820] Specific examples

[1821] Assume that User A is planning a three-day trip to Kyoto. Their budget is 50,000 yen, and they are interested in "temples." When User A enters their search criteria into the app, the app retrieves information about Kyoto's temples from a tourist information API. The app displays a ranking of the top spots (e.g., "Kinkaku-ji Temple" and "Kiyomizu-dera Temple") based on user ratings. User A selects "Kinkaku-ji Temple" and "Kiyomizu-dera Temple" and adds them to their bookmarks. The app calculates the total cost and travel time required, and displays these to the user. The app also navigates User A during the trip, providing real-time information such as traffic delays. After the trip is over, User A leaves ratings and comments on tourist spots and accommodations through the app.

[1822] Prompt Sentence Examples

[1823] "I'm planning a three-day trip to Kyoto. My budget is 50,000 yen, and I'm interested in temples. Please suggest an app that will help me search for tourist spots, display rankings, and help me create a trip plan. I'd also like navigation and real-time information during my trip, and collect feedback after my trip."

[1824] As described above, by using this system, users can efficiently plan their trips, obtain necessary information in real time, and incorporate feedback after the trip.

[1825] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1826] Step 1:

[1827] Description: User enters travel search criteria, including, for example, location, budget, dates, and category of sightseeing (e.g., temples).

[1828] Specific operation: The user enters conditions such as "Kyoto," "3 days," "budget 50,000 yen," and "tourist category: temples" through an application on a smartphone or smart glasses.

[1829] Input: User's travel criteria (location, budget, dates, category).

[1830] Output: The entered travel conditions are saved on the terminal and sent to the server.

[1831] Step 2:

[1832] Description: The server queries a database based on the received travel search criteria to extract relevant attraction, accommodation, and transportation data.

[1833] Specific operation: Uses the tourist information API to obtain tourist spot information for a specific area (e.g., Kyoto) and save it in a database.

[1834] Input: User's travel requirements.

[1835] Output: Data on relevant attractions, accommodation and transportation options.

[1836] Step 3:

[1837] Description: The server sorts the extracted data into a ranking format based on user ratings and popularity, and sends it to the user's device.

[1838] Specific operation: The data obtained from the API is sorted by user rating and then ranked. The ranking results are then sent to the user's device.

[1839] Input: Extracted tourist attraction, accommodation, and transportation data.

[1840] Output: Data sorted into ranking format.

[1841] Step 4:

[1842] Description: The user can view the search results received from the server in a list format, select items of interest and add them to their bookmarks.

[1843] Specific operation: Select an item of interest such as "Kinkaku-ji Temple" or "Kiyomizu-dera Temple" from the list of tourist spots and accommodations displayed on the device and add it to your bookmarks.

[1844] Input: Data sorted into ranking format.

[1845] Output: A list of attractions and accommodations selected by the user.

[1846] Step 5:

[1847] Description: The server calculates details such as travel time, transportation means, and total cost based on the information added to the bookmark.

[1848] Specific operation: Based on the tourist attractions and accommodations added to the bookmarks, the travel route is calculated, and the means of transportation to be used, their costs, and total travel time are calculated.

[1849] Input: Information about attractions and accommodations added to bookmarks.

[1850] Output: Detailed information such as required travel time, transportation mode, and total cost.

[1851] Step 6:

[1852] Description: The server sends the calculated details to the user terminal, which displays them to the user.

[1853] Specific operation: Send detailed information to the user terminal, and the terminal displays the information through the user interface.

[1854] Input: Details such as required travel time, mode of transportation, and total cost.

[1855] Output: Detailed information about the trip plan displayed on the user's device.

[1856] Step 7:

[1857] Description: During the trip, the device provides navigation based on bookmark information and receives real-time information from the server to notify the user.

[1858] Specific operation: Uses GPS to obtain current location and displays the optimal route to the next destination. If there is a public transport delay, the user will be notified via push notification and an alternative route will be suggested.

[1859] Input: Bookmark information, real-time traffic information.

[1860] Output: Navigation instructions, emergency push notifications, and alternative route suggestions.

[1861] Step 8:

[1862] Description: After completing a trip, users enter their feedback and ratings, which are collected by the server and stored in a database.

[1863] What it does: Users enter ratings and comments for attractions and accommodations, and the server stores that information in a database. It uses this information to improve search results the next time.

[1864] Input: User feedback and ratings.

[1865] Output: Feedback information stored in a database.

[1866] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1867] The present invention provides a system that allows users to efficiently plan their trips. This system incorporates an emotion engine that recognizes the user's emotions and reflects them in suggesting travel destinations and customizing the plan. Specific program processing of the system and its implementation are described below.

[1868] Program processing flow

[1869] 1. Initial settings and data integration

[1870] server

[1871] The server sends requests to various APIs to obtain tourist information, accommodation data, and transportation data.

[1872] The acquired data is stored in a database, including tourist spot names, locations, ratings, photos, etc.

[1873] 2. Search function based on user requests

[1874] Terminal

[1875] The terminal allows the user to input search criteria (e.g., location, budget, dates, etc.) for tourist spots and accommodations through a user interface.

[1876] When a user enters search criteria and presses the search button, the terminal sends the criteria to the server.

[1877] server

[1878] The server generates a query to the database based on the received search criteria.

[1879] Run the query to extract relevant attraction and accommodation entries.

[1880] The extracted entries are ranked based on user ratings and popularity.

[1881] Send ranked search results to your device.

[1882] Terminal

[1883] The terminal displays the search results received from the server to the user, who then selects a spot of interest from the displayed list.

[1884] 3. Utilizing the Emotion Engine

[1885] Terminal

[1886] When users enter travel search criteria, they also enter their emotions at the time (for example, through text input or facial expression recognition).

[1887] The terminal transmits the input emotion data to the emotion engine.

[1888] server

[1889] The server's emotion engine analyzes the received emotion data and recommends tourist spots and activities accordingly.

[1890] For example, if a user inputs the emotion "I want to relax," relaxation facilities and quiet tourist spots will be displayed preferentially.

[1891] 4. Creating and managing travel plans

[1892] Terminal

[1893] Users can add selected items from the search results to their bookmarks.

[1894] The terminal transmits the information added to the bookmark and the emotion data to the server.

[1895] server

[1896] The server stores the information added to the bookmark in a database and calculates details such as the required travel time, transportation means, and total cost.

[1897] The calculated details are sent to the terminal, which displays them to the user.

[1898] It provides customized suggestions by taking into account the bookmark content as well as the user's past ratings and sentiment data.

[1899] 5. Travel support

[1900] Terminal

[1901] The device provides navigation from the current location to the next destination based on the bookmark information.

[1902] Uses the GPS function to obtain your current location and display the optimal route to your destination.

[1903] server

[1904] It monitors changes in traffic information and weather conditions in real time, and if an abnormality occurs, the information is sent to the device via push notification.

[1905] The device notifies the user of the emergency information received from the server and prompts them to take appropriate action.

[1906] 6. After-sales feedback

[1907] Terminal

[1908] Provide an interface to collect user feedback and ratings after the trip is completed.

[1909] User

[1910] Enter your ratings and comments about each tourist attraction and accommodation.

[1911] server

[1912] The collected ratings and comments are stored in a database and used to improve the quality of search results next time.

[1913] Specific examples

[1914] For example, if a user selects "Kyoto" as a travel destination and enters emotions such as "relaxation" or "a desire to experience nature" as search criteria, the emotion engine will analyze these emotions and prioritize suggestions such as the bamboo forest path or the tranquil temples of Ohara. Furthermore, if a user frequently records the emotion "fun" during their trip, that emotional data will be used to suggest more activities and entertainment facilities for the next trip.

[1915] In this way, by utilizing the emotion engine, it is possible to provide optimal travel plans based on the user's emotions. It is also possible to further personalize the next proposal based on feedback during and after the trip.

[1916] The processing flow will be explained below.

[1917] Program processing flow

[1918] 1. Initial settings and data integration

[1919] Step 1:

[1920] The server sends requests to various APIs to obtain tourist information, accommodation data, and transportation data.

[1921] Step 2:

[1922] The server stores the acquired data in a database by category, including tourist spot names, locations, ratings, photos, etc.

[1923] Step 3:

[1924] The server periodically calls the API to update the database with new data and updates.

[1925] 2. Search function based on user requests

[1926] Step 4:

[1927] The terminal allows the user to input search criteria (e.g., location, budget, dates, etc.) for tourist spots and accommodations through a user interface.

[1928] Step 5:

[1929] When a user enters search criteria and presses the search button, the terminal sends the criteria to the server.

[1930] Step 6:

[1931] The server generates a query to the database based on the received search criteria.

[1932] Step 7:

[1933] The server executes the query and extracts relevant tourist attraction and accommodation entries.

[1934] Step 8:

[1935] The server ranks the extracted entries based on popularity and ratings.

[1936] Step 9:

[1937] The server transmits the ranked search results to the terminal.

[1938] Step 10:

[1939] The terminal displays the search results received from the server to the user, who then selects a spot of interest from the displayed list.

[1940] 3. Utilizing the Emotion Engine

[1941] Step 11:

[1942] When users enter search criteria, the device also prompts them to enter their emotional data, which is acquired through text input and real-time facial recognition.

[1943] Step 12:

[1944] The terminal transmits the input emotion data to the emotion engine of the server.

[1945] Step 13:

[1946] The server's emotion engine analyzes the received emotion data and recommends tourist spots and activities accordingly.

[1947] Step 14:

[1948] The server then sends the results of its recommendations for the most suitable tourist spots and activities to the user based on the emotion engine to the terminal.

[1949] 4. Creating and managing travel plans

[1950] Step 15:

[1951] Users can add selected items from the search results to their bookmarks.

[1952] Step 16:

[1953] The terminal transmits the information added to the bookmark to the server.

[1954] Step 17:

[1955] The server stores the information added to the bookmark in a database and calculates details such as the required travel time, transportation means, and total cost.

[1956] Step 18:

[1957] The server sends the calculated details to the terminal, which displays them to the user.

[1958] Step 19:

[1959] The server takes into account the bookmark content as well as the user's past ratings and sentiment data to provide customized suggestions.

[1960] 5. Travel support

[1961] Step 20:

[1962] The device provides navigation from the current location to the next destination based on the bookmark information.

[1963] Step 21:

[1964] Uses the device's GPS function to obtain your current location and display the optimal route to your destination.

[1965] Step 22:

[1966] The server monitors traffic information and changes in weather conditions in real time.

[1967] Step 23:

[1968] If an abnormality occurs, the server sends the information to the device via push notification.

[1969] Step 24:

[1970] The device notifies the user of the emergency information received from the server and prompts them to take appropriate action.

[1971] 6. After-sales feedback

[1972] Step 25:

[1973] The terminal provides an interface to collect feedback and ratings from users after the trip is completed.

[1974] Step 26:

[1975] Users enter ratings and comments about each tourist spot and accommodation.

[1976] Step 27:

[1977] The terminal transmits the collected ratings and comments to the server.

[1978] Step 28:

[1979] The server stores the received ratings and comments in a database.

[1980] Step 29:

[1981] The server uses the stored feedback to adjust the algorithm it uses to improve the quality of search results next time.

[1982] Specific examples

[1983] For example, if a user selects "Kyoto" as a travel destination and enters emotions such as "relaxation" or "a desire to experience nature" as search criteria, the emotion engine will analyze these emotions and prioritize suggestions such as the bamboo forest path or the tranquil temples of Ohara. Furthermore, if a user frequently records the emotion "fun" during their trip, that emotional data will be used to suggest more activities and entertainment facilities for the next trip.

[1984] In this way, by utilizing the emotion engine, it is possible to provide optimal travel plans based on the user's emotions, and further personalize the next suggestions based on feedback during and after the trip.

[1985] Example 2

[1986] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1987] Conventional travel planning systems lacked suggestions based on user emotions and intuition, making it difficult to provide optimal travel plans for individual users. They also lacked the functionality to respond to real-time traffic information and weather conditions. This resulted in problems that reduced user satisfaction and the quality of the travel experience.

[1988] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1989] In this invention, the server includes means for receiving travel search conditions from a user and extracting data on relevant tourist destinations, accommodations, means of transportation, etc. from a database, means for ranking the relevant data and sending it to the user terminal, means for saving the items selected by the user and generating a bookmark, means for calculating detailed information such as the required travel time, means of transportation, and total cost based on the bookmark information, means for displaying the bookmark information and detailed information to the user, and means for receiving user emotion data and making suggestions based on the emotion. This makes it possible to provide optimal travel plans based on the user's emotions and intuition, and to provide travel support based on real-time information.

[1990] "Receive travel search conditions from the user" refers to the operation in which the system collects information such as travel destination, budget, and schedule provided by the user.

[1991] "Data on tourist attractions, accommodation, transportation, etc." refers to specific information on tourist attractions, accommodation options, transportation, etc. related to travel.

[1992] "Extracting from a database" refers to the act of searching and retrieving relevant information from a database based on specific conditions.

[1993] "Ranking and sending to user's device" refers to sorting search results based on user ratings and popularity, and transferring the list to the user's device.

[1994] "Saving the items selected by the user and generating a bookmark" refers to the action of saving information such as the travel destination and accommodation selected by the user, and creating a document summarizing the travel plan based on that information.

[1995] "Calculating detailed information such as required travel time, transportation means, and total cost based on bookmark information" refers to the process of calculating travel time, transportation means to choose, and total travel costs based on information about tourist attractions and accommodations listed in the bookmark.

[1996] "Displaying bookmark information and detailed information to the user" refers to the action of presenting the calculated and organized details of the travel plan to the user in an easy-to-read format.

[1997] "Receive the user's emotional data and make suggestions based on the emotion" refers to the process of obtaining the emotional information entered by the user (e.g., wanting to relax, wanting to have fun, etc.) and recommending an appropriate travel plan based on that information.

[1998] "Providing a navigation function from the current location to the next destination based on bookmark information" refers to the operation of guiding the user on how to get from their current location to their destination by referring to the information contained in the bookmark.

[1999] "Monitoring changes in travel information and weather conditions in real time and notifying the user of emergency information" means constantly checking the latest travel status and weather information, and immediately contacting the user's device if any abnormalities occur.

[2000] "Receive user feedback and ratings, store them in a database, and use them to improve the quality of search results in the future" refers to the action of collecting reviews and ratings provided by users after their trip, storing them in a database to help improve search results in the future.

[2001] The present invention is a system that allows users to efficiently plan their trips. This system incorporates an emotion engine that recognizes the user's emotions and reflects them in suggesting travel destinations and customizing the plan. Specific program processing and embodiments of the system are described below.

[2002] Initial settings and data integration

[2003] server

[2004] The server sends requests to multiple external APIs (e.g., tourist destination information API and hotel reservation API) to obtain tourist information, accommodation data, and transportation data.

[2005] The acquired data includes tourist spot names, locations, ratings, photos, etc., and is stored in a database (e.g., a MySQL database).

[2006] Search function based on user requests

[2007] Terminal

[2008] Users use an interface to input search criteria such as travel destination, budget, dates, number of people, etc. For example, they can input criteria such as "I want to travel to Kyoto in March, with a budget of 50,000 yen or less."

[2009] server

[2010] The server creates a query to the database based on the received search criteria and extracts data on relevant tourist destinations and accommodations, for example, using a MySQL query.

[2011] The extracted data is sorted into a ranking format based on user ratings and popularity and sent to the device.

[2012] Terminal

[2013] The terminal displays the search results received from the server in a ranked format to the user, who can then select spots of interest from the list.

[2014] Utilizing the Emotion Engine

[2015] Terminal

[2016] When users enter their travel search criteria, they also input their emotions (e.g., "I want to relax") via text input and facial expression recognition.

[2017] server

[2018] The server's emotion engine analyzes the received emotion data and recommends tourist spots and activities according to that emotion. For example, if the user inputs "I want to relax," it will prioritize relaxation facilities and quiet tourist spots.

[2019] Create and manage your travel plans

[2020] Terminal

[2021] Users can add selected items from the search results to their "bookmarks," which are tentative schedules that summarize their travel plans.

[2022] server

[2023] The server stores the information added to the bookmark in a database and calculates travel time, transportation methods, and total costs as needed, for example using the Google Maps API to calculate travel time.

[2024] The calculation results are sent to the terminal and displayed to the user.

[2025] Travel support

[2026] Terminal

[2027] The device provides navigation from the current location to the next destination based on the bookmark information, using the GPS function to obtain the current location and display the optimal route.

[2028] server

[2029] Traffic information and changes in weather conditions are monitored in real time, and if any abnormalities occur, push notifications are sent to the device.

[2030] The device will notify the user of the received emergency information and prompt them to take appropriate action.

[2031] After-sales feedback

[2032] Terminal

[2033] After completing the trip, users have an interface to enter feedback and ratings.

[2034] User

[2035] Enter your ratings and comments about each tourist attraction and accommodation.

[2036] server

[2037] The collected ratings and comments are stored in a database and used to improve the quality of search results next time.

[2038] Specific examples

[2039] For example, if a user selects "Kyoto" as a travel destination and enters emotions such as "relaxation" or "a desire to experience nature" as search criteria, the emotion engine will analyze this emotion and prioritize suggestions for the bamboo forest path or the tranquil temples of Ohara. Also, if the user frequently records "fun" during their trip, that emotional data will be used to suggest more activities and entertainment facilities for their next trip.

[2040] Example prompts to input to the generative AI model

[2041] If I choose "Kyoto" as my travel destination and input emotions such as "relaxation" and "wanting to feel nature," what tourist spots would you recommend?

[2042] In this way, the system of the present invention aims to provide an optimal travel plan that takes into account the user's emotional data and improve user satisfaction.

[2043] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2044] Program processing flow and specific steps

[2045] Step 1: Initial setup and data integration

[2046] The server sends requests to multiple external APIs to obtain tourist information, accommodation data, and transportation data. For example, it can send requests to a tourist attraction information API or a hotel reservation API. Input: Data request from external API. Output: Tourist attraction information, accommodation list, transportation data. Specific operation: Obtain tourist attraction names, locations, photos, etc. and save them in a MySQL database.

[2047] Step 2: Search function based on user requests

[2048] The terminal displays an interface for the user to input search criteria such as travel destination, budget, dates, number of people, etc. For example, the user inputs criteria such as "I want to travel to Kyoto in March, with a budget of 50,000 yen or less." Input: Search criteria from the user. Output: List of searched tourist spots and accommodations. Specific operation: The entered search criteria are sent from the terminal to the server by pressing the search button.

[2049] Step 3: Creating and Executing a Database Query

[2050] The server creates a query to the database based on the received search criteria. For example, it creates a MySQL query to extract information on relevant tourist attractions and accommodations. Input: Search criteria. Output: List of search results. Specific operation: Executes a database query to obtain information on tourist attractions and accommodations.

[2051] Step 4: Sort and submit search results

[2052] The server sorts the extracted data into a ranking format based on user ratings and popularity, and sends it to the terminal. Input: Search result data. Output: Search results sorted in ranking format. Specific operation: Ranking is performed based on rating scores and number of reservations, and the sorted data is sent to the terminal.

[2053] Step 5: Viewing search results

[2054] The device displays the search results received from the server to the user, allowing the user to select spots of interest. For example, "Kiyomizu-dera Temple" or "Nijo Castle" are displayed. Input: Sorted search results. Output: List of tourist spots displayed to the user. Specific operation: Displayed in ranking format, allowing the user to check details.

[2055] Step 6: Enter and submit emotion data

[2056] The device provides an interface that allows users to input their emotions at the time they enter travel search criteria. For example, they can input emotions such as "I want to relax." Input: Emotional data from the user. Output: Emotional data sent to the server. Specific operations: The emotion input field is displayed, and the entered data is transferred to the server.

[2057] Step 7: Analyze sentiment data and make recommendations

[2058] The server uses an emotion engine to analyze the received emotion data and recommends tourist spots and activities accordingly. For example, if the emotion is "I want to relax," it will prioritize relaxation facilities and quiet tourist spots. Input: User emotion data. Output: Recommendation of tourist spots based on emotion....

Claims

1. A means for receiving travel search criteria from users and extracting data such as relevant tourist spots, accommodations, and transportation methods from a database; A means for arranging the relevant data in a ranking format and transmitting the same to a user terminal; a means for saving user selections and generating bookmarks; A method to calculate detailed information such as travel time, transportation means, and total cost based on the bookmark information, means for displaying the bookmark information and detailed information to a user; A system including:

2. means for providing a navigation function from a current location to a next destination based on the bookmark information; A means of monitoring traffic information and weather condition changes in real time and notifying emergency information to user devices. The system of claim 1 further comprising:

3. A means to receive user feedback and ratings, store them in a database, and use them to improve the quality of search results next time. The system of claim 1 further comprising:

Images