system

Abstract

We provide the system. [Solution] An input means for the user to input their departure point, accommodation, and destination, Based on the information of the accommodation transmitted from the aforementioned input means, an acquisition means for obtaining dining spots around the accommodation, A calculation means that calculates the optimal travel route and travel time based on the departure and destination information transmitted from the input means, A means of obtaining tourist information for tourist spots around the aforementioned destination, An integration means that combines the information obtained from the acquisition means, calculation means, and tourist information means into a single travel plan and presents it to the user, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In a conventional travel planning system, there was a problem that it was very time-consuming because the user had to separately investigate information on the departure place, accommodation, and destination and combine them to make a travel plan. Also, it was not possible to automatically provide recommended dining information around the accommodation or tourist guides around the destination, and the user had to investigate separately. Therefore, it was difficult to create an efficient and consistent travel plan.

Means for Solving the Problems

[0005] The present invention provides a system that includes an input means for the user to input their departure point, accommodation, and destination; an acquisition means for obtaining dining spots around the accommodation based on the accommodation information transmitted from the input means; a calculation means for calculating the optimal travel route and travel time based on the departure point and destination information transmitted from the input means; a sightseeing information means for obtaining sightseeing spots around the destination; and an integration means for integrating the information obtained from the acquisition means, calculation means, and sightseeing information means into a single travel plan and presenting it to the user. This allows the user to input their travel plans all at once and automatically generate an efficient travel plan based on consistent information. Furthermore, the calculation means calculates the optimal travel route considering the timetables and operating status of public transportation, and the integration means displays the travel plan to the user in timeline or list format.

[0006] A "user" is someone who inputs information to plan a trip and then reviews and uses the travel plan provided by the system.

[0007] A "terminal" is a device used by a user to input information, and includes smartphones, tablets, computers, and other similar devices.

[0008] A "server" is a central system that processes information sent by users, generates travel plans, and sends them to the terminal.

[0009] "Input method" refers to a mechanism for users to input necessary travel information such as departure point, accommodation, and destination, and includes forms and interfaces.

[0010] "Acquisition method" refers to a mechanism for obtaining information about restaurants and other related spots around the accommodation from a database or external API, based on the entered accommodation information.

[0011] A "calculation method" is a system for calculating the optimal travel route and travel time based on information about the departure point and destination, and it uses map data and transportation APIs.

[0012] A "tourist information system" is a mechanism for obtaining and providing users with information about tourist spots and attractions around their destination.

[0013] An "integration method" is a system that integrates information obtained from acquisition methods, calculation methods, and tourist information methods, and presents it to the user as a single travel plan.

[0014] A "travel plan" is a consistent travel schedule from departure to return, generated based on user input and various information provided by the system.

[0015] A "travel route" refers to the optimal path from the starting point to the destination, and includes the means of transportation used and the estimated travel time.

[0016] "Dining spots" refer to restaurants, cafes, and other establishments recommended to users when they want to eat near their accommodation.

[0017] A "tourist spot" refers to a place of interest or tourist attraction that should be visited in the vicinity of a destination. [Brief explanation of the drawing]

[0018] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of the data processing device and smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5]It is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] It is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] It is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] It is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] It shows an emotion map to which a plurality of emotions are mapped. [Figure 10] It shows an emotion map to which a plurality of emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when an emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when an emotion engine is combined.

Mode for Carrying Out the Invention

[0019] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0020] First, the terms used in the following description will be explained.

[0021] In the following embodiments, the signed processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Furthermore, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include CPU (Central Processing Unit), GPU (Graphics Processing Unit), GPGPU (General-Purpose computing on Graphics Processing Units), and APU (Accelerated Processing Unit).

[0022] In the following embodiments, signed RAM (Random Access Memory) is a memory that temporarily stores information and is used as work memory by the processor.

[0023] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.

[0024] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0025] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0026] [First Embodiment]

[0027] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0028] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0029] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0030] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0031] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0032] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0033] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0034] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0035] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0036] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0037] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0038] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0039] This invention provides a system that offers consistent information to users when planning a trip and efficiently generates a travel plan. The system comprises a terminal, a server, and multiple processing means.

[0040] System Overview

[0041] This system consists of the following elements:

[0042] 1. Terminal:

[0043] This device allows users to input their departure point, accommodation, and destination.

[0044] Includes means for sending user-entered information to a server.

[0045] 2. Server:

[0046] It is a central system that processes information received from terminals.

[0047] A "means of obtaining" information about dining spots near your accommodation.

[0048] A "calculation tool" for calculating travel routes and travel times based on information about the departure point and destination.

[0049] A "tourist information tool" for obtaining information about tourist attractions around a destination.

[0050] This "integration method" combines the above information into a single travel plan and presents it to the user.

[0051] Program processing

[0052] User input and data transmission

[0053] The user enters travel information via their device, such as their departure point ("Tokyo"), accommodation ("a hotel near Kyoto Station"), and destination ("Kyoto"). The device then sends this information to the server.

[0054] Obtaining information about the area around your accommodation

[0055] The server uses the accommodation information ("Hotels near Kyoto Station") sent from the terminal to retrieve information about restaurants and other dining spots around the accommodation using a database or external API. This information may include, for example, sushi restaurants, ramen shops, and cafes.

[0056] Route calculation from departure point to destination

[0057] The server calculates the optimal travel route based on information about the departure point "Tokyo" and the destination "Kyoto." This calculation uses information on public transportation such as bullet trains, buses, and taxis. The server considers the timetables and operating status of each mode of transport to provide the optimal travel route and travel time.

[0058] Tourist information for the area around your destination

[0059] The server uses the destination "Kyoto" information to retrieve information about nearby tourist spots using a database or external API. For example, this includes detailed information about tourist attractions such as Kiyomizu-dera Temple, Kinkaku-ji Temple, and Gion.

[0060] Plan generation and display

[0061] The server generates a single, integrated travel plan based on all the information it has gathered. This plan includes departure times, modes of transportation, arrival times, dining options near the accommodation, and a schedule of sightseeing visits. The integration system then displays this plan to the user in an appropriate format (such as a timeline or list).

[0062] Specific example

[0063] For example, if a user plans a trip from Tokyo to Kyoto, the system will work as follows:

[0064] 1. The user enters "Tokyo" (departure point), "Hotels around Kyoto Station" (accommodation), and "Kyoto" (destination).

[0065] 2. The terminal sends the input information to the server.

[0066] 3. The server uses the accommodation information to retrieve information on restaurants, ramen shops, cafes, and other dining spots around Kyoto Station.

[0067] 4. The server calculates the optimal travel route from the departure point "Tokyo" to the destination "Kyoto" and provides details about transportation methods such as Shinkansen (bullet train).

[0068] 5. The server retrieves information about tourist spots in the destination "Kyoto," such as Kiyomizu-dera Temple, Kinkaku-ji Temple, and Gion.

[0069] 6. The server integrates this information and generates a single travel plan.

[0070] 7. The device displays this plan to the user in either a timeline or list format.

[0071] In this way, users can easily create efficient and consistent travel plans.

[0072] The following describes the processing flow.

[0073] Step 1:

[0074] The user enters their departure point, accommodation, and destination via their device. For example, they might enter "Tokyo" as the departure point, "Hotels around Kyoto Station" as the accommodation, and "Kyoto" as the destination.

[0075] Step 2:

[0076] The terminal sends the entered information to the server. Specifically, it sends a request to the server that includes information about the departure point, accommodation, and destination.

[0077] Step 3:

[0078] The server analyzes the information received from the terminal and generates a query to obtain information about accommodations (for example, "hotels around Kyoto Station").

[0079] Step 4:

[0080] The server sends a query to the database or an external API to search for dining options near the accommodation.

[0081] Step 5:

[0082] The server temporarily stores information about restaurants near the accommodation (e.g., sushi restaurants, ramen shops, cafes, etc.) that it has acquired.

[0083] Step 6:

[0084] The server calculates the optimal travel route based on information about the departure point "Tokyo" and the destination "Kyoto." Specifically, it calculates the best mode of transport, such as bullet trains, buses, and taxis, and the travel time, taking into account public transportation timetables and operating conditions.

[0085] Step 7:

[0086] The server temporarily stores the calculation results (travel route, departure and arrival times, transfer information, etc.).

[0087] Step 8:

[0088] The server generates a query to retrieve details about tourist spots based on information about the destination "Kyoto".

[0089] Step 9:

[0090] The server sends a query to the database or external API to search for tourist attractions near the destination (e.g., Kiyomizu-dera Temple, Kinkaku-ji Temple, Gion, etc.).

[0091] Step 10:

[0092] The server temporarily stores information about tourist spots it has acquired.

[0093] Step 11:

[0094] The server integrates all the information it has acquired and calculated to generate a single travel plan. Specifically, it combines departure times, modes of transportation, arrival times, dining options near accommodations, and sightseeing schedules into one plan.

[0095] Step 12:

[0096] The server generates a travel plan and sends it to the device.

[0097] Step 13:

[0098] The device displays the travel plan received from the server to the user. Specifically, the plan is displayed in either a timeline or list format.

[0099] Step 14:

[0100] The user reviews the displayed travel plan and plans or modifies the travel details.

[0101] (Example 1)

[0102] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0103] Traditional travel planning systems required users to manually link their departure point, accommodation, and destination, or to individually search for detailed information. This resulted in a time-consuming and laborious process, making it difficult to create a consistent travel plan. Furthermore, some systems lacked real-time information and adequately provided optimal routes considering public transport schedules and service status. Consequently, these systems were inconvenient for travelers and insufficient to assist with planning.

[0104] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0105] In this invention, the server includes data transmission means for transmitting travel information entered by the user in real time, data analysis means for analyzing information from external data sources and formatting it into an easy-to-use format, route search means for optimizing travel routes and travel times between the departure point and destination, information acquisition means for obtaining detailed information on tourist spots from external data sources, and data integration means for integrating the acquired information and organizing it in a schedule format. This makes it possible for users to easily create consistent and detailed travel plans. Specifically, it becomes possible to acquire information on dining spots and tourist spots in real time and provide users with travel plans that include optimal routes that take into account public transportation timetables and operating conditions.

[0106] An "input method" refers to a device or software that provides an interface for users to input travel information such as their departure point, accommodation, and destination into the system.

[0107] "Acquisition means" refers to a means of collecting related information, such as dining spots around the accommodation, based on the accommodation information transmitted from the input means.

[0108] "Calculation means" refers to algorithms or software used to calculate the optimal travel route and travel time based on the departure and destination information transmitted from the input means.

[0109] A "tourism information service" is a means of obtaining and providing users with information about tourist attractions and related topics around their destination.

[0110] An "integration means" is a means of integrating information obtained from acquisition means, calculation means, and tourist information means into a single travel plan and presenting it to the user.

[0111] "Data transmission means" refers to a method for transmitting travel information entered by a user to a server in real time.

[0112] "Data analysis means" refers to methods for analyzing information obtained from external data sources and formatting it into a user-friendly format.

[0113] A "route search method" refers to an algorithm or software used to optimize the travel route and travel time between a starting point and a destination.

[0114] "Information acquisition means" refers to methods for obtaining tourist spots and other related information from external data sources.

[0115] A "data integration method" is a means of integrating all acquired information, organizing it into a schedule format, and providing it to the user.

[0116] This invention is a system that enables users to efficiently plan their trips. The system consists of the following elements: a terminal, a server, and multiple processing means.

[0117] 1. Terminal

[0118] A terminal is a device used by users to input travel information such as their departure point, accommodation, and destination. Specific examples of terminals include smartphones, tablets, and PCs. The information entered by the user is sent to the server through the terminal. Here, when the user enters information into the interface and presses the submit button, an HTTP POST request is executed to the server.

[0119] 2. Server

[0120] The server is a central system that receives information sent from terminals and generates travel plans using multiple processing methods. The server has the following functions:

[0121] Acquisition means

[0122] The server uses acquisition methods to retrieve information about nearby dining spots based on accommodation information sent from the terminal. This retrieval utilizes external APIs (e.g., Google® Places API) or local databases. For example, based on information such as "hotels around Kyoto Station," it collects information on sushi restaurants, ramen shops, cafes, etc.

[0123] means of calculation

[0124] The server uses computational methods to calculate the optimal travel route and travel time based on information about the origin and destination. This calculation uses data from public transport timetables and operating status. Specifically, it obtains data from a real-time traffic information API and uses the Dijkstra algorithm or the A algorithm to derive the optimal route.

[0125] Tourist information services

[0126] The server uses tourist information tools to obtain information about tourist spots around the destination. This information is obtained using external APIs (e.g., TriPad® visor API) and databases. Based on destination information such as "Kyoto," it collects detailed information about places like Kiyomizu-dera Temple, Kinkaku-ji Temple, and Gion.

[0127] Data analysis means

[0128] The server analyzes the acquired information and formats it into a user-friendly format. It analyzes JSON data obtained from external data sources, extracts the necessary information, and formats it accordingly.

[0129] Route search means

[0130] The server has a route search mechanism to calculate the optimal travel route between the origin and destination. It calculates the shortest route and optimal travel time based on public transport timetables and service information.

[0131] Data Integration Means

[0132] The server integrates information obtained from acquisition, calculation, and tourist information sources to generate a single, integrated travel plan. The travel plan is then organized and presented to the user in timeline or list format.

[0133] 3. Plan generation and display

[0134] The server sends the generated integrated travel plan to the device, which then displays it to the user. Specifically, it is provided to the user as a timeline on a web page or as a list on a mobile app. For example, the schedule might be organized in the format of "9:00 Depart Tokyo by Shinkansen → 12:00 Arrive Kyoto → 12:30 Lunch at Kyoto Station (sushi restaurant)".

[0135] Specific example

[0136] For example, if a user plans a trip from "Tokyo" to "Kyoto," the system will work as follows:

[0137] 1. The user enters their departure point as "Tokyo," their accommodation as "a hotel near Kyoto Station," and their destination as "Kyoto" on their device.

[0138] 2. The terminal sends this input information to the server.

[0139] 3. The server retrieves information about the accommodation and collects information about sushi restaurants, ramen shops, cafes, etc., around Kyoto Station.

[0140] 4. The server calculates the optimal travel route from the departure point "Tokyo" to the destination "Kyoto" and provides the means of transportation, such as the Shinkansen (bullet train).

[0141] 5. The server retrieves tourist information for the destination "Kyoto" and collects detailed information on places like Kiyomizu-dera Temple, Kinkaku-ji Temple, and Gion.

[0142] 6. The server integrates this information and generates travel plans in timeline or list format.

[0143] 7. The device displays this integrated travel plan to the user.

[0144] Examples of prompts for generative AI models

[0145] Use the following prompts to input into the generative AI model:

[0146] I would like to plan a 3-day trip from Tokyo to Kyoto. The departure point is Tokyo, the accommodation is a hotel near Kyoto Station, and the destination is Kyoto. Please generate an optimal travel plan with a detailed schedule including information on sightseeing spots and dining options.

[0147] In this way, users can easily create efficient and consistent travel plans.

[0148] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0149] Step 1:

[0150] The user enters their departure point, accommodation, and destination.

[0151] Input: The user enters the departure point "Tokyo", accommodation "Hotels around Kyoto Station", and destination "Kyoto" into the terminal's input interface.

[0152] Specific operation: The user enters the required information into the input form displayed on the device screen and presses the submit button.

[0153] Step 2:

[0154] The terminal sends the input information to the server.

[0155] Input: Travel information entered and submitted by the user.

[0156] Output: Input information is sent to the server.

[0157] Specific operation: The terminal sends the information entered by the user to the server in the form of an HTTP POST request, and the server receives it.

[0158] Step 3:

[0159] The server retrieves information about restaurants and dining options near the accommodation.

[0160] Input: Accommodation information "Hotels near Kyoto Station".

[0161] Output: Information on dining spots near your accommodation.

[0162] Specific operation: The server uses the Google Places API to send HTTP requests to retrieve information on sushi restaurants, ramen shops, cafes, etc., based on "hotels around Kyoto Station," and receives the response in JSON format.

[0163] Step 4:

[0164] The server calculates the travel route from the starting point to the destination.

[0165] Input: Departure point "Tokyo", Destination "Kyoto".

[0166] Output: Optimal travel route and travel time.

[0167] Specific operation: The server retrieves operational data from public transport timetable APIs and uses Dijkstra's algorithm or A algorithm to calculate the optimal travel route based on that data.

[0168] Step 5:

[0169] The server collects information about tourist attractions around the destination.

[0170] Input: Destination "Kyoto".

[0171] Output: Detailed information about tourist attractions.

[0172] Specific operation: The server uses the TripAdvisor API to send an HTTP request to retrieve information on tourist spots related to "Kyoto" (e.g., Kiyomizu-dera Temple, Kinkaku-ji Temple, Gion), and receives the response in JSON format.

[0173] Step 6:

[0174] The server analyzes the collected data and formats it into a unified format.

[0175] Input: Various data obtained (restaurants, travel routes, tourist spots).

[0176] Output: Formatted data.

[0177] Specific operation: The server parses the received JSON data and extracts the necessary information. It then performs data processing to format each piece of information into a timeline or list format.

[0178] Step 7:

[0179] The server generates an integrated travel plan.

[0180] Input: Various formatted data.

[0181] Output: Integrated travel plan.

[0182] Specific operation: The server generates a single, sequential travel plan based on the formatted data. It then integrates this plan into a schedule format and determines what to provide to the user.

[0183] Step 8:

[0184] The device displays an integrated travel plan to the user.

[0185] Input: Integrated travel plan sent from the server.

[0186] Output: A travel plan display that can be visually confirmed by the user.

[0187] Specific operation: The terminal renders the travel plan received from the server onto the display screen and visually presents it to the user in either a timeline or list format.

[0188] Through these steps, users can easily create and visually confirm efficient and consistent travel plans.

[0189] (Application Example 1)

[0190] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0191] Conventional travel plan generation systems would generate a travel plan based on the user's input of departure point, accommodation, and destination, but they did not cover planning that utilized video content. Furthermore, they could not take into account videos that the user wanted to watch or review videos they wanted to refer to during the travel plan generation process. As a result, they failed to meet the user's need to create a detailed plan based on video information about travel destinations, tourist spots, and restaurants.

[0192] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0193] In this invention, the server includes input means for the user to input their departure point, accommodation, and destination; acquisition means for obtaining dining spots around the accommodation; calculation means for calculating the optimal travel route and travel time; tourist information means for obtaining tourist spots around the destination; and video analysis means for generating a travel plan based on video content desired by the user. This makes it possible for the user to efficiently generate a travel plan based on videos they have watched or review videos.

[0194] "Input means" refers to devices or interfaces that allow users to input their departure point, accommodation, and destination.

[0195] The "acquisition means" refers to a function that acquires information about restaurants near the accommodation based on the accommodation information transmitted from the input means.

[0196] The "calculation means" is a function that calculates the optimal travel route and travel time based on the departure and destination information transmitted from the input means.

[0197] A "tourist information service" is a function for obtaining information about tourist spots around a destination.

[0198] The "video analysis method" is a function that generates travel plans based on the video content desired by the user.

[0199] The "integration means" refers to a function that integrates information obtained from acquisition means, calculation means, tourist information means, and video analysis means into a single travel plan and presents it to the user.

[0200] Modes for carrying out the invention

[0201] This invention is a system that provides consistent information to users when planning a trip and efficiently generates a travel plan. The system comprises a terminal, a server, and multiple processing means.

[0202] System Overview

[0203] This system consists of the following elements:

[0204] 1. Terminal:

[0205] This device allows users to input their departure point, accommodation, and destination.

[0206] Includes means for sending user-entered information to a server.

[0207] 2. Server:

[0208] It is a central system that processes information received from terminals.

[0209] A "means of obtaining" information about dining spots near your accommodation.

[0210] A "calculation tool" for calculating travel routes and travel times based on information about the departure point and destination.

[0211] A "tourist information tool" for obtaining information about tourist attractions around a destination.

[0212] A "video analysis method" for generating travel plans based on the video content desired by the user.

[0213] This "integration method" combines the above information into a single travel plan and presents it to the user.

[0214] Operation details

[0215] User input and data transmission

[0216] The user enters their departure point, accommodation, and destination via their device. The entered data is then sent from the device to the server. This device can be a typical smartphone, tablet, or personal computer.

[0217] Obtaining information about the area around your accommodation

[0218] The server uses the accommodation information sent from the terminal to retrieve information about dining spots near the accommodation using a database or external API. This includes information on various restaurants, cafes, and other establishments.

[0219] Route calculation from departure point to destination

[0220] The server calculates the optimal travel route and travel time based on the departure and destination information. This calculation uses information on public transportation such as bullet trains, buses, and taxis. Public transportation timetables and operating status are also taken into consideration.

[0221] Tourist information for the area around your destination

[0222] The server uses the destination information to retrieve information about nearby tourist attractions using a database or external API. This includes detailed information about major tourist destinations and facilities.

[0223] Analysis and utilization of video content

[0224] Based on the video content requested by the user, the server uses video analysis tools to generate travel plans. It analyzes videos and review videos watched by the user and extracts related tourist spots and dining options.

[0225] Plan generation and display

[0226] The server integrates all information obtained from data acquisition, calculation, tourist information, and video analysis to generate a single travel plan. This travel plan is presented to the user in timeline or list format. An example of a specific prompt message would be: "I am planning a trip from Tokyo to Kyoto, staying near Kyoto Station, and visiting Kiyomizu-dera Temple, Kinkaku-ji Temple, and Gion."

[0227] The specific APIs used will be those that provide travel-related data (e.g., Google Places API, OpenWeather API), and the Python requests module will be used to retrieve and send the data. This system will allow users to easily and efficiently create consistent travel plans.

[0228] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0229] Step 1:

[0230] The user enters their departure point, accommodation, and destination using their device. The entered data is then sent to the server by the device.

[0231] Input: Information about the departure point, accommodation, and destination entered by the user.

[0232] Output: User input data is sent to the server.

[0233] Step 2:

[0234] The server uses the received accommodation information to retrieve information about restaurants near the accommodation using a database or external API.

[0235] Input: Accommodation information received by the server.

[0236] Output: A list of dining spots near your accommodation.

[0237] Specific operation: The server uses the latitude and longitude of the accommodation to send requests to the Google Places API and other dining spot information APIs to retrieve information on nearby restaurants and cafes.

[0238] Step 3:

[0239] The server calculates the optimal travel route and travel time based on the departure and destination information.

[0240] Input: Information about the departure and destination locations.

[0241] Output: Optimal travel route and travel time.

[0242] Specific operation: The server uses route calculation APIs such as the Google Maps API to obtain the travel route and travel time between two specified points. It also takes into account public transport information.

[0243] Step 4:

[0244] The server retrieves information about tourist attractions around the destination.

[0245] Input: Destination information.

[0246] Output: A list of tourist attractions around the destination.

[0247] Specific operation: The server uses the destination's latitude and longitude to send a request to a tourist spot information API to retrieve information about nearby tourist spots.

[0248] Step 5:

[0249] The server uses video analysis tools to generate travel plans based on the video content requested by the user.

[0250] Input: Information about the videos the user has watched.

[0251] Output: Elements of tourist spots and travel plans based on the videos watched.

[0252] Specific operation: The server analyzes the video's metadata and content, and extracts relevant tourist spots and activities.

[0253] Step 6:

[0254] The server integrates information obtained from acquisition means, calculation means, tourist information means, and video analysis means to generate a single travel plan.

[0255] Input: Dining spots near the accommodation, optimal travel route, sightseeing spots near the destination, and video analysis results.

[0256] Output: Integrated travel plan.

[0257] Specific operation: The server integrates various pieces of information to generate a consistent and efficient travel plan, which is then formatted in either a timeline or list format.

[0258] Step 7:

[0259] The device then presents this integrated travel plan to the user.

[0260] Input: Integrated travel plan sent from the server.

[0261] Output: Display of the travel plan in a format visible to the user.

[0262] Specific operation: The device will display the travel plan in a timeline or list format, allowing the user to easily review each step of the trip.

[0263] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0264] This invention is a system that efficiently generates travel plans by providing consistent information while taking into account the user's emotions when planning a trip. The system comprises a terminal, a server, an emotion engine, and multiple processing means.

[0265] System Overview

[0266] This system consists of the following elements:

[0267] 1. Terminal:

[0268] This is a device for users to input their departure point, accommodation, and destination.

[0269] Includes means for sending user-entered information and emotional feedback to a server.

[0270] 2. Server:

[0271] It is a central system that processes information received from terminals.

[0272] A "means of obtaining" information about dining spots near your accommodation.

[0273] A "calculation tool" for calculating travel routes and travel times based on information about the departure point and destination.

[0274] A "tourist information tool" for obtaining information about tourist attractions around a destination.

[0275] This "integration method" combines the above information into a single travel plan and presents it to the user.

[0276] 3. Emotional Engine:

[0277] A system for recognizing and analyzing user emotions.

[0278] This includes methods for analyzing user emotions from their input and actions, and adjusting travel plans based on the analysis results.

[0279] Program processing

[0280] User input and data transmission

[0281] The user enters information about their departure point, accommodation, destination, and their mood or feelings through their device. For example, they might enter "Tokyo" as the departure point, "a hotel near Kyoto Station" as the accommodation, and "Kyoto" as the destination, and then add emotional information such as "I want to relax" or "I want to enjoy a delicious meal."

[0282] The device sends this input information and sentiment information to the server.

[0283] Obtaining information about the area around your accommodation

[0284] Based on the accommodation information ("hotels near Kyoto Station") sent from the terminal, the server uses a database or an external API to obtain information about dining spots around the accommodation. For example, it includes information such as sushi restaurants, ramen shops, cafes, etc.

[0285] Recommendation based on emotions

[0286] The emotion engine analyzes the user's emotion information and recommends specific dining spots and tourist attractions based on the results. For example, for the emotion of "wanting to relax", cafes with a calm atmosphere and hot spring facilities are preferentially proposed.

[0287] Route calculation from the departure point to the destination

[0288] Based on the information of the departure point "Tokyo" and the destination "Kyoto", the server calculates the optimal travel route. Information on public transportation such as bullet trains, buses, and taxis is used for this calculation. The server takes into account the schedules and operating conditions of each transportation agency and provides the optimal travel route and travel time.

[0289] [[ID=十九]] Tourist guide around the destination

[0290] Based on the information of the destination "Kyoto", the server uses a database or an external API to obtain information about tourist attractions around. For example, it includes detailed information on tourist destinations such as Kiyomizu Temple, Kinkaku-ji Temple, and Gion.

[0291] Generation and display of a plan

[0292] The server integrates all the information obtained and calculated to generate a single travel plan. This plan includes departure time, means of transportation, arrival time, dining spots around the accommodation (including recommendations based on emotions), visit schedule of tourist attractions, etc. The integration means displays this plan in a format (timeline format or list format) appropriate for the user.

[0293] Specific example

[0294] For example, if a user plans a trip from Tokyo to Kyoto, the system will work as follows:

[0295] 1. The user enters "Tokyo" (departure point), "hotels around Kyoto Station" (accommodation), and "Kyoto" (destination), and provides emotional information such as "I want to relax" and "I want to enjoy a delicious meal."

[0296] 2. The terminal sends input information and emotional information to the server.

[0297] 3. The server uses the accommodation information to retrieve information on restaurants, ramen shops, cafes, and other dining spots around Kyoto Station.

[0298] 4. The emotion engine analyzes the user's emotional information and prioritizes suggesting cafes where the user can spend a relaxing time.

[0299] 5. The server calculates the optimal travel route from the departure point "Tokyo" to the destination "Kyoto" and provides details about the means of transportation, such as the Shinkansen (bullet train).

[0300] 6. The server retrieves information about tourist spots in the destination "Kyoto," such as Kiyomizu-dera Temple, Kinkaku-ji Temple, and Gion.

[0301] 7. The server integrates this information and generates a single travel plan.

[0302] 8. The device displays this plan to the user in either a timeline or list format.

[0303] In this way, the system of the present invention can easily create efficient and consistent travel plans that take the user's emotions into consideration.

[0304] The following describes the processing flow.

[0305] Step 1:

[0306] The user inputs departure location, accommodation destination, destination, and emotional information through the terminal. For example, input "Tokyo" for the departure location, "Hotel near Kyoto Station" for the accommodation destination, "Kyoto" for the destination, and add emotional information such as "want to relax" and "want to enjoy delicious food".

[0307] Step 2:

[0308] The terminal sends the input information and emotional information to the server. Specifically, it sends a request including the departure location, accommodation destination, destination, and emotional information to the server.

[0309] Step 3:

[0310] Based on the accommodation destination information ("Hotel near Kyoto Station") received by the server from the terminal, it generates a query to obtain dining spot information around the accommodation destination using a database or an external API.

[0311] Step 4:

[0312] The server sends a query to search for dining spots around the accommodation destination to the database or the external API.

[0313] Step 5:

[0314] The server temporarily stores the information of the dining spots around the accommodation destination it has obtained (such as sushi restaurants, ramen shops, cafes, etc.).

[0315] Step 6:

[0316] The emotion engine analyzes the user's emotional information and adjusts the dining spot information based on the results. For example, for the emotion of "want to relax", it preferentially selects cafes with a quiet and calm atmosphere.

[0317] Step 7:

[0318] The server calculates the optimal travel route based on information about the departure point "Tokyo" and the destination "Kyoto." Specifically, it calculates the best mode of transport, such as bullet trains, buses, and taxis, and the travel time, taking into account public transportation timetables and operating conditions.

[0319] Step 8:

[0320] The server temporarily stores the calculation results (travel route, departure and arrival times, transfer information, etc.).

[0321] Step 9:

[0322] The server generates a query to retrieve details about tourist spots based on information about the destination "Kyoto".

[0323] Step 10:

[0324] The server sends a query to the database or external API to search for tourist attractions near the destination (e.g., Kiyomizu-dera Temple, Kinkaku-ji Temple, Gion, etc.).

[0325] Step 11:

[0326] The server temporarily stores information about tourist spots it has acquired.

[0327] Step 12:

[0328] The emotion engine adjusts tourist spot information based on the user's emotional information. For example, if the user feels like "I want to relax," it will prioritize selecting quiet temples and nature parks.

[0329] Step 13:

[0330] The server integrates all the information it has acquired and calculated to generate a single travel plan. Specifically, it combines departure time, mode of transportation, arrival time, dining spots near accommodation (including emotionally-based recommendations), and a schedule of sightseeing visits into one plan.

[0331] Step 14:

[0332] The server generates a travel plan and sends it to the device.

[0333] Step 15:

[0334] The device displays the travel plan received from the server to the user. Specifically, the plan is displayed in either a timeline or list format.

[0335] Step 16:

[0336] The user reviews the displayed travel plan and adjusts the plan as needed.

[0337] (Example 2)

[0338] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0339] Conventional travel planning systems have been insufficient in providing information that takes user emotions into account, making it difficult to efficiently generate consistent travel plans. Furthermore, there was a need to effectively suggest dining and sightseeing spots near accommodations based on user input, and to present optimal travel routes that take public transportation timetables into consideration.

[0340] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0341] In this invention, the server includes an input means for the user to input their departure point, accommodation, and destination; an acquisition means for obtaining restaurant spots based on accommodation information; a calculation means for calculating the optimal travel route based on departure point and destination information; an emotion analysis means for analyzing the user's emotional information and recommending restaurant and tourist spots based on the analysis results; and an integration means for integrating the obtained information into a single travel plan and presenting it to the user. This makes it possible to generate an efficient and consistent travel plan that takes the user's emotions into consideration.

[0342] "Input means" refers to devices or programs that allow users to input their origin, accommodation, destination, and emotional information.

[0343] "Acquisition means" refers to functions or systems that collect information on dining spots around the accommodation based on information transmitted from the input means.

[0344] "Calculation means" refers to functions or algorithms that calculate the optimal travel route and travel time based on information about the departure point and destination.

[0345] "Emotional analysis means" refers to a function or system that analyzes emotional information entered by the user and recommends dining spots and tourist spots based on the results.

[0346] "Integration means" refers to functions or programs that combine information obtained from acquisition means, calculation means, and sentiment analysis means into a single travel plan and present it to the user.

[0347] A "user" refers to someone who uses the system to plan their trip.

[0348] A "server" is a central computer system that processes information sent by users and performs calculations and retrieves necessary data.

[0349] A "terminal" refers to a device used by a user to input and receive information, such as a smartphone or a personal computer.

[0350] A "dining spot" refers to places including restaurants located near the user's accommodation.

[0351] A "tourist spot" refers to a place that includes tourist attractions and points of interest located near a destination.

[0352] A "travel route" refers to the optimal path from the starting point to the destination, taking into account public transport and other means of transportation.

[0353] "Travel time" refers to the time required to travel from the starting point to the destination.

[0354] Modes for carrying out the invention

[0355] This invention is a system that efficiently generates travel plans by providing consistent information to users while taking their emotions into consideration when they are planning a trip. The system comprises a terminal, a server, emotion analysis means, and multiple processing means.

[0356] 1. Terminal:

[0357] This is a device in which users input information for travel planning. The information input includes departure point, accommodation, destination, and the user's emotional state. For example, a computer device such as a smartphone or personal computer is used. The device communicates with a server via the internet and transmits the input information.

[0358] 2. Server:

[0359] A server is a central system that processes information received from terminals. A server includes the following processing methods:

[0360] Acquisition method: Based on the accommodation information entered by the user, information on dining spots around the accommodation is obtained using an external API (e.g., Google Places API).

[0361] Calculation Method: Based on origin and destination information, the travel route and travel time are calculated. The Google Maps API is used to determine the optimal mode of transport and its duration.

[0362] Emotion analysis method: The system analyzes the emotional information entered by the user and recommends appropriate dining spots and tourist attractions based on the results. For example, for the emotion of "wanting to relax," it recommends quiet cafes or hot spring facilities.

[0363] Integration method: Information obtained from acquisition, calculation, and sentiment analysis methods is integrated into a single travel plan. The integrated plan is appropriately formatted in timeline or list format and presented to the user.

[0364] This system works as follows:

[0365] 1. User Input: The user enters basic travel information and sentiment information via their device. For example, they might enter "Tokyo" as the departure point, "Hotels near Kyoto Station" as the accommodation, "Kyoto" as the destination, and sentiment information such as "I want to relax" or "I want to enjoy delicious food."

[0366] 2. Terminal sends: The terminal sends the input information to the server.

[0367] 3. Server Processing: Based on the received information, the server retrieves information such as restaurants near the accommodation, the optimal route from the departure point to the destination, and tourist attractions near the destination, and adjusts the recommended spots based on sentiment information.

[0368] 4. Integration and Display: The server integrates the retrieved and calculated information, generates a travel plan, and sends it to the terminal. Finally, the terminal displays the generated plan to the user.

[0369] Specific example

[0370] For example, if a user enters a travel plan from Tokyo to Kyoto, the system will work as follows:

[0371] 1. The user enters "Tokyo" (departure point), "Hotels around Kyoto Station" (accommodation), and "Kyoto" (destination), and adds sentiment information such as "I want to relax" and "I want to enjoy a delicious meal."

[0372] 2. The terminal sends this input information to the server.

[0373] 3. Based on the accommodation information, the server retrieves information on restaurants, ramen shops, cafes, and other dining spots around Kyoto Station.

[0374] 4. An emotion analysis system analyzes emotional information and prioritizes recommending relaxing cafes and hot spring facilities.

[0375] 5. The server uses the Google Maps API to calculate the optimal travel route from the departure point "Tokyo" to the destination "Kyoto".

[0376] 6. The server retrieves information about tourist spots in Kyoto, such as Kiyomizu-dera Temple, Kinkaku-ji Temple, and Gion.

[0377] 7. The server integrates this information and generates a travel plan in either a timeline or list format.

[0378] 8. The device will display this plan to the user.

[0379] Example of a prompt

[0380] When creating a travel plan, specify the departure point as "Tokyo," the accommodation as "a hotel near Kyoto Station," and the destination as "Kyoto." Then, taking into account emotional information such as "I want to relax" and "I want to enjoy delicious food," generate a consistent travel plan that includes travel routes, restaurants near the accommodation, and sightseeing spots.

[0381] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0382] Step 1:

[0383] User input

[0384] The user enters travel information using the device. This information includes departure point, accommodation, destination, and sentiment. For example, the user might enter "Tokyo" as the departure point, "a hotel near Kyoto Station" as the accommodation, "Kyoto" as the destination, and sentiment "I want to relax" or "I want to enjoy a delicious meal." This information is temporarily stored in the device's internal memory.

[0385] Step 2:

[0386] Terminal transmission

[0387] The terminal transmits stored user input information to the server via the internet. To do this, the terminal uses an appropriate communication protocol (e.g., HTTP) to send the input information to the server's endpoint. Through this transmission process, the server receives the user's travel and sentiment information.

[0388] Step 3:

[0389] Obtaining information about the area around your accommodation

[0390] The server retrieves dining spot information based on the received accommodation information (for example, "hotels near Kyoto Station"). Specifically, it calls the Google Places API to obtain a list of restaurants near the accommodation and their details (address, rating, category, etc.). This updates the database of dining spot information.

[0391] Input: Accommodation information

[0392] Output: Dining spot information (address, rating, category, etc.)

[0393] Step 4:

[0394] Emotion analysis

[0395] A sentiment analysis system on the server analyzes the user's emotional information. Natural language processing technology is used for the analysis to identify emotions from the user's input. For example, based on the emotional information "I want to relax," the system prioritizes selecting relaxing cafes and hot spring facilities. The analysis results are stored in a database and used for future recommendations.

[0396] Input: Sentiment information

[0397] Output: List of recommended categories

[0398] Step 5:

[0399] Travel route calculation

[0400] The server uses the Google Maps API to calculate the optimal travel route based on the departure point "Tokyo" and destination "Kyoto." It also considers information on public transportation such as bullet trains, buses, and taxis (timetables, service status, etc.) to provide the best possible route. The calculation results are output to the user as an optimal travel schedule.

[0401] Input: Departure point, Destination

[0402] Output: Optimal travel route and time

[0403] Step 6:

[0404] Tourist information for the area around your destination

[0405] The server retrieves nearby tourist attractions based on the destination information "Kyoto." To do this, it calls, for example, the TripAdvisor API to obtain a list of nearby tourist attractions (e.g., Kiyomizu-dera Temple, Kinkaku-ji Temple, Gion, etc.) and detailed information (name, address, rating, etc.). The retrieved information is stored in a database.

[0406] Input: Destination information

[0407] Output: Tourist spot information (name, address, rating, etc.)

[0408] Step 7:

[0409] Plan integration and generation

[0410] The server integrates information obtained from acquisition, calculation, and sentiment analysis methods into a single travel plan. This plan includes departure times, modes of transportation, arrival times, dining options near accommodations, and a schedule of sightseeing visits. The plan is formatted in timeline or list format and stored in a database.

[0411] Input: Information on dining spots, travel routes, and tourist attractions.

[0412] Output: Integrated travel plan

[0413] Step 8:

[0414] Displaying plans

[0415] The device displays an integrated travel plan sent from the server to the user. The display format can be a timeline or list, making it easy for the user to review. The user can then view this screen to get a detailed understanding of their travel schedule and destinations.

[0416] Input: Integrated travel plan

[0417] Output: Display of travel plan

[0418] (Application Example 2)

[0419] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0420] In food delivery services, it is difficult to suggest the most suitable dishes and restaurants based on the user's current emotions and mood, and there is a lack of an integrated system for calculating efficient delivery routes. Therefore, in order to increase user satisfaction, a system is needed that selects restaurants that take user emotions into consideration and plans efficient delivery routes.

[0421] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0422] In this invention, the server includes an input means for receiving user input information, an acquisition means for acquiring information on restaurants and bars near the accommodation, a calculation means for calculating the optimal travel route and travel time, a guidance means for acquiring information on tourist attractions, an emotion engine that makes suggestions based on the user's emotional information, and an integration means that integrates the information obtained from the acquisition means, calculation means and guidance means into a single travel plan and presents it to the user. This makes it possible to suggest restaurants and bars that take the user's emotions into consideration and to calculate an efficient delivery route.

[0423] "Input means" refers to devices or interfaces for users to input their origin, accommodation, destination, and emotional information.

[0424] "Method of acquisition" refers to the means of collecting information on restaurants and bars in the vicinity of a hotel based on the accommodation information entered by the user.

[0425] The "calculation means" refers to a function that calculates the optimal travel route and travel time based on the departure and destination information entered by the user.

[0426] "Guidance methods" refer to means of obtaining and providing users with information about tourist attractions around their destination.

[0427] An "emotion engine" is a system that analyzes a user's emotional information and makes specific suggestions based on the results.

[0428] An "integration means" is a function that integrates information obtained from acquisition means, calculation means, and guidance means, and presents it to the user as a single travel plan.

[0429] A specific system for implementing this invention comprises an input means for the user to input their departure point, accommodation, destination, and emotional information; an acquisition means for acquiring restaurants and bars around the accommodation; a calculation means for calculating the optimal travel route and travel time based on the departure point and destination information; a guidance means for acquiring tourist attractions around the destination; an emotional engine that makes suggestions based on the user's emotional information; and an integration means for integrating the information obtained from the acquisition means, calculation means, and guidance means and presenting it to the user.

[0430] Program generation and execution

[0431] The system's program is built using Python. This system utilizes the Google Maps API to search for nearby restaurants and bars based on the user's current location. Additionally, an emotion engine analyzes the user's emotional information, and suggestions are made based on the results.

[0432] For example, if a user enters "I want to relax" or "I want to enjoy a delicious meal," this information is sent from the input device to the server. The server uses the Google Maps API to retrieve information about restaurants and bars near the accommodation. Meanwhile, the emotion engine analyzes the user's emotional information and suggests places like "a relaxing cafe" or "a highly-rated restaurant."

[0433] The server also calculates the optimal travel route from the departure point "Tokyo" to the destination "Kyoto," taking into account public transport timetables and service status. This information is then compiled into a single travel plan by an integrated system and displayed to the user in either a timeline or list format.

[0434] Hardware and software to be used

[0435] Hardware: Smartphones, tablets, servers

[0436] Software: Google Maps API, Python

[0437] The server receives user input, retrieves data using the Google Maps API, performs sentiment analysis using an emotion engine, integrates the obtained information, and presents it to the user.

[0438] Specific example

[0439] If a user plans a trip from Tokyo to Kyoto, enters "I want to relax" and "I want to enjoy delicious food," and decides to stay at a hotel near Kyoto Station, the system will operate as follows:

[0440] 1. Information and emotional information entered by the user via the input method are sent to the server.

[0441] 2. The server uses the Google Maps API to obtain information on accommodations around Kyoto Station and nearby restaurants and bars.

[0442] 3. The emotion engine analyzes the user's emotional information and prioritizes suggesting relaxing cafes and highly-rated restaurants.

[0443] 4. The calculation method calculates the optimal travel route from Tokyo to Kyoto, taking into account details of public transportation such as the Shinkansen (bullet train).

[0444] 5. The integration mechanism combines this information into a single travel plan and displays it to the user in a timeline or list format.

[0445] Example of a prompt

[0446] "The user is currently located near Tokyo Station and is looking to relax. Use the Google Maps API to search for nearby cafes and list those that serve herbal tea. Also, calculate the optimal delivery route from those cafes to the user's location."

[0447] In this way, a system is provided that allows users to efficiently create optimal travel plans that take their emotions into consideration.

[0448] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0449] Step 1:

[0450] The user uses a terminal to input their departure point, accommodation, destination, and sentiment information. This input is then sent to the server in the next step. This input includes text data and is treated as basic information for subsequent data processing.

[0451] Step 2:

[0452] The terminal transmits the user's entered departure point, accommodation, destination, and sentiment information to the server. The server receives this input data and prepares to process each information item individually, converting it into an appropriate format for storage in the database.

[0453] Step 3:

[0454] The server uses the Google Maps API to retrieve information about restaurants and bars near the accommodation, based on the accommodation's location information. This process generates a list of restaurants and bars. The input data is the accommodation's location information, and the output is a list of restaurants and bars.

[0455] Step 4:

[0456] The emotion engine analyzes the user's emotional information. The input data is text information related to emotions, and the output is a list of emotion-based suggestions. This analysis identifies dining establishments that are suitable for the user's emotional state.

[0457] Step 5:

[0458] The server uses the Google Maps API to calculate the optimal travel route and travel time based on the origin and destination information. The input data is the location information of the origin and destination, and the output is detailed information about the travel route and travel time. This calculation also takes real-time traffic information into account.

[0459] Step 6:

[0460] The server retrieves information about tourist attractions around the destination using the Google Maps API and other external APIs. The input data is the location information of the destination, and the output is a list of tourist attractions.

[0461] Step 7:

[0462] The server integrates all information obtained from acquisition methods (food and beverage establishment information), calculation methods (travel routes and travel times), guidance methods (tourist attraction information), and an emotion engine (emotion-based suggestions). This integration generates a single travel plan. The travel plan includes content that takes the user's emotions into consideration and is provided in either a timeline or list format.

[0463] Step 8:

[0464] The server sends the generated travel plan to the terminal, which then displays this plan to the user. The input is an integrated travel plan, and the output is visualized plan information presented to the user. This plan includes suggested restaurants, optimal travel routes, and schedules for visiting tourist attractions.

[0465] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0466] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0467] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0468] [Second Embodiment]

[0469] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0470] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0471] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0472] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0473] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0474] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0475] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0476] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0477] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0478] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0479] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0480] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0481] This invention provides a system that offers consistent information to users when planning a trip and efficiently generates a travel plan. The system comprises a terminal, a server, and multiple processing means.

[0482] System Overview

[0483] This system consists of the following elements:

[0484] 1. Terminal:

[0485] This device allows users to input their departure point, accommodation, and destination.

[0486] Includes means for sending user-entered information to a server.

[0487] 2. Server:

[0488] It is a central system that processes information received from terminals.

[0489] A "means of obtaining" information about dining spots near your accommodation.

[0490] A "calculation tool" for calculating travel routes and travel times based on information about the departure point and destination.

[0491] A "tourist information tool" for obtaining information about tourist attractions around a destination.

[0492] This "integration method" combines the above information into a single travel plan and presents it to the user.

[0493] Program processing

[0494] User input and data transmission

[0495] The user enters travel information via their device, such as their departure point ("Tokyo"), accommodation ("a hotel near Kyoto Station"), and destination ("Kyoto"). The device then sends this information to the server.

[0496] Obtaining information about the area around your accommodation

[0497] The server uses the accommodation information ("Hotels near Kyoto Station") sent from the terminal to retrieve information about restaurants and other dining spots around the accommodation using a database or external API. This information may include, for example, sushi restaurants, ramen shops, and cafes.

[0498] Route calculation from departure point to destination

[0499] The server calculates the optimal travel route based on information about the departure point "Tokyo" and the destination "Kyoto." This calculation uses information on public transportation such as bullet trains, buses, and taxis. The server considers the timetables and operating status of each mode of transport to provide the optimal travel route and travel time.

[0500] Tourist information for the area around your destination

[0501] The server uses the destination "Kyoto" information to retrieve information about nearby tourist spots using a database or external API. For example, this includes detailed information about tourist attractions such as Kiyomizu-dera Temple, Kinkaku-ji Temple, and Gion.

[0502] Plan generation and display

[0503] The server generates a single, integrated travel plan based on all the information it has gathered. This plan includes departure times, modes of transportation, arrival times, dining options near the accommodation, and a schedule of sightseeing visits. The integration system then displays this plan to the user in an appropriate format (such as a timeline or list).

[0504] Specific example

[0505] For example, if a user plans a trip from Tokyo to Kyoto, the system will work as follows:

[0506] 1. The user enters "Tokyo" (departure point), "Hotels around Kyoto Station" (accommodation), and "Kyoto" (destination).

[0507] 2. The terminal sends the input information to the server.

[0508] 3. The server uses the accommodation information to retrieve information on restaurants, ramen shops, cafes, and other dining spots around Kyoto Station.

[0509] 4. The server calculates the optimal travel route from the departure point "Tokyo" to the destination "Kyoto" and provides details about transportation methods such as Shinkansen (bullet train).

[0510] 5. The server retrieves information about tourist spots in the destination "Kyoto," such as Kiyomizu-dera Temple, Kinkaku-ji Temple, and Gion.

[0511] 6. The server integrates this information and generates a single travel plan.

[0512] 7. The device displays this plan to the user in either a timeline or list format.

[0513] In this way, users can easily create efficient and consistent travel plans.

[0514] The following describes the processing flow.

[0515] Step 1:

[0516] The user enters their departure point, accommodation, and destination via their device. For example, they might enter "Tokyo" as the departure point, "Hotels around Kyoto Station" as the accommodation, and "Kyoto" as the destination.

[0517] Step 2:

[0518] The terminal sends the entered information to the server. Specifically, it sends a request to the server that includes information about the departure point, accommodation, and destination.

[0519] Step 3:

[0520] The server analyzes the information received from the terminal and generates a query to obtain information about accommodations (for example, "hotels around Kyoto Station").

[0521] Step 4:

[0522] The server sends a query to the database or an external API to search for dining options near the accommodation.

[0523] Step 5:

[0524] The server temporarily stores information about restaurants near the accommodation (e.g., sushi restaurants, ramen shops, cafes, etc.) that it has acquired.

[0525] Step 6:

[0526] The server calculates the optimal travel route based on information about the departure point "Tokyo" and the destination "Kyoto." Specifically, it calculates the best mode of transport, such as bullet trains, buses, and taxis, and the travel time, taking into account public transportation timetables and operating conditions.

[0527] Step 7:

[0528] The server temporarily stores the calculation results (travel route, departure and arrival times, transfer information, etc.).

[0529] Step 8:

[0530] The server generates a query to retrieve details about tourist spots based on information about the destination "Kyoto".

[0531] Step 9:

[0532] The server sends a query to the database or external API to search for tourist attractions near the destination (e.g., Kiyomizu-dera Temple, Kinkaku-ji Temple, Gion, etc.).

[0533] Step 10:

[0534] The server temporarily stores information about tourist spots it has acquired.

[0535] Step 11:

[0536] The server integrates all the information it has acquired and calculated to generate a single travel plan. Specifically, it combines departure times, modes of transportation, arrival times, dining options near accommodations, and sightseeing schedules into one plan.

[0537] Step 12:

[0538] The server generates a travel plan and sends it to the device.

[0539] Step 13:

[0540] The device displays the travel plan received from the server to the user. Specifically, the plan is displayed in either a timeline or list format.

[0541] Step 14:

[0542] The user reviews the displayed travel plan and plans or modifies the travel details.

[0543] (Example 1)

[0544] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0545] Traditional travel planning systems required users to manually link their departure point, accommodation, and destination, or to individually search for detailed information. This resulted in a time-consuming and laborious process, making it difficult to create a consistent travel plan. Furthermore, some systems lacked real-time information and adequately provided optimal routes considering public transport schedules and service status. Consequently, these systems were inconvenient for travelers and insufficient to assist with planning.

[0546] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0547] In this invention, the server includes data transmission means for transmitting travel information entered by the user in real time, data analysis means for analyzing information from external data sources and formatting it into an easy-to-use format, route search means for optimizing travel routes and travel times between the departure point and destination, information acquisition means for obtaining detailed information on tourist spots from external data sources, and data integration means for integrating the acquired information and organizing it in a schedule format. This makes it possible for users to easily create consistent and detailed travel plans. Specifically, it becomes possible to acquire information on dining spots and tourist spots in real time and provide users with travel plans that include optimal routes that take into account public transportation timetables and operating conditions.

[0548] An "input method" refers to a device or software that provides an interface for users to input travel information such as their departure point, accommodation, and destination into the system.

[0549] "Acquisition means" refers to a means of collecting related information, such as dining spots around the accommodation, based on the accommodation information transmitted from the input means.

[0550] "Calculation means" refers to algorithms or software used to calculate the optimal travel route and travel time based on the departure and destination information transmitted from the input means.

[0551] A "tourism information service" is a means of obtaining and providing users with information about tourist attractions and related topics around their destination.

[0552] An "integration means" is a means of integrating information obtained from acquisition means, calculation means, and tourist information means into a single travel plan and presenting it to the user.

[0553] "Data transmission means" refers to a method for transmitting travel information entered by a user to a server in real time.

[0554] "Data analysis means" refers to methods for analyzing information obtained from external data sources and formatting it into a user-friendly format.

[0555] A "route search method" refers to an algorithm or software used to optimize the travel route and travel time between a starting point and a destination.

[0556] "Information acquisition means" refers to methods for obtaining tourist spots and other related information from external data sources.

[0557] A "data integration method" is a means of integrating all acquired information, organizing it into a schedule format, and providing it to the user.

[0558] This invention is a system that enables users to efficiently plan their trips. The system consists of the following elements: a terminal, a server, and multiple processing means.

[0559] 1. Terminal

[0560] A terminal is a device used by users to input travel information such as their departure point, accommodation, and destination. Specific examples of terminals include smartphones, tablets, and PCs. The information entered by the user is sent to the server through the terminal. Here, when the user enters information into the interface and presses the submit button, an HTTP POST request is executed to the server.

[0561] 2. Server

[0562] The server is a central system that receives information sent from terminals and generates travel plans using multiple processing methods. The server has the following functions:

[0563] Acquisition means

[0564] The server uses acquisition methods to retrieve information about nearby dining spots based on the accommodation information sent from the terminal. This retrieval utilizes external APIs (e.g., Google Places API) or local databases. For example, based on information such as "hotels around Kyoto Station," it collects information on sushi restaurants, ramen shops, cafes, etc.

[0565] means of calculation

[0566] The server uses computational methods to calculate the optimal travel route and travel time based on information about the origin and destination. This calculation uses data from public transport timetables and operating status. Specifically, it obtains data from a real-time traffic information API and uses the Dijkstra algorithm or the A algorithm to derive the optimal route.

[0567] Tourist information services

[0568] The server uses tourist information tools to obtain information about tourist spots around the destination. This information is obtained using external APIs (e.g., TripAdvisor API) and databases. Based on destination information such as "Kyoto," it collects detailed information about places like Kiyomizu-dera Temple, Kinkaku-ji Temple, and Gion.

[0569] Data analysis means

[0570] The server analyzes the acquired information and formats it into a user-friendly format. It analyzes JSON data obtained from external data sources, extracts the necessary information, and formats it accordingly.

[0571] Route search means

[0572] The server has a route search mechanism to calculate the optimal travel route between the origin and destination. It calculates the shortest route and optimal travel time based on public transport timetables and service information.

[0573] Data Integration Means

[0574] The server integrates information obtained from acquisition, calculation, and tourist information sources to generate a single, integrated travel plan. The travel plan is then organized and presented to the user in timeline or list format.

[0575] 3. Plan generation and display

[0576] The server sends the generated integrated travel plan to the device, which then displays it to the user. Specifically, it is provided to the user as a timeline on a web page or as a list on a mobile app. For example, the schedule might be organized in the format of "9:00 Depart Tokyo by Shinkansen → 12:00 Arrive Kyoto → 12:30 Lunch at Kyoto Station (sushi restaurant)".

[0577] Specific example

[0578] For example, if a user plans a trip from "Tokyo" to "Kyoto," the system will work as follows:

[0579] 1. The user enters their departure point as "Tokyo," their accommodation as "a hotel near Kyoto Station," and their destination as "Kyoto" on their device.

[0580] 2. The terminal sends this input information to the server.

[0581] 3. The server retrieves information about the accommodation and collects information about sushi restaurants, ramen shops, cafes, etc., around Kyoto Station.

[0582] 4. The server calculates the optimal travel route from the departure point "Tokyo" to the destination "Kyoto" and provides the means of transportation, such as the Shinkansen (bullet train).

[0583] 5. The server retrieves tourist information for the destination "Kyoto" and collects detailed information on places like Kiyomizu-dera Temple, Kinkaku-ji Temple, and Gion.

[0584] 6. The server integrates this information and generates travel plans in timeline or list format.

[0585] 7. The device displays this integrated travel plan to the user.

[0586] Examples of prompts for generative AI models

[0587] Use the following prompts to input into the generative AI model:

[0588] I would like to plan a 3-day trip from Tokyo to Kyoto. The departure point is Tokyo, the accommodation is a hotel near Kyoto Station, and the destination is Kyoto. Please generate an optimal travel plan with a detailed schedule including information on sightseeing spots and dining options.

[0589] In this way, users can easily create efficient and consistent travel plans.

[0590] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0591] Step 1:

[0592] The user enters their departure point, accommodation, and destination.

[0593] Input: The user enters the departure point "Tokyo", accommodation "Hotels around Kyoto Station", and destination "Kyoto" into the terminal's input interface.

[0594] Specific operation: The user enters the required information into the input form displayed on the device screen and presses the submit button.

[0595] Step 2:

[0596] The terminal sends the input information to the server.

[0597] Input: Travel information entered and submitted by the user.

[0598] Output: Input information is sent to the server.

[0599] Specific operation: The terminal sends the information entered by the user to the server in the form of an HTTP POST request, and the server receives it.

[0600] Step 3:

[0601] The server retrieves information about restaurants and dining options near the accommodation.

[0602] Input: Accommodation information "Hotels near Kyoto Station".

[0603] Output: Information on dining spots near your accommodation.

[0604] Specific operation: The server uses the Google Places API to send HTTP requests to retrieve information on sushi restaurants, ramen shops, cafes, etc., based on "hotels around Kyoto Station," and receives the response in JSON format.

[0605] Step 4:

[0606] The server calculates the travel route from the starting point to the destination.

[0607] Input: Departure point "Tokyo", Destination "Kyoto".

[0608] Output: Optimal travel route and travel time.

[0609] Specific operation: The server retrieves operational data from public transport timetable APIs and uses Dijkstra's algorithm or A algorithm to calculate the optimal travel route based on that data.

[0610] Step 5:

[0611] The server collects information about tourist attractions around the destination.

[0612] Input: Destination "Kyoto".

[0613] Output: Detailed information about tourist attractions.

[0614] Specific operation: The server uses the TripAdvisor API to send an HTTP request to retrieve information on tourist spots related to "Kyoto" (e.g., Kiyomizu-dera Temple, Kinkaku-ji Temple, Gion), and receives the response in JSON format.

[0615] Step 6:

[0616] The server analyzes the collected data and formats it into a unified format.

[0617] Input: Various data obtained (restaurants, travel routes, tourist spots).

[0618] Output: Formatted data.

[0619] Specific operation: The server parses the received JSON data and extracts the necessary information. It then performs data processing to format each piece of information into a timeline or list format.

[0620] Step 7:

[0621] The server generates an integrated travel plan.

[0622] Input: Various formatted data.

[0623] Output: Integrated travel plan.

[0624] Specific operation: The server generates a single, sequential travel plan based on the formatted data. It then integrates this plan into a schedule format and determines what to provide to the user.

[0625] Step 8:

[0626] The device displays an integrated travel plan to the user.

[0627] Input: Integrated travel plan sent from the server.

[0628] Output: A travel plan display that can be visually confirmed by the user.

[0629] Specific operation: The terminal renders the travel plan received from the server onto the display screen and visually presents it to the user in either a timeline or list format.

[0630] Through these steps, users can easily create and visually confirm efficient and consistent travel plans.

[0631] (Application Example 1)

[0632] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0633] Conventional travel plan generation systems would generate a travel plan based on the user's input of departure point, accommodation, and destination, but they did not cover planning that utilized video content. Furthermore, they could not take into account videos that the user wanted to watch or review videos they wanted to refer to during the travel plan generation process. As a result, they failed to meet the user's need to create a detailed plan based on video information about travel destinations, tourist spots, and restaurants.

[0634] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0635] In this invention, the server includes input means for the user to input their departure point, accommodation, and destination; acquisition means for obtaining dining spots around the accommodation; calculation means for calculating the optimal travel route and travel time; tourist information means for obtaining tourist spots around the destination; and video analysis means for generating a travel plan based on video content desired by the user. This makes it possible for the user to efficiently generate a travel plan based on videos they have watched or review videos.

[0636] "Input means" refers to devices or interfaces that allow users to input their departure point, accommodation, and destination.

[0637] The "acquisition means" refers to a function that acquires information about restaurants near the accommodation based on the accommodation information transmitted from the input means.

[0638] The "calculation means" is a function that calculates the optimal travel route and travel time based on the departure and destination information transmitted from the input means.

[0639] A "tourist information service" is a function for obtaining information about tourist spots around a destination.

[0640] The "video analysis method" is a function that generates travel plans based on the video content desired by the user.

[0641] The "integration means" refers to a function that integrates information obtained from acquisition means, calculation means, tourist information means, and video analysis means into a single travel plan and presents it to the user.

[0642] Modes for carrying out the invention

[0643] This invention is a system that provides consistent information to users when planning a trip and efficiently generates a travel plan. The system comprises a terminal, a server, and multiple processing means.

[0644] System Overview

[0645] This system consists of the following elements:

[0646] 1. Terminal:

[0647] This device allows users to input their departure point, accommodation, and destination.

[0648] Includes means for sending user-entered information to a server.

[0649] 2. Server:

[0650] It is a central system that processes information received from terminals.

[0651] A "means of obtaining" information about dining spots near your accommodation.

[0652] A "calculation tool" for calculating travel routes and travel times based on information about the departure point and destination.

[0653] A "tourist information tool" for obtaining information about tourist attractions around a destination.

[0654] A "video analysis method" for generating travel plans based on the video content desired by the user.

[0655] This "integration method" combines the above information into a single travel plan and presents it to the user.

[0656] Operation details

[0657] User input and data transmission

[0658] The user enters their departure point, accommodation, and destination via their device. The entered data is then sent from the device to the server. This device can be a typical smartphone, tablet, or personal computer.

[0659] Obtaining information about the area around your accommodation

[0660] The server uses the accommodation information sent from the terminal to retrieve information about dining spots near the accommodation using a database or external API. This includes information on various restaurants, cafes, and other establishments.

[0661] Route calculation from departure point to destination

[0662] The server calculates the optimal travel route and travel time based on the departure and destination information. This calculation uses information on public transportation such as bullet trains, buses, and taxis. Public transportation timetables and operating status are also taken into consideration.

[0663] Tourist information for the area around your destination

[0664] The server uses the destination information to retrieve information about nearby tourist attractions using a database or external API. This includes detailed information about major tourist destinations and facilities.

[0665] Analysis and utilization of video content

[0666] Based on the video content requested by the user, the server uses video analysis tools to generate travel plans. It analyzes videos and review videos watched by the user and extracts related tourist spots and dining options.

[0667] Plan generation and display

[0668] The server integrates all information obtained from data acquisition, calculation, tourist information, and video analysis to generate a single travel plan. This travel plan is presented to the user in timeline or list format. An example of a specific prompt message would be: "I am planning a trip from Tokyo to Kyoto, staying near Kyoto Station, and visiting Kiyomizu-dera Temple, Kinkaku-ji Temple, and Gion."

[0669] The specific APIs used will be those that provide travel-related data (e.g., Google Places API, OpenWeather API), and the Python requests module will be used to retrieve and send the data. This system will allow users to easily and efficiently create consistent travel plans.

[0670] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0671] Step 1:

[0672] The user enters their departure point, accommodation, and destination using their device. The entered data is then sent to the server by the device.

[0673] Input: Information about the departure point, accommodation, and destination entered by the user.

[0674] Output: User input data is sent to the server.

[0675] Step 2:

[0676] The server uses the received accommodation information to retrieve information about restaurants near the accommodation using a database or external API.

[0677] Input: Accommodation information received by the server.

[0678] Output: A list of dining spots near your accommodation.

[0679] Specific operation: The server uses the latitude and longitude of the accommodation to send requests to the Google Places API and other dining spot information APIs to retrieve information on nearby restaurants and cafes.

[0680] Step 3:

[0681] The server calculates the optimal travel route and travel time based on the origin and destination information.

[0682] Input: Information about the departure and destination locations.

[0683] Output: Optimal travel route and travel time.

[0684] Specific operation: The server uses route calculation APIs such as the Google Maps API to obtain the travel route and travel time between two specified points. It also takes into account public transport information.

[0685] Step 4:

[0686] The server retrieves information about tourist attractions around the destination.

[0687] Input: Destination information.

[0688] Output: A list of tourist attractions around the destination.

[0689] Specific operation: The server uses the destination's latitude and longitude to send a request to a tourist spot information API to retrieve information about nearby tourist spots.

[0690] Step 5:

[0691] The server uses video analysis tools to generate travel plans based on the video content requested by the user.

[0692] Input: Information about the videos the user has watched.

[0693] Output: Elements of tourist spots and travel plans based on the videos watched.

[0694] Specific operation: The server analyzes the video's metadata and content, and extracts relevant tourist spots and activities.

[0695] Step 6:

[0696] The server integrates information obtained from acquisition means, calculation means, tourist information means, and video analysis means to generate a single travel plan.

[0697] Input: Dining spots near the accommodation, optimal travel route, sightseeing spots near the destination, and video analysis results.

[0698] Output: Integrated travel plan.

[0699] Specific operation: The server integrates various pieces of information to generate a consistent and efficient travel plan, which is then formatted in either a timeline or list format.

[0700] Step 7:

[0701] The device then presents this integrated travel plan to the user.

[0702] Input: Integrated travel plan sent from the server.

[0703] Output: Display of the travel plan in a format visible to the user.

[0704] Specific operation: The device will display the travel plan in a timeline or list format, allowing the user to easily review each step of the trip.

[0705] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0706] This invention is a system that efficiently generates travel plans by providing consistent information while taking into account the user's emotions when planning a trip. The system comprises a terminal, a server, an emotion engine, and multiple processing means.

[0707] System Overview

[0708] This system consists of the following elements:

[0709] 1. Terminal:

[0710] This is a device for users to input their departure point, accommodation, and destination.

[0711] Includes means for sending user-entered information and emotional feedback to a server.

[0712] 2. Server:

[0713] It is a central system that processes information received from terminals.

[0714] A "means of obtaining" information about dining spots near your accommodation.

[0715] A "calculation tool" for calculating travel routes and travel times based on information about the departure point and destination.

[0716] A "tourist information tool" for obtaining information about tourist attractions around a destination.

[0717] This "integration method" combines the above information into a single travel plan and presents it to the user.

[0718] 3. Emotional Engine:

[0719] A system for recognizing and analyzing user emotions.

[0720] This includes methods for analyzing user emotions from their input and actions, and adjusting travel plans based on the analysis results.

[0721] Program processing

[0722] User input and data transmission

[0723] The user enters information about their departure point, accommodation, destination, and their mood or feelings through their device. For example, they might enter "Tokyo" as the departure point, "a hotel near Kyoto Station" as the accommodation, and "Kyoto" as the destination, and then add emotional information such as "I want to relax" or "I want to enjoy a delicious meal."

[0724] The device sends this input information and sentiment information to the server.

[0725] Obtaining information about the area around your accommodation

[0726] The server uses the accommodation information ("Hotels near Kyoto Station") sent from the terminal to retrieve information about restaurants and other dining spots around the accommodation using a database or external API. This information may include, for example, sushi restaurants, ramen shops, and cafes.

[0727] Emotion-based recommendations

[0728] The emotion engine analyzes the user's emotional information and, based on the results, recommends specific dining and sightseeing spots. For example, if the user feels like "I want to relax," it will prioritize suggesting cafes with a calm atmosphere or hot spring facilities.

[0729] Route calculation from departure point to destination

[0730] The server calculates the optimal travel route based on the departure point "Tokyo" and destination "Kyoto." This calculation uses information on public transportation such as bullet trains, buses, and taxis. The server considers the timetables and operating status of each mode of transport to provide the optimal travel route and travel time.

[0731] Tourist information for the area around your destination

[0732] The server uses the destination "Kyoto" information to retrieve information about nearby tourist spots using a database or external API. This includes detailed information about tourist attractions such as Kiyomizu-dera Temple, Kinkaku-ji Temple, and Gion.

[0733] Plan generation and display

[0734] The server integrates all acquired and calculated information to generate a single travel plan. This plan includes departure times, modes of transportation, arrival times, dining spots near accommodations (including sentiment-based recommendations), and a schedule of sightseeing visits. The integration method displays this plan to the user in an appropriate format (timeline or list).

[0735] Specific example

[0736] For example, if a user plans a trip from Tokyo to Kyoto, the system will work as follows:

[0737] 1. The user enters "Tokyo" (departure point), "hotels around Kyoto Station" (accommodation), and "Kyoto" (destination), and provides emotional information such as "I want to relax" and "I want to enjoy a delicious meal."

[0738] 2. The terminal sends input information and emotional information to the server.

[0739] 3. The server uses the accommodation information to retrieve information on restaurants, ramen shops, cafes, and other dining spots around Kyoto Station.

[0740] 4. The emotion engine analyzes the user's emotional information and prioritizes suggesting cafes where the user can spend a relaxing time.

[0741] 5. The server calculates the optimal travel route from the departure point "Tokyo" to the destination "Kyoto" and provides details about the means of transportation, such as the Shinkansen (bullet train).

[0742] 6. The server retrieves information about tourist spots in the destination "Kyoto," such as Kiyomizu-dera Temple, Kinkaku-ji Temple, and Gion.

[0743] 7. The server integrates this information and generates a single travel plan.

[0744] 8. The device displays this plan to the user in either a timeline or list format.

[0745] In this way, the system of the present invention can easily create efficient and consistent travel plans that take the user's emotions into consideration.

[0746] The following describes the processing flow.

[0747] Step 1:

[0748] The user enters their departure point, accommodation, destination, and sentiment information via their device. For example, they might enter "Tokyo" as the departure point, "a hotel near Kyoto Station" as the accommodation, and "Kyoto" as the destination, and then add sentiment information such as "I want to relax" or "I want to enjoy a delicious meal."

[0749] Step 2:

[0750] The device sends the entered information and sentiment information to the server. Specifically, it sends a request to the server that includes the origin, accommodation, destination, and sentiment information.

[0751] Step 3:

[0752] Based on the accommodation information received from the terminal ("Hotels near Kyoto Station"), the server generates a query to retrieve information about restaurants near the accommodation using a database or external API.

[0753] Step 4:

[0754] The server sends a query to the database or an external API to search for dining options near the accommodation.

[0755] Step 5:

[0756] The server temporarily stores information about restaurants near the accommodation (e.g., sushi restaurants, ramen shops, cafes, etc.) that it has acquired.

[0757] Step 6:

[0758] The emotion engine analyzes the user's emotional information and adjusts the restaurant recommendations based on the results. For example, if the user feels like "I want to relax," it prioritizes selecting cafes with a quiet and calm atmosphere.

[0759] Step 7:

[0760] The server calculates the optimal travel route based on information about the departure point "Tokyo" and the destination "Kyoto." Specifically, it calculates the best mode of transport, such as bullet trains, buses, and taxis, and the travel time, taking into account public transportation timetables and operating conditions.

[0761] Step 8:

[0762] The server temporarily stores the calculation results (travel route, departure and arrival times, transfer information, etc.).

[0763] Step 9:

[0764] The server generates a query to retrieve details about tourist spots based on information about the destination "Kyoto".

[0765] Step 10:

[0766] The server sends a query to the database or external API to search for tourist attractions near the destination (e.g., Kiyomizu-dera Temple, Kinkaku-ji Temple, Gion, etc.).

[0767] Step 11:

[0768] The server temporarily stores information about tourist spots it has acquired.

[0769] Step 12:

[0770] The emotion engine adjusts tourist spot information based on the user's emotional information. For example, if the user feels like "I want to relax," it will prioritize selecting quiet temples and nature parks.

[0771] Step 13:

[0772] The server integrates all the information it has acquired and calculated to generate a single travel plan. Specifically, it combines departure time, mode of transportation, arrival time, dining spots near accommodation (including emotionally-based recommendations), and a schedule of sightseeing visits into one plan.

[0773] Step 14:

[0774] The server generates a travel plan and sends it to the device.

[0775] Step 15:

[0776] The device displays the travel plan received from the server to the user. Specifically, the plan is displayed in either a timeline or list format.

[0777] Step 16:

[0778] The user reviews the displayed travel plan and adjusts the plan as needed.

[0779] (Example 2)

[0780] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0781] Conventional travel planning systems have been insufficient in providing information that takes user emotions into account, making it difficult to efficiently generate consistent travel plans. Furthermore, there was a need to effectively suggest dining and sightseeing spots near accommodations based on user input, and to present optimal travel routes that take public transportation timetables into consideration.

[0782] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0783] In this invention, the server includes an input means for the user to input their departure point, accommodation, and destination; an acquisition means for obtaining restaurant spots based on accommodation information; a calculation means for calculating the optimal travel route based on departure point and destination information; an emotion analysis means for analyzing the user's emotional information and recommending restaurant and tourist spots based on the analysis results; and an integration means for integrating the obtained information into a single travel plan and presenting it to the user. This makes it possible to generate an efficient and consistent travel plan that takes the user's emotions into consideration.

[0784] "Input means" refers to devices or programs that allow users to input their origin, accommodation, destination, and emotional information.

[0785] "Acquisition means" refers to functions or systems that collect information on dining spots around the accommodation based on information transmitted from the input means.

[0786] "Calculation means" refers to functions or algorithms that calculate the optimal travel route and travel time based on information about the departure point and destination.

[0787] "Emotional analysis means" refers to a function or system that analyzes emotional information entered by the user and recommends dining spots and tourist spots based on the results.

[0788] "Integration means" refers to functions or programs that combine information obtained from acquisition means, calculation means, and sentiment analysis means into a single travel plan and present it to the user.

[0789] A "user" refers to someone who uses the system to plan their trip.

[0790] A "server" is a central computer system that processes information sent by users and performs calculations and retrieves necessary data.

[0791] A "terminal" refers to a device used by a user to input and receive information, such as a smartphone or a personal computer.

[0792] A "dining spot" refers to places, including restaurants, located near the user's accommodation.

[0793] A "tourist spot" refers to a place that includes tourist attractions and points of interest located near a destination.

[0794] A "travel route" refers to the optimal path from the starting point to the destination, taking into account public transport and other means of transportation.

[0795] "Travel time" refers to the time required to travel from the starting point to the destination.

[0796] Modes for carrying out the invention

[0797] This invention is a system that efficiently generates travel plans by providing consistent information to users while taking their emotions into consideration when they are planning a trip. The system comprises a terminal, a server, emotion analysis means, and multiple processing means.

[0798] 1. Terminal:

[0799] This is a device in which users input information for travel planning. The information input includes departure point, accommodation, destination, and the user's emotional state. For example, a computer device such as a smartphone or personal computer is used. The device communicates with a server via the internet and transmits the input information.

[0800] 2. Server:

[0801] A server is a central system that processes information received from terminals. A server includes the following processing methods:

[0802] Acquisition method: Based on the accommodation information entered by the user, information on dining spots around the accommodation is obtained using an external API (e.g., Google Places API).

[0803] Calculation Method: Based on origin and destination information, the travel route and travel time are calculated. The Google Maps API is used to determine the optimal mode of transport and its duration.

[0804] Emotion analysis method: The system analyzes the emotional information entered by the user and recommends appropriate dining spots and tourist attractions based on the results. For example, for the emotion of "wanting to relax," it recommends quiet cafes or hot spring facilities.

[0805] Integration method: Information obtained from acquisition, calculation, and sentiment analysis methods is integrated into a single travel plan. The integrated plan is appropriately formatted in timeline or list format and presented to the user.

[0806] This system works as follows:

[0807] 1. User Input: The user enters basic travel information and sentiment information via their device. For example, they might enter "Tokyo" as the departure point, "Hotels near Kyoto Station" as the accommodation, "Kyoto" as the destination, and sentiment information such as "I want to relax" or "I want to enjoy delicious food."

[0808] 2. Terminal sends: The terminal sends the input information to the server.

[0809] 3. Server Processing: Based on the received information, the server retrieves information such as restaurants near the accommodation, the optimal route from the departure point to the destination, and tourist attractions near the destination, and adjusts the recommended spots based on sentiment information.

[0810] 4. Integration and Display: The server integrates the retrieved and calculated information, generates a travel plan, and sends it to the terminal. Finally, the terminal displays the generated plan to the user.

[0811] Specific example

[0812] For example, if a user enters a travel plan from Tokyo to Kyoto, the system will work as follows:

[0813] 1. The user enters "Tokyo" (departure point), "Hotels around Kyoto Station" (accommodation), and "Kyoto" (destination), and adds sentiment information such as "I want to relax" and "I want to enjoy a delicious meal."

[0814] 2. The terminal sends this input information to the server.

[0815] 3. Based on the accommodation information, the server retrieves information on restaurants, ramen shops, cafes, and other dining spots around Kyoto Station.

[0816] 4. An emotion analysis system analyzes emotional information and prioritizes recommending relaxing cafes and hot spring facilities.

[0817] 5. The server uses the Google Maps API to calculate the optimal travel route from the departure point "Tokyo" to the destination "Kyoto".

[0818] 6. The server retrieves information about tourist spots in Kyoto, such as Kiyomizu-dera Temple, Kinkaku-ji Temple, and Gion.

[0819] 7. The server integrates this information and generates a travel plan in either a timeline or list format.

[0820] 8. The device will display this plan to the user.

[0821] Example of a prompt

[0822] When creating a travel plan, specify the departure point as "Tokyo," the accommodation as "a hotel near Kyoto Station," and the destination as "Kyoto." Then, taking into account emotional information such as "I want to relax" and "I want to enjoy delicious food," generate a consistent travel plan that includes travel routes, restaurants near the accommodation, and sightseeing spots.

[0823] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0824] Step 1:

[0825] User input

[0826] The user enters travel information using the device. This information includes departure point, accommodation, destination, and sentiment. For example, the user might enter "Tokyo" as the departure point, "a hotel near Kyoto Station" as the accommodation, "Kyoto" as the destination, and sentiment "I want to relax" or "I want to enjoy a delicious meal." This information is temporarily stored in the device's internal memory.

[0827] Step 2:

[0828] Terminal transmission

[0829] The terminal transmits stored user input information to the server via the internet. To do this, the terminal uses an appropriate communication protocol (e.g., HTTP) to send the input information to the server's endpoint. Through this transmission process, the server receives the user's travel and sentiment information.

[0830] Step 3:

[0831] Obtaining information about the area around your accommodation

[0832] The server retrieves dining spot information based on the received accommodation information (for example, "hotels near Kyoto Station"). Specifically, it calls the Google Places API to obtain a list of restaurants near the accommodation and their details (address, rating, category, etc.). This updates the database of dining spot information.

[0833] Input: Accommodation information

[0834] Output: Dining spot information (address, rating, category, etc.)

[0835] Step 4:

[0836] Emotion analysis

[0837] A sentiment analysis system on the server analyzes the user's emotional information. Natural language processing technology is used for the analysis to identify emotions from the user's input. For example, based on the emotional information "I want to relax," the system prioritizes selecting relaxing cafes and hot spring facilities. The analysis results are stored in a database and used for future recommendations.

[0838] Input: Sentiment information

[0839] Output: List of recommended categories

[0840] Step 5:

[0841] Travel route calculation

[0842] The server uses the Google Maps API to calculate the optimal travel route based on the departure point "Tokyo" and destination "Kyoto." It also considers information on public transportation such as bullet trains, buses, and taxis (timetables, service status, etc.) to provide the best possible route. The calculation results are output to the user as an optimal travel schedule.

[0843] Input: Departure point, Destination

[0844] Output: Optimal travel route and time

[0845] Step 6:

[0846] Tourist information for the area around your destination

[0847] The server retrieves nearby tourist attractions based on the destination information, "Kyoto." To do this, it calls the TripAdvisor API, for example, to obtain a list of nearby tourist attractions (e.g., Kiyomizu-dera Temple, Kinkaku-ji Temple, Gion, etc.) and detailed information (name, address, rating, etc.). The retrieved information is stored in a database.

[0848] Input: Destination information

[0849] Output: Tourist spot information (name, address, rating, etc.)

[0850] Step 7:

[0851] Plan integration and generation

[0852] The server integrates information obtained from acquisition, calculation, and sentiment analysis methods into a single travel plan. This plan includes departure times, modes of transportation, arrival times, dining options near accommodations, and a schedule of sightseeing visits. The plan is formatted in timeline or list format and stored in a database.

[0853] Input: Information on dining spots, travel routes, and tourist attractions.

[0854] Output: Integrated travel plan

[0855] Step 8:

[0856] Displaying plans

[0857] The device displays an integrated travel plan sent from the server to the user. The display format can be a timeline or list, making it easy for the user to review. The user can then view this screen to get a detailed understanding of their travel schedule and destinations.

[0858] Input: Integrated travel plan

[0859] Output: Display of travel plan

[0860] (Application Example 2)

[0861] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0862] In food delivery services, it is difficult to suggest the most suitable dishes and restaurants based on the user's current emotions and mood, and there is a lack of an integrated system for calculating efficient delivery routes. Therefore, in order to increase user satisfaction, a system is needed that selects restaurants that take user emotions into consideration and plans efficient delivery routes.

[0863] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0864] In this invention, the server includes an input means for receiving user input information, an acquisition means for acquiring information on restaurants and bars near the accommodation, a calculation means for calculating the optimal travel route and travel time, a guidance means for acquiring information on tourist attractions, an emotion engine that makes suggestions based on the user's emotional information, and an integration means that integrates the information obtained from the acquisition means, calculation means and guidance means into a single travel plan and presents it to the user. This makes it possible to suggest restaurants and bars that take the user's emotions into consideration and to calculate an efficient delivery route.

[0865] "Input means" refers to devices or interfaces for users to input their origin, accommodation, destination, and emotional information.

[0866] "Method of acquisition" refers to the means of collecting information on restaurants and bars in the vicinity of a hotel based on the accommodation information entered by the user.

[0867] The "calculation means" refers to a function that calculates the optimal travel route and travel time based on the departure and destination information entered by the user.

[0868] "Guidance methods" refer to means of obtaining and providing users with information about tourist attractions around their destination.

[0869] An "emotion engine" is a system that analyzes a user's emotional information and makes specific suggestions based on the results.

[0870] An "integration means" is a function that integrates information obtained from acquisition means, calculation means, and guidance means, and presents it to the user as a single travel plan.

[0871] A specific system for implementing this invention comprises an input means for the user to input their departure point, accommodation, destination, and emotional information; an acquisition means for acquiring restaurants and bars around the accommodation; a calculation means for calculating the optimal travel route and travel time based on the departure point and destination information; a guidance means for acquiring tourist attractions around the destination; an emotional engine that makes suggestions based on the user's emotional information; and an integration means for integrating the information obtained from the acquisition means, calculation means, and guidance means and presenting it to the user.

[0872] Program generation and execution

[0873] The system's program is built using Python. This system utilizes the Google Maps API to search for nearby restaurants and bars based on the user's current location. Additionally, an emotion engine analyzes the user's emotional information, and suggestions are made based on the results.

[0874] For example, if a user enters "I want to relax" or "I want to enjoy a delicious meal," this information is sent from the input device to the server. The server uses the Google Maps API to retrieve information about restaurants and bars near the accommodation. Meanwhile, the emotion engine analyzes the user's emotional information and suggests places like "a relaxing cafe" or "a highly-rated restaurant."

[0875] The server also calculates the optimal travel route from the departure point "Tokyo" to the destination "Kyoto," taking into account public transport timetables and service status. This information is then compiled into a single travel plan by an integrated system and displayed to the user in either a timeline or list format.

[0876] Hardware and software to be used

[0877] Hardware: Smartphones, tablets, servers

[0878] Software: Google Maps API, Python

[0879] The server receives user input, retrieves data using the Google Maps API, performs sentiment analysis using an emotion engine, integrates the obtained information, and presents it to the user.

[0880] Specific example

[0881] If a user plans a trip from Tokyo to Kyoto, enters "I want to relax" and "I want to enjoy delicious food," and decides to stay at a hotel near Kyoto Station, the system will operate as follows:

[0882] 1. Information and emotional information entered by the user via the input method are sent to the server.

[0883] 2. The server uses the Google Maps API to retrieve information on accommodations around Kyoto Station and nearby restaurants and bars.

[0884] 3. The emotion engine analyzes the user's emotional information and prioritizes suggesting relaxing cafes and highly-rated restaurants.

[0885] 4. The calculation method calculates the optimal travel route from Tokyo to Kyoto, taking into account details of public transportation such as the Shinkansen (bullet train).

[0886] 5. The integration mechanism combines this information into a single travel plan and displays it to the user in a timeline or list format.

[0887] Example of a prompt

[0888] "The user is currently located near Tokyo Station and is looking to relax. Use the Google Maps API to search for nearby cafes and list those that serve herbal tea. Also, calculate the optimal delivery route from those cafes to the user's location."

[0889] In this way, a system is provided that allows users to efficiently create optimal travel plans that take their emotions into consideration.

[0890] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0891] Step 1:

[0892] The user uses a terminal to input their departure point, accommodation, destination, and sentiment information. This input is then sent to the server in the next step. This input includes text data and is treated as basic information for subsequent data processing.

[0893] Step 2:

[0894] The terminal transmits the user's entered departure point, accommodation, destination, and sentiment information to the server. The server receives this input data and prepares to process each information item individually, converting it into an appropriate format for storage in the database.

[0895] Step 3:

[0896] The server uses the Google Maps API to retrieve information about restaurants and bars near the accommodation, based on the accommodation's location information. This process generates a list of restaurants and bars. The input data is the accommodation's location information, and the output is a list of restaurants and bars.

[0897] Step 4:

[0898] The emotion engine analyzes the user's emotional information. The input data is text information related to emotions, and the output is a list of emotion-based suggestions. This analysis identifies dining establishments that are suitable for the user's emotional state.

[0899] Step 5:

[0900] The server uses the Google Maps API to calculate the optimal travel route and travel time based on the origin and destination information. The input data is the location information of the origin and destination, and the output is detailed information about the travel route and travel time. This calculation also takes real-time traffic information into account.

[0901] Step 6:

[0902] The server retrieves information about tourist attractions around the destination using the Google Maps API and other external APIs. The input data is the location information of the destination, and the output is a list of tourist attractions.

[0903] Step 7:

[0904] The server integrates all information obtained from acquisition methods (food and beverage establishment information), calculation methods (travel routes and travel times), guidance methods (tourist attraction information), and an emotion engine (emotion-based suggestions). This integration generates a single travel plan. The travel plan includes content that takes the user's emotions into consideration and is provided in either a timeline or list format.

[0905] Step 8:

[0906] The server sends the generated travel plan to the terminal, which then displays this plan to the user. The input is an integrated travel plan, and the output is visualized plan information presented to the user. This plan includes suggested restaurants, optimal travel routes, and schedules for visiting tourist attractions.

[0907] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0908] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0909] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0910] [Third Embodiment]

[0911] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0912] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0913] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0914] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0915] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0916] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0917] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0918] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0919] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0920] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0921] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0922] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0923] This invention provides a system that offers consistent information to users when planning a trip and efficiently generates a travel plan. The system comprises a terminal, a server, and multiple processing means.

[0924] System Overview

[0925] This system consists of the following elements:

[0926] 1. Terminal:

[0927] This device allows users to input their departure point, accommodation, and destination.

[0928] Includes means for sending user-entered information to a server.

[0929] 2. Server:

[0930] It is a central system that processes information received from terminals.

[0931] A "means of obtaining" information about dining spots near your accommodation.

[0932] A "calculation tool" for calculating travel routes and travel times based on information about the departure point and destination.

[0933] A "tourist information tool" for obtaining information about tourist attractions around a destination.

[0934] This "integration method" combines the above information into a single travel plan and presents it to the user.

[0935] Program processing

[0936] User input and data transmission

[0937] The user enters travel information via their device, such as their departure point ("Tokyo"), accommodation ("a hotel near Kyoto Station"), and destination ("Kyoto"). The device then sends this information to the server.

[0938] Obtaining information about the area around your accommodation

[0939] The server uses the accommodation information ("Hotels near Kyoto Station") sent from the terminal to retrieve information about restaurants and other dining spots around the accommodation using a database or external API. This information may include, for example, sushi restaurants, ramen shops, and cafes.

[0940] Route calculation from departure point to destination

[0941] The server calculates the optimal travel route based on information about the departure point "Tokyo" and the destination "Kyoto." This calculation uses information on public transportation such as bullet trains, buses, and taxis. The server considers the timetables and operating status of each mode of transport to provide the optimal travel route and travel time.

[0942] Tourist information for the area around your destination

[0943] The server uses the destination "Kyoto" information to retrieve information about nearby tourist spots using a database or external API. For example, this includes detailed information about tourist attractions such as Kiyomizu-dera Temple, Kinkaku-ji Temple, and Gion.

[0944] Plan generation and display

[0945] The server generates a single, integrated travel plan based on all the information it has gathered. This plan includes departure times, modes of transportation, arrival times, dining options near the accommodation, and a schedule of sightseeing visits. The integration system then displays this plan to the user in an appropriate format (such as a timeline or list).

[0946] Specific example

[0947] For example, if a user plans a trip from Tokyo to Kyoto, the system will work as follows:

[0948] 1. The user enters "Tokyo" (departure point), "Hotels around Kyoto Station" (accommodation), and "Kyoto" (destination).

[0949] 2. The terminal sends the input information to the server.

[0950] 3. The server uses the accommodation information to retrieve information on restaurants, ramen shops, cafes, and other dining spots around Kyoto Station.

[0951] 4. The server calculates the optimal travel route from the departure point "Tokyo" to the destination "Kyoto" and provides details about transportation methods such as Shinkansen (bullet train).

[0952] 5. The server retrieves information about tourist spots in the destination "Kyoto," such as Kiyomizu-dera Temple, Kinkaku-ji Temple, and Gion.

[0953] 6. The server integrates this information and generates a single travel plan.

[0954] 7. The device displays this plan to the user in either a timeline or list format.

[0955] In this way, users can easily create efficient and consistent travel plans.

[0956] The following describes the processing flow.

[0957] Step 1:

[0958] The user enters their departure point, accommodation, and destination via their device. For example, they might enter "Tokyo" as the departure point, "Hotels around Kyoto Station" as the accommodation, and "Kyoto" as the destination.

[0959] Step 2:

[0960] The terminal sends the entered information to the server. Specifically, it sends a request to the server that includes information about the departure point, accommodation, and destination.

[0961] Step 3:

[0962] The server analyzes the information received from the terminal and generates a query to obtain information about accommodations (for example, "hotels around Kyoto Station").

[0963] Step 4:

[0964] The server sends a query to the database or an external API to search for dining options near the accommodation.

[0965] Step 5:

[0966] The server temporarily stores information about restaurants near the accommodation (e.g., sushi restaurants, ramen shops, cafes, etc.) that it has acquired.

[0967] Step 6:

[0968] The server calculates the optimal travel route based on information about the departure point "Tokyo" and the destination "Kyoto." Specifically, it calculates the best mode of transport, such as bullet trains, buses, and taxis, and the travel time, taking into account public transportation timetables and operating conditions.

[0969] Step 7:

[0970] The server temporarily stores the calculation results (travel route, departure and arrival times, transfer information, etc.).

[0971] Step 8:

[0972] The server generates a query to retrieve details about tourist spots based on information about the destination "Kyoto".

[0973] Step 9:

[0974] The server sends a query to the database or external API to search for tourist attractions near the destination (e.g., Kiyomizu-dera Temple, Kinkaku-ji Temple, Gion, etc.).

[0975] Step 10:

[0976] The server temporarily stores information about tourist spots it has acquired.

[0977] Step 11:

[0978] The server integrates all the information it has acquired and calculated to generate a single travel plan. Specifically, it combines departure times, modes of transportation, arrival times, dining options near accommodations, and sightseeing schedules into one plan.

[0979] Step 12:

[0980] The server generates a travel plan and sends it to the device.

[0981] Step 13:

[0982] The device displays the travel plan received from the server to the user. Specifically, the plan is displayed in either a timeline or list format.

[0983] Step 14:

[0984] The user reviews the displayed travel plan and plans or modifies the travel details.

[0985] (Example 1)

[0986] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0987] Traditional travel planning systems required users to manually link their departure point, accommodation, and destination, or to individually search for detailed information. This resulted in a time-consuming and laborious process, making it difficult to create a consistent travel plan. Furthermore, some systems lacked real-time information and adequately provided optimal routes considering public transport schedules and service status. Consequently, these systems were inconvenient for travelers and insufficient to assist with planning.

[0988] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0989] In this invention, the server includes data transmission means for transmitting travel information entered by the user in real time, data analysis means for analyzing information from external data sources and formatting it into an easy-to-use format, route search means for optimizing travel routes and travel times between the departure point and destination, information acquisition means for obtaining detailed information on tourist spots from external data sources, and data integration means for integrating the acquired information and organizing it in a schedule format. This makes it possible for users to easily create consistent and detailed travel plans. Specifically, it becomes possible to acquire information on dining spots and tourist spots in real time and provide users with travel plans that include optimal routes that take into account public transportation timetables and operating conditions.

[0990] An "input method" refers to a device or software that provides an interface for users to input travel information such as their departure point, accommodation, and destination into the system.

[0991] "Acquisition means" refers to a means of collecting related information, such as dining spots around the accommodation, based on the accommodation information transmitted from the input means.

[0992] "Calculation means" refers to algorithms or software used to calculate the optimal travel route and travel time based on the departure and destination information transmitted from the input means.

[0993] A "tourism information service" is a means of obtaining and providing users with information about tourist attractions and related topics around their destination.

[0994] An "integration means" is a means of integrating information obtained from acquisition means, calculation means, and tourist information means into a single travel plan and presenting it to the user.

[0995] "Data transmission means" refers to a method for transmitting travel information entered by a user to a server in real time.

[0996] "Data analysis means" refers to methods for analyzing information obtained from external data sources and formatting it into a user-friendly format.

[0997] A "route search method" refers to an algorithm or software used to optimize the travel route and travel time between a starting point and a destination.

[0998] "Information acquisition means" refers to methods for obtaining tourist spots and other related information from external data sources.

[0999] A "data integration method" is a means of integrating all acquired information, organizing it into a schedule format, and providing it to the user.

[1000] This invention is a system that enables users to efficiently plan their trips. The system consists of the following elements: a terminal, a server, and multiple processing means.

[1001] 1. Terminal

[1002] A terminal is a device used by users to input travel information such as their departure point, accommodation, and destination. Specific examples of terminals include smartphones, tablets, and PCs. The information entered by the user is sent to the server through the terminal. Here, when the user enters information into the interface and presses the submit button, an HTTP POST request is executed to the server.

[1003] 2. Server

[1004] The server is a central system that receives information sent from terminals and generates travel plans using multiple processing methods. The server has the following functions:

[1005] Acquisition means

[1006] The server uses acquisition methods to retrieve information about nearby dining spots based on the accommodation information sent from the terminal. This retrieval utilizes external APIs (e.g., Google Places API) or local databases. For example, based on information such as "hotels around Kyoto Station," it collects information on sushi restaurants, ramen shops, cafes, etc.

[1007] means of calculation

[1008] The server uses computational methods to calculate the optimal travel route and travel time based on information about the origin and destination. This calculation uses data from public transport timetables and operating status. Specifically, it obtains data from a real-time traffic information API and uses the Dijkstra algorithm or the A algorithm to derive the optimal route.

[1009] Tourist information services

[1010] The server uses tourist information tools to obtain information about tourist spots around the destination. This information is obtained using external APIs (e.g., TripAdvisor API) and databases. Based on destination information such as "Kyoto," it collects detailed information about places like Kiyomizu-dera Temple, Kinkaku-ji Temple, and Gion.

[1011] Data analysis means

[1012] The server analyzes the acquired information and formats it into a user-friendly format. It analyzes JSON data obtained from external data sources, extracts the necessary information, and formats it accordingly.

[1013] Route search means

[1014] The server has a route search mechanism to calculate the optimal travel route between the origin and destination. It calculates the shortest route and optimal travel time based on public transport timetables and service information.

[1015] Data Integration Means

[1016] The server integrates information obtained from acquisition, calculation, and tourist information sources to generate a single, integrated travel plan. The travel plan is then organized and presented to the user in timeline or list format.

[1017] 3. Plan generation and display

[1018] The server sends the generated integrated travel plan to the device, which then displays it to the user. Specifically, it is provided to the user as a timeline on a web page or as a list on a mobile app. For example, the schedule might be organized in the format of "9:00 Depart Tokyo by Shinkansen → 12:00 Arrive Kyoto → 12:30 Lunch at Kyoto Station (sushi restaurant)".

[1019] Specific example

[1020] For example, if a user plans a trip from "Tokyo" to "Kyoto," the system will work as follows:

[1021] 1. The user enters their departure point as "Tokyo," their accommodation as "a hotel near Kyoto Station," and their destination as "Kyoto" on their device.

[1022] 2. The terminal sends this input information to the server.

[1023] 3. The server retrieves information about the accommodation and collects information about sushi restaurants, ramen shops, cafes, etc., around Kyoto Station.

[1024] 4. The server calculates the optimal travel route from the departure point "Tokyo" to the destination "Kyoto" and provides the means of transportation, such as the Shinkansen (bullet train).

[1025] 5. The server retrieves tourist information for the destination "Kyoto" and collects detailed information on places like Kiyomizu-dera Temple, Kinkaku-ji Temple, and Gion.

[1026] 6. The server integrates this information and generates travel plans in timeline or list format.

[1027] 7. The device displays this integrated travel plan to the user.

[1028] Examples of prompts for generative AI models

[1029] Use the following prompts to input into the generative AI model:

[1030] I would like to plan a 3-day trip from Tokyo to Kyoto. The departure point is Tokyo, the accommodation is a hotel near Kyoto Station, and the destination is Kyoto. Please generate an optimal travel plan with a detailed schedule including information on sightseeing spots and dining options.

[1031] In this way, users can easily create efficient and consistent travel plans.

[1032] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1033] Step 1:

[1034] The user enters their departure point, accommodation, and destination.

[1035] Input: The user enters the departure point "Tokyo", accommodation "Hotels around Kyoto Station", and destination "Kyoto" into the terminal's input interface.

[1036] Specific operation: The user enters the required information into the input form displayed on the device screen and presses the submit button.

[1037] Step 2:

[1038] The terminal sends the input information to the server.

[1039] Input: Travel information entered and submitted by the user.

[1040] Output: Input information is sent to the server.

[1041] Specific operation: The terminal sends the information entered by the user to the server in the form of an HTTP POST request, and the server receives it.

[1042] Step 3:

[1043] The server retrieves information about restaurants and dining options near the accommodation.

[1044] Input: Accommodation information "Hotels near Kyoto Station".

[1045] Output: Information on dining spots near your accommodation.

[1046] Specific operation: The server uses the Google Places API to send HTTP requests to retrieve information on sushi restaurants, ramen shops, cafes, etc., based on "hotels around Kyoto Station," and receives the response in JSON format.

[1047] Step 4:

[1048] The server calculates the travel route from the starting point to the destination.

[1049] Input: Departure point "Tokyo", Destination "Kyoto".

[1050] Output: Optimal travel route and travel time.

[1051] Specific operation: The server retrieves operational data from public transport timetable APIs and uses Dijkstra's algorithm or A algorithm to calculate the optimal travel route based on that data.

[1052] Step 5:

[1053] The server collects information about tourist attractions around the destination.

[1054] Input: Destination "Kyoto".

[1055] Output: Detailed information about tourist attractions.

[1056] Specific operation: The server uses the TripAdvisor API to send an HTTP request to retrieve information on tourist spots related to "Kyoto" (e.g., Kiyomizu-dera Temple, Kinkaku-ji Temple, Gion), and receives the response in JSON format.

[1057] Step 6:

[1058] The server analyzes the collected data and formats it into a unified format.

[1059] Input: Various data obtained (restaurants, travel routes, tourist spots).

[1060] Output: Formatted data.

[1061] Specific operation: The server parses the received JSON data and extracts the necessary information. It then performs data processing to format each piece of information into a timeline or list format.

[1062] Step 7:

[1063] The server generates an integrated travel plan.

[1064] Input: Various formatted data.

[1065] Output: Integrated travel plan.

[1066] Specific operation: The server generates a single, sequential travel plan based on the formatted data. It then integrates this plan into a schedule format and determines what to provide to the user.

[1067] Step 8:

[1068] The device displays an integrated travel plan to the user.

[1069] Input: Integrated travel plan sent from the server.

[1070] Output: A travel plan display that can be visually confirmed by the user.

[1071] Specific operation: The terminal renders the travel plan received from the server onto the display screen and visually presents it to the user in either a timeline or list format.

[1072] Through these steps, users can easily create and visually confirm efficient and consistent travel plans.

[1073] (Application Example 1)

[1074] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1075] Conventional travel plan generation systems would generate a travel plan based on the user's input of departure point, accommodation, and destination, but they did not cover planning that utilized video content. Furthermore, they could not take into account videos that the user wanted to watch or review videos they wanted to refer to during the travel plan generation process. As a result, they failed to meet the user's need to create a detailed plan based on video information about travel destinations, tourist spots, and restaurants.

[1076] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1077] In this invention, the server includes input means for the user to input their departure point, accommodation, and destination; acquisition means for obtaining dining spots around the accommodation; calculation means for calculating the optimal travel route and travel time; tourist information means for obtaining tourist spots around the destination; and video analysis means for generating a travel plan based on video content desired by the user. This makes it possible for the user to efficiently generate a travel plan based on videos they have watched or review videos.

[1078] "Input means" refers to devices or interfaces that allow users to input their departure point, accommodation, and destination.

[1079] The "acquisition means" refers to a function that acquires information about restaurants near the accommodation based on the accommodation information transmitted from the input means.

[1080] The "calculation means" is a function that calculates the optimal travel route and travel time based on the departure and destination information transmitted from the input means.

[1081] A "tourist information service" is a function for obtaining information about tourist spots around a destination.

[1082] The "video analysis method" is a function that generates travel plans based on the video content desired by the user.

[1083] The "integration means" refers to a function that integrates information obtained from acquisition means, calculation means, tourist information means, and video analysis means into a single travel plan and presents it to the user.

[1084] Modes for carrying out the invention

[1085] This invention is a system that provides consistent information to users when planning a trip and efficiently generates a travel plan. The system comprises a terminal, a server, and multiple processing means.

[1086] System Overview

[1087] This system consists of the following elements:

[1088] 1. Terminal:

[1089] This device allows users to input their departure point, accommodation, and destination.

[1090] Includes means for sending user-entered information to a server.

[1091] 2. Server:

[1092] It is a central system that processes information received from terminals.

[1093] A "means of obtaining" information about dining spots near your accommodation.

[1094] A "calculation tool" for calculating travel routes and travel times based on information about the departure point and destination.

[1095] A "tourist information tool" for obtaining information about tourist attractions around a destination.

[1096] A "video analysis method" for generating travel plans based on the video content desired by the user.

[1097] This "integration method" combines the above information into a single travel plan and presents it to the user.

[1098] Operation details

[1099] User input and data transmission

[1100] The user enters their departure point, accommodation, and destination via their device. The entered data is then sent from the device to the server. This device can be a typical smartphone, tablet, or personal computer.

[1101] Obtaining information about the area around your accommodation

[1102] The server uses the accommodation information sent from the terminal to retrieve information about dining spots near the accommodation using a database or external API. This includes information on various restaurants, cafes, and other establishments.

[1103] Route calculation from departure point to destination

[1104] The server calculates the optimal travel route and travel time based on the departure and destination information. This calculation uses information on public transportation such as bullet trains, buses, and taxis. Public transportation timetables and operating status are also taken into consideration.

[1105] Tourist information for the area around your destination

[1106] The server uses the destination information to retrieve information about nearby tourist attractions using a database or external API. This includes detailed information about major tourist destinations and facilities.

[1107] Analysis and utilization of video content

[1108] Based on the video content requested by the user, the server uses video analysis tools to generate travel plans. It analyzes videos and review videos watched by the user and extracts related tourist spots and dining options.

[1109] Plan generation and display

[1110] The server integrates all information obtained from data acquisition, calculation, tourist information, and video analysis to generate a single travel plan. This travel plan is presented to the user in timeline or list format. An example of a specific prompt message would be: "I am planning a trip from Tokyo to Kyoto, staying near Kyoto Station, and visiting Kiyomizu-dera Temple, Kinkaku-ji Temple, and Gion."

[1111] The specific APIs used will be those that provide travel-related data (e.g., Google Places API, OpenWeather API), and the Python requests module will be used to retrieve and send the data. This system will allow users to easily and efficiently create consistent travel plans.

[1112] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1113] Step 1:

[1114] The user enters their departure point, accommodation, and destination using their device. The entered data is then sent to the server by the device.

[1115] Input: Information about the departure point, accommodation, and destination entered by the user.

[1116] Output: User input data is sent to the server.

[1117] Step 2:

[1118] The server uses the received accommodation information to retrieve information about restaurants near the accommodation using a database or external API.

[1119] Input: Accommodation information received by the server.

[1120] Output: A list of dining spots near your accommodation.

[1121] Specific operation: The server uses the latitude and longitude of the accommodation to send requests to the Google Places API and other dining spot information APIs to retrieve information on nearby restaurants and cafes.

[1122] Step 3:

[1123] The server calculates the optimal travel route and travel time based on the origin and destination information.

[1124] Input: Information about the departure and destination locations.

[1125] Output: Optimal travel route and travel time.

[1126] Specific operation: The server uses route calculation APIs such as the Google Maps API to obtain the travel route and travel time between two specified points. It also takes into account public transport information.

[1127] Step 4:

[1128] The server retrieves information about tourist attractions around the destination.

[1129] Input: Destination information.

[1130] Output: A list of tourist attractions around the destination.

[1131] Specific operation: The server uses the destination's latitude and longitude to send a request to a tourist spot information API to retrieve information about nearby tourist spots.

[1132] Step 5:

[1133] The server uses video analysis tools to generate travel plans based on the video content requested by the user.

[1134] Input: Information about the videos the user has watched.

[1135] Output: Elements of tourist spots and travel plans based on the videos watched.

[1136] Specific operation: The server analyzes the video's metadata and content, and extracts relevant tourist spots and activities.

[1137] Step 6:

[1138] The server integrates information obtained from acquisition means, calculation means, tourist information means, and video analysis means to generate a single travel plan.

[1139] Input: Dining spots near the accommodation, optimal travel route, sightseeing spots near the destination, and video analysis results.

[1140] Output: Integrated travel plan.

[1141] Specific operation: The server integrates various pieces of information to generate a consistent and efficient travel plan, which is then formatted in either a timeline or list format.

[1142] Step 7:

[1143] The device then presents this integrated travel plan to the user.

[1144] Input: Integrated travel plan sent from the server.

[1145] Output: Display of the travel plan in a format visible to the user.

[1146] Specific operation: The device will display the travel plan in a timeline or list format, allowing the user to easily review each step of the trip.

[1147] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1148] This invention is a system that efficiently generates travel plans by providing consistent information while taking into account the user's emotions when planning a trip. The system comprises a terminal, a server, an emotion engine, and multiple processing means.

[1149] System Overview

[1150] This system consists of the following elements:

[1151] 1. Terminal:

[1152] This is a device for users to input their departure point, accommodation, and destination.

[1153] Includes means for sending user-entered information and emotional feedback to a server.

[1154] 2. Server:

[1155] It is a central system that processes information received from terminals.

[1156] A "means of obtaining" information about dining spots near your accommodation.

[1157] A "calculation tool" for calculating travel routes and travel times based on information about the departure point and destination.

[1158] A "tourist information tool" for obtaining information about tourist attractions around a destination.

[1159] This "integration method" combines the above information into a single travel plan and presents it to the user.

[1160] 3. Emotional Engine:

[1161] A system for recognizing and analyzing user emotions.

[1162] This includes methods for analyzing user emotions from their input and actions, and adjusting travel plans based on the analysis results.

[1163] Program processing

[1164] User input and data transmission

[1165] The user enters information about their departure point, accommodation, destination, and their mood or feelings through their device. For example, they might enter "Tokyo" as the departure point, "a hotel near Kyoto Station" as the accommodation, and "Kyoto" as the destination, and then add emotional information such as "I want to relax" or "I want to enjoy a delicious meal."

[1166] The device sends this input information and sentiment information to the server.

[1167] Obtaining information about the area around your accommodation

[1168] The server uses the accommodation information ("Hotels near Kyoto Station") sent from the terminal to retrieve information about restaurants and other dining spots around the accommodation using a database or external API. This information may include, for example, sushi restaurants, ramen shops, and cafes.

[1169] Emotion-based recommendations

[1170] The emotion engine analyzes the user's emotional information and, based on the results, recommends specific dining and sightseeing spots. For example, if the user feels like "I want to relax," it will prioritize suggesting cafes with a calm atmosphere or hot spring facilities.

[1171] Route calculation from departure point to destination

[1172] The server calculates the optimal travel route based on the departure point "Tokyo" and destination "Kyoto." This calculation uses information on public transportation such as bullet trains, buses, and taxis. The server considers the timetables and operating status of each mode of transport to provide the optimal travel route and travel time.

[1173] Tourist information for the area around your destination

[1174] The server uses the destination "Kyoto" information to retrieve information about nearby tourist spots using a database or external API. This includes detailed information about tourist attractions such as Kiyomizu-dera Temple, Kinkaku-ji Temple, and Gion.

[1175] Plan generation and display

[1176] The server integrates all acquired and calculated information to generate a single travel plan. This plan includes departure times, modes of transportation, arrival times, dining spots near accommodations (including sentiment-based recommendations), and a schedule of sightseeing visits. The integration method displays this plan to the user in an appropriate format (timeline or list).

[1177] Specific example

[1178] For example, if a user plans a trip from Tokyo to Kyoto, the system will work as follows:

[1179] 1. The user enters "Tokyo" (departure point), "hotels around Kyoto Station" (accommodation), and "Kyoto" (destination), and provides emotional information such as "I want to relax" and "I want to enjoy a delicious meal."

[1180] 2. The terminal sends input information and emotional information to the server.

[1181] 3. The server uses the accommodation information to retrieve information on restaurants, ramen shops, cafes, and other dining spots around Kyoto Station.

[1182] 4. The emotion engine analyzes the user's emotional information and prioritizes suggesting cafes where the user can spend a relaxing time.

[1183] 5. The server calculates the optimal travel route from the departure point "Tokyo" to the destination "Kyoto" and provides details about the means of transportation, such as the Shinkansen (bullet train).

[1184] 6. The server retrieves information about tourist spots in the destination "Kyoto," such as Kiyomizu-dera Temple, Kinkaku-ji Temple, and Gion.

[1185] 7. The server integrates this information and generates a single travel plan.

[1186] 8. The device displays this plan to the user in either a timeline or list format.

[1187] In this way, the system of the present invention can easily create efficient and consistent travel plans that take the user's emotions into consideration.

[1188] The following describes the processing flow.

[1189] Step 1:

[1190] The user enters their departure point, accommodation, destination, and sentiment information via their device. For example, they might enter "Tokyo" as the departure point, "a hotel near Kyoto Station" as the accommodation, and "Kyoto" as the destination, and then add sentiment information such as "I want to relax" or "I want to enjoy a delicious meal."

[1191] Step 2:

[1192] The device sends the entered information and sentiment information to the server. Specifically, it sends a request to the server that includes the origin, accommodation, destination, and sentiment information.

[1193] Step 3:

[1194] Based on the accommodation information received from the terminal ("Hotels near Kyoto Station"), the server generates a query to retrieve information about restaurants near the accommodation using a database or external API.

[1195] Step 4:

[1196] The server sends a query to the database or an external API to search for dining options near the accommodation.

[1197] Step 5:

[1198] The server temporarily stores information about restaurants near the accommodation (e.g., sushi restaurants, ramen shops, cafes, etc.) that it has acquired.

[1199] Step 6:

[1200] The emotion engine analyzes the user's emotional information and adjusts the restaurant recommendations based on the results. For example, if the user feels like "I want to relax," it prioritizes selecting cafes with a quiet and calm atmosphere.

[1201] Step 7:

[1202] The server calculates the optimal travel route based on information about the departure point "Tokyo" and the destination "Kyoto." Specifically, it calculates the best mode of transport, such as bullet trains, buses, and taxis, and the travel time, taking into account public transportation timetables and operating conditions.

[1203] Step 8:

[1204] The server temporarily stores the calculation results (travel route, departure and arrival times, transfer information, etc.).

[1205] Step 9:

[1206] The server generates a query to retrieve details about tourist spots based on information about the destination "Kyoto".

[1207] Step 10:

[1208] The server sends a query to the database or external API to search for tourist attractions near the destination (e.g., Kiyomizu-dera Temple, Kinkaku-ji Temple, Gion, etc.).

[1209] Step 11:

[1210] The server temporarily stores information about tourist spots it has acquired.

[1211] Step 12:

[1212] The emotion engine adjusts tourist spot information based on the user's emotional information. For example, if the user feels like "I want to relax," it will prioritize selecting quiet temples and nature parks.

[1213] Step 13:

[1214] The server integrates all the information it has acquired and calculated to generate a single travel plan. Specifically, it combines departure time, mode of transportation, arrival time, dining spots near accommodation (including emotionally-based recommendations), and a schedule of sightseeing visits into one plan.

[1215] Step 14:

[1216] The server generates a travel plan and sends it to the device.

[1217] Step 15:

[1218] The device displays the travel plan received from the server to the user. Specifically, the plan is displayed in either a timeline or list format.

[1219] Step 16:

[1220] The user reviews the displayed travel plan and adjusts the plan as needed.

[1221] (Example 2)

[1222] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1223] Conventional travel planning systems have been insufficient in providing information that takes user emotions into account, making it difficult to efficiently generate consistent travel plans. Furthermore, there was a need to effectively suggest dining and sightseeing spots near accommodations based on user input, and to present optimal travel routes that take public transportation timetables into consideration.

[1224] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1225] In this invention, the server includes an input means for the user to input their departure point, accommodation, and destination; an acquisition means for obtaining restaurant spots based on accommodation information; a calculation means for calculating the optimal travel route based on departure point and destination information; an emotion analysis means for analyzing the user's emotional information and recommending restaurant and tourist spots based on the analysis results; and an integration means for integrating the obtained information into a single travel plan and presenting it to the user. This makes it possible to generate an efficient and consistent travel plan that takes the user's emotions into consideration.

[1226] "Input means" refers to devices or programs that allow users to input their origin, accommodation, destination, and emotional information.

[1227] "Acquisition means" refers to functions or systems that collect information on dining spots around the accommodation based on information transmitted from the input means.

[1228] "Calculation means" refers to functions or algorithms that calculate the optimal travel route and travel time based on information about the departure point and destination.

[1229] "Emotional analysis means" refers to a function or system that analyzes emotional information entered by the user and recommends dining spots and tourist spots based on the results.

[1230] "Integration means" refers to functions or programs that combine information obtained from acquisition means, calculation means, and sentiment analysis means into a single travel plan and present it to the user.

[1231] A "user" refers to someone who uses the system to plan their trip.

[1232] A "server" is a central computer system that processes information sent by users and performs calculations and retrieves necessary data.

[1233] A "terminal" refers to a device used by a user to input and receive information, such as a smartphone or a personal computer.

[1234] A "dining spot" refers to places, including restaurants, located near the user's accommodation.

[1235] A "tourist spot" refers to a place that includes tourist attractions and points of interest located near a destination.

[1236] A "travel route" refers to the optimal path from the starting point to the destination, taking into account public transport and other means of transportation.

[1237] "Travel time" refers to the time required to travel from the starting point to the destination.

[1238] Modes for carrying out the invention

[1239] This invention is a system that efficiently generates travel plans by providing consistent information to users while taking their emotions into consideration when they are planning a trip. The system comprises a terminal, a server, emotion analysis means, and multiple processing means.

[1240] 1. Terminal:

[1241] This is a device in which users input information for travel planning. The information input includes departure point, accommodation, destination, and the user's emotional state. For example, a computer device such as a smartphone or personal computer is used. The device communicates with a server via the internet and transmits the input information.

[1242] 2. Server:

[1243] A server is a central system that processes information received from terminals. A server includes the following processing methods:

[1244] Acquisition method: Based on the accommodation information entered by the user, information on dining spots around the accommodation is obtained using an external API (e.g., Google Places API).

[1245] Calculation Method: Based on origin and destination information, the travel route and travel time are calculated. The Google Maps API is used to determine the optimal mode of transport and its duration.

[1246] Emotion analysis method: The system analyzes the emotional information entered by the user and recommends appropriate dining spots and tourist attractions based on the results. For example, for the emotion of "wanting to relax," it recommends quiet cafes or hot spring facilities.

[1247] Integration method: Information obtained from acquisition, calculation, and sentiment analysis methods is integrated into a single travel plan. The integrated plan is appropriately formatted in timeline or list format and presented to the user.

[1248] This system works as follows:

[1249] 1. User Input: The user enters basic travel information and sentiment information via their device. For example, they might enter "Tokyo" as the departure point, "Hotels near Kyoto Station" as the accommodation, "Kyoto" as the destination, and sentiment information such as "I want to relax" or "I want to enjoy delicious food."

[1250] 2. Terminal sends: The terminal sends the input information to the server.

[1251] 3. Server Processing: Based on the received information, the server retrieves information such as restaurants near the accommodation, the optimal route from the departure point to the destination, and tourist attractions near the destination, and adjusts the recommended spots based on sentiment information.

[1252] 4. Integration and Display: The server integrates the retrieved and calculated information, generates a travel plan, and sends it to the terminal. Finally, the terminal displays the generated plan to the user.

[1253] Specific example

[1254] For example, if a user enters a travel plan from Tokyo to Kyoto, the system will work as follows:

[1255] 1. The user enters "Tokyo" (departure point), "Hotels around Kyoto Station" (accommodation), and "Kyoto" (destination), and adds sentiment information such as "I want to relax" and "I want to enjoy a delicious meal."

[1256] 2. The terminal sends this input information to the server.

[1257] 3. Based on the accommodation information, the server retrieves information on restaurants, ramen shops, cafes, and other dining spots around Kyoto Station.

[1258] 4. An emotion analysis system analyzes emotional information and prioritizes recommending relaxing cafes and hot spring facilities.

[1259] 5. The server uses the Google Maps API to calculate the optimal travel route from the departure point "Tokyo" to the destination "Kyoto".

[1260] 6. The server retrieves information about tourist spots in Kyoto, such as Kiyomizu-dera Temple, Kinkaku-ji Temple, and Gion.

[1261] 7. The server integrates this information and generates a travel plan in either a timeline or list format.

[1262] 8. The device will display this plan to the user.

[1263] Example of a prompt

[1264] When creating a travel plan, specify the departure point as "Tokyo," the accommodation as "a hotel near Kyoto Station," and the destination as "Kyoto." Then, taking into account emotional information such as "I want to relax" and "I want to enjoy delicious food," generate a consistent travel plan that includes travel routes, restaurants near the accommodation, and sightseeing spots.

[1265] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1266] Step 1:

[1267] User input

[1268] The user enters travel information using the device. This information includes departure point, accommodation, destination, and sentiment. For example, the user might enter "Tokyo" as the departure point, "a hotel near Kyoto Station" as the accommodation, "Kyoto" as the destination, and sentiment "I want to relax" or "I want to enjoy a delicious meal." This information is temporarily stored in the device's internal memory.

[1269] Step 2:

[1270] Terminal transmission

[1271] The terminal transmits stored user input information to the server via the internet. To do this, the terminal uses an appropriate communication protocol (e.g., HTTP) to send the input information to the server's endpoint. Through this transmission process, the server receives the user's travel and sentiment information.

[1272] Step 3:

[1273] Obtaining information about the area around your accommodation

[1274] The server retrieves dining spot information based on the received accommodation information (for example, "hotels near Kyoto Station"). Specifically, it calls the Google Places API to obtain a list of restaurants near the accommodation and their details (address, rating, category, etc.). This updates the database of dining spot information.

[1275] Input: Accommodation information

[1276] Output: Dining spot information (address, rating, category, etc.)

[1277] Step 4:

[1278] Emotion analysis

[1279] A sentiment analysis system on the server analyzes the user's emotional information. Natural language processing technology is used for the analysis to identify emotions from the user's input. For example, based on the emotional information "I want to relax," the system prioritizes selecting relaxing cafes and hot spring facilities. The analysis results are stored in a database and used for future recommendations.

[1280] Input: Sentiment information

[1281] Output: List of recommended categories

[1282] Step 5:

[1283] Travel route calculation

[1284] The server uses the Google Maps API to calculate the optimal travel route based on the departure point "Tokyo" and destination "Kyoto." It also considers information on public transportation such as bullet trains, buses, and taxis (timetables, service status, etc.) to provide the best possible route. The calculation results are output to the user as an optimal travel schedule.

[1285] Input: Departure point, Destination

[1286] Output: Optimal travel route and time

[1287] Step 6:

[1288] Tourist information for the area around your destination

[1289] The server retrieves nearby tourist attractions based on the destination information, "Kyoto." To do this, it calls the TripAdvisor API, for example, to obtain a list of nearby tourist attractions (e.g., Kiyomizu-dera Temple, Kinkaku-ji Temple, Gion, etc.) and detailed information (name, address, rating, etc.). The retrieved information is stored in a database.

[1290] Input: Destination information

[1291] Output: Tourist spot information (name, address, rating, etc.)

[1292] Step 7:

[1293] Plan integration and generation

[1294] The server integrates information obtained from acquisition, calculation, and sentiment analysis methods into a single travel plan. This plan includes departure times, modes of transportation, arrival times, dining options near accommodations, and a schedule of sightseeing visits. The plan is formatted in timeline or list format and stored in a database.

[1295] Input: Information on dining spots, travel routes, and tourist attractions.

[1296] Output: Integrated travel plan

[1297] Step 8:

[1298] Displaying plans

[1299] The device displays an integrated travel plan sent from the server to the user. The display format can be a timeline or list, making it easy for the user to review. The user can then view this screen to get a detailed understanding of their travel schedule and destinations.

[1300] Input: Integrated travel plan

[1301] Output: Display of travel plan

[1302] (Application Example 2)

[1303] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1304] In food delivery services, it is difficult to suggest the most suitable dishes and restaurants based on the user's current emotions and mood, and there is a lack of an integrated system for calculating efficient delivery routes. Therefore, in order to increase user satisfaction, a system is needed that selects restaurants that take user emotions into consideration and plans efficient delivery routes.

[1305] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[1306] In this invention, the server includes an input means for receiving user input information, an acquisition means for acquiring information on restaurants and bars near the accommodation, a calculation means for calculating the optimal travel route and travel time, a guidance means for acquiring information on tourist attractions, an emotion engine that makes suggestions based on the user's emotional information, and an integration means that integrates the information obtained from the acquisition means, calculation means and guidance means into a single travel plan and presents it to the user. This makes it possible to suggest restaurants and bars that take the user's emotions into consideration and to calculate an efficient delivery route.

[1307] "Input means" refers to devices or interfaces for users to input their origin, accommodation, destination, and emotional information.

[1308] "Method of acquisition" refers to the means of collecting information on restaurants and bars in the vicinity of a hotel based on the accommodation information entered by the user.

[1309] The "calculation means" refers to a function that calculates the optimal travel route and travel time based on the departure and destination information entered by the user.

[1310] "Guidance methods" refer to means of obtaining and providing users with information about tourist attractions around their destination.

[1311] An "emotion engine" is a system that analyzes a user's emotional information and makes specific suggestions based on the results.

[1312] An "integration means" is a function that integrates information obtained from acquisition means, calculation means, and guidance means, and presents it to the user as a single travel plan.

[1313] A specific system for implementing this invention comprises an input means for the user to input their departure point, accommodation, destination, and emotional information; an acquisition means for acquiring restaurants and bars around the accommodation; a calculation means for calculating the optimal travel route and travel time based on the departure point and destination information; a guidance means for acquiring tourist attractions around the destination; an emotional engine that makes suggestions based on the user's emotional information; and an integration means for integrating the information obtained from the acquisition means, calculation means, and guidance means and presenting it to the user.

[1314] Program generation and execution

[1315] The system's program is built using Python. This system utilizes the Google Maps API to search for nearby restaurants and bars based on the user's current location. Additionally, an emotion engine analyzes the user's emotional information, and suggestions are made based on the results.

[1316] For example, if a user enters "I want to relax" or "I want to enjoy a delicious meal," this information is sent from the input device to the server. The server uses the Google Maps API to retrieve information about restaurants and bars near the accommodation. Meanwhile, the emotion engine analyzes the user's emotional information and suggests places like "a relaxing cafe" or "a highly-rated restaurant."

[1317] The server also calculates the optimal travel route from the departure point "Tokyo" to the destination "Kyoto," taking into account public transport timetables and service status. This information is then compiled into a single travel plan by an integrated system and displayed to the user in either a timeline or list format.

[1318] Hardware and software to be used

[1319] Hardware: Smartphones, tablets, servers

[1320] Software: Google Maps API, Python

[1321] The server receives user input, retrieves data using the Google Maps API, performs sentiment analysis using an emotion engine, integrates the obtained information, and presents it to the user.

[1322] Specific example

[1323] If a user plans a trip from Tokyo to Kyoto, enters "I want to relax" and "I want to enjoy delicious food," and decides to stay at a hotel near Kyoto Station, the system will operate as follows:

[1324] 1. Information and emotional information entered by the user via the input method are sent to the server.

[1325] 2. The server uses the Google Maps API to obtain information on accommodations around Kyoto Station and nearby restaurants and bars.

[1326] 3. The emotion engine analyzes the user's emotional information and prioritizes suggesting relaxing cafes and highly-rated restaurants.

[1327] 4. The calculation method calculates the optimal travel route from Tokyo to Kyoto, taking into account details of public transportation such as the Shinkansen (bullet train).

[1328] 5. The integration mechanism combines this information into a single travel plan and displays it to the user in a timeline or list format.

[1329] Example of a prompt

[1330] "The user is currently located near Tokyo Station and is looking to relax. Use the Google Maps API to search for nearby cafes and list those that serve herbal tea. Also, calculate the optimal delivery route from those cafes to the user's location."

[1331] In this way, a system is provided that allows users to efficiently create optimal travel plans that take their emotions into consideration.

[1332] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1333] Step 1:

[1334] The user uses a terminal to input their departure point, accommodation, destination, and sentiment information. This input is then sent to the server in the next step. This input includes text data and is treated as basic information for subsequent data processing.

[1335] Step 2:

[1336] The terminal transmits the user's entered departure point, accommodation, destination, and sentiment information to the server. The server receives this input data and prepares to process each information item individually, converting it into an appropriate format for storage in the database.

[1337] Step 3:

[1338] The server uses the Google Maps API to retrieve information about restaurants and bars near the accommodation, based on the accommodation's location information. This process generates a list of restaurants and bars. The input data is the accommodation's location information, and the output is a list of restaurants and bars.

[1339] Step 4:

[1340] The emotion engine analyzes the user's emotional information. The input data is text information related to emotions, and the output is a list of emotion-based suggestions. This analysis identifies dining establishments that are suitable for the user's emotional state.

[1341] Step 5:

[1342] The server uses the Google Maps API to calculate the optimal travel route and travel time based on the origin and destination information. The input data is the location information of the origin and destination, and the output is detailed information about the travel route and travel time. This calculation also takes real-time traffic information into account.

[1343] Step 6:

[1344] The server retrieves information about tourist attractions around the destination using the Google Maps API and other external APIs. The input data is the location information of the destination, and the output is a list of tourist attractions.

[1345] Step 7:

[1346] The server integrates all information obtained from acquisition methods (food and beverage establishment information), calculation methods (travel routes and travel times), guidance methods (tourist attraction information), and an emotion engine (emotion-based suggestions). This integration generates a single travel plan. The travel plan includes content that takes the user's emotions into consideration and is provided in either a timeline or list format.

[1347] Step 8:

[1348] The server sends the generated travel plan to the terminal, which then displays this plan to the user. The input is an integrated travel plan, and the output is visualized plan information presented to the user. This plan includes suggested restaurants, optimal travel routes, and schedules for visiting tourist attractions.

[1349] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1350] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1351] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[1352] [Fourth Embodiment]

[1353] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[1354] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1355] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1356] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[1357] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1358] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1359] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1360] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[1361] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1362] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1363] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1364] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1365] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1366] This invention provides a system that offers consistent information to users when planning a trip and efficiently generates a travel plan. The system comprises a terminal, a server, and multiple processing means.

[1367] System Overview

[1368] This system consists of the following elements:

[1369] 1. Terminal:

[1370] This device allows users to input their departure point, accommodation, and destination.

[1371] Includes means for sending user-entered information to a server.

[1372] 2. Server:

[1373] It is a central system that processes information received from terminals.

[1374] A "means of obtaining" information about dining spots near your accommodation.

[1375] A "calculation tool" for calculating travel routes and travel times based on information about the departure point and destination.

[1376] A "tourist information tool" for obtaining information about tourist attractions around a destination.

[1377] This "integration method" combines the above information into a single travel plan and presents it to the user.

[1378] Program processing

[1379] User input and data transmission

[1380] The user enters travel information via their device, such as departure point "Tokyo," accommodation "hotels near Kyoto Station," and destination "Kyoto." The device then sends this information to the server.

[1381] Obtaining information about the area around your accommodation

[1382] The server uses the accommodation information ("Hotels near Kyoto Station") sent from the terminal to retrieve information about restaurants and other dining spots around the accommodation using a database or external API. This information may include, for example, sushi restaurants, ramen shops, and cafes.

[1383] Route calculation from departure point to destination

[1384] The server calculates the optimal travel route based on information about the departure point "Tokyo" and the destination "Kyoto." This calculation uses information on public transportation such as bullet trains, buses, and taxis. The server considers the timetables and operating status of each mode of transport to provide the optimal travel route and travel time.

[1385] Tourist information for the area around your destination

[1386] The server uses the destination "Kyoto" information to retrieve information about nearby tourist spots using a database or external API. For example, this includes detailed information about tourist attractions such as Kiyomizu-dera Temple, Kinkaku-ji Temple, and Gion.

[1387] Plan generation and display

[1388] The server generates a single, integrated travel plan based on all the information it has gathered. This plan includes departure times, modes of transportation, arrival times, dining options near the accommodation, and a schedule of sightseeing visits. The integration system then displays this plan to the user in an appropriate format (such as a timeline or list).

[1389] Specific example

[1390] For example, if a user plans a trip from Tokyo to Kyoto, the system will work as follows:

[1391] 1. The user enters "Tokyo" (departure point), "Hotels around Kyoto Station" (accommodation), and "Kyoto" (destination).

[1392] 2. The terminal sends the input information to the server.

[1393] 3. The server uses the accommodation information to retrieve information on restaurants, ramen shops, cafes, and other dining spots around Kyoto Station.

[1394] 4. The server calculates the optimal travel route from the departure point "Tokyo" to the destination "Kyoto" and provides details about transportation methods such as Shinkansen (bullet train).

[1395] 5. The server retrieves information about tourist spots in the destination "Kyoto," such as Kiyomizu-dera Temple, Kinkaku-ji Temple, and Gion.

[1396] 6. The server integrates this information and generates a single travel plan.

[1397] 7. The device displays this plan to the user in either a timeline or list format.

[1398] In this way, users can easily create efficient and consistent travel plans.

[1399] The following describes the processing flow.

[1400] Step 1:

[1401] The user enters their departure point, accommodation, and destination via their device. For example, they might enter "Tokyo" as the departure point, "Hotels around Kyoto Station" as the accommodation, and "Kyoto" as the destination.

[1402] Step 2:

[1403] The terminal sends the entered information to the server. Specifically, it sends a request to the server that includes information about the departure point, accommodation, and destination.

[1404] Step 3:

[1405] The server analyzes the information received from the terminal and generates a query to obtain information about accommodations (for example, "hotels around Kyoto Station").

[1406] Step 4:

[1407] The server sends a query to the database or an external API to search for dining options near the accommodation.

[1408] Step 5:

[1409] The server temporarily stores information about restaurants near the accommodation (e.g., sushi restaurants, ramen shops, cafes, etc.) that it has acquired.

[1410] Step 6:

[1411] The server calculates the optimal travel route based on information about the departure point "Tokyo" and the destination "Kyoto." Specifically, it calculates the best mode of transport, such as bullet trains, buses, and taxis, and the travel time, taking into account public transportation timetables and operating conditions.

[1412] Step 7:

[1413] The server temporarily stores the calculation results (travel route, departure and arrival times, transfer information, etc.).

[1414] Step 8:

[1415] The server generates a query to retrieve details about tourist spots based on information about the destination "Kyoto".

[1416] Step 9:

[1417] The server sends a query to the database or external API to search for tourist attractions near the destination (e.g., Kiyomizu-dera Temple, Kinkaku-ji Temple, Gion, etc.).

[1418] Step 10:

[1419] The server temporarily stores information about tourist spots it has acquired.

[1420] Step 11:

[1421] The server integrates all the information it has acquired and calculated to generate a single travel plan. Specifically, it combines departure times, modes of transportation, arrival times, dining options near accommodations, and sightseeing schedules into one plan.

[1422] Step 12:

[1423] The server generates a travel plan and sends it to the device.

[1424] Step 13:

[1425] The device displays the travel plan received from the server to the user. Specifically, the plan is displayed in either a timeline or list format.

[1426] Step 14:

[1427] The user reviews the displayed travel plan and plans or modifies the travel details.

[1428] (Example 1)

[1429] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1430] Traditional travel planning systems required users to manually link their departure point, accommodation, and destination, or to individually search for detailed information. This resulted in a time-consuming and laborious process, making it difficult to create a consistent travel plan. Furthermore, some systems lacked real-time information and adequately provided optimal routes considering public transport schedules and service status. Consequently, these systems were inconvenient for travelers and insufficient to assist with planning.

[1431] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1432] In this invention, the server includes data transmission means for transmitting travel information entered by the user in real time, data analysis means for analyzing information from external data sources and formatting it into an easy-to-use format, route search means for optimizing travel routes and travel times between the departure point and destination, information acquisition means for obtaining detailed information on tourist spots from external data sources, and data integration means for integrating the acquired information and organizing it in a schedule format. This makes it possible for users to easily create consistent and detailed travel plans. Specifically, it becomes possible to acquire information on dining spots and tourist spots in real time and provide users with travel plans that include optimal routes that take into account public transportation timetables and operating conditions.

[1433] An "input method" refers to a device or software that provides an interface for users to input travel information such as their departure point, accommodation, and destination into the system.

[1434] "Acquisition means" refers to a means of collecting related information, such as dining spots around the accommodation, based on the accommodation information transmitted from the input means.

[1435] "Calculation means" refers to algorithms or software used to calculate the optimal travel route and travel time based on the departure and destination information transmitted from the input means.

[1436] A "tourism information service" is a means of obtaining and providing users with information about tourist attractions and related topics around their destination.

[1437] An "integration means" is a means of integrating information obtained from acquisition means, calculation means, and tourist information means into a single travel plan and presenting it to the user.

[1438] "Data transmission means" refers to a method for transmitting travel information entered by a user to a server in real time.

[1439] "Data analysis means" refers to methods for analyzing information obtained from external data sources and formatting it into a user-friendly format.

[1440] A "route search method" refers to an algorithm or software used to optimize the travel route and travel time between a starting point and a destination.

[1441] "Information acquisition means" refers to methods for obtaining tourist spots and other related information from external data sources.

[1442] A "data integration method" is a means of integrating all acquired information, organizing it into a schedule format, and providing it to the user.

[1443] This invention is a system that enables users to efficiently plan their trips. The system consists of the following elements: a terminal, a server, and multiple processing means.

[1444] 1. Terminal

[1445] A terminal is a device used by users to input travel information such as their departure point, accommodation, and destination. Specific examples of terminals include smartphones, tablets, and PCs. The information entered by the user is sent to the server through the terminal. Here, when the user enters information into the interface and presses the submit button, an HTTP POST request is executed to the server.

[1446] 2. Server

[1447] The server is a central system that receives information sent from terminals and generates travel plans using multiple processing methods. The server has the following functions:

[1448] Acquisition means

[1449] The server uses acquisition methods to retrieve information about nearby dining spots based on the accommodation information sent from the terminal. This retrieval utilizes external APIs (e.g., Google Places API) or local databases. For example, based on information such as "hotels around Kyoto Station," it collects information on sushi restaurants, ramen shops, cafes, etc.

[1450] means of calculation

[1451] The server uses computational methods to calculate the optimal travel route and travel time based on information about the origin and destination. This calculation uses data from public transport timetables and operating status. Specifically, it obtains data from a real-time traffic information API and uses the Dijkstra algorithm or the A algorithm to derive the optimal route.

[1452] Tourist information services

[1453] The server uses tourist information tools to obtain information about tourist spots around the destination. This information is obtained using external APIs (e.g., TripAdvisor API) and databases. Based on destination information such as "Kyoto," it collects detailed information about places like Kiyomizu-dera Temple, Kinkaku-ji Temple, and Gion.

[1454] Data analysis means

[1455] The server analyzes the acquired information and formats it into a user-friendly format. It analyzes JSON data obtained from external data sources, extracts the necessary information, and formats it accordingly.

[1456] Route search means

[1457] The server has a route search mechanism to calculate the optimal travel route between the origin and destination. It calculates the shortest route and optimal travel time based on public transport timetables and service information.

[1458] Data Integration Means

[1459] The server integrates information obtained from acquisition, calculation, and tourist information sources to generate a single, integrated travel plan. The travel plan is then organized and presented to the user in timeline or list format.

[1460] 3. Plan generation and display

[1461] The server sends the generated integrated travel plan to the device, which then displays it to the user. Specifically, it is provided to the user as a timeline on a web page or as a list on a mobile app. For example, the schedule might be organized in the format of "9:00 Depart Tokyo by Shinkansen → 12:00 Arrive Kyoto → 12:30 Lunch at Kyoto Station (sushi restaurant)".

[1462] Specific example

[1463] For example, if a user plans a trip from "Tokyo" to "Kyoto," the system will work as follows:

[1464] 1. The user enters their departure point as "Tokyo," their accommodation as "a hotel near Kyoto Station," and their destination as "Kyoto" on their device.

[1465] 2. The terminal sends this input information to the server.

[1466] 3. The server retrieves information about the accommodation and collects information about sushi restaurants, ramen shops, cafes, etc., around Kyoto Station.

[1467] 4. The server calculates the optimal travel route from the departure point "Tokyo" to the destination "Kyoto" and provides the means of transportation, such as the Shinkansen (bullet train).

[1468] 5. The server retrieves tourist information for the destination "Kyoto" and collects detailed information on places like Kiyomizu-dera Temple, Kinkaku-ji Temple, and Gion.

[1469] 6. The server integrates this information and generates travel plans in timeline or list format.

[1470] 7. The device displays this integrated travel plan to the user.

[1471] Examples of prompts for generative AI models

[1472] Use the following prompts to input into the generative AI model:

[1473] I would like to plan a 3-day trip from Tokyo to Kyoto. The departure point is Tokyo, the accommodation is a hotel near Kyoto Station, and the destination is Kyoto. Please generate an optimal travel plan with a detailed schedule including information on sightseeing spots and dining options.

[1474] In this way, users can easily create efficient and consistent travel plans.

[1475] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1476] Step 1:

[1477] The user enters their departure point, accommodation, and destination.

[1478] Input: The user enters the departure point "Tokyo", accommodation "Hotels around Kyoto Station", and destination "Kyoto" into the terminal's input interface.

[1479] Specific operation: The user enters the required information into the input form displayed on the device screen and presses the submit button.

[1480] Step 2:

[1481] The terminal sends the input information to the server.

[1482] Input: Travel information entered and submitted by the user.

[1483] Output: Input information is sent to the server.

[1484] Specific operation: The terminal sends the information entered by the user to the server in the form of an HTTP POST request, and the server receives it.

[1485] Step 3:

[1486] The server retrieves information about restaurants and dining options near the accommodation.

[1487] Input: Accommodation information "Hotels near Kyoto Station".

[1488] Output: Information on dining spots near your accommodation.

[1489] Specific operation: The server uses the Google Places API to send HTTP requests to retrieve information on sushi restaurants, ramen shops, cafes, etc., based on "hotels around Kyoto Station," and receives the response in JSON format.

[1490] Step 4:

[1491] The server calculates the travel route from the starting point to the destination.

[1492] Input: Departure point "Tokyo", Destination "Kyoto".

[1493] Output: Optimal travel route and travel time.

[1494] Specific operation: The server retrieves operational data from public transport timetable APIs and uses Dijkstra's algorithm or A algorithm to calculate the optimal travel route based on that data.

[1495] Step 5:

[1496] The server collects information about tourist attractions around the destination.

[1497] Input: Destination "Kyoto".

[1498] Output: Detailed information about tourist attractions.

[1499] Specific operation: The server uses the TripAdvisor API to send an HTTP request to retrieve information on tourist spots related to "Kyoto" (e.g., Kiyomizu-dera Temple, Kinkaku-ji Temple, Gion), and receives the response in JSON format.

[1500] Step 6:

[1501] The server analyzes the collected data and formats it into a unified format.

[1502] Input: Various data obtained (restaurants, travel routes, tourist spots).

[1503] Output: Formatted data.

[1504] Specific operation: The server parses the received JSON data and extracts the necessary information. It then performs data processing to format each piece of information into a timeline or list format.

[1505] Step 7:

[1506] The server generates an integrated travel plan.

[1507] Input: Various formatted data.

[1508] Output: Integrated travel plan.

[1509] Specific operation: The server generates a single, sequential travel plan based on the formatted data. It then integrates this plan into a schedule format and determines what to provide to the user.

[1510] Step 8:

[1511] The device displays an integrated travel plan to the user.

[1512] Input: Integrated travel plan sent from the server.

[1513] Output: A travel plan display that can be visually confirmed by the user.

[1514] Specific operation: The terminal renders the travel plan received from the server onto the display screen and visually presents it to the user in either a timeline or list format.

[1515] Through these steps, users can easily create and visually confirm efficient and consistent travel plans.

[1516] (Application Example 1)

[1517] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1518] Conventional travel plan generation systems would generate a travel plan based on the user's input of departure point, accommodation, and destination, but they did not cover planning that utilized video content. Furthermore, they could not take into account videos that the user wanted to watch or review videos they wanted to refer to during the travel plan generation process. As a result, they failed to meet the user's need to create a detailed plan based on video information about travel destinations, tourist spots, and restaurants.

[1519] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1520] In this invention, the server includes input means for the user to input their departure point, accommodation, and destination; acquisition means for obtaining dining spots around the accommodation; calculation means for calculating the optimal travel route and travel time; tourist information means for obtaining tourist spots around the destination; and video analysis means for generating a travel plan based on video content desired by the user. This makes it possible for the user to efficiently generate a travel plan based on videos they have watched or review videos.

[1521] "Input means" refers to devices or interfaces that allow users to input their departure point, accommodation, and destination.

[1522] The "acquisition means" refers to a function that acquires information about restaurants near the accommodation based on the accommodation information transmitted from the input means.

[1523] The "calculation means" is a function that calculates the optimal travel route and travel time based on the departure and destination information transmitted from the input means.

[1524] A "tourist information service" is a function for obtaining information about tourist spots around a destination.

[1525] The "video analysis method" is a function that generates travel plans based on the video content desired by the user.

[1526] The "integration means" refers to a function that integrates information obtained from acquisition means, calculation means, tourist information means, and video analysis means into a single travel plan and presents it to the user.

[1527] Modes for carrying out the invention

[1528] This invention is a system that provides consistent information to users when planning a trip and efficiently generates a travel plan. The system comprises a terminal, a server, and multiple processing means.

[1529] System Overview

[1530] This system consists of the following elements:

[1531] 1. Terminal:

[1532] This device allows users to input their departure point, accommodation, and destination.

[1533] Includes means for sending user-entered information to a server.

[1534] 2. Server:

[1535] It is a central system that processes information received from terminals.

[1536] A "means of obtaining" information about dining spots near your accommodation.

[1537] A "calculation tool" for calculating travel routes and travel times based on information about the departure point and destination.

[1538] A "tourist information tool" for obtaining information about tourist attractions around a destination.

[1539] A "video analysis method" for generating travel plans based on the video content desired by the user.

[1540] This "integration method" combines the above information into a single travel plan and presents it to the user.

[1541] Operation details

[1542] User input and data transmission

[1543] The user enters their departure point, accommodation, and destination via their device. The entered data is then sent from the device to the server. This device can be a typical smartphone, tablet, or personal computer.

[1544] Obtaining information about the area around your accommodation

[1545] The server uses the accommodation information sent from the terminal to retrieve information about dining spots near the accommodation using a database or external API. This includes information on various restaurants, cafes, and other establishments.

[1546] Route calculation from departure point to destination

[1547] The server calculates the optimal travel route and travel time based on the departure and destination information. This calculation uses information on public transportation such as bullet trains, buses, and taxis. Public transportation timetables and operating status are also taken into consideration.

[1548] Tourist information for the area around your destination

[1549] The server uses the destination information to retrieve information about nearby tourist attractions using a database or external API. This includes detailed information about major tourist destinations and facilities.

[1550] Analysis and utilization of video content

[1551] Based on the video content requested by the user, the server uses video analysis tools to generate travel plans. It analyzes videos and review videos watched by the user and extracts related tourist spots and dining options.

[1552] Plan generation and display

[1553] The server integrates all information obtained from data acquisition, calculation, tourist information, and video analysis to generate a single travel plan. This travel plan is presented to the user in timeline or list format. An example of a specific prompt message would be: "I am planning a trip from Tokyo to Kyoto, staying near Kyoto Station, and visiting Kiyomizu-dera Temple, Kinkaku-ji Temple, and Gion."

[1554] The specific APIs used will be those that provide travel-related data (e.g., Google Places API, OpenWeather API), and the Python requests module will be used to retrieve and send the data. This system will allow users to easily and efficiently create consistent travel plans.

[1555] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1556] Step 1:

[1557] The user enters their departure point, accommodation, and destination using their device. The entered data is then sent to the server by the device.

[1558] Input: Information about the departure point, accommodation, and destination entered by the user.

[1559] Output: User input data is sent to the server.

[1560] Step 2:

[1561] The server uses the received accommodation information to retrieve information about restaurants near the accommodation using a database or external API.

[1562] Input: Accommodation information received by the server.

[1563] Output: A list of dining spots near your accommodation.

[1564] Specific operation: The server uses the latitude and longitude of the accommodation to send requests to the Google Places API and other dining spot information APIs to retrieve information on nearby restaurants and cafes.

[1565] Step 3:

[1566] The server calculates the optimal travel route and travel time based on the origin and destination information.

[1567] Input: Information about the departure and destination locations.

[1568] Output: Optimal travel route and travel time.

[1569] Specific operation: The server uses route calculation APIs such as the Google Maps API to obtain the travel route and travel time between two specified points. It also takes into account public transport information.

[1570] Step 4:

[1571] The server retrieves information about tourist attractions around the destination.

[1572] Input: Destination information.

[1573] Output: A list of tourist attractions around the destination.

[1574] Specific operation: The server uses the destination's latitude and longitude to send a request to a tourist spot information API to retrieve information about nearby tourist spots.

[1575] Step 5:

[1576] The server uses video analysis tools to generate travel plans based on the video content requested by the user.

[1577] Input: Information about the videos the user has watched.

[1578] Output: Elements of tourist spots and travel plans based on the videos watched.

[1579] Specific operation: The server analyzes the video's metadata and content, and extracts relevant tourist spots and activities.

[1580] Step 6:

[1581] The server integrates information obtained from acquisition means, calculation means, tourist information means, and video analysis means to generate a single travel plan.

[1582] Input: Dining spots near the accommodation, optimal travel route, sightseeing spots near the destination, and video analysis results.

[1583] Output: Integrated travel plan.

[1584] Specific operation: The server integrates various pieces of information to generate a consistent and efficient travel plan, which is then formatted in either a timeline or list format.

[1585] Step 7:

[1586] The device then presents this integrated travel plan to the user.

[1587] Input: Integrated travel plan sent from the server.

[1588] Output: Display of the travel plan in a format visible to the user.

[1589] Specific operation: The device will display the travel plan in a timeline or list format, allowing the user to easily review each step of the trip.

[1590] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1591] This invention is a system that efficiently generates travel plans by providing consistent information while taking into account the user's emotions when planning a trip. The system comprises a terminal, a server, an emotion engine, and multiple processing means.

[1592] System Overview

[1593] This system consists of the following elements:

[1594] 1. Terminal:

[1595] This is a device for users to input their departure point, accommodation, and destination.

[1596] Includes means for sending user-entered information and emotional feedback to a server.

[1597] 2. Server:

[1598] It is a central system that processes information received from terminals.

[1599] A "means of obtaining" information about dining spots near your accommodation.

[1600] A "calculation tool" for calculating travel routes and travel times based on information about the departure point and destination.

[1601] A "tourist information tool" for obtaining information about tourist attractions around a destination.

[1602] This "integration method" combines the above information into a single travel plan and presents it to the user.

[1603] 3. Emotional Engine:

[1604] A system for recognizing and analyzing user emotions.

[1605] This includes methods for analyzing user emotions from their input and actions, and adjusting travel plans based on the analysis results.

[1606] Program processing

[1607] User input and data transmission

[1608] The user enters information about their departure point, accommodation, destination, and their mood or feelings through their device. For example, they might enter "Tokyo" as the departure point, "a hotel near Kyoto Station" as the accommodation, and "Kyoto" as the destination, and then add emotional information such as "I want to relax" or "I want to enjoy a delicious meal."

[1609] The device sends this input information and sentiment information to the server.

[1610] Obtaining information about the area around your accommodation

[1611] The server uses the accommodation information ("Hotels near Kyoto Station") sent from the terminal to retrieve information about restaurants and other dining spots around the accommodation using a database or external API. This information may include, for example, sushi restaurants, ramen shops, and cafes.

[1612] Emotion-based recommendations

[1613] The emotion engine analyzes the user's emotional information and, based on the results, recommends specific dining and sightseeing spots. For example, if the user feels like "I want to relax," it will prioritize suggesting cafes with a calm atmosphere or hot spring facilities.

[1614] Route calculation from departure point to destination

[1615] The server calculates the optimal travel route based on the departure point "Tokyo" and destination "Kyoto." This calculation uses information on public transportation such as bullet trains, buses, and taxis. The server considers the timetables and operating status of each mode of transport to provide the optimal travel route and travel time.

[1616] Tourist information for the area around your destination

[1617] The server uses the destination "Kyoto" information to retrieve information about nearby tourist spots using a database or external API. This includes detailed information about tourist attractions such as Kiyomizu-dera Temple, Kinkaku-ji Temple, and Gion.

[1618] Plan generation and display

[1619] The server integrates all acquired and calculated information to generate a single travel plan. This plan includes departure times, modes of transportation, arrival times, dining spots near accommodations (including sentiment-based recommendations), and a schedule of sightseeing visits. The integration method displays this plan to the user in an appropriate format (timeline or list).

[1620] Specific example

[1621] For example, if a user plans a trip from Tokyo to Kyoto, the system will work as follows:

[1622] 1. The user enters "Tokyo" (departure point), "hotels around Kyoto Station" (accommodation), and "Kyoto" (destination), and provides emotional information such as "I want to relax" and "I want to enjoy a delicious meal."

[1623] 2. The terminal sends input information and emotional information to the server.

[1624] 3. The server uses the accommodation information to retrieve information on restaurants, ramen shops, cafes, and other dining spots around Kyoto Station.

[1625] 4. The emotion engine analyzes the user's emotional information and prioritizes suggesting cafes where the user can spend a relaxing time.

[1626] 5. The server calculates the optimal travel route from the departure point "Tokyo" to the destination "Kyoto" and provides details about the means of transportation, such as the Shinkansen (bullet train).

[1627] 6. The server retrieves information about tourist spots in the destination "Kyoto," such as Kiyomizu-dera Temple, Kinkaku-ji Temple, and Gion.

[1628] 7. The server integrates this information and generates a single travel plan.

[1629] 8. The device displays this plan to the user in either a timeline or list format.

[1630] In this way, the system of the present invention can easily create efficient and consistent travel plans that take the user's emotions into consideration.

[1631] The following describes the processing flow.

[1632] Step 1:

[1633] The user enters their departure point, accommodation, destination, and sentiment information via their device. For example, they might enter "Tokyo" as the departure point, "a hotel near Kyoto Station" as the accommodation, and "Kyoto" as the destination, and then add sentiment information such as "I want to relax" or "I want to enjoy a delicious meal."

[1634] Step 2:

[1635] The device sends the entered information and sentiment information to the server. Specifically, it sends a request to the server that includes the origin, accommodation, destination, and sentiment information.

[1636] Step 3:

[1637] Based on the accommodation information received from the terminal ("Hotels near Kyoto Station"), the server generates a query to retrieve information about restaurants near the accommodation using a database or external API.

[1638] Step 4:

[1639] The server sends a query to the database or an external API to search for dining options near the accommodation.

[1640] Step 5:

[1641] The server temporarily stores information about restaurants near the accommodation (e.g., sushi restaurants, ramen shops, cafes, etc.) that it has acquired.

[1642] Step 6:

[1643] The emotion engine analyzes the user's emotional information and adjusts the restaurant recommendations based on the results. For example, if the user feels like "I want to relax," it prioritizes selecting cafes with a quiet and calm atmosphere.

[1644] Step 7:

[1645] The server calculates the optimal travel route based on information about the departure point "Tokyo" and the destination "Kyoto." Specifically, it calculates the best mode of transport, such as bullet trains, buses, and taxis, and the travel time, taking into account public transportation timetables and operating conditions.

[1646] Step 8:

[1647] The server temporarily stores the calculation results (travel route, departure and arrival times, transfer information, etc.).

[1648] Step 9:

[1649] The server generates a query to retrieve details about tourist spots based on information about the destination "Kyoto".

[1650] Step 10:

[1651] The server sends a query to the database or external API to search for tourist attractions near the destination (e.g., Kiyomizu-dera Temple, Kinkaku-ji Temple, Gion, etc.).

[1652] Step 11:

[1653] The server temporarily stores information about tourist spots it has acquired.

[1654] Step 12:

[1655] The emotion engine adjusts tourist spot information based on the user's emotional information. For example, if the user feels like "I want to relax," it will prioritize selecting quiet temples and nature parks.

[1656] Step 13:

[1657] The server integrates all the information it has acquired and calculated to generate a single travel plan. Specifically, it combines departure time, mode of transportation, arrival time, dining spots near accommodation (including emotionally-based recommendations), and a schedule of sightseeing visits into one plan.

[1658] Step 14:

[1659] The server generates a travel plan and sends it to the device.

[1660] Step 15:

[1661] The device displays the travel plan received from the server to the user. Specifically, the plan is displayed in either a timeline or list format.

[1662] Step 16:

[1663] The user reviews the displayed travel plan and adjusts the plan as needed.

[1664] (Example 2)

[1665] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1666] Conventional travel planning systems have been insufficient in providing information that takes user emotions into account, making it difficult to efficiently generate consistent travel plans. Furthermore, there was a need to effectively suggest dining and sightseeing spots near accommodations based on user input, and to present optimal travel routes that take public transportation timetables into consideration.

[1667] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1668] In this invention, the server includes an input means for the user to input their departure point, accommodation, and destination; an acquisition means for obtaining restaurant spots based on accommodation information; a calculation means for calculating the optimal travel route based on departure point and destination information; an emotion analysis means for analyzing the user's emotional information and recommending restaurant and tourist spots based on the analysis results; and an integration means for integrating the obtained information into a single travel plan and presenting it to the user. This makes it possible to generate an efficient and consistent travel plan that takes the user's emotions into consideration.

[1669] "Input means" refers to devices or programs that allow users to input their origin, accommodation, destination, and emotional information.

[1670] "Acquisition means" refers to functions or systems that collect information on dining spots around the accommodation based on information transmitted from the input means.

[1671] "Calculation means" refers to functions or algorithms that calculate the optimal travel route and travel time based on information about the departure point and destination.

[1672] "Emotional analysis means" refers to a function or system that analyzes emotional information entered by the user and recommends dining spots and tourist spots based on the results.

[1673] "Integration means" refers to functions or programs that combine information obtained from acquisition means, calculation means, and sentiment analysis means into a single travel plan and present it to the user.

[1674] A "user" refers to someone who uses the system to plan their trip.

[1675] A "server" is a central computer system that processes information sent by users and performs calculations and retrieves necessary data.

[1676] A "terminal" refers to a device used by a user to input and receive information, such as a smartphone or a personal computer.

[1677] A "dining spot" refers to places including restaurants located near the user's accommodation.

[1678] A "tourist spot" refers to a place that includes tourist attractions and points of interest located near a destination.

[1679] A "travel route" refers to the optimal path from the starting point to the destination, taking into account public transport and other means of transportation.

[1680] "Travel time" refers to the time required to travel from the starting point to the destination.

[1681] Modes for carrying out the invention

[1682] This invention is a system that efficiently generates travel plans by providing consistent information to users while taking their emotions into consideration when they are planning a trip. The system comprises a terminal, a server, emotion analysis means, and multiple processing means.

[1683] 1. Terminal:

[1684] This is a device in which users input information for travel planning. The information input includes departure point, accommodation, destination, and the user's emotional state. For example, a computer device such as a smartphone or personal computer is used. The device communicates with a server via the internet and transmits the input information.

[1685] 2. Server:

[1686] A server is a central system that processes information received from terminals. A server includes the following processing methods:

[1687] Acquisition method: Based on the accommodation information entered by the user, information on dining spots around the accommodation is obtained using an external API (e.g., Google Places API).

[1688] Calculation Method: Based on origin and destination information, the travel route and travel time are calculated. The Google Maps API is used to determine the optimal mode of transport and its duration.

[1689] Emotion analysis method: The system analyzes the emotional information entered by the user and recommends appropriate dining spots and tourist attractions based on the results. For example, for the emotion of "wanting to relax," it recommends quiet cafes or hot spring facilities.

[1690] Integration method: Information obtained from acquisition, calculation, and sentiment analysis methods is integrated into a single travel plan. The integrated plan is appropriately formatted in timeline or list format and presented to the user.

[1691] This system works as follows:

[1692] 1. User Input: The user enters basic travel information and sentiment information via their device. For example, they might enter "Tokyo" as the departure point, "Hotels near Kyoto Station" as the accommodation, "Kyoto" as the destination, and sentiment information such as "I want to relax" or "I want to enjoy delicious food."

[1693] 2. Terminal sends: The terminal sends the input information to the server.

[1694] 3. Server Processing: Based on the received information, the server retrieves information such as restaurants near the accommodation, the optimal route from the departure point to the destination, and tourist attractions near the destination, and adjusts the recommended spots based on sentiment information.

[1695] 4. Integration and Display: The server integrates the retrieved and calculated information, generates a travel plan, and sends it to the terminal. Finally, the terminal displays the generated plan to the user.

[1696] Specific example

[1697] For example, if a user enters a travel plan from Tokyo to Kyoto, the system will work as follows:

[1698] 1. The user enters "Tokyo" (departure point), "Hotels around Kyoto Station" (accommodation), and "Kyoto" (destination), and adds sentiment information such as "I want to relax" and "I want to enjoy a delicious meal."

[1699] 2. The terminal sends this input information to the server.

[1700] 3. Based on the accommodation information, the server retrieves information on restaurants, ramen shops, cafes, and other dining spots around Kyoto Station.

[1701] 4. An emotion analysis system analyzes emotional information and prioritizes recommending relaxing cafes and hot spring facilities.

[1702] 5. The server uses the Google Maps API to calculate the optimal travel route from the departure point "Tokyo" to the destination "Kyoto".

[1703] 6. The server retrieves information about tourist spots in Kyoto, such as Kiyomizu-dera Temple, Kinkaku-ji Temple, and Gion.

[1704] 7. The server integrates this information and generates a travel plan in either a timeline or list format.

[1705] 8. The device will display this plan to the user.

[1706] Example of a prompt

[1707] When creating a travel plan, specify the departure point as "Tokyo," the accommodation as "a hotel near Kyoto Station," and the destination as "Kyoto." Then, taking into account emotional information such as "I want to relax" and "I want to enjoy delicious food," generate a consistent travel plan that includes travel routes, restaurants near the accommodation, and sightseeing spots.

[1708] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1709] Step 1:

[1710] User input

[1711] The user enters travel information using the device. This information includes departure point, accommodation, destination, and sentiment. For example, the user might enter "Tokyo" as the departure point, "a hotel near Kyoto Station" as the accommodation, "Kyoto" as the destination, and sentiment "I want to relax" or "I want to enjoy a delicious meal." This information is temporarily stored in the device's internal memory.

[1712] Step 2:

[1713] Terminal transmission

[1714] The terminal transmits stored user input information to the server via the internet. To do this, the terminal uses an appropriate communication protocol (e.g., HTTP) to send the input information to the server's endpoint. Through this transmission process, the server receives the user's travel and sentiment information.

[1715] Step 3:

[1716] Obtaining information about the area around your accommodation

[1717] The server retrieves dining spot information based on the received accommodation information (for example, "hotels near Kyoto Station"). Specifically, it calls the Google Places API to obtain a list of restaurants near the accommodation and their details (address, rating, category, etc.). This updates the database of dining spot information.

[1718] Input: Accommodation information

[1719] Output: Dining spot information (address, rating, category, etc.)

[1720] Step 4:

[1721] Emotion analysis

[1722] A sentiment analysis system on the server analyzes the user's emotional information. Natural language processing technology is used for the analysis to identify emotions from the user's input. For example, based on the emotional information "I want to relax," the system prioritizes selecting relaxing cafes and hot spring facilities. The analysis results are stored in a database and used for future recommendations.

[1723] Input: Sentiment information

[1724] Output: List of recommended categories

[1725] Step 5:

[1726] Travel route calculation

[1727] The server uses the Google Maps API to calculate the optimal travel route based on the departure point "Tokyo" and destination "Kyoto." It also considers information on public transportation such as bullet trains, buses, and taxis (timetables, service status, etc.) to provide the best possible route. The calculation results are output to the user as an optimal travel schedule.

[1728] Input: Departure point, Destination

[1729] Output: Optimal travel route and time

[1730] Step 6:

[1731] Tourist information for the area around your destination

[1732] The server retrieves nearby tourist attractions based on the destination information, "Kyoto." To do this, it calls the TripAdvisor API, for example, to obtain a list of nearby tourist attractions (e.g., Kiyomizu-dera Temple, Kinkaku-ji Temple, Gion, etc.) and detailed information (name, address, rating, etc.). The retrieved information is stored in a database.

[1733] Input: Destination information

[1734] Output: Tourist spot information (name, address, rating, etc.)

[1735] Step 7:

[1736] Plan integration and generation

[1737] The server integrates information obtained from acquisition, calculation, and sentiment analysis methods into a single travel plan. This plan includes departure times, modes of transportation, arrival times, dining options near accommodations, and a schedule of sightseeing visits. The plan is formatted in timeline or list format and stored in a database.

[1738] Input: Information on dining spots, travel routes, and tourist attractions.

[1739] Output: Integrated travel plan

[1740] Step 8:

[1741] Displaying plans

[1742] The device displays an integrated travel plan sent from the server to the user. The display format can be a timeline or list, making it easy for the user to review. The user can then view this screen to get a detailed understanding of their travel schedule and destinations.

[1743] Input: Integrated travel plan

[1744] Output: Display of travel plan

[1745] (Application Example 2)

[1746] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1747] In food delivery services, it is difficult to suggest the most suitable dishes and restaurants based on the user's current emotions and mood, and there is a lack of an integrated system for calculating efficient delivery routes. Therefore, in order to increase user satisfaction, a system is needed that selects restaurants that take user emotions into consideration and plans efficient delivery routes.

[1748] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[1749] In this invention, the server includes an input means for receiving user input information, an acquisition means for acquiring information on restaurants and bars near the accommodation, a calculation means for calculating the optimal travel route and travel time, a guidance means for acquiring information on tourist attractions, an emotion engine that makes suggestions based on the user's emotional information, and an integration means that integrates the information obtained from the acquisition means, calculation means and guidance means into a single travel plan and presents it to the user. This makes it possible to suggest restaurants and bars that take the user's emotions into consideration and to calculate an efficient delivery route.

[1750] "Input means" refers to devices or interfaces for users to input their origin, accommodation, destination, and emotional information.

[1751] "Method of acquisition" refers to the means of collecting information on restaurants and bars in the vicinity of a hotel based on the accommodation information entered by the user.

[1752] The "calculation means" refers to a function that calculates the optimal travel route and travel time based on the departure and destination information entered by the user.

[1753] "Guidance methods" refer to means of obtaining and providing users with information about tourist attractions around their destination.

[1754] An "emotion engine" is a system that analyzes a user's emotional information and makes specific suggestions based on the results.

[1755] An "integration means" is a function that integrates information obtained from acquisition means, calculation means, and guidance means, and presents it to the user as a single travel plan.

[1756] A specific system for implementing this invention comprises an input means for the user to input their departure point, accommodation, destination, and emotional information; an acquisition means for acquiring restaurants and bars around the accommodation; a calculation means for calculating the optimal travel route and travel time based on the departure point and destination information; a guidance means for acquiring tourist attractions around the destination; an emotional engine that makes suggestions based on the user's emotional information; and an integration means for integrating the information obtained from the acquisition means, calculation means, and guidance means and presenting it to the user.

[1757] Program generation and execution

[1758] The system's program is built using Python. This system utilizes the Google Maps API to search for nearby restaurants and bars based on the user's current location. Additionally, an emotion engine analyzes the user's emotional information, and suggestions are made based on the results.

[1759] For example, if a user enters "I want to relax" or "I want to enjoy a delicious meal," this information is sent from the input device to the server. The server uses the Google Maps API to retrieve information about restaurants and bars near the accommodation. Meanwhile, the emotion engine analyzes the user's emotional information and suggests places like "a relaxing cafe" or "a highly-rated restaurant."

[1760] The server also calculates the optimal travel route from the departure point "Tokyo" to the destination "Kyoto," taking into account public transport timetables and service status. This information is then compiled into a single travel plan by an integrated system and displayed to the user in either a timeline or list format.

[1761] Hardware and software to be used

[1762] Hardware: Smartphones, tablets, servers

[1763] Software: Google Maps API, Python

[1764] The server receives user input, retrieves data using the Google Maps API, performs sentiment analysis using an emotion engine, integrates the obtained information, and presents it to the user.

[1765] Specific example

[1766] If a user plans a trip from Tokyo to Kyoto, enters "I want to relax" and "I want to enjoy delicious food," and decides to stay at a hotel near Kyoto Station, the system will operate as follows:

[1767] 1. Information and emotional information entered by the user via the input method are sent to the server.

[1768] 2. The server uses the Google Maps API to retrieve information on accommodations around Kyoto Station and nearby restaurants and bars.

[1769] 3. The emotion engine analyzes the user's emotional information and prioritizes suggesting relaxing cafes and highly-rated restaurants.

[1770] 4. The calculation method calculates the optimal travel route from Tokyo to Kyoto, taking into account details of public transportation such as the Shinkansen (bullet train).

[1771] 5. The integration mechanism combines this information into a single travel plan and displays it to the user in a timeline or list format.

[1772] Example of a prompt

[1773] "The user is currently located near Tokyo Station and is looking to relax. Use the Google Maps API to search for nearby cafes and list those that serve herbal tea. Also, calculate the optimal delivery route from those cafes to the user's location."

[1774] In this way, a system is provided that allows users to efficiently create optimal travel plans that take their emotions into consideration.

[1775] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1776] Step 1:

[1777] The user uses a terminal to input their departure point, accommodation, destination, and sentiment information. This input is then sent to the server in the next step. This input includes text data and is treated as basic information for subsequent data processing.

[1778] Step 2:

[1779] The terminal transmits the user's entered departure point, accommodation, destination, and sentiment information to the server. The server receives this input data and prepares to process each information item individually, converting it into an appropriate format for storage in the database.

[1780] Step 3:

[1781] The server uses the Google Maps API to retrieve information about restaurants and bars near the accommodation, based on the accommodation's location information. This process generates a list of restaurants and bars. The input data is the accommodation's location information, and the output is a list of restaurants and bars.

[1782] Step 4:

[1783] The emotion engine analyzes the user's emotional information. The input data is text information related to emotions, and the output is a list of emotion-based suggestions. This analysis identifies dining establishments that are suitable for the user's emotional state.

[1784] Step 5:

[1785] The server uses the Google Maps API to calculate the optimal travel route and travel time based on the origin and destination information. The input data is the location information of the origin and destination, and the output is detailed information about the travel route and travel time. This calculation also takes real-time traffic information into account.

[1786] Step 6:

[1787] The server retrieves information about tourist attractions around the destination using the Google Maps API and other external APIs. The input data is the location information of the destination, and the output is a list of tourist attractions.

[1788] Step 7:

[1789] The server integrates all information obtained from acquisition methods (food and beverage establishment information), calculation methods (travel routes and travel times), guidance methods (tourist attraction information), and an emotion engine (emotion-based suggestions). This integration generates a single travel plan. The travel plan includes content that takes the user's emotions into consideration and is provided in either a timeline or list format.

[1790] Step 8:

[1791] The server sends the generated travel plan to the terminal, which then displays this plan to the user. The input is an integrated travel plan, and the output is visualized plan information presented to the user. This plan includes suggested restaurants, optimal travel routes, and schedules for visiting tourist attractions.

[1792] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1793] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1794] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[1795] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1796] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[1797] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[1798] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[1799] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[1800] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[1801] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[1802] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[1803] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[1804] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[1805] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1806] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[1807] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[1808] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[1809] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[1810] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[1811] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[1812] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted as being incorporated by reference.

[1813] The following is further disclosed regarding the embodiments described above.

[1814] (Claim 1)

[1815] An input method for the user to enter their departure point, accommodation, and destination,

[1816] Based on the information of the accommodation transmitted from the aforementioned input means, an acquisition means for obtaining dining spots around the accommodation,

[1817] A calculation means that calculates the optimal travel route and travel time based on the departure and destination information transmitted from the input means,

[1818] A means of obtaining tourist information for tourist spots around the aforementioned destination,

[1819] An integration means that combines the information obtained from the acquisition means, calculation means, and tourist information means into a single travel plan and presents it to the user,

[1820] A system that includes this.

[1821] (Claim 2)

[1822] The system according to claim 1, characterized in that the calculation means calculates the optimal travel route considering the timetables and operating status of public transportation.

[1823] (Claim 3)

[1824] The system according to claim 1, characterized in that the integration means displays the travel plan to the user in a timeline format or a list format.

[1825] "Example 1"

[1826] (Claim 1)

[1827] An input method for the user to enter their departure point, accommodation, and destination,

[1828] Based on the information of the accommodation transmitted from the aforementioned input means, an acquisition means for obtaining dining spots around the accommodation,

[1829] A calculation means that calculates the optimal travel route and travel time based on the departure and destination information transmitted from the input means,

[1830] A means of obtaining tourist information for tourist spots around the aforementioned destination,

[1831] An integration means that combines the information obtained from the acquisition means, calculation means, and tourist information means into a single travel plan and presents it to the user,

[1832] A system that includes this.

[1833] (Claim 2)

[1834] The system according to claim 1, characterized in that the calculation means calculates the optimal travel route considering the timetables and operating status of public transportation.

[1835] (Claim 3)

[1836] The system according to claim 1, characterized in that the integration means displays the travel plan to the user in a timeline format or a list format.

[1837] (Claim 4)

[1838] A data transmission means for sending travel information entered by the user to the server in real time,

[1839] A data analysis method for analyzing information from external data sources and formatting it into a user-friendly format,

[1840] A route search method for optimizing the travel route and travel time between the origin and destination,

[1841] A means of obtaining information to acquire detailed information about tourist spots from external data sources,

[1842] A data integration method for consolidating acquired information and organizing it in a schedule format,

[1843] The system according to claim 1, comprising:

[1844] "Application Example 1"

[1845] (Claim 1)

[1846] An input method for the user to enter their departure point, accommodation, and destination,

[1847] Based on the information of the accommodation transmitted from the aforementioned input means, an acquisition means for obtaining dining spots around the accommodation,

[1848] A calculation means that calculates the optimal travel route and travel time based on the departure and destination information transmitted from the input means,

[1849] A means of obtaining tourist information for tourist spots around the aforementioned destination,

[1850] A video analysis method for generating travel plans based on video content desired by the user,

[1851] An integration means that combines the information obtained from the acquisition means, calculation means, tourist information means, and video analysis means into a single travel plan and presents it to the user,

[1852] A system that includes this.

[1853] (Claim 2)

[1854] The system according to claim 1, characterized in that the calculation means calculates the optimal travel route considering the timetables and operating status of public transportation.

[1855] (Claim 3)

[1856] The system according to claim 1, characterized in that the integration means displays the travel plan to the user in a timeline format or a list format.

[1857] "Example 2 of combining an emotion engine"

[1858] (Claim 1)

[1859] An input method for the user to enter their departure point, accommodation, and destination,

[1860] Based on the information of the accommodation transmitted from the aforementioned input means, an acquisition means for obtaining dining spots around the accommodation,

[1861] A calculation means that calculates the optimal travel route and travel time based on the departure and destination information transmitted from the input means,

[1862] A sentiment analysis method that analyzes user sentiment information and recommends dining spots and tourist spots based on the analysis results,

[1863] An integration means that integrates the information obtained from the calculation means and acquisition means into a single travel plan and presents it to the user,

[1864] A system including the acquisition means, calculation means, emotion analysis means, and integration means.

[1865] (Claim 2)

[1866] The system according to claim 1, characterized in that the calculation means calculates the optimal travel route considering the timetables and operating status of public transportation.

[1867] (Claim 3)

[1868] The system according to claim 1, characterized in that the integration means displays the travel plan to the user in a timeline format or a list format.

[1869] "Application example 2 when combining with an emotional engine"

[1870] (Claim 1)

[1871] An input method for the user to enter their departure point, accommodation, and destination,

[1872] Based on the information about the accommodation transmitted from the aforementioned input means, an acquisition means for obtaining information about restaurants and bars in the vicinity of the accommodation,

[1873] A calculation means that calculates the optimal travel route and travel time based on the departure and destination information transmitted from the input means,

[1874] A means of providing information on tourist attractions around the aforementioned destination,

[1875] An emotion engine that makes suggestions based on the user's emotional information,

[1876] An integration means that integrates the information obtained from the acquisition means, calculation means, and guidance means into a single travel plan and presents it to the user,

[1877] A system that includes this.

[1878] (Claim 2)

[1879] The system according to claim 1, characterized in that the calculation means calculates the optimal travel route considering the timetables and operating status of public transportation.

[1880] (Claim 3)

[1881] The system according to claim 1, characterized in that the integration means displays the travel plan to the user in a timeline format or a list format. [Explanation of Symbols]

[1882] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. An input method for the user to enter their departure point, accommodation, and destination, Based on the information of the accommodation transmitted from the aforementioned input means, an acquisition means for obtaining dining spots around the accommodation, A calculation means that calculates the optimal travel route and travel time based on the departure and destination information transmitted from the input means, A means of obtaining tourist information for tourist spots around the aforementioned destination, An integration means that combines the information obtained from the acquisition means, calculation means, and tourist information means into a single travel plan and presents it to the user, A system that includes this.

2. The system according to claim 1, characterized in that the calculation means calculates the optimal travel route considering the timetables and operating status of public transportation.

3. The system according to claim 1, characterized in that the integration means displays the travel plan to the user in a timeline format or a list format.

Images