system

Abstract

We provide the system. [Solution] A means for users to input their travel destination, dates, and budget, A means for automatically generating an optimal travel plan based on the input information, A means for presenting the automatically generated travel plan to the user, A means for the user to review and modify the aforementioned travel plan, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Conventional travel planning systems have required individual travel planning, hotel reservations, transportation means, sightseeing guides, souvenir and restaurant recommendations, and post-trip diary writing, imposing a great burden on users. In addition, there has been no system that integrates these services, and travelers have had to use multiple applications and websites. Furthermore, due to the dispersion of travel-related information, it has been difficult to integrate the information and provide an optimal plan. As a result, there has been a problem of reduced planning efficiency and increased stress for travelers.

Means for Solving the Problems

[0005] The present invention solves these problems by providing a system that includes means for the user to input a travel destination, itinerary, and budget; means for automatically generating an optimal travel plan based on the input information; means for presenting the automatically generated travel plan to the user; and means for the user to confirm and modify the presented travel plan. Furthermore, by including means for the user to input desired accommodation conditions, means for obtaining information from affiliated booking sites based on the input conditions, and means for presenting the obtained information to the user and confirming the booking, the system enables the user to complete everything from travel planning to booking in a single system. In addition, by including means for the user to input their current location and destination, means for calculating the optimal route based on the input information, and means for presenting the calculated route to the user, the system reduces stress related to travel. Furthermore, by including means for the user to select tourist destinations they wish to visit, means for obtaining information about the selected tourist destinations, and means for presenting the obtained information to the user, the system simplifies information gathering during travel. In addition, by including means for the user to input desired souvenir and restaurant conditions, means for collecting information based on the input conditions and suggesting the optimal stores, and means for presenting the suggested store information to the user, the system reduces stress related to shopping and dining during travel. Finally, by including means for collecting user travel data, means for automatically generating a travel diary based on the collected data, and means for presenting the generated travel diary to the user and allowing them to make corrections, the complexity of creating records after a trip is eliminated. As a result, users can seamlessly manage the entire travel process with a single integrated system, significantly improving the efficiency of travel planning.

[0006] A "user" is an end-user who uses this system to plan, review, modify, and execute travel plans.

[0007] A "travel plan" is a plan that includes a travel schedule, accommodations, sightseeing destinations, and transportation methods, which are automatically generated based on the user's input information.

[0008] A "destination" refers to the geographical location or city that a user sets as their travel destination.

[0009] "Schedule" refers to the specific dates (year, month, and day) that the user sets as the start and end dates of their trip.

[0010] "Budget" refers to the maximum amount of money a user plans to spend on their trip.

[0011] "Accommodation facilities" refer to hotels, inns, guesthouses, and other facilities where users stay during their travels.

[0012] A "booking site" refers to an online platform that partners with businesses to allow them to make reservations for accommodations, transportation, and other services.

[0013] A "Map API" refers to an external application programming interface that provides geographic information and route calculations.

[0014] A "tourist destination" refers to a place or landmark that a user visits during their trip.

[0015] "Route" refers to the travel path from your current location to your destination.

[0016] "Souvenirs" refer to mementos or gifts purchased at a travel destination.

[0017] "Eating establishments" refers to restaurants, cafes, diners, and other places that users visit to eat.

[0018] "Travel data" refers to information entered by users during their trips and itinerary data acquired by the system.

[0019] A "travel diary" refers to a diary that is automatically generated based on the user's travel records. [Brief explanation of the drawing]

[0020] [Figure 1] It is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] It is a conceptual diagram showing an example of the main functions of a data processing device and a smart device according to the first embodiment. [Figure 3] It is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] It is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] It is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] It is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] It is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] It is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] It shows an emotion map to which a plurality of emotions are mapped. [Figure 10] It shows an emotion map to which a plurality of emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when an emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when an emotion engine is combined.

MODE FOR CARRYING OUT THE INVENTION

[0021] Hereinafter, an example of an embodiment of the system relating to the technology of this disclosure will be described with reference to the attached drawings.

[0022] First, let's explain the terminology used in the following explanation.

[0023] In the following embodiments, the signed processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Furthermore, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include CPU (Central Processing Unit), GPU (Graphics Processing Unit), GPGPU (General-Purpose computing on Graphics Processing Units), and APU (Accelerated Processing Unit).

[0024] In the following embodiments, signed RAM (Random Access Memory) is a memory that temporarily stores information and is used as work memory by the processor.

[0025] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.

[0026] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0027] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0028] [First Embodiment]

[0029] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0030] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0031] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0032] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0033] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0034] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0035] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0036] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0037] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0038] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0039] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0040] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0041] The travel support system according to the present invention generates an optimal travel plan, makes accommodation reservations, provides directions, tourist information, souvenir and restaurant recommendations, and automatically generates a travel diary, all based on the user's input of necessary information such as travel destination, itinerary, and budget. The system of the present invention is realized by a terminal with a user interface, a server that processes data, and by linking with an external database or API.

[0042] 1. User travel plan creation

[0043] The user enters their travel destination, dates, and budget into their device. The server receives this information and collects relevant data from its database and external APIs. For example, if the user enters "Kyoto" as the destination, "October 10th to October 12th" as the dates, and "50,000 yen" as the budget, the server automatically generates the most suitable hotel, sightseeing spots, and transportation options based on this information. The generated plan is sent to the user's device, where they can review and modify it.

[0044] 2. Hotel Reservation

[0045] The user enters their desired accommodation criteria. For example, if the user enters criteria such as "3-star hotel," "city center," and "under 10,000 yen per night," the server searches affiliated booking sites and lists hotels that match the criteria. The information of the relevant hotels is displayed on the terminal, and the user selects their desired hotel from the list and proceeds with the booking process. The server confirms the booking process through the booking site's API.

[0046] 3. Directions

[0047] The user enters their current location and destination. For example, if the current location is "Kyoto Station" and the destination is "Kinkaku-ji Temple," the server uses a map API to calculate the optimal route. The calculated route information is sent to the device and displayed to the user. Details such as the map, distance, estimated travel time, and information on using public transportation are displayed.

[0048] 4. Tourist Guide

[0049] The user selects a tourist destination they wish to visit. For example, if they select "Kiyomizu-dera Temple," the server collects detailed information about Kiyomizu-dera from its internal database and external APIs. This information includes the history of the tourist destination, its highlights, opening hours, and admission fees. The collected information is displayed on the device for easy access by the user.

[0050] 5. Recommendations for souvenirs and restaurants

[0051] The user enters their desired souvenir or restaurant criteria. For example, if they enter criteria such as "souvenirs under 1,000 yen" or "restaurant serving local cuisine," the server collects information on stores that match those criteria. A list of matching stores is displayed on the terminal, and the user can select the souvenir or restaurant that suits their needs.

[0052] 6. Automatic generation of travel diaries

[0053] At the end of the trip, the user can choose to have a travel diary automatically generated. The server automatically generates the travel diary based on the data collected during the trip. For example, details such as the tourist spots visited, activities experienced, accommodations, and meals are automatically generated as text and sent to the device. The user can review the generated diary and make corrections as needed.

[0054] This allows users to efficiently manage the entire travel process within a single integrated system. A key feature of this system is its consistent support for everything from travel planning, booking, transportation, access to tourist information, souvenir and meal selection, to creating travel records after the trip.

[0055] The following describes the processing flow.

[0056] User travel plan creation

[0057] Step 1:

[0058] The user enters their travel destination, dates, and budget. For example, they might enter "Kyoto," "October 10th to October 12th," and "50,000 yen."

[0059] Step 2:

[0060] The terminal sends the entered information to the server.

[0061] Step 3:

[0062] The server retrieves the necessary data for generating travel plans (e.g., popularity of tourist destinations, accommodation availability, transportation options, etc.) from a database or external API.

[0063] Step 4:

[0064] Based on data acquired by the server, the system automatically generates travel plans optimized for the user's conditions. Specifically, it creates plans that include combinations of tourist destinations, modes of transportation, and accommodations.

[0065] Step 5:

[0066] The server sends the generated travel plan to the device.

[0067] Step 6:

[0068] The device displays the travel plan to the user. The user can review the plan details and modify them as needed.

[0069] Hotel Reservations

[0070] Step 1:

[0071] The user enters their desired accommodation criteria. For example, they might enter "3-star hotel," "city center," and "under 10,000 yen per night."

[0072] Step 2:

[0073] The terminal sends the entered conditions to the server.

[0074] Step 3:

[0075] The server calls the API of a partner booking site to search for hotels that meet the specified criteria.

[0076] Step 4:

[0077] The server organizes the search results and creates a list of hotels that best match the criteria.

[0078] Step 5:

[0079] The server sends the hotel list to the terminal.

[0080] Step 6:

[0081] The device displays a list of hotels to the user. The user selects their desired hotel and makes a reservation.

[0082] Step 7:

[0083] The server uses the booking site's API to complete the booking process and confirm the reservation for the selected hotel.

[0084] Directions

[0085] Step 1:

[0086] The user enters their current location and destination. For example, they might enter "Kyoto Station" and "Kinkaku-ji Temple".

[0087] Step 2:

[0088] The terminal sends the entered information to the server.

[0089] Step 3:

[0090] The server calls a map API to calculate the optimal route.

[0091] Step 4:

[0092] The server sends the calculation results (route, distance, travel time, mode of transport, etc.) to the terminal.

[0093] Step 5:

[0094] The device displays route information to the user. The user can then view detailed directions (e.g., maps, instructions on using public transportation, etc.).

[0095] Tourist guide

[0096] Step 1:

[0097] The user selects a tourist destination they want to visit. Example: Select "Kiyomizu-dera Temple".

[0098] Step 2:

[0099] The device sends information about the selected tourist destination to the server.

[0100] Step 3:

[0101] The server retrieves detailed information about tourist destinations from an internal database or an external API.

[0102] Step 4:

[0103] The server organizes the information it has acquired and sends tourist guide information to the terminal.

[0104] Step 5:

[0105] The device displays tourist information to the user, such as history, points of interest, opening hours, and admission fees.

[0106] Recommended souvenirs and restaurants

[0107] Step 1:

[0108] The user enters their desired souvenir or restaurant criteria. For example, they might enter "Souvenirs under 1,000 yen" or "Restaurant serving local cuisine."

[0109] Step 2:

[0110] The terminal sends the entered conditions to the server.

[0111] Step 3:

[0112] The server searches for stores that meet the specified criteria from its database or partner APIs.

[0113] Step 4:

[0114] The server organizes the search results and creates a list of the best stores.

[0115] Step 5:

[0116] The server sends the store list to the terminal.

[0117] Step 6:

[0118] The device displays a list of stores to the user. The user selects the desired souvenir or restaurant and checks the details.

[0119] Automatic generation of travel diaries

[0120] Step 1:

[0121] The user chooses to automatically generate a travel diary at the end of their trip.

[0122] Step 2:

[0123] The device sends the user's selection to the server.

[0124] Step 3:

[0125] The server collects data gathered during the trip (for example, tourist destinations visited, activities experienced, accommodations, meals eaten, etc.).

[0126] Step 4:

[0127] The server automatically generates a travel diary based on the collected data.

[0128] Step 5:

[0129] The server sends the generated travel diary to the device.

[0130] Step 6:

[0131] The device displays the generated travel diary to the user and provides an interface for making corrections as needed.

[0132] (Example 1)

[0133] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0134] There is a need for a single, integrated system that can efficiently manage everything from travel planning and booking to transportation, access to tourist information, souvenir and restaurant selection, and post-trip record-keeping. Current systems require managing each of these elements individually, resulting in cumbersome operation and a burden on users. Therefore, the challenge is to provide a system that consistently supports the entire travel process and significantly improves user convenience.

[0135] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0136] In this invention, the server includes means for the user to input the travel destination, itinerary, and budget; means for automatically generating an optimal travel plan based on the input information; means for presenting the automatically generated travel plan to the user; means for the user to confirm and modify the presented travel plan; means for the user to input the user's current location and destination; means for calculating the optimal route based on the input information; means for presenting the calculated route to the user; means for inputting information about tourist destinations the user wishes to visit; means for collecting and presenting detailed information about the tourist destinations; means for inputting the user's desired souvenir and restaurant conditions; means for collecting and presenting store information that matches the conditions; means for automatically generating the user's travel record; and means for presenting and modifying the automatically generated travel record to the user. This makes it possible to consistently support the user from planning and booking a trip to transportation, referencing tourist information, selecting souvenirs and restaurants, and creating a post-trip record, thereby greatly improving user convenience.

[0137] A "user" is an individual or group that uses this system to plan and execute a trip.

[0138] A "destination" refers to a geographical location that a user sets as their travel destination.

[0139] "Schedule" refers to the period from the user's start date to the end date of their trip.

[0140] "Budget" refers to the amount of money a user can spend on a trip.

[0141] "Means" refers to equipment, software, or processes used to perform a specific operation or function.

[0142] A "database" is an organized collection of data used to manage user input information and other related information.

[0143] An "API" refers to an application programming interface used to access external services and data and achieve interoperability.

[0144] A "travel plan" refers to a travel itinerary that is planned based on the destination, dates, and budget.

[0145] "Accommodation" refers to hotels and other residential facilities that users book for their stay during their travels.

[0146] A "booking site" refers to a website or service that allows users to make online reservations for accommodations, transportation, and other services.

[0147] "Current location" refers to the user's physical location at that moment.

[0148] A "route" refers to the optimal route or means of transportation from your current location to your destination.

[0149] A "tourist destination" refers to a place that users would like to visit during their travels, and which has historical, cultural, or natural attractions.

[0150] "Souvenirs" refer to goods or items purchased during a trip and taken home.

[0151] "Restaurant" refers to a facility that users visit to eat.

[0152] A "travel log" refers to documents or data that record events experienced and places visited by a user during a trip.

[0153] The travel support system of this invention is a system that allows users to centrally manage everything from planning and booking trips to transportation, accessing tourist information, selecting souvenirs and restaurants, and creating post-trip records. This system is realized by a terminal with a user interface, a server that processes data, and by linking with external databases and APIs.

[0154] First, the user enters their travel destination, dates, and budget through the terminal's input interface. This allows the user to easily send basic travel information to the server. For example, the user might set the destination to "Kyoto," the dates to "October 10th to October 12th," and the budget to "50,000 yen." This information is then sent from the terminal to the server.

[0155] Based on the information received, the server collects relevant information from databases and external APIs (e.g., map service API, hotel reservation API). Using this information, the server automatically generates an optimal travel plan using a generative AI model. For example, a 3-night, 4-day travel plan within Kyoto city limits, costing under 50,000 yen, with accommodation in a 3-star hotel in the city center.

[0156] The generated travel plan is sent from the server to the terminal and presented to the user. The user can review this plan on the terminal and make modifications as needed. For example, it can flexibly accommodate requests such as "I want a more luxurious hotel" or "I want to change the order of the sightseeing spots."

[0157] When a user specifies their desired accommodation conditions, such as "3-star hotel," "city center," and "under 10,000 yen per night," the server uses the API of a partner booking site to search for accommodations that match those conditions. The retrieved information is displayed on the terminal, and the user selects their desired accommodation and proceeds with the booking process. The server confirms the booking through the booking site's API and sends the confirmation information to the terminal.

[0158] During travel, users enter their current location and destination into their device and request route information from the server. For example, if they enter "Current location: Kyoto Station" and "Destination: Kinkaku-ji Temple," the server uses a map service API to calculate the optimal route and sends detailed route information (map, distance, estimated travel time, public transport usage, etc.) to their device. Users can then use this information to travel smoothly.

[0159] Furthermore, when a user searches for information on a tourist destination they wish to visit, selecting a specific destination triggers the server to collect detailed information about the destination (history, points of interest, opening hours, admission fees, etc.) from its internal database and external APIs, and display it on the user's device. For example, selecting "Kiyomizu-dera Temple" will immediately display detailed information about Kiyomizu-dera.

[0160] When a user searches for souvenirs or restaurants during their trip, they enter their desired criteria. For example, if they enter conditions such as "souvenirs under 1,000 yen" or "restaurants serving local cuisine," the server will collect information on relevant establishments based on these criteria and display it as a list on their device. The user can then select from this list and obtain detailed information.

[0161] After the trip ends, users can choose to have their travel diary automatically generated. The server uses an AI model to automatically generate the travel diary based on data accumulated during the trip (visited tourist spots, activities experienced, accommodations, meals, etc.). The generated diary is sent to the user's device, where they can review and revise it as needed.

[0162] Examples of prompt statements:

[0163] "I would like to travel to Kyoto from October 10th to October 12th. My budget is 50,000 yen. Please suggest the best travel plan based on this information."

[0164] This system allows users to efficiently manage the entire travel process within a single integrated system. It provides consistent support for everything from travel planning, booking, transportation, access to tourist information, souvenir and meal selection, to post-trip record-keeping, significantly improving user convenience.

[0165] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0166] Step 1:

[0167] The user enters their travel destination, dates, and budget into the device. Specific examples of input fields include "Destination: Kyoto," "Dates: October 10th to October 12th," and "Budget: 50,000 yen." The device then sends this information to the server.

[0168] input:

[0169] destination

[0170] schedule

[0171] budget

[0172] output:

[0173] User input data is sent to the server.

[0174] Specific actions:

[0175] When a user enters information into the input form on their device and presses the "Submit" button, this information is sent to the server as an HTTP request.

[0176] Step 2:

[0177] Based on the user information received by the server, it collects relevant information from the database and external APIs. For example, it retrieves hotel information from the database and transportation and tourist information from external APIs (map service API, accommodation reservation API).

[0178] input:

[0179] User input data (destination, dates, budget)

[0180] output:

[0181] Relevant information collected from databases and external APIs

[0182] Specific actions:

[0183] The server analyzes the received input data, issues queries to its internal database, and sends requests to external APIs to collect information. The collected information is then integrated within the server.

[0184] Step 3:

[0185] Based on the information collected by the server, an AI model is used to automatically generate the optimal travel plan.

[0186] input:

[0187] Collected relevant information (hotel information, transportation information, tourist information, etc.)

[0188] output:

[0189] Automatically generated travel plan

[0190] Specific actions:

[0191] The collected information is input into the AI ​​model on the server, and the prompt "Destination: Kyoto, Dates: October 10th to October 12th, Budget: Please propose the best travel plan based on 50,000 yen" is used. The generated travel plan is saved on the server.

[0192] Step 4:

[0193] The server generates a travel plan and sends it to the device. The device then presents it to the user, who can review and modify it.

[0194] input:

[0195] Automatically generated travel plan

[0196] output:

[0197] Travel plans presented to the user

[0198] Specific actions:

[0199] The server sends the generated travel plan to the terminal, which then displays its contents to the user. The user can review the displayed plan and make any necessary modifications.

[0200] Step 5:

[0201] The user enters their desired accommodation criteria. For example, "3-star hotel," "city center," and "under 10,000 yen per night." The device then sends these criteria to the server.

[0202] input:

[0203] Desired conditions for the remitter

[0204] output:

[0205] Preferred conditions of the hotel sent to the server

[0206] Specific actions:

[0207] When a user enters criteria into the accommodation search form on their device and presses the "Search" button, these criteria are sent to the server as an HTTP request.

[0208] Step 6:

[0209] The server searches for accommodations that match the user's desired criteria using the API of partner booking sites, and sends the results to the user's device.

[0210] input:

[0211] Desired conditions for the remitter

[0212] output:

[0213] List of accommodations that meet the criteria

[0214] Specific actions:

[0215] The server sends a request to the reservation site API based on the received request conditions, performs a search, and receives the results.

[0216] Step 7:

[0217] The terminal displays a list of accommodation information received by the user, who then selects their preferred accommodation. The user confirms their selection and proceeds with the booking process.

[0218] input:

[0219] List of accommodations that meet the criteria

[0220] output:

[0221] Reservation information for the accommodation selected by the user

[0222] Specific actions:

[0223] The user selects their desired hotel from the list of accommodations displayed on their device and presses the "Confirm Reservation" button, which sends the reservation information to the server.

[0224] Step 8:

[0225] The server confirms the reservation process through the API of the partnered reservation site and sends the reservation information to the terminal.

[0226] input:

[0227] Reservation information for the accommodation selected by the user

[0228] output:

[0229] Confirmed reservation information

[0230] Specific actions:

[0231] The server uses the reservation site API to confirm the reservation and sends the confirmation information to the terminal.

[0232] Step 9:

[0233] The user enters their current location and destination, and requests route information from the server. For example, the user might enter "Kyoto Station" as their current location and "Kinkaku-ji Temple" as their destination.

[0234] input:

[0235] Current location and destination

[0236] output:

[0237] Route information request sent to the server

[0238] Specific actions:

[0239] When a user enters their current location and destination into the route search form on their device and presses the "Search" button, this information is sent to the server.

[0240] Step 10:

[0241] Based on the current location and destination information received by the server, the optimal route is calculated using a map service API, and detailed route information is sent to the terminal.

[0242] input:

[0243] Current location and destination

[0244] output:

[0245] Optimal route information

[0246] Specific actions:

[0247] The server inputs the current location and destination information into a map service API and calculates the optimal route. The resulting route information (map, distance, estimated travel time, information on using public transportation, etc.) is then sent to the terminal.

[0248] Step 11:

[0249] The user enters information about the tourist destination they want to visit into the terminal and requests that information from the server. For example, they might select "Kiyomizu-dera Temple".

[0250] input:

[0251] Tourist destinations I want to visit

[0252] output:

[0253] Tourist destination information request sent to the server

[0254] Specific actions:

[0255] When a user enters the name of a tourist destination they want to visit into the tourist destination search form on their device and presses the "Search" button, this information is sent to the server.

[0256] Step 12:

[0257] The server uses internal databases and external APIs to collect detailed information about tourist destinations and transmit it to the terminal.

[0258] input:

[0259] Tourist destinations I want to visit

[0260] output:

[0261] Detailed information about tourist attractions

[0262] Specific actions:

[0263] The server inputs information about the tourist destination you wish to visit into its internal database and external APIs, collects detailed information such as the history, attractions, opening hours, and admission fees of the tourist destination, and sends it to your device.

[0264] Step 13:

[0265] The user enters their desired souvenir or restaurant criteria into a terminal and requests that information from the server. For example, "souvenirs under 1,000 yen" or "restaurants serving local cuisine."

[0266] input:

[0267] Conditions for souvenirs and restaurants

[0268] output:

[0269] Souvenir and restaurant information request sent to the server

[0270] Specific actions:

[0271] When a user enters their desired criteria into the search form on their device and presses the "Search" button, this information is sent to the server.

[0272] Step 14:

[0273] The server searches for relevant stores from its partner store information database based on the user's preferences and sends that information to the terminal.

[0274] input:

[0275] Conditions for souvenirs and restaurants

[0276] output:

[0277] List of relevant store information

[0278] Specific actions:

[0279] The server inputs the desired conditions into the partnered store information database and conducts a search. It obtains a list of corresponding stores and transmits it to the terminal.

[0280] Step 15:

[0281] The user selects the automatic generation of a travel diary and sends a request to the server. A travel diary is generated based on the data collected during the trip.

[0282] Input:

[0283] Request for automatic generation of travel diary

[0284] Output:

[0285] Travel diary generation request sent to the server

[0286] Specific operation:

[0287] This request is sent to the server when the user selects "Automatic Generation of Travel Diary" from the terminal menu and presses the "Generate" button.

[0288] Step 16:

[0289] The server automatically generates a travel diary using the generation AI model based on the data collected during the trip and transmits the result to the terminal.

[0290] Input:

[0291] Data collected during the trip

[0292] Output:

[0293] Automatically generated travel diary

[0294] Specific operation:

[0295] The server inputs data collected during the trip (visited tourist spots, activities experienced, accommodations, meals, etc.) into an AI model to automatically generate a travel diary. The generated travel diary is sent to the user's device, and the user can modify and save it as needed.

[0296] (Application Example 1)

[0297] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0298] Traditional travel support systems provided functions such as user travel plan creation, accommodation booking, directions, tourist guides, and automatic generation of travel diaries. However, these functions were specialized for travel and difficult to apply to other uses. Furthermore, there was a need for a system that could comprehensively manage and optimize operations in a logistics center within a single system. In particular, the challenge was to integrate and process functions such as delivery route optimization, inventory management, pallet placement, picking list generation, worker movement optimization, and automatic generation of inventory inflow and outflow reports.

[0299] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0300] In this invention, the server includes means for the user to input the travel destination, itinerary, and budget; means for automatically generating an optimal travel plan based on the input information; means for presenting the automatically generated travel plan to the user; means for the user to confirm and modify the presented travel plan; means for centrally managing and optimizing operations within the logistics center; means for optimizing delivery routes; means for managing inventory within the warehouse; means for optimally arranging pallets and shelves; means for generating picking lists; means for optimizing worker movement; and means for automatically generating inventory inflow and outflow reports. This enables comprehensive optimization of operations within a logistics center using a single system, resulting in efficient operation.

[0301] "Travel destination" refers to information indicating the place where the user wants to go.

[0302] "Schedule" refers to information indicating the period during which the user will travel.

[0303] "Budget" refers to the amount of money that the user plans to spend on the trip.

[0304] "Optimal travel plan" refers to a travel plan that is calculated and generated based on the user's input information and is the most efficient and satisfactory.

[0305] "Logistics center" refers to a facility where operations such as storage, sorting, and distribution of goods and materials are concentrated.

[0306] "Means for collectively managing and optimizing operations" refers to means for integrally managing the entire business process within the logistics center and achieving efficiency improvements.

[0307] "Means for optimizing the delivery route" refers to means for calculating and optimizing the delivery route of goods in the shortest distance or shortest time.

[0308] "Means for managing the inventory in the warehouse" refers to means for efficiently managing the quantity and location of the inventory items stored in the warehouse.

[0309] "Means for optimally arranging pallets and shelves" refers to means for efficiently arranging pallets and shelves and maximizing the use of space.

[0310] "Means for generating a picking list" refers to means for listing the goods required for orders or shipments and efficiently performing picking.

[0311] "Means for optimizing the flow line of workers" refers to means for optimizing the route along which workers move within the warehouse or logistics center and reducing unnecessary movement.

[0312] "Methods for automatically generating inventory inflow and outflow reports" refers to methods for automatically generating reports based on information about inventory inflows and outflows.

[0313] Modes for carrying out the invention

[0314] System Overview

[0315] The system according to the present invention provides multiple functions in an integrated manner to streamline operations within a logistics center. This system applies travel support system technology to logistics operations and includes the following main functions:

[0316] 1. Optimization of delivery routes

[0317] 2. Inventory management within the warehouse

[0318] 3. Optimal placement of pallets and shelves

[0319] 4. Generating a picking list

[0320] 5. Optimizing worker movement patterns

[0321] 6. Automatic generation of inventory in / out reports

[0322] Hardware and software used

[0323] The system consists of devices such as servers, terminals, and robots. The specific hardware and software used include the following:

[0324] Server: The central component that processes data and performs optimization calculations based on user input.

[0325] Device: A device used by a user to input information and display results. Examples: smartphone, tablet.

[0326] Robot: A device that performs picking and placement tasks within a logistics center.

[0327] Software: Programming languages ​​such as Python and JavaScript (registered trademark), libraries for API requests (e.g., requests), and database management systems (e.g., MySQL (registered trademark)).

[0328] Process Overview

[0329] 1. Optimization of delivery routes

[0330] The server calculates the optimal delivery route based on the current location and destination. A map API is used to suggest the shortest distance or shortest time route. The calculation results are sent to the terminal or robot for execution.

[0331] Example prompt:

[0332] "Please generate the optimal picking route within the warehouse."

[0333] 2. Inventory management within the warehouse

[0334] The server manages the quantity and location information of inventory items. When inbound and outbound information is entered by users, the inventory database is updated. This makes it possible to monitor inventory status in real time.

[0335] Example prompt:

[0336] "Please display the current stock quantity and location of item ID 001."

[0337] 3. Optimal placement of pallets and shelves

[0338] The server calculates the optimal placement of pallets and shelves to maximize space utilization within the warehouse. This reduces wasted space and enables efficient storage.

[0339] 4. Generating a picking list

[0340] The server automatically generates a picking list based on the order information. The picking list is sent to terminals or robots, enabling efficient picking operations.

[0341] 5. Optimizing worker movement patterns

[0342] The server calculates the optimal movement path based on the worker's current task and travel route. This reduces unnecessary movement and improves work efficiency.

[0343] 6. Automatic generation of inventory in / out reports

[0344] The server automatically generates periodic inventory inflow and outflow reports based on inventory inflow and outflow information. This ensures transparency in inventory management and enables efficient operation.

[0345] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0346] Step 1:

[0347] Users input warehouse inventory information into a terminal. This includes information such as the ID, quantity, and location of each item. The input data is sent to a server, which stores the data in a database. The inventory management system updates this data in real time and uses it for subsequent processing.

[0348] Step 2:

[0349] The user requests optimization of a specific delivery route. They enter their current location and destination on their device and send this information to the server. The server uses a map API to calculate the optimal route based on this input data. The calculation results generate route information for the shortest distance or shortest time, which is then sent to the device and the robot. The robot operates based on this route information.

[0350] Step 3:

[0351] The server optimizes the placement of pallets and shelves within the warehouse. In this step, it runs an algorithm based on inventory information and warehouse space data to calculate the most efficient placement plan. The calculation results are output to the terminal as a proposed placement.

[0352] Step 4:

[0353] The user requests the generation of a picking list for a specific order. They enter the order ID into a terminal and send that information to the server. The server generates a list of necessary items based on the order data, and creates a picking list that also includes information about the shelves where those items are located. The picking list is sent to the terminal or robot, and the picking operation is carried out efficiently.

[0354] Step 5:

[0355] The server optimizes the worker's movement. It collects information on the worker's current location and the task they are currently performing, and runs an algorithm to calculate the most efficient movement path. The calculation result is output to the terminal as the optimal travel path, and the worker performs their work according to that path.

[0356] Step 6:

[0357] The server automatically generates inventory inflow and outflow reports on a regular basis. It collects inventory inflow and outflow information, performs data analysis, and creates reports. The generated reports are sent to terminals, where users can view them. This improves the transparency and efficiency of inventory management.

[0358] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0359] The travel support system according to the present invention generates an optimal travel plan, makes accommodation reservations, provides directions, guides tourists, recommends souvenirs and restaurants, and automatically generates a travel diary, based on user input information and emotional information recognized by an emotion engine. This system is realized by a terminal with a user interface, a server that processes data, and by linking with external databases and APIs.

[0360] 1. User travel plan creation

[0361] The user enters their travel destination, dates, and budget into their device. The server receives the input information and collects relevant information from databases and external APIs. For example, if the user enters "Kyoto" as the destination, "October 10th to October 12th" as the dates, and "50,000 yen" as the budget, the server automatically generates the most suitable hotels, sightseeing spots, and transportation options based on this information. Furthermore, an emotion engine recognizes the user's emotional state and customizes the travel plan, for example, suggesting a relaxing itinerary if the user is feeling stressed. The generated plan is sent to the device, where the user can review and modify it.

[0362] 2. Hotel Reservation

[0363] The user enters their desired accommodation criteria. For example, if the user enters "3-star hotel," "city center," and "under 10,000 yen per night," the server searches affiliated booking sites and lists hotels that match the criteria. Based on the emotional information recognized by the emotion engine, if, for example, the user is detected as tired, it will suggest hotels with ample relaxation facilities. Information on the relevant hotels is displayed on the terminal, and the user selects their preferred hotel and proceeds with the booking process. The server confirms the booking process through the booking site's API.

[0364] 3. Directions

[0365] The user enters their current location and destination. For example, if the current location is "Kyoto Station" and the destination is "Kinkaku-ji Temple," the server uses a map API to calculate the optimal route. The emotion engine suggests routes that reduce the user's current fatigue and stress levels, such as routes that avoid crowds and include rest stops. The calculated route information is sent to the device and displayed to the user. Details such as the map, distance, estimated travel time, and how to use public transport are displayed.

[0366] 4. Tourist Guide

[0367] The user selects a tourist destination they wish to visit. For example, if they select "Kiyomizu-dera Temple," the server gathers detailed information about Kiyomizu-dera from its internal database and external APIs. An emotion engine then customizes the information based on the user's interests and emotions, for example, highlighting natural attractions for users who want to relax. The collected information is displayed on the device for easy access by the user.

[0368] 5. Recommendations for souvenirs and restaurants

[0369] The user enters their desired souvenir or restaurant criteria. For example, if they enter "souvenirs under 1,000 yen" and "restaurant serving local cuisine," the server collects information on stores that match the criteria. An emotion engine customizes the information based on the user's preferences and mood; for example, if the user is tired, it might suggest a relaxing cafe. A list of suitable stores is displayed on the terminal, and the user can select the souvenir or restaurant that best suits their needs.

[0370] 6. Automatic generation of travel diaries

[0371] At the end of the trip, the user can choose to have a travel diary automatically generated. The server automatically generates the travel diary based on the data collected during the trip. For example, details such as the tourist spots visited, activities experienced, accommodations, and meals are automatically generated as text. An emotion engine reflects the user's emotional changes during the trip, customizing the diary content by highlighting important emotional moments. The generated travel diary is sent to the device, where the user can review and edit it as needed.

[0372] In this way, by combining user input information with emotional information recognized by the emotion engine, this system can seamlessly manage the entire travel process and provide the user with the optimal travel experience.

[0373] The following describes the processing flow.

[0374] User travel plan creation

[0375] Step 1:

[0376] The user enters their travel destination, dates, and budget. For example, they might enter "Kyoto," "October 10th to October 12th," and "50,000 yen."

[0377] Step 2:

[0378] The terminal sends the entered information to the server.

[0379] Step 3:

[0380] The server activates the emotion engine to recognize the user's current emotional state. If the user is feeling stressed, it retrieves that information.

[0381] Step 4:

[0382] The server retrieves the necessary data for generating travel plans from databases and external APIs. For example, this includes tourist attractions in Kyoto, accommodations, and transportation options.

[0383] Step 5:

[0384] Based on data acquired by the server, the system automatically generates an optimal travel plan tailored to the user's emotional state. For example, if the user is feeling stressed, it will suggest a plan that includes many relaxing activities.

[0385] Step 6:

[0386] The server sends the generated travel plan to the device.

[0387] Step 7:

[0388] The device displays the travel plan to the user. The user can review the plan details and modify them as needed.

[0389] Hotel Reservations

[0390] Step 1:

[0391] The user enters their desired accommodation criteria. For example, they might enter "3-star hotel," "city center," and "under 10,000 yen per night."

[0392] Step 2:

[0393] The terminal sends the entered conditions to the server.

[0394] Step 3:

[0395] The server uses an emotion engine to recognize the user's emotional state. For example, it might recognize that the user is tired.

[0396] Step 4:

[0397] The server calls the API of a partner booking site to search for hotels that meet the specified criteria.

[0398] Step 5:

[0399] The server organizes the search results and lists suitable hotels based on the results of the sentiment engine. For example, it might prioritize hotels with ample relaxation facilities.

[0400] Step 6:

[0401] The server sends the hotel list to the terminal.

[0402] Step 7:

[0403] The terminal displays a list of hotels to the user. The user selects their desired hotel and proceeds with the booking process.

[0404] Step 8:

[0405] The server uses the booking site's API to complete the booking process and confirm the reservation for the selected hotel.

[0406] Directions

[0407] Step 1:

[0408] The user enters their current location and destination. For example, they might enter "Kyoto Station" and "Kinkaku-ji Temple".

[0409] Step 2:

[0410] The terminal sends the entered information to the server.

[0411] Step 3:

[0412] The server uses an emotion engine to recognize the user's emotional state. For example, it might recognize that the user is tired.

[0413] Step 4:

[0414] The server calls a map API to calculate the optimal route. Depending on the user's emotional state, it suggests routes that avoid congestion or include rest stops.

[0415] Step 5:

[0416] The server sends the calculation results to the terminal.

[0417] Step 6:

[0418] The device displays route information to the user. Detailed information such as maps, distance, estimated travel time, and instructions on using public transportation are shown.

[0419] Tourist guide

[0420] Step 1:

[0421] The user selects a tourist destination they want to visit. Example: Select "Kiyomizu-dera Temple".

[0422] Step 2:

[0423] The device sends information about the selected tourist destination to the server.

[0424] Step 3:

[0425] The server uses an emotion engine to recognize the user's emotional state. For example, it recognizes that the user wants to relax.

[0426] Step 4:

[0427] The server retrieves information about tourist destinations from internal databases and external APIs.

[0428] Step 5:

[0429] The server organizes the information it has gathered and customizes it based on the user's emotional state, highlighting relaxing sights and activities.

[0430] Step 6:

[0431] The server sends tourist guide information to the terminal.

[0432] Step 7:

[0433] The device displays tourist guide information to the user, including history, points of interest, opening hours, and admission fees.

[0434] Recommended souvenirs and restaurants

[0435] Step 1:

[0436] The user enters their desired souvenir or restaurant criteria. For example, they might enter "Souvenirs under 1,000 yen" or "Restaurant serving local cuisine."

[0437] Step 2:

[0438] The terminal sends the entered conditions to the server.

[0439] Step 3:

[0440] The server uses an emotion engine to recognize the user's emotional state. For example, it recognizes that the user wants to relax.

[0441] Step 4:

[0442] The server searches for store information that matches the specified criteria from the database or affiliated APIs.

[0443] Step 5:

[0444] The server organizes search results and suggests the most suitable stores based on the user's emotional state, prioritizing relaxing cafes and shops.

[0445] Step 6:

[0446] The server sends the store list to the terminal.

[0447] Step 7:

[0448] The device displays a list of stores to the user. This list includes store names, addresses, opening hours, and details about products and menus.

[0449] Automatic generation of travel diaries

[0450] Step 1:

[0451] The user chooses to automatically generate a travel diary at the end of their trip.

[0452] Step 2:

[0453] The device sends the user's selection to the server.

[0454] Step 3:

[0455] The server collects data during the trip (such as tourist destinations visited, activities experienced, accommodations, and meals eaten).

[0456] Step 4:

[0457] The server uses an emotion engine to analyze the user's emotional changes during their trip.

[0458] Step 5:

[0459] The server automatically generates a travel diary based on collected data and emotional information. It highlights important emotional moments and creates a detailed diary.

[0460] Step 6:

[0461] The server sends the generated travel diary to the device.

[0462] Step 7:

[0463] The device displays the generated travel diary to the user and provides an interface that allows the user to modify it as needed.

[0464] (Example 2)

[0465] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0466] Traditional travel support systems provide simple plans without considering the user's emotional state, lacking customization to suit individual user feelings and preferences. Furthermore, they lacked sufficient integrated support for users to seamlessly plan trips, book accommodations, and get directions. As a result, users often had to expend considerable time and effort to achieve a better travel experience.

[0467] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server is

[0468] A means for users to input their travel destination, dates, and budget,

[0469] A means for automatically generating an optimal travel plan based on the input information,

[0470] A means for presenting the automatically generated travel plan to the user,

[0471] A means for the user to review and modify the aforementioned travel plan,

[0472] A means of recognizing the user's emotional state using an emotion engine and customizing travel plans,

[0473] This includes providing optimal travel plans that take into account the user's emotional state.

[0474] Also, the server,

[0475] A means for users to enter their desired accommodation conditions,

[0476] A means of obtaining information from affiliated reservation sites based on the aforementioned entered conditions,

[0477] A means of presenting the acquired information to the user and confirming the reservation,

[0478] A means of suggesting accommodations based on the user's emotional state using an emotion engine,

[0479] This includes enabling accommodation suggestions and bookings based on user sentiment.

[0480] Furthermore, the server,

[0481] A means for the user to input their current location and destination,

[0482] A means for calculating the optimal route based on the input information,

[0483] Means for presenting the calculated route to the user,

[0484] A means of customizing the path based on the user's emotional state using an emotion engine,

[0485] This includes providing the optimal path tailored to the user's emotional state.

[0486] These measures provide an integrated travel support system that utilizes an emotion engine to consider the user's emotional state, allowing users to have a more satisfying travel experience.

[0487] A "user" is an individual or group that uses the system to create, review, or modify travel plans.

[0488] A "terminal" is an electronic device used by a user to input information and receive information from a system.

[0489] A "server" is a central processing unit that receives input information from users and performs tasks such as generating travel plans, collecting data, and analyzing it using an emotion engine.

[0490] A "travel plan" refers to information such as itineraries, accommodations, and sightseeing spots that are automatically generated based on the user's input information and the results of the emotion engine's analysis.

[0491] An "emotion engine" is software or an algorithm that analyzes user input data and past data to recognize the user's emotional state and customize the plan accordingly.

[0492] "Customization" refers to individually adjusting the plans and information provided based on the user's emotional state and preferences.

[0493] A "database" is a digital storage system that stores travel-related information and allows it to be searched and retrieved as needed.

[0494] An "API" is an interface that enables communication with external services and databases, and is used for integration with partner reservation sites and map services.

[0495] A "booking site" is an online platform for booking accommodations, transportation, activities, and other similar services.

[0496] "Route" refers to the optimal means of transportation and route from the user's specified starting point to the destination.

[0497] "Recommendations" refer to the optimal options presented by the system based on the user's input information and emotional state.

[0498] A "travel diary" is a record of places visited, activities, and emotional changes during a trip, compiled in an automatically generated text format.

[0499] The travel support system according to the present invention is a system that generates an optimal travel plan, makes accommodation reservations, provides directions, guides tourists, recommends souvenirs and restaurants, and automatically generates a travel diary based on user input information and emotional information recognized by an emotion engine. This system is realized by a terminal with a user interface, a server that processes data, and by linking with external databases and APIs.

[0500] Users input information such as their travel destination, dates, and budget using their device. For example, if a user enters information such as "Kyoto," "October 10th to October 12th," and "50,000 yen," the server receives this information and collects relevant information from its database and external APIs. Based on the user's input, the server automatically generates a plan of the most suitable accommodations, sightseeing spots, and transportation. This system also uses an emotion engine to recognize the user's emotional state and can suggest plans that promote relaxation, for example.

[0501] Furthermore, it also has a function to search for accommodations based on conditions entered by the user. For example, if the user enters conditions such as "3-star hotel," "city center," and "under 10,000 yen per night," the server retrieves information through the API of partner booking sites and presents that information to the user. An emotion engine analyzes the user's emotional state and suggests relaxing hotels for tired users. Once the user selects a desired hotel and proceeds with the booking process, the server confirms the reservation through the booking site's API.

[0502] Furthermore, when a user enters their current location and destination, the server uses a map API to calculate the optimal route. For example, if the current location is entered as "Kyoto Station" and the destination as "Kinkaku-ji Temple," the server will suggest a route that avoids congestion and includes rest stops. This is also a result of the emotion engine taking the user's emotional state into consideration. The calculated route information is sent to the device, where a map, distance, estimated travel time, and information on using public transportation are displayed in detail.

[0503] The app also includes a tourist guide function; when a user selects a tourist destination they wish to visit, the server collects detailed information from an internal database and external APIs. For example, if "Kiyomizu-dera Temple" is selected, the emotion engine customizes the information based on the user's interests and emotions, providing users who want to relax with a focus on natural attractions. The collected information is displayed on the device for easy reference.

[0504] Furthermore, it also has a function to guide users to souvenirs and restaurants. When a user enters conditions such as "souvenirs under 1,000 yen" or "restaurants serving local cuisine," the server collects information on stores that match the conditions, and an emotion engine customizes the information based on the user's preferences and mood. For example, it suggests a relaxing cafe to a tired user. A list of relevant stores is displayed on the device, and the user can select souvenirs or restaurants that suit their needs.

[0505] At the end of the trip, if the user chooses to automatically generate a travel diary, the server will automatically generate a travel diary based on the data collected during the trip. For example, details such as the tourist attractions visited, activities experienced, accommodations, and meals eaten will be automatically generated as text. An emotion engine will reflect the user's emotional changes during the trip, customizing the diary content by highlighting important emotional moments. The generated travel diary is sent to the device, where the user can review and edit it as needed.

[0506] Example of a prompt

[0507] "Please create a sightseeing plan for a visit to Kyoto from October 10th to October 12th. The budget is 50,000 yen."

[0508] "Could you please give me directions from Kyoto Station to Kinkaku-ji Temple? I'd like to avoid the crowds."

[0509] "Could you tell me about some relaxing sights at Kiyomizu-dera Temple?"

[0510] In this way, by combining user input information with emotional information recognized by the emotion engine, the system seamlessly manages the entire travel process and provides the user with the optimal travel experience.

[0511] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0512] Step 1:

[0513] The user enters their travel destination, dates, and budget using the device's interface.

[0514] Specific action: The user enters "Kyoto," "October 10th to October 12th," and "50,000 yen" into the search field on their device and presses the send button.

[0515] Input: Travel destination, dates, budget

[0516] Output: Data sent from the terminal to the server based on user input.

[0517] Step 2:

[0518] The server receives user input and collects relevant information from databases and external APIs.

[0519] Specific operation: The server uses the entered information "Kyoto," "October 10th to October 12th," and "50,000 yen" to collect data on accommodations, tourist attractions, and transportation.

[0520] Input: User-entered travel destination, dates, and budget information.

[0521] Output: Information on the best accommodations, tourist attractions, and transportation options.

[0522] Step 3:

[0523] The server uses an emotion engine to analyze user input and past data to recognize the user's emotional state.

[0524] Specific operation: The emotion engine analyzes whether the user is feeling stressed and suggests a relaxation plan that can reduce stress.

[0525] Input: User input information, historical data

[0526] Output: Recognition results of the user's emotional state

[0527] Step 4:

[0528] The server automatically generates the optimal travel plan based on the user's input information and the results of the emotion engine's analysis.

[0529] Specific operation: The server will create a plan that includes a stay at a three-star hotel in Kyoto, sightseeing at Kiyomizu-dera and Kinkaku-ji temples, and a visit to relaxing cafes.

[0530] Input: User input information, emotion engine analysis results, information from databases and external APIs.

[0531] Output: Auto-generated travel plan

[0532] Step 5:

[0533] The server generates a travel plan and sends it to the user's device, which then displays it.

[0534] Specific action: Plan details will be displayed as a pop-up on the device for the user to review.

[0535] Input: Auto-generated travel plan

[0536] Output: Display of travel plan

[0537] Step 6:

[0538] The user enters their desired accommodation criteria.

[0539] Specific action: The user enters "3-star hotel," "city center," and "under 10,000 yen per night," and presses the submit button.

[0540] Input: Desired accommodation conditions

[0541] Output: Data sent from the terminal to the server based on the conditions entered by the user.

[0542] Step 7:

[0543] The server uses the API of partner booking sites to collect hotel information that matches the specified criteria.

[0544] Specific operation: The server sends a query to partner sites and lists hotels that meet the criteria of "3-star hotel," "city center," and "under 10,000 yen per night."

[0545] Input: Desired accommodation conditions

[0546] Output: List of suggested hotels

[0547] Step 8:

[0548] The server uses an emotion engine to suggest hotels that take into account the user's emotional state.

[0549] Specific action: The emotion engine recognizes that the user is tired and suggests a hotel with a spa.

[0550] Input: Desired accommodation conditions, user's emotional state

[0551] Output: Hotel recommendations that reflect the user's emotional state.

[0552] Step 9:

[0553] The server sends suggested hotel information to the terminal, which then displays it.

[0554] Specific action: A list of suggested hotels is displayed on the device.

[0555] Input: Hotel suggestions that reflect the user's emotional state.

[0556] Output: List of hotels

[0557] Step 10:

[0558] The user selects their desired hotel and completes the booking process on their device. The server confirms the booking through the booking site's API.

[0559] Specific operation: When the user selects their desired hotel and presses the book button, the server processes the booking confirmation.

[0560] Input: Hotel information selected by the user

[0561] Output: Hotel reservation confirmed

[0562] Step 11:

[0563] The user enters their current location and destination.

[0564] Specific action: The user enters "Kyoto Station" and "Kinkaku-ji Temple".

[0565] Input: Current location and destination

[0566] Output: Data sent from the terminal to the server based on user input.

[0567] Step 12:

[0568] The server uses a map API to calculate the optimal route.

[0569] Specific operation: The server queries the map API and calculates the route.

[0570] Input: Current location and destination

[0571] Output: Optimal route information

[0572] Step 13:

[0573] The server uses an emotion engine to customize the route based on the user's emotional state.

[0574] Specific action: Suggest a route that includes rest stops to avoid congestion.

[0575] Input: User's emotional state, optimal route information

[0576] Output: Customized route information

[0577] Step 14:

[0578] The server sends the calculated route information to the terminal, and the terminal displays it.

[0579] Specific actions: The device displays a map, distance, estimated travel time, and instructions on using public transportation.

[0580] Input: Customized route information

[0581] Output: Display of route information

[0582] Step 15:

[0583] The user selects the tourist destination they want to visit.

[0584] Specific action: The user selects "Kiyomizu-dera Temple".

[0585] Input: Selection of tourist destination

[0586] Output: Data sent from the terminal to the server based on the information selected by the user.

[0587] Step 16:

[0588] The server collects detailed information about tourist destinations from internal databases and external APIs.

[0589] Specific operation: The server collects information about Kiyomizu-dera Temple from a database and external APIs.

[0590] Input: Tourist destination selection information

[0591] Output: Detailed information about tourist attractions

[0592] Step 17:

[0593] The server uses an emotion engine to provide information based on the user's interests and emotions.

[0594] Specific action: Provide users who want to enjoy nature with information about natural attractions that emphasize the natural environment.

[0595] Input: User interests and emotional state, detailed information about tourist destinations.

[0596] Output: Customized tourist destination information

[0597] Step 18:

[0598] The server sends the collected guide information to the terminal, and the terminal displays it.

[0599] Specific action: Detailed tourist information will be displayed on the device.

[0600] Input: Customized tourist destination information

[0601] Output: Display of tourist information

[0602] Step 19:

[0603] The user enters their desired souvenirs and restaurant preferences.

[0604] Specific action: The user enters "souvenirs under 1,000 yen" and "restaurant serving local cuisine".

[0605] Input: Conditions for souvenirs and restaurants

[0606] Output: Data sent from the terminal to the server based on the conditions entered by the user.

[0607] Step 20:

[0608] The server collects store information that matches the specified criteria from an external API.

[0609] Specific operation: The server sends a query to the partner API and retrieves store information that matches the criteria.

[0610] Input: Conditions for souvenirs and restaurants

[0611] Output: Relevant store information

[0612] Step 21:

[0613] The server uses an emotion engine to provide recommendations based on the user's preferences and mood.

[0614] Specific action: Suggest a relaxing cafe to tired users.

[0615] Input: User preferences and mood, store information

[0616] Output: Customized store information

[0617] Step 22:

[0618] The server sends the collected store information to the terminal, which then displays it.

[0619] Specific action: A list of recommended stores will be displayed on the device.

[0620] Input: Customized store information

[0621] Output: Display of store information

[0622] Step 23:

[0623] At the end of the trip, the user can choose to have a travel diary automatically generated.

[0624] Specific action: After the trip ends, the user selects "Automatically generate travel diary".

[0625] Input: Select option for automatic generation of travel diary

[0626] Output: Data sent from the terminal to the server containing user selection information.

[0627] Step 24:

[0628] The server automatically generates a travel diary based on data collected during the trip.

[0629] Specific operation: The server generates text based on information about tourist destinations, accommodations, and restaurants visited.

[0630] Input: Data collected during the trip

[0631] Output: Auto-generated travel diary

[0632] Step 25:

[0633] The server uses an emotion engine to customize the travel diary, highlighting important emotional moments and generating content.

[0634] Specific actions: Highlight and record in your diary moments that you particularly enjoyed.

[0635] Input: Data collected during the trip, results of emotion engine analysis

[0636] Output: Customized travel diary

[0637] Step 26:

[0638] The server generates a travel diary and sends it to the device, which then displays it.

[0639] Specific operation: A detailed travel diary is displayed on the device for the user to review.

[0640] Input: Customized travel diary

[0641] Output: Display of travel diary

[0642] (Application Example 2)

[0643] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0644] Traditional travel support systems required users to manually select and book travel plans and accommodations individually, which was a cumbersome process. Furthermore, they struggled to automatically adjust plans to suit the user's mood and fatigue level, and offered insufficient suggestions to reduce user fatigue, especially during long journeys and sightseeing. Additionally, real-time navigation and tourist information were not provided during vehicle travel, limiting user convenience.

[0645] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0646] In this invention, the server includes means for the user to input the travel destination, itinerary, and budget; means for automatically generating an optimal travel plan based on the input information; means for presenting the automatically generated travel plan to the user; means for the user to confirm and modify the presented travel plan; means for providing route information to an autonomous vehicle and guiding it to the destination; means for collecting and presenting information on tourist destinations the user will visit; and means for suggesting optimal sightseeing plans and rest spots based on the user's emotional state. This allows the user to manage all aspects of their trip in one place and enables an optimal travel experience and fatigue recovery based on their emotional state.

[0647] A "travel destination" is a place that a user plans to visit during their trip.

[0648] "Itinerary" refers to the period of time that includes the start and end dates of a trip.

[0649] "Budget" refers to the total cost of the trip, which is the amount the user plans to spend.

[0650] A "travel plan" is a plan that includes the travel itinerary, places to visit, means of transportation, and accommodations, which are automatically generated based on the user's input information.

[0651] An "autonomous vehicle" is a vehicle that can travel autonomously to its destination without the need for a human driver.

[0652] "Route information" refers to data about the travel route from the current location to the destination.

[0653] A "tourist destination" refers to a tourist spot or famous place that a user wishes to visit.

[0654] "Emotional state" refers to the user's current psychological and physiological state, including fatigue levels and stress levels.

[0655] A "rest stop" is a place where travelers can take a short break or refresh themselves during their trip.

[0656] "Accommodation facilities" refer to facilities such as hotels and inns where users stay during their travels.

[0657] A "booking site" is a website used to make online reservations for accommodations and other travel-related facilities.

[0658] A "navigation system" is a system that calculates the optimal route to a destination and provides real-time directions.

[0659] This invention is a system for improving the user's travel experience, and this system is realized by the following means and processes: The user inputs information such as travel destination, itinerary, and budget through a user interface. This information is sent from the terminal to a server, which automatically generates an optimal travel plan based on the above information. The generated plan is then sent back to the terminal and presented to the user.

[0660] The server first receives user input information and then collects relevant information through external databases and APIs. For example, if a user enters "City A" as the "travel destination," "January 1st to January 3rd" as the "dates," and "50,000 yen" as the "budget," the server automatically selects the most suitable accommodations, tourist attractions, and modes of transportation to generate a travel plan.

[0661] Furthermore, the system includes an emotion engine that detects the user's emotional state. The emotion engine analyzes the user's voice and facial expressions to assess their current psychological and physiological condition. Based on this information, the server dynamically customizes the travel plan, for example, suggesting relaxing activities if the user is feeling stressed.

[0662] During their trip, users can utilize self-driving vehicles. These vehicles provide directions to their destinations based on route information provided by a server. For example, if a user enters "Departure Point B" as their current location and "Tourist Spot C" as their destination, the server calculates the optimal route and sends it to the self-driving vehicle. At this time, an emotion engine can sense the user's fatigue level and suggest a route that includes rest stops along the way, for example.

[0663] As the vehicle approaches a tourist destination, information about that destination is provided to the user through monitors and audio systems inside the autonomous vehicle. The server collects detailed tourist destination information from internal databases and external APIs, and displays information customized according to the user's interests and feelings.

[0664] Furthermore, users can input information about restaurants they want to visit and souvenirs they want to buy during their trip. The server provides optimal store information based on the user's conditions and preferences. For example, by searching for "souvenirs under 1,000 yen" or "restaurants serving local cuisine," stores that match the criteria will be listed.

[0665] At the end of the trip, the server automatically generates a travel diary based on the data collected during the trip. This travel diary includes information on the tourist attractions visited, the activities experienced, and the accommodations, and also reflects the user's emotional changes. The generated travel diary is sent to the user's device, where they can review and edit it.

[0666] The program uses Python to communicate with APIs and perform data collection and calculations. The emotion engine utilizes speech analysis and facial recognition technologies, specifically OpenCV and Google Cloud's Emotional Analytics API. Google Maps API and OpenStreetMap API are used for navigation.

[0667] As a concrete example, the following prompt sentences can be input into the generating AI model:

[0668] "I would like to travel to City A between October 10th and October 12th, 2023, with a budget of 50,000 yen. Please suggest the best travel plan, including places where I can relax."

[0669] Therefore, this system can manage every aspect of a trip in one place and provide an optimal travel experience based on the user's emotional state.

[0670] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0671] Step 1:

[0672] The user enters their travel destination, dates, and budget into the device. Once the user enters this information, the device sends the data to the server. The entered information is provided to the server as text data.

[0673] Step 2:

[0674] The server collects relevant information from external databases and APIs based on the destination, dates, and budget received from the user. Specifically, it retrieves data such as hotel availability, tourist attraction details, and transportation options. Data processing at this stage involves tagging and formatting the collected data. As a result, a list of integrated travel plan candidates is generated.

[0675] Step 3:

[0676] The emotion engine analyzes the user's voice input and facial expression data to recognize the user's current emotional state. This recognized emotional information is used to customize the travel plan. For example, if the user is fatigued, relaxing activities will be included in the plan. After the emotional data is entered into the server, it is analyzed and tagged with the corresponding emotion.

[0677] Step 4:

[0678] The server generates an optimal travel plan based on the user's input information and emotional state. This plan includes accommodations, sightseeing spots, and transportation. The plan is generated using a generative AI model. Specifically, information that matches the user's preferences and emotional state is automatically selected. The generated travel plan is sent to the device in text format.

[0679] Step 5:

[0680] The terminal displays a generated travel plan to the user. The user reviews this plan and makes modifications as needed, such as changing accommodations or adding tourist attractions. The modified plan is sent back to the server for final confirmation. The user's modification information is sent to the server and reflected in the database.

[0681] Step 6:

[0682] When a user uses an autonomous vehicle, the server provides route information. The user enters their current location and destination into a terminal, and this data is sent to the server. Based on the entered information, the server calculates the optimal route and suggests a route that includes rest stops, depending on the user's emotional state. The calculated route is then sent to the autonomous vehicle.

[0683] Step 7:

[0684] Autonomous vehicles navigate to their destinations based on route information received from a server. Real-time directions are provided to the user through in-vehicle monitors and voice systems. As the vehicle approaches a tourist destination, information about that destination is displayed. Route information and tourist destination data are entered into the vehicle's navigation system and provided to the user.

[0685] Step 8:

[0686] At the end of the trip, if the user chooses to automatically generate a travel diary, the server will generate a diary based on the data collected during the trip. The diary will include information about the tourist spots the user visited, the activities they experienced, their accommodations, and a reflection of their emotional changes. The generated travel diary will be sent to the user's device in text format, where they can review and edit it.

[0687] Example of a prompt:

[0688] "I would like to travel to City A between October 10th and October 12th, 2023, with a budget of 50,000 yen. Please suggest the best travel plan, including places where I can relax."

[0689] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0690] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include those described above. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions shown by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0691] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0692] [Second Embodiment]

[0693] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0694] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0695] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0696] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0697] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0698] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0699] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0700] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0701] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0702] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0703] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0704] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0705] The travel support system according to the present invention generates an optimal travel plan, makes accommodation reservations, provides directions, tourist information, souvenir and restaurant recommendations, and automatically generates a travel diary, all based on the user's input of necessary information such as travel destination, itinerary, and budget. The system of the present invention is realized by a terminal with a user interface, a server that processes data, and by linking with an external database or API.

[0706] 1. User travel plan creation

[0707] The user enters their travel destination, dates, and budget into their device. The server receives this information and collects relevant data from its database and external APIs. For example, if the user enters "Kyoto" as the destination, "October 10th to October 12th" as the dates, and "50,000 yen" as the budget, the server automatically generates the most suitable hotel, sightseeing spots, and transportation options based on this information. The generated plan is sent to the user's device, where they can review and modify it.

[0708] 2. Hotel Reservation

[0709] The user enters their desired accommodation criteria. For example, if the user enters criteria such as "3-star hotel," "city center," and "under 10,000 yen per night," the server searches affiliated booking sites and lists hotels that match the criteria. The information of the relevant hotels is displayed on the terminal, and the user selects their desired hotel from the list and proceeds with the booking process. The server confirms the booking process through the booking site's API.

[0710] 3. Directions

[0711] The user enters their current location and destination. For example, if the current location is "Kyoto Station" and the destination is "Kinkaku-ji Temple," the server uses a map API to calculate the optimal route. The calculated route information is sent to the device and displayed to the user. Details such as the map, distance, estimated travel time, and information on using public transportation are displayed.

[0712] 4. Tourist Guide

[0713] The user selects a tourist destination they wish to visit. For example, if they select "Kiyomizu-dera Temple," the server collects detailed information about Kiyomizu-dera from its internal database and external APIs. This information includes the history of the tourist destination, its highlights, opening hours, and admission fees. The collected information is displayed on the device for easy access by the user.

[0714] 5. Recommendations for souvenirs and restaurants

[0715] The user enters their desired souvenir or restaurant criteria. For example, if they enter criteria such as "souvenirs under 1,000 yen" or "restaurant serving local cuisine," the server collects information on stores that match those criteria. A list of matching stores is displayed on the terminal, and the user can select the souvenir or restaurant that suits their needs.

[0716] 6. Automatic generation of travel diaries

[0717] At the end of the trip, the user can choose to have a travel diary automatically generated. The server automatically generates the travel diary based on the data collected during the trip. For example, details such as the tourist spots visited, activities experienced, accommodations, and meals are automatically generated as text and sent to the device. The user can review the generated diary and make corrections as needed.

[0718] This allows users to efficiently manage the entire travel process within a single integrated system. A key feature of this system is its consistent support for everything from travel planning, booking, transportation, access to tourist information, souvenir and meal selection, to creating travel records after the trip.

[0719] The following describes the processing flow.

[0720] User travel plan creation

[0721] Step 1:

[0722] The user enters their travel destination, dates, and budget. For example, they might enter "Kyoto," "October 10th to October 12th," and "50,000 yen."

[0723] Step 2:

[0724] The terminal sends the entered information to the server.

[0725] Step 3:

[0726] The server retrieves the necessary data for generating travel plans (e.g., popularity of tourist destinations, accommodation availability, transportation options, etc.) from a database or external API.

[0727] Step 4:

[0728] Based on data acquired by the server, the system automatically generates travel plans optimized for the user's conditions. Specifically, it creates plans that include combinations of tourist destinations, modes of transportation, and accommodations.

[0729] Step 5:

[0730] The server sends the generated travel plan to the device.

[0731] Step 6:

[0732] The device displays the travel plan to the user. The user can review the plan details and modify them as needed.

[0733] Hotel Reservations

[0734] Step 1:

[0735] The user enters their desired accommodation criteria. For example, they might enter "3-star hotel," "city center," and "under 10,000 yen per night."

[0736] Step 2:

[0737] The terminal sends the entered conditions to the server.

[0738] Step 3:

[0739] The server calls the API of a partner booking site to search for hotels that meet the specified criteria.

[0740] Step 4:

[0741] The server organizes the search results and creates a list of hotels that best match the criteria.

[0742] Step 5:

[0743] The server sends the hotel list to the terminal.

[0744] Step 6:

[0745] The device displays a list of hotels to the user. The user selects their desired hotel and makes a reservation.

[0746] Step 7:

[0747] The server uses the booking site's API to complete the booking process and confirm the reservation for the selected hotel.

[0748] Directions

[0749] Step 1:

[0750] The user enters their current location and destination. For example, they might enter "Kyoto Station" and "Kinkaku-ji Temple".

[0751] Step 2:

[0752] The terminal sends the entered information to the server.

[0753] Step 3:

[0754] The server calls a map API to calculate the optimal route.

[0755] Step 4:

[0756] The server sends the calculation results (route, distance, travel time, mode of transport, etc.) to the terminal.

[0757] Step 5:

[0758] The device displays route information to the user. The user can then view detailed directions (e.g., maps, instructions on using public transportation, etc.).

[0759] Tourist guide

[0760] Step 1:

[0761] The user selects a tourist destination they want to visit. Example: Select "Kiyomizu-dera Temple".

[0762] Step 2:

[0763] The device sends information about the selected tourist destination to the server.

[0764] Step 3:

[0765] The server retrieves detailed information about tourist destinations from an internal database or an external API.

[0766] Step 4:

[0767] The server organizes the information it has acquired and sends tourist guide information to the terminal.

[0768] Step 5:

[0769] The device displays tourist information to the user, such as history, points of interest, opening hours, and admission fees.

[0770] Recommended souvenirs and restaurants

[0771] Step 1:

[0772] The user enters their desired souvenir or restaurant criteria. For example, they might enter "Souvenirs under 1,000 yen" or "Restaurant serving local cuisine."

[0773] Step 2:

[0774] The terminal sends the entered conditions to the server.

[0775] Step 3:

[0776] The server searches for stores that meet the specified criteria from its database or partner APIs.

[0777] Step 4:

[0778] The server organizes the search results and creates a list of the best stores.

[0779] Step 5:

[0780] The server sends the store list to the terminal.

[0781] Step 6:

[0782] The device displays a list of stores to the user. The user selects the desired souvenir or restaurant and checks the details.

[0783] Automatic generation of travel diaries

[0784] Step 1:

[0785] The user chooses to automatically generate a travel diary at the end of their trip.

[0786] Step 2:

[0787] The device sends the user's selection to the server.

[0788] Step 3:

[0789] The server collects data gathered during the trip (for example, tourist destinations visited, activities experienced, accommodations, meals eaten, etc.).

[0790] Step 4:

[0791] The server automatically generates a travel diary based on the collected data.

[0792] Step 5:

[0793] The server sends the generated travel diary to the device.

[0794] Step 6:

[0795] The device displays the generated travel diary to the user and provides an interface for making corrections as needed.

[0796] (Example 1)

[0797] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0798] There is a need for a single, integrated system that can efficiently manage everything from travel planning and booking to transportation, access to tourist information, souvenir and restaurant selection, and post-trip record-keeping. Current systems require managing each of these elements individually, resulting in cumbersome operation and a burden on users. Therefore, the challenge is to provide a system that consistently supports the entire travel process and significantly improves user convenience.

[0799] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0800] In this invention, the server includes means for the user to input the travel destination, itinerary, and budget; means for automatically generating an optimal travel plan based on the input information; means for presenting the automatically generated travel plan to the user; means for the user to confirm and modify the presented travel plan; means for the user to input the user's current location and destination; means for calculating the optimal route based on the input information; means for presenting the calculated route to the user; means for inputting information about tourist destinations the user wishes to visit; means for collecting and presenting detailed information about the tourist destinations; means for inputting the user's desired souvenir and restaurant conditions; means for collecting and presenting store information that matches the conditions; means for automatically generating the user's travel record; and means for presenting and modifying the automatically generated travel record to the user. This makes it possible to consistently support the user from planning and booking a trip to transportation, referencing tourist information, selecting souvenirs and restaurants, and creating a post-trip record, thereby greatly improving user convenience.

[0801] A "user" is an individual or group that uses this system to plan and execute a trip.

[0802] A "destination" refers to a geographical location that a user sets as their travel destination.

[0803] "Schedule" refers to the period from the user's start date to the end date of their trip.

[0804] "Budget" refers to the amount of money a user can spend on a trip.

[0805] "Means" refers to equipment, software, or processes used to perform a specific operation or function.

[0806] A "database" is an organized collection of data used to manage user input information and other related information.

[0807] An "API" refers to an application programming interface used to access external services and data and achieve interoperability.

[0808] A "travel plan" refers to a travel itinerary that is planned based on the destination, dates, and budget.

[0809] "Accommodation" refers to hotels and other residential facilities that users book for their stay during their travels.

[0810] A "booking site" refers to a website or service that allows users to make online reservations for accommodations, transportation, and other services.

[0811] "Current location" refers to the user's physical location at that moment.

[0812] A "route" refers to the optimal route or means of transportation from your current location to your destination.

[0813] A "tourist destination" refers to a place that users would like to visit during their travels, and which has historical, cultural, or natural attractions.

[0814] "Souvenirs" refer to goods or items purchased during a trip and taken home.

[0815] "Restaurant" refers to a facility that users visit to eat.

[0816] A "travel log" refers to documents or data that record events experienced and places visited by a user during a trip.

[0817] The travel support system of this invention is a system that allows users to centrally manage everything from planning and booking trips to transportation, accessing tourist information, selecting souvenirs and restaurants, and creating post-trip records. This system is realized by a terminal with a user interface, a server that processes data, and by linking with external databases and APIs.

[0818] First, the user enters their travel destination, dates, and budget through the terminal's input interface. This allows the user to easily send basic travel information to the server. For example, the user might set the destination to "Kyoto," the dates to "October 10th to October 12th," and the budget to "50,000 yen." This information is then sent from the terminal to the server.

[0819] Based on the information received, the server collects relevant information from databases and external APIs (e.g., map service API, hotel reservation API). Using this information, the server automatically generates an optimal travel plan using a generative AI model. For example, a 3-night, 4-day travel plan within Kyoto city limits, costing under 50,000 yen, with accommodation in a 3-star hotel in the city center.

[0820] The generated travel plan is sent from the server to the terminal and presented to the user. The user can review this plan on the terminal and make modifications as needed. For example, it can flexibly accommodate requests such as "I want a more luxurious hotel" or "I want to change the order of the sightseeing spots."

[0821] When a user specifies their desired accommodation conditions, such as "3-star hotel," "city center," and "under 10,000 yen per night," the server uses the API of a partner booking site to search for accommodations that match those conditions. The retrieved information is displayed on the terminal, and the user selects their desired accommodation and proceeds with the booking process. The server confirms the booking through the booking site's API and sends the confirmation information to the terminal.

[0822] During travel, users enter their current location and destination into their device and request route information from the server. For example, if they enter "Current location: Kyoto Station" and "Destination: Kinkaku-ji Temple," the server uses a map service API to calculate the optimal route and sends detailed route information (map, distance, estimated travel time, public transport usage, etc.) to their device. Users can then use this information to travel smoothly.

[0823] Furthermore, when a user searches for information on a tourist destination they wish to visit, selecting a specific destination triggers the server to collect detailed information about the destination (history, points of interest, opening hours, admission fees, etc.) from its internal database and external APIs, and display it on the user's device. For example, selecting "Kiyomizu-dera Temple" will immediately display detailed information about Kiyomizu-dera.

[0824] When a user searches for souvenirs or restaurants during their trip, they enter their desired criteria. For example, if they enter conditions such as "souvenirs under 1,000 yen" or "restaurants serving local cuisine," the server will collect information on relevant establishments based on these criteria and display it as a list on their device. The user can then select from this list and obtain detailed information.

[0825] After the trip ends, users can choose to have their travel diary automatically generated. The server uses an AI model to automatically generate the travel diary based on data accumulated during the trip (visited tourist spots, activities experienced, accommodations, meals, etc.). The generated diary is sent to the user's device, where they can review and revise it as needed.

[0826] Examples of prompt statements:

[0827] "I would like to travel to Kyoto from October 10th to October 12th. My budget is 50,000 yen. Please suggest the best travel plan based on this information."

[0828] This system allows users to efficiently manage the entire travel process within a single integrated system. It provides consistent support for everything from travel planning, booking, transportation, access to tourist information, souvenir and meal selection, to post-trip record-keeping, significantly improving user convenience.

[0829] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0830] Step 1:

[0831] The user enters their travel destination, dates, and budget into the device. Specific examples of input fields include "Destination: Kyoto," "Dates: October 10th to October 12th," and "Budget: 50,000 yen." The device then sends this information to the server.

[0832] input:

[0833] destination

[0834] schedule

[0835] budget

[0836] output:

[0837] User input data is sent to the server.

[0838] Specific actions:

[0839] When a user enters information into the input form on their device and presses the "Submit" button, this information is sent to the server as an HTTP request.

[0840] Step 2:

[0841] Based on the user information received by the server, it collects relevant information from the database and external APIs. For example, it retrieves hotel information from the database and transportation and tourist information from external APIs (map service API, accommodation reservation API).

[0842] input:

[0843] User input data (destination, dates, budget)

[0844] output:

[0845] Relevant information collected from databases and external APIs

[0846] Specific actions:

[0847] The server analyzes the received input data, issues queries to its internal database, and sends requests to external APIs to collect information. The collected information is then integrated within the server.

[0848] Step 3:

[0849] Based on the information collected by the server, an AI model is used to automatically generate the optimal travel plan.

[0850] input:

[0851] Collected relevant information (hotel information, transportation information, tourist information, etc.)

[0852] output:

[0853] Automatically generated travel plan

[0854] Specific actions:

[0855] The collected information is input into the AI ​​model on the server, and the prompt "Destination: Kyoto, Dates: October 10th to October 12th, Budget: Please propose the best travel plan based on 50,000 yen" is used. The generated travel plan is saved on the server.

[0856] Step 4:

[0857] The server generates a travel plan and sends it to the device. The device then presents it to the user, who can review and modify it.

[0858] input:

[0859] Automatically generated travel plan

[0860] output:

[0861] Travel plans presented to the user

[0862] Specific actions:

[0863] The server sends the generated travel plan to the terminal, which then displays its contents to the user. The user can review the displayed plan and make any necessary modifications.

[0864] Step 5:

[0865] The user enters their desired accommodation criteria. For example, "3-star hotel," "city center," and "under 10,000 yen per night." The device then sends these criteria to the server.

[0866] input:

[0867] Desired conditions for the remitter

[0868] output:

[0869] Preferred conditions of the hotel sent to the server

[0870] Specific actions:

[0871] When a user enters criteria into the accommodation search form on their device and presses the "Search" button, these criteria are sent to the server as an HTTP request.

[0872] Step 6:

[0873] The server searches for accommodations that match the user's desired criteria using the API of partner booking sites, and sends the results to the user's device.

[0874] input:

[0875] Desired conditions for the remitter

[0876] output:

[0877] List of accommodations that meet the criteria

[0878] Specific actions:

[0879] The server sends a request to the reservation site API based on the received request conditions, performs a search, and receives the results.

[0880] Step 7:

[0881] The terminal displays a list of accommodation information received by the user, who then selects their preferred accommodation. The user confirms their selection and proceeds with the booking process.

[0882] input:

[0883] List of accommodations that meet the criteria

[0884] output:

[0885] Reservation information for the accommodation selected by the user

[0886] Specific actions:

[0887] The user selects their desired hotel from the list of accommodations displayed on their device and presses the "Confirm Reservation" button, which sends the reservation information to the server.

[0888] Step 8:

[0889] The server confirms the reservation process through the API of the partnered reservation site and sends the reservation information to the terminal.

[0890] input:

[0891] Reservation information for the accommodation selected by the user

[0892] output:

[0893] Confirmed reservation information

[0894] Specific actions:

[0895] The server uses the reservation site API to confirm the reservation and sends the confirmation information to the terminal.

[0896] Step 9:

[0897] The user enters their current location and destination, and requests route information from the server. For example, the user might enter "Kyoto Station" as their current location and "Kinkaku-ji Temple" as their destination.

[0898] input:

[0899] Current location and destination

[0900] output:

[0901] Route information request sent to the server

[0902] Specific actions:

[0903] When a user enters their current location and destination into the route search form on their device and presses the "Search" button, this information is sent to the server.

[0904] Step 10:

[0905] Based on the current location and destination information received by the server, the optimal route is calculated using a map service API, and detailed route information is sent to the terminal.

[0906] input:

[0907] Current location and destination

[0908] output:

[0909] Optimal route information

[0910] Specific actions:

[0911] The server inputs the current location and destination information into a map service API and calculates the optimal route. The resulting route information (map, distance, estimated travel time, information on using public transportation, etc.) is then sent to the terminal.

[0912] Step 11:

[0913] The user enters information about the tourist destination they want to visit into the terminal and requests that information from the server. For example, they might select "Kiyomizu-dera Temple".

[0914] input:

[0915] Tourist destinations I want to visit

[0916] output:

[0917] Tourist destination information request sent to the server

[0918] Specific actions:

[0919] When a user enters the name of a tourist destination they want to visit into the tourist destination search form on their device and presses the "Search" button, this information is sent to the server.

[0920] Step 12:

[0921] The server uses internal databases and external APIs to collect detailed information about tourist destinations and transmit it to the terminal.

[0922] input:

[0923] Tourist destinations I want to visit

[0924] output:

[0925] Detailed information about tourist attractions

[0926] Specific actions:

[0927] The server inputs information about the tourist destination you wish to visit into its internal database and external APIs, collects detailed information such as the history, attractions, opening hours, and admission fees of the tourist destination, and sends it to your device.

[0928] Step 13:

[0929] The user enters their desired souvenir or restaurant criteria into a terminal and requests that information from the server. For example, "souvenirs under 1,000 yen" or "restaurants serving local cuisine."

[0930] input:

[0931] Conditions for souvenirs and restaurants

[0932] output:

[0933] Souvenir and restaurant information request sent to the server

[0934] Specific actions:

[0935] When a user enters their desired criteria into the search form on their device and presses the "Search" button, this information is sent to the server.

[0936] Step 14:

[0937] The server searches for relevant stores from its partner store information database based on the user's preferences and sends that information to the terminal.

[0938] input:

[0939] Conditions for souvenirs and restaurants

[0940] output:

[0941] List of relevant store information

[0942] Specific actions:

[0943] The server inputs the desired criteria into a partner store information database and performs a search. It retrieves a list of matching stores and sends it to the terminal.

[0944] Step 15:

[0945] The user selects the option to automatically generate a travel diary and sends a request to the server. The travel diary is then generated based on the data collected during the trip.

[0946] input:

[0947] Request for automatic generation of travel diary

[0948] output:

[0949] Travel diary generation request sent to the server

[0950] Specific actions:

[0951] When the user selects "Automatically generate travel diary" from the terminal's menu and presses the "Generate" button, this request is sent to the server.

[0952] Step 16:

[0953] The server automatically generates a travel diary using a generative AI model based on data collected during the trip, and then sends the results to the device.

[0954] input:

[0955] Data collected during travel

[0956] output:

[0957] Automatically generated travel diary

[0958] Specific actions:

[0959] The server inputs data collected during the trip (visited tourist spots, activities experienced, accommodations, meals, etc.) into an AI model to automatically generate a travel diary. The generated travel diary is sent to the user's device, and the user can modify and save it as needed.

[0960] (Application Example 1)

[0961] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0962] Traditional travel support systems provided functions such as user travel plan creation, accommodation booking, directions, tourist guides, and automatic generation of travel diaries. However, these functions were specialized for travel and difficult to apply to other uses. Furthermore, there was a need for a system that could comprehensively manage and optimize operations in a logistics center within a single system. In particular, the challenge was to integrate and process functions such as delivery route optimization, inventory management, pallet placement, picking list generation, worker movement optimization, and automatic generation of inventory inflow and outflow reports.

[0963] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0964] In this invention, the server includes means for the user to input the travel destination, itinerary, and budget; means for automatically generating an optimal travel plan based on the input information; means for presenting the automatically generated travel plan to the user; means for the user to confirm and modify the presented travel plan; means for centrally managing and optimizing operations within the logistics center; means for optimizing delivery routes; means for managing inventory within the warehouse; means for optimally arranging pallets and shelves; means for generating picking lists; means for optimizing worker movement; and means for automatically generating inventory inflow and outflow reports. This enables comprehensive optimization of operations within a logistics center using a single system, resulting in efficient operation.

[0965] "Travel destination" refers to information indicating the place the user wants to go.

[0966] "Schedule" refers to information that indicates the period during which the user will be traveling.

[0967] "Budget" refers to the amount of money a user plans to spend on their trip.

[0968] An "optimal travel plan" is the most efficient and satisfying travel plan, calculated and generated based on the user's input information.

[0969] A "logistics center" is a facility where operations such as the storage, sorting, and distribution of goods and materials are carried out in a centralized manner.

[0970] "Means for centrally managing and optimizing operations" refers to methods for comprehensively managing and streamlining the entire business process within a logistics center.

[0971] "Methods for optimizing delivery routes" refer to methods for calculating and optimizing the delivery route of goods to achieve the shortest distance and shortest time.

[0972] "Means of managing inventory within a warehouse" refers to methods for efficiently managing the quantity and location of inventory stored within a warehouse.

[0973] "Methods for optimally arranging pallets and shelves" refers to methods for efficiently arranging pallets and shelves and making the most of available space.

[0974] "Methods for generating picking lists" refer to methods for listing the items needed for orders and shipments, and for efficiently picking them.

[0975] "Methods for optimizing worker movement" refer to methods for optimizing the routes workers take within warehouses and logistics centers, thereby reducing unnecessary movement.

[0976] "Methods for automatically generating inventory inflow and outflow reports" refers to methods for automatically generating reports based on information about inventory inflows and outflows.

[0977] Modes for carrying out the invention

[0978] System Overview

[0979] The system according to the present invention provides multiple functions in an integrated manner to streamline operations within a logistics center. This system applies travel support system technology to logistics operations and includes the following main functions:

[0980] 1. Optimizing delivery routes

[0981] 2. Inventory management within the warehouse

[0982] 3. Optimal placement of pallets and shelves

[0983] 4. Generating a picking list

[0984] 5. Optimizing worker movement patterns

[0985] 6. Automatic generation of inventory in / out reports

[0986] Hardware and software used

[0987] The system consists of devices such as servers, terminals, and robots. The specific hardware and software used include the following:

[0988] Server: The central component that processes data and performs optimization calculations based on user input.

[0989] Device: A device used by a user to input information and display results. Examples: smartphone, tablet.

[0990] Robot: A device that performs picking and placement tasks within a logistics center.

[0991] Software: Programming languages ​​such as Python and JavaScript, libraries for API requests (e.g., requests), and database management systems (e.g., MySQL).

[0992] Process Overview

[0993] 1. Optimizing delivery routes

[0994] The server calculates the optimal delivery route based on the current location and destination. A map API is used to suggest the shortest distance or shortest time route. The calculation results are sent to the terminal or robot for execution.

[0995] Example prompt:

[0996] "Please generate the optimal picking route within the warehouse."

[0997] 2. Inventory management within the warehouse

[0998] The server manages the quantity and location information of inventory items. When inbound and outbound information is entered by users, the inventory database is updated. This makes it possible to monitor inventory status in real time.

[0999] Example prompt:

[1000] "Please display the current stock quantity and location of item ID 001."

[1001] 3. Optimal placement of pallets and shelves

[1002] The server calculates the optimal placement of pallets and shelves to maximize space utilization within the warehouse. This reduces wasted space and enables efficient storage.

[1003] 4. Generating a picking list

[1004] The server automatically generates a picking list based on the order information. The picking list is sent to terminals or robots, enabling efficient picking operations.

[1005] 5. Optimizing worker movement patterns

[1006] The server calculates the optimal movement path based on the worker's current task and travel route. This reduces unnecessary movement and improves work efficiency.

[1007] 6. Automatic generation of inventory in / out reports

[1008] The server automatically generates periodic inventory inflow and outflow reports based on inventory inflow and outflow information. This ensures transparency in inventory management and enables efficient operation.

[1009] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1010] Step 1:

[1011] Users input warehouse inventory information into a terminal. This includes information such as the ID, quantity, and location of each item. The input data is sent to a server, which stores the data in a database. The inventory management system updates this data in real time and uses it for subsequent processing.

[1012] Step 2:

[1013] The user requests optimization of a specific delivery route. They enter their current location and destination on their device and send this information to the server. The server uses a map API to calculate the optimal route based on this input data. The calculation results generate the shortest distance or shortest time route information, which is then sent to the device and the robot. The robot operates based on this route information.

[1014] Step 3:

[1015] The server optimizes the placement of pallets and shelves within the warehouse. In this step, it runs an algorithm based on inventory information and warehouse space data to calculate the most efficient placement plan. The calculation results are output to the terminal as a proposed placement.

[1016] Step 4:

[1017] The user requests the generation of a picking list for a specific order. They enter the order ID into a terminal and send that information to the server. The server generates a list of necessary items based on the order data, and creates a picking list that also includes information about the shelves where those items are located. The picking list is sent to the terminal or robot, and the picking operation is carried out efficiently.

[1018] Step 5:

[1019] The server optimizes the worker's movement. It collects information on the worker's current location and the task they are currently performing, and runs an algorithm to calculate the most efficient movement path. The calculation result is output to the terminal as the optimal travel path, and the worker performs their work according to that path.

[1020] Step 6:

[1021] The server automatically generates inventory inflow and outflow reports on a regular basis. It collects inventory inflow and outflow information, performs data analysis, and creates reports. The generated reports are sent to terminals, where users can view them. This improves the transparency and efficiency of inventory management.

[1022] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1023] The travel support system according to the present invention generates an optimal travel plan, makes accommodation reservations, provides directions, guides tourists, recommends souvenirs and restaurants, and automatically generates a travel diary, based on user input information and emotional information recognized by an emotion engine. This system is realized by a terminal with a user interface, a server that processes data, and by linking with external databases and APIs.

[1024] 1. User travel plan creation

[1025] The user enters their travel destination, dates, and budget into their device. The server receives the input information and collects relevant information from databases and external APIs. For example, if the user enters "Kyoto" as the destination, "October 10th to October 12th" as the dates, and "50,000 yen" as the budget, the server automatically generates the most suitable hotels, sightseeing spots, and transportation options based on this information. Furthermore, an emotion engine recognizes the user's emotional state and customizes the travel plan, for example, suggesting a relaxing itinerary if the user is feeling stressed. The generated plan is sent to the device, where the user can review and modify it.

[1026] 2. Hotel Reservation

[1027] The user enters their desired accommodation criteria. For example, if the user enters "3-star hotel," "city center," and "under 10,000 yen per night," the server searches affiliated booking sites and lists hotels that match the criteria. Based on the emotional information recognized by the emotion engine, if, for example, the user is detected as tired, it will suggest hotels with ample relaxation facilities. Information on the relevant hotels is displayed on the terminal, and the user selects their preferred hotel and proceeds with the booking process. The server confirms the booking process through the booking site's API.

[1028] 3. Directions

[1029] The user enters their current location and destination. For example, if the current location is "Kyoto Station" and the destination is "Kinkaku-ji Temple," the server uses a map API to calculate the optimal route. The emotion engine suggests routes that reduce the user's current fatigue and stress levels, such as routes that avoid crowds and include rest stops. The calculated route information is sent to the device and displayed to the user. Details such as the map, distance, estimated travel time, and how to use public transport are displayed.

[1030] 4. Tourist Guide

[1031] The user selects a tourist destination they wish to visit. For example, if they select "Kiyomizu-dera Temple," the server gathers detailed information about Kiyomizu-dera from its internal database and external APIs. An emotion engine then customizes the information based on the user's interests and emotions, for example, highlighting natural attractions for users who want to relax. The collected information is displayed on the device for easy access by the user.

[1032] 5. Recommendations for souvenirs and restaurants

[1033] The user enters their desired souvenir or restaurant criteria. For example, if they enter "souvenirs under 1,000 yen" and "restaurant serving local cuisine," the server collects information on stores that match the criteria. An emotion engine customizes the information based on the user's preferences and mood; for example, if the user is tired, it might suggest a relaxing cafe. A list of suitable stores is displayed on the terminal, and the user can select the souvenir or restaurant that best suits their needs.

[1034] 6. Automatic generation of travel diaries

[1035] At the end of the trip, the user can choose to have a travel diary automatically generated. The server automatically generates the travel diary based on the data collected during the trip. For example, details such as the tourist spots visited, activities experienced, accommodations, and meals are automatically generated as text. An emotion engine reflects the user's emotional changes during the trip, customizing the diary content by highlighting important emotional moments. The generated travel diary is sent to the device, where the user can review and edit it as needed.

[1036] In this way, by combining user input information with emotional information recognized by the emotion engine, this system can seamlessly manage the entire travel process and provide the user with the optimal travel experience.

[1037] The following describes the processing flow.

[1038] User travel plan creation

[1039] Step 1:

[1040] The user enters their travel destination, dates, and budget. For example, they might enter "Kyoto," "October 10th to October 12th," and "50,000 yen."

[1041] Step 2:

[1042] The terminal sends the entered information to the server.

[1043] Step 3:

[1044] The server activates the emotion engine to recognize the user's current emotional state. If the user is feeling stressed, it retrieves that information.

[1045] Step 4:

[1046] The server retrieves the necessary data for generating travel plans from databases and external APIs. For example, this includes tourist attractions in Kyoto, accommodations, and transportation options.

[1047] Step 5:

[1048] Based on data acquired by the server, the system automatically generates an optimal travel plan tailored to the user's emotional state. For example, if the user is feeling stressed, it will suggest a plan that includes many relaxing activities.

[1049] Step 6:

[1050] The server sends the generated travel plan to the device.

[1051] Step 7:

[1052] The device displays the travel plan to the user. The user can review the plan details and modify them as needed.

[1053] Hotel Reservations

[1054] Step 1:

[1055] The user enters their desired accommodation criteria. For example, they might enter "3-star hotel," "city center," and "under 10,000 yen per night."

[1056] Step 2:

[1057] The terminal sends the entered conditions to the server.

[1058] Step 3:

[1059] The server uses an emotion engine to recognize the user's emotional state. For example, it might recognize that the user is tired.

[1060] Step 4:

[1061] The server calls the API of a partner booking site to search for hotels that meet the specified criteria.

[1062] Step 5:

[1063] The server organizes the search results and lists suitable hotels based on the results of the sentiment engine. For example, it might prioritize hotels with ample relaxation facilities.

[1064] Step 6:

[1065] The server sends the hotel list to the terminal.

[1066] Step 7:

[1067] The terminal displays a list of hotels to the user. The user selects their desired hotel and proceeds with the booking process.

[1068] Step 8:

[1069] The server uses the booking site's API to complete the booking process and confirm the reservation for the selected hotel.

[1070] Directions

[1071] Step 1:

[1072] The user enters their current location and destination. For example, they might enter "Kyoto Station" and "Kinkaku-ji Temple".

[1073] Step 2:

[1074] The terminal sends the entered information to the server.

[1075] Step 3:

[1076] The server uses an emotion engine to recognize the user's emotional state. For example, it might recognize that the user is tired.

[1077] Step 4:

[1078] The server calls a map API to calculate the optimal route. Depending on the user's emotional state, it suggests routes that avoid congestion or include rest stops.

[1079] Step 5:

[1080] The server sends the calculation results to the terminal.

[1081] Step 6:

[1082] The device displays route information to the user. Detailed information such as maps, distance, estimated travel time, and instructions on using public transportation are shown.

[1083] Tourist guide

[1084] Step 1:

[1085] The user selects a tourist destination they want to visit. Example: Select "Kiyomizu-dera Temple".

[1086] Step 2:

[1087] The device sends information about the selected tourist destination to the server.

[1088] Step 3:

[1089] The server uses an emotion engine to recognize the user's emotional state. For example, it recognizes that the user wants to relax.

[1090] Step 4:

[1091] The server retrieves information about tourist destinations from internal databases and external APIs.

[1092] Step 5:

[1093] The server organizes the information it has gathered and customizes it based on the user's emotional state, highlighting relaxing sights and activities.

[1094] Step 6:

[1095] The server sends tourist guide information to the terminal.

[1096] Step 7:

[1097] The device displays tourist guide information to the user, including history, points of interest, opening hours, and admission fees.

[1098] Recommended souvenirs and restaurants

[1099] Step 1:

[1100] The user enters their desired souvenir or restaurant criteria. For example, they might enter "Souvenirs under 1,000 yen" or "Restaurant serving local cuisine."

[1101] Step 2:

[1102] The terminal sends the entered conditions to the server.

[1103] Step 3:

[1104] The server uses an emotion engine to recognize the user's emotional state. For example, it recognizes that the user wants to relax.

[1105] Step 4:

[1106] The server searches for store information that matches the specified criteria from the database or affiliated APIs.

[1107] Step 5:

[1108] The server organizes search results and suggests the most suitable stores based on the user's emotional state, prioritizing relaxing cafes and shops.

[1109] Step 6:

[1110] The server sends the store list to the terminal.

[1111] Step 7:

[1112] The device displays a list of stores to the user. This list includes store names, addresses, opening hours, and details about products and menus.

[1113] Automatic generation of travel diaries

[1114] Step 1:

[1115] The user chooses to automatically generate a travel diary at the end of their trip.

[1116] Step 2:

[1117] The device sends the user's selection to the server.

[1118] Step 3:

[1119] The server collects data during the trip (such as tourist destinations visited, activities experienced, accommodations, and meals eaten).

[1120] Step 4:

[1121] The server uses an emotion engine to analyze the user's emotional changes during their trip.

[1122] Step 5:

[1123] The server automatically generates a travel diary based on collected data and emotional information. It highlights important emotional moments and creates a detailed diary.

[1124] Step 6:

[1125] The server sends the generated travel diary to the device.

[1126] Step 7:

[1127] The device displays the generated travel diary to the user and provides an interface that allows the user to modify it as needed.

[1128] (Example 2)

[1129] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[1130] Traditional travel support systems provide simple plans without considering the user's emotional state, lacking customization to suit individual feelings and preferences. Furthermore, they lacked sufficient integrated support for users to seamlessly plan trips, book accommodations, and get directions. As a result, users often had to expend considerable time and effort to achieve a better travel experience.

[1131] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server is

[1132] A means for users to input their travel destination, dates, and budget,

[1133] A means for automatically generating an optimal travel plan based on the input information,

[1134] A means for presenting the automatically generated travel plan to the user,

[1135] A means for the user to review and modify the aforementioned travel plan,

[1136] A means of recognizing the user's emotional state using an emotion engine and customizing travel plans,

[1137] This includes providing optimal travel plans that take into account the user's emotional state.

[1138] Also, the server,

[1139] A means for users to enter their desired accommodation conditions,

[1140] A means of obtaining information from affiliated reservation sites based on the aforementioned entered conditions,

[1141] A means of presenting the acquired information to the user and confirming the reservation,

[1142] A means of suggesting accommodations based on the user's emotional state using an emotion engine,

[1143] This includes enabling accommodation suggestions and bookings based on user sentiment.

[1144] Furthermore, the server,

[1145] A means for the user to input their current location and destination,

[1146] A means for calculating the optimal route based on the input information,

[1147] Means for presenting the calculated route to the user,

[1148] A means of customizing the path based on the user's emotional state using an emotion engine,

[1149] This includes providing the optimal path tailored to the user's emotional state.

[1150] These measures provide an integrated travel support system that utilizes an emotion engine to consider the user's emotional state, allowing users to have a more satisfying travel experience.

[1151] A "user" is an individual or group that uses the system to create, review, or modify travel plans.

[1152] A "terminal" is an electronic device used by a user to input information and receive information from a system.

[1153] A "server" is a central processing unit that receives input information from users and performs tasks such as generating travel plans, collecting data, and analyzing it using an emotion engine.

[1154] A "travel plan" refers to information such as itineraries, accommodations, and sightseeing spots that are automatically generated based on the user's input information and the results of the emotion engine's analysis.

[1155] An "emotion engine" is software or an algorithm that analyzes user input data and past data to recognize the user's emotional state and customize the plan accordingly.

[1156] "Customization" refers to individually adjusting the plans and information provided based on the user's emotional state and preferences.

[1157] A "database" is a digital storage system that stores travel-related information and allows it to be searched and retrieved as needed.

[1158] An "API" is an interface that enables communication with external services and databases, and is used for integration with partner reservation sites and map services.

[1159] A "booking site" is an online platform for booking accommodations, transportation, activities, and other similar services.

[1160] "Route" refers to the optimal means of transportation and route from the user's specified starting point to the destination.

[1161] "Recommendations" refer to the optimal options presented by the system based on the user's input information and emotional state.

[1162] A "travel diary" is a record of places visited, activities, and emotional changes during a trip, compiled in an automatically generated text format.

[1163] The travel support system according to the present invention is a system that generates an optimal travel plan, makes accommodation reservations, provides directions, guides tourists, recommends souvenirs and restaurants, and automatically generates a travel diary based on user input information and emotional information recognized by an emotion engine. This system is realized by a terminal with a user interface, a server that processes data, and by linking with external databases and APIs.

[1164] Users input information such as their travel destination, dates, and budget using their device. For example, if a user enters information such as "Kyoto," "October 10th to October 12th," and "50,000 yen," the server receives this information and collects relevant information from its database and external APIs. Based on the user's input, the server automatically generates a plan of the most suitable accommodations, sightseeing spots, and transportation. This system also uses an emotion engine to recognize the user's emotional state and can suggest plans that promote relaxation, for example.

[1165] Furthermore, it also has a function to search for accommodations based on conditions entered by the user. For example, if the user enters conditions such as "3-star hotel," "city center," and "under 10,000 yen per night," the server retrieves information through the API of partner booking sites and presents that information to the user. An emotion engine analyzes the user's emotional state and suggests relaxing hotels for tired users. Once the user selects a desired hotel and proceeds with the booking process, the server confirms the reservation through the booking site's API.

[1166] Furthermore, when a user enters their current location and destination, the server uses a map API to calculate the optimal route. For example, if the current location is entered as "Kyoto Station" and the destination as "Kinkaku-ji Temple," the server will suggest a route that avoids congestion and includes rest stops. This is also a result of the emotion engine taking the user's emotional state into consideration. The calculated route information is sent to the device, where a map, distance, estimated travel time, and information on using public transportation are displayed in detail.

[1167] The app also includes a tourist guide function; when a user selects a tourist destination they wish to visit, the server collects detailed information from an internal database and external APIs. For example, if "Kiyomizu-dera Temple" is selected, the emotion engine customizes the information based on the user's interests and emotions, providing users who want to relax with a focus on natural attractions. The collected information is displayed on the device for easy reference.

[1168] Furthermore, it also has a function to guide users to souvenirs and restaurants. When a user enters conditions such as "souvenirs under 1,000 yen" or "restaurants serving local cuisine," the server collects information on stores that match the conditions, and an emotion engine customizes the information based on the user's preferences and mood. For example, it suggests a relaxing cafe to a tired user. A list of relevant stores is displayed on the device, and the user can select souvenirs or restaurants that suit their needs.

[1169] At the end of the trip, if the user chooses to automatically generate a travel diary, the server will automatically generate a travel diary based on the data collected during the trip. For example, details such as the tourist attractions visited, activities experienced, accommodations, and meals eaten will be automatically generated as text. An emotion engine will reflect the user's emotional changes during the trip, customizing the diary content by highlighting important emotional moments. The generated travel diary is sent to the device, where the user can review and edit it as needed.

[1170] Example of a prompt

[1171] "Please create a sightseeing plan for a visit to Kyoto from October 10th to October 12th. The budget is 50,000 yen."

[1172] "Could you please give me directions from Kyoto Station to Kinkaku-ji Temple? I'd like to avoid the crowds."

[1173] "Could you tell me about some relaxing sights at Kiyomizu-dera Temple?"

[1174] In this way, by combining user input information with emotional information recognized by the emotion engine, the system seamlessly manages the entire travel process and provides the user with the optimal travel experience.

[1175] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1176] Step 1:

[1177] The user enters their travel destination, dates, and budget using the device's interface.

[1178] Specific action: The user enters "Kyoto," "October 10th to October 12th," and "50,000 yen" into the search field on their device and presses the send button.

[1179] Input: Travel destination, dates, budget

[1180] Output: Data sent from the terminal to the server based on user input.

[1181] Step 2:

[1182] The server receives user input and collects relevant information from databases and external APIs.

[1183] Specific operation: The server uses the entered information "Kyoto," "October 10th to October 12th," and "50,000 yen" to collect data on accommodations, tourist attractions, and transportation.

[1184] Input: User-entered travel destination, dates, and budget information.

[1185] Output: Information on the best accommodations, tourist attractions, and transportation options.

[1186] Step 3:

[1187] The server uses an emotion engine to analyze user input and past data to recognize the user's emotional state.

[1188] Specific operation: The emotion engine analyzes whether the user is feeling stressed and suggests a relaxation plan that can reduce stress.

[1189] Input: User input information, historical data

[1190] Output: Recognition results of the user's emotional state

[1191] Step 4:

[1192] The server automatically generates the optimal travel plan based on the user's input information and the results of the emotion engine's analysis.

[1193] Specific operation: The server will create a plan that includes a stay at a three-star hotel in Kyoto, sightseeing at Kiyomizu-dera and Kinkaku-ji temples, and a visit to relaxing cafes.

[1194] Input: User input information, emotion engine analysis results, information from databases and external APIs.

[1195] Output: Auto-generated travel plan

[1196] Step 5:

[1197] The server generates a travel plan and sends it to the user's device, which then displays it.

[1198] Specific action: The plan details will be displayed as a pop-up on the device for the user to review.

[1199] Input: Auto-generated travel plan

[1200] Output: Display of travel plan

[1201] Step 6:

[1202] The user enters their desired accommodation criteria.

[1203] Specific action: The user enters "3-star hotel," "city center," and "under 10,000 yen per night," and presses the submit button.

[1204] Input: Desired accommodation conditions

[1205] Output: Data sent from the terminal to the server based on the conditions entered by the user.

[1206] Step 7:

[1207] The server uses the API of partner booking sites to collect hotel information that matches the specified criteria.

[1208] Specific operation: The server sends a query to partner sites and lists hotels that meet the criteria of "3-star hotel," "city center," and "under 10,000 yen per night."

[1209] Input: Desired accommodation conditions

[1210] Output: List of suggested hotels

[1211] Step 8:

[1212] The server uses an emotion engine to suggest hotels that take into account the user's emotional state.

[1213] Specific action: The emotion engine recognizes that the user is tired and suggests a hotel with a spa.

[1214] Input: Desired accommodation conditions, user's emotional state

[1215] Output: Hotel recommendations that reflect the user's emotional state.

[1216] Step 9:

[1217] The server sends suggested hotel information to the terminal, which then displays it.

[1218] Specific action: A list of suggested hotels is displayed on the device.

[1219] Input: Hotel suggestions that reflect the user's emotional state.

[1220] Output: List of hotels

[1221] Step 10:

[1222] The user selects their desired hotel and completes the booking process on their device. The server confirms the booking through the booking site's API.

[1223] Specific operation: When the user selects their desired hotel and presses the book button, the server processes the booking confirmation.

[1224] Input: Hotel information selected by the user

[1225] Output: Hotel reservation confirmed

[1226] Step 11:

[1227] The user enters their current location and destination.

[1228] Specific action: The user enters "Kyoto Station" and "Kinkaku-ji Temple".

[1229] Input: Current location and destination

[1230] Output: Data sent from the terminal to the server based on user input.

[1231] Step 12:

[1232] The server uses a map API to calculate the optimal route.

[1233] Specific operation: The server queries the map API and calculates the route.

[1234] Input: Current location and destination

[1235] Output: Optimal route information

[1236] Step 13:

[1237] The server uses an emotion engine to customize the route based on the user's emotional state.

[1238] Specific action: Suggest a route that includes rest stops to avoid congestion.

[1239] Input: User's emotional state, optimal route information

[1240] Output: Customized route information

[1241] Step 14:

[1242] The server sends the calculated route information to the terminal, and the terminal displays it.

[1243] Specific actions: The device displays a map, distance, estimated travel time, and instructions on using public transportation.

[1244] Input: Customized route information

[1245] Output: Display of route information

[1246] Step 15:

[1247] The user selects the tourist destination they want to visit.

[1248] Specific action: The user selects "Kiyomizu-dera Temple".

[1249] Input: Selection of tourist destination

[1250] Output: Data sent from the terminal to the server based on the information selected by the user.

[1251] Step 16:

[1252] The server collects detailed information about tourist destinations from internal databases and external APIs.

[1253] Specific operation: The server collects information about Kiyomizu-dera Temple from a database and external APIs.

[1254] Input: Tourist destination selection information

[1255] Output: Detailed information about tourist attractions

[1256] Step 17:

[1257] The server uses an emotion engine to provide information based on the user's interests and emotions.

[1258] Specific action: Provide users who want to enjoy nature with information about natural attractions that emphasize the natural environment.

[1259] Input: User's interests and emotional state, detailed information about tourist destinations.

[1260] Output: Customized tourist information

[1261] Step 18:

[1262] The server sends the collected guide information to the terminal, and the terminal displays it.

[1263] Specific action: Detailed tourist information will be displayed on the device.

[1264] Input: Customized tourist destination information

[1265] Output: Display of tourist information

[1266] Step 19:

[1267] The user enters their desired souvenirs and restaurant preferences.

[1268] Specific action: The user enters "souvenirs under 1,000 yen" and "restaurant serving local cuisine".

[1269] Input: Conditions for souvenirs and restaurants

[1270] Output: Data sent from the terminal to the server based on the conditions entered by the user.

[1271] Step 20:

[1272] The server collects store information that matches the specified criteria from an external API.

[1273] Specific operation: The server sends a query to the partner API and retrieves store information that matches the criteria.

[1274] Input: Conditions for souvenirs and restaurants

[1275] Output: Relevant store information

[1276] Step 21:

[1277] The server uses an emotion engine to provide recommendations based on the user's preferences and mood.

[1278] Specific action: Suggest a relaxing cafe to tired users.

[1279] Input: User preferences and mood, store information

[1280] Output: Customized store information

[1281] Step 22:

[1282] The server sends the collected store information to the terminal, which then displays it.

[1283] Specific action: A list of recommended stores will be displayed on the device.

[1284] Input: Customized store information

[1285] Output: Display of store information

[1286] Step 23:

[1287] At the end of the trip, the user can choose to have a travel diary automatically generated.

[1288] Specific action: After the trip ends, the user selects "Automatically generate travel diary".

[1289] Input: Select option for automatic generation of travel diary

[1290] Output: Data sent from the terminal to the server containing user selection information.

[1291] Step 24:

[1292] The server automatically generates a travel diary based on data collected during the trip.

[1293] Specific operation: The server generates text based on information about tourist destinations, accommodations, and restaurants visited.

[1294] Input: Data collected during the trip

[1295] Output: Auto-generated travel diary

[1296] Step 25:

[1297] The server uses an emotion engine to customize the travel diary, highlighting important emotional moments and generating content.

[1298] Specific actions: Highlight and record in your diary moments that you particularly enjoyed.

[1299] Input: Data collected during the trip, results of emotion engine analysis

[1300] Output: Customized travel diary

[1301] Step 26:

[1302] The server generates a travel diary and sends it to the device, which then displays it.

[1303] Specific operation: A detailed travel diary is displayed on the device for the user to review.

[1304] Input: Customized travel diary

[1305] Output: Display of travel diary

[1306] (Application Example 2)

[1307] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[1308] Traditional travel support systems required users to manually select and book travel plans and accommodations individually, which was a cumbersome process. Furthermore, they struggled to automatically adjust plans to suit the user's mood and fatigue level, and offered insufficient suggestions to reduce user fatigue, especially during long journeys and sightseeing. Additionally, real-time navigation and tourist information were not provided during vehicle travel, limiting user convenience.

[1309] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[1310] In this invention, the server includes means for the user to input the travel destination, itinerary, and budget; means for automatically generating an optimal travel plan based on the input information; means for presenting the automatically generated travel plan to the user; means for the user to confirm and modify the presented travel plan; means for providing route information to an autonomous vehicle and guiding it to the destination; means for collecting and presenting information on tourist destinations the user will visit; and means for suggesting optimal sightseeing plans and rest spots based on the user's emotional state. This allows the user to manage all aspects of their trip in one place and enables an optimal travel experience and fatigue recovery based on their emotional state.

[1311] A "travel destination" is a place that a user plans to visit during their trip.

[1312] "Itinerary" refers to the period of time that includes the start and end dates of a trip.

[1313] "Budget" refers to the total cost of the trip, which is the amount the user plans to spend.

[1314] A "travel plan" is a plan that includes the travel itinerary, places to visit, means of transportation, and accommodations, which are automatically generated based on the user's input information.

[1315] An "autonomous vehicle" is a vehicle that can travel autonomously to its destination without the need for a human driver.

[1316] "Route information" refers to data about the travel route from the current location to the destination.

[1317] A "tourist destination" refers to a tourist spot or famous place that a user would like to visit.

[1318] "Emotional state" refers to the user's current psychological and physiological state, including fatigue levels and stress levels.

[1319] A "rest stop" is a place where travelers can take a short break or refresh themselves during their trip.

[1320] "Accommodation facilities" refer to facilities such as hotels and inns where users stay during their travels.

[1321] A "booking site" is a website used to make online reservations for accommodations and other travel-related facilities.

[1322] A "navigation system" is a system that calculates the optimal route to a destination and provides real-time directions.

[1323] This invention is a system for improving the user's travel experience, and this system is realized by the following means and processes: The user inputs information such as travel destination, itinerary, and budget through a user interface. This information is sent from the terminal to a server, which automatically generates an optimal travel plan based on the above information. The generated plan is then sent back to the terminal and presented to the user.

[1324] The server first receives user input information and then collects relevant information through external databases and APIs. For example, if a user enters "City A" as the "travel destination," "January 1st to January 3rd" as the "dates," and "50,000 yen" as the "budget," the server automatically selects the most suitable accommodations, tourist attractions, and modes of transportation to generate a travel plan.

[1325] Furthermore, the system includes an emotion engine that detects the user's emotional state. The emotion engine analyzes the user's voice and facial expressions to assess their current psychological and physiological condition. Based on this information, the server dynamically customizes the travel plan, for example, suggesting relaxing activities if the user is feeling stressed.

[1326] During their trip, users can utilize self-driving vehicles. These vehicles provide directions to their destinations based on route information provided by a server. For example, if a user enters "Departure Point B" as their current location and "Tourist Spot C" as their destination, the server calculates the optimal route and sends it to the self-driving vehicle. At this time, an emotion engine can sense the user's fatigue level and suggest a route that includes rest stops along the way, for example.

[1327] As the vehicle approaches a tourist destination, information about that destination is provided to the user through monitors and audio systems inside the autonomous vehicle. The server collects detailed tourist destination information from internal databases and external APIs, and displays information customized according to the user's interests and feelings.

[1328] Furthermore, users can input information about restaurants they want to visit and souvenirs they want to buy during their trip. The server provides optimal store information based on the user's conditions and preferences. For example, by searching for "souvenirs under 1,000 yen" or "restaurants serving local cuisine," stores that match the criteria will be listed.

[1329] At the end of the trip, the server automatically generates a travel diary based on the data collected during the trip. This travel diary includes information on the tourist attractions visited, the activities experienced, and the accommodations, and also reflects the user's emotional changes. The generated travel diary is sent to the user's device, where they can review and edit it.

[1330] The program uses Python to communicate with APIs and perform data collection and calculations. The emotion engine utilizes speech analysis and facial recognition technologies, specifically OpenCV and Google Cloud's Emotional Analytics API. Google Maps API and OpenStreetMap API are used for navigation.

[1331] As a concrete example, the following prompt sentences can be input into the generating AI model:

[1332] "I would like to travel to City A between October 10th and October 12th, 2023, with a budget of 50,000 yen. Please suggest the best travel plan, including places where I can relax."

[1333] Therefore, this system can manage every aspect of a trip in one place and provide an optimal travel experience based on the user's emotional state.

[1334] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1335] Step 1:

[1336] The user enters their travel destination, dates, and budget into the device. Once the user enters this information, the device sends the data to the server. The entered information is provided to the server as text data.

[1337] Step 2:

[1338] The server collects relevant information from external databases and APIs based on the destination, dates, and budget received from the user. Specifically, it retrieves data such as hotel availability, tourist attraction details, and transportation options. Data processing at this stage involves tagging and formatting the collected data. As a result, a list of integrated travel plan candidates is generated.

[1339] Step 3:

[1340] The emotion engine analyzes the user's voice input and facial expression data to recognize the user's current emotional state. This recognized emotional information is used to customize the travel plan. For example, if the user is fatigued, relaxing activities will be included in the plan. After the emotional data is entered into the server, it is analyzed and tagged with the corresponding emotion.

[1341] Step 4:

[1342] The server generates an optimal travel plan based on the user's input information and emotional state. This plan includes accommodations, sightseeing spots, and transportation. The plan is generated using a generative AI model. Specifically, information that matches the user's preferences and emotional state is automatically selected. The generated travel plan is sent to the device in text format.

[1343] Step 5:

[1344] The terminal displays a generated travel plan to the user. The user reviews this plan and makes modifications as needed, such as changing accommodations or adding tourist attractions. The modified plan is sent back to the server for final confirmation. The user's modification information is sent to the server and reflected in the database.

[1345] Step 6:

[1346] When a user uses an autonomous vehicle, the server provides route information. The user enters their current location and destination into a terminal, and this data is sent to the server. Based on the entered information, the server calculates the optimal route and suggests a route that includes rest stops, depending on the user's emotional state. The calculated route is then sent to the autonomous vehicle.

[1347] Step 7:

[1348] Autonomous vehicles navigate to their destinations based on route information received from a server. Real-time directions are provided to the user through in-vehicle monitors and voice systems. As the vehicle approaches a tourist destination, information about that destination is displayed. Route information and tourist destination data are entered into the vehicle's navigation system and provided to the user.

[1349] Step 8:

[1350] At the end of the trip, if the user chooses to automatically generate a travel diary, the server will generate a diary based on the data collected during the trip. The diary will include information about the tourist spots the user visited, the activities they experienced, their accommodations, and a reflection of their emotional changes. The generated travel diary will be sent to the user's device in text format, where they can review and edit it.

[1351] Example of a prompt:

[1352] "I would like to travel to City A between October 10th and October 12th, 2023, with a budget of 50,000 yen. Please suggest the best travel plan, including places where I can relax."

[1353] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1354] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include those described above. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions shown by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1355] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[1356] [Third Embodiment]

[1357] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[1358] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1359] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1360] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[1361] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1362] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1363] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1364] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1365] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1366] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1367] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1368] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[1369] The travel support system according to the present invention generates an optimal travel plan, makes accommodation reservations, provides directions, tourist information, souvenir and restaurant recommendations, and automatically generates a travel diary, all based on the user's input of necessary information such as travel destination, itinerary, and budget. The system of the present invention is realized by a terminal with a user interface, a server that processes data, and by linking with an external database or API.

[1370] 1. User travel plan creation

[1371] The user enters their travel destination, dates, and budget into their device. The server receives this information and collects relevant data from its database and external APIs. For example, if the user enters "Kyoto" as the destination, "October 10th to October 12th" as the dates, and "50,000 yen" as the budget, the server automatically generates the most suitable hotel, sightseeing spots, and transportation options based on this information. The generated plan is sent to the user's device, where they can review and modify it.

[1372] 2. Hotel Reservation

[1373] The user enters their desired accommodation criteria. For example, if the user enters criteria such as "3-star hotel," "city center," and "under 10,000 yen per night," the server searches affiliated booking sites and lists hotels that match the criteria. The information of the relevant hotels is displayed on the terminal, and the user selects their desired hotel from the list and proceeds with the booking process. The server confirms the booking process through the booking site's API.

[1374] 3. Directions

[1375] The user enters their current location and destination. For example, if the current location is "Kyoto Station" and the destination is "Kinkaku-ji Temple," the server uses a map API to calculate the optimal route. The calculated route information is sent to the device and displayed to the user. Details such as the map, distance, estimated travel time, and information on using public transportation are displayed.

[1376] 4. Tourist Guide

[1377] The user selects a tourist destination they wish to visit. For example, if they select "Kiyomizu-dera Temple," the server collects detailed information about Kiyomizu-dera from its internal database and external APIs. This information includes the history of the tourist destination, its highlights, opening hours, and admission fees. The collected information is displayed on the device for easy access by the user.

[1378] 5. Recommendations for souvenirs and restaurants

[1379] The user enters their desired souvenir or restaurant criteria. For example, if they enter criteria such as "souvenirs under 1,000 yen" or "restaurant serving local cuisine," the server collects information on stores that match those criteria. A list of matching stores is displayed on the terminal, and the user can select the souvenir or restaurant that suits their needs.

[1380] 6. Automatic generation of travel diaries

[1381] At the end of the trip, the user can choose to have a travel diary automatically generated. The server automatically generates the travel diary based on the data collected during the trip. For example, details such as the tourist spots visited, activities experienced, accommodations, and meals are automatically generated as text and sent to the device. The user can review the generated diary and make corrections as needed.

[1382] This allows users to efficiently manage the entire travel process within a single integrated system. A key feature of this system is its consistent support for everything from travel planning, booking, transportation, access to tourist information, souvenir and meal selection, to creating travel records after the trip.

[1383] The following describes the processing flow.

[1384] User travel plan creation

[1385] Step 1:

[1386] The user enters their travel destination, dates, and budget. For example, they might enter "Kyoto," "October 10th to October 12th," and "50,000 yen."

[1387] Step 2:

[1388] The terminal sends the entered information to the server.

[1389] Step 3:

[1390] The server retrieves the necessary data for generating travel plans (e.g., popularity of tourist destinations, accommodation availability, transportation options, etc.) from a database or external API.

[1391] Step 4:

[1392] Based on data acquired by the server, the system automatically generates travel plans optimized for the user's conditions. Specifically, it creates plans that include combinations of tourist destinations, modes of transportation, and accommodations.

[1393] Step 5:

[1394] The server sends the generated travel plan to the device.

[1395] Step 6:

[1396] The device displays the travel plan to the user. The user can review the plan details and modify them as needed.

[1397] Hotel Reservations

[1398] Step 1:

[1399] The user enters their desired accommodation criteria. For example, they might enter "3-star hotel," "city center," and "under 10,000 yen per night."

[1400] Step 2:

[1401] The terminal sends the entered conditions to the server.

[1402] Step 3:

[1403] The server calls the API of a partner booking site to search for hotels that meet the specified criteria.

[1404] Step 4:

[1405] The server organizes the search results and creates a list of hotels that best match the criteria.

[1406] Step 5:

[1407] The server sends the hotel list to the terminal.

[1408] Step 6:

[1409] The device displays a list of hotels to the user. The user selects their desired hotel and makes a reservation.

[1410] Step 7:

[1411] The server uses the booking site's API to complete the booking process and confirm the reservation for the selected hotel.

[1412] Directions

[1413] Step 1:

[1414] The user enters their current location and destination. For example, they might enter "Kyoto Station" and "Kinkaku-ji Temple".

[1415] Step 2:

[1416] The terminal sends the entered information to the server.

[1417] Step 3:

[1418] The server calls a map API to calculate the optimal route.

[1419] Step 4:

[1420] The server sends the calculation results (route, distance, travel time, mode of transport, etc.) to the terminal.

[1421] Step 5:

[1422] The device displays route information to the user. The user can then view detailed directions (e.g., maps, instructions on using public transportation, etc.).

[1423] Tourist guide

[1424] Step 1:

[1425] The user selects a tourist destination they want to visit. Example: Select "Kiyomizu-dera Temple".

[1426] Step 2:

[1427] The device sends information about the selected tourist destination to the server.

[1428] Step 3:

[1429] The server retrieves detailed information about tourist destinations from an internal database or an external API.

[1430] Step 4:

[1431] The server organizes the information it has acquired and sends tourist guide information to the terminal.

[1432] Step 5:

[1433] The device displays tourist information to the user, such as history, points of interest, opening hours, and admission fees.

[1434] Recommended souvenirs and restaurants

[1435] Step 1:

[1436] The user enters their desired souvenir or restaurant criteria. For example, they might enter "Souvenirs under 1,000 yen" or "Restaurant serving local cuisine."

[1437] Step 2:

[1438] The terminal sends the entered conditions to the server.

[1439] Step 3:

[1440] The server searches for stores that meet the specified criteria from its database or partner APIs.

[1441] Step 4:

[1442] The server organizes the search results and creates a list of the best stores.

[1443] Step 5:

[1444] The server sends the store list to the terminal.

[1445] Step 6:

[1446] The device displays a list of stores to the user. The user selects the desired souvenir or restaurant and checks the details.

[1447] Automatic generation of travel diaries

[1448] Step 1:

[1449] The user chooses to automatically generate a travel diary at the end of their trip.

[1450] Step 2:

[1451] The device sends the user's selection to the server.

[1452] Step 3:

[1453] The server collects data gathered during the trip (for example, tourist destinations visited, activities experienced, accommodations, meals eaten, etc.).

[1454] Step 4:

[1455] The server automatically generates a travel diary based on the collected data.

[1456] Step 5:

[1457] The server sends the generated travel diary to the device.

[1458] Step 6:

[1459] The device displays the generated travel diary to the user and provides an interface for making corrections as needed.

[1460] (Example 1)

[1461] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1462] There is a need for a single, integrated system that can efficiently manage everything from travel planning and booking to transportation, access to tourist information, souvenir and restaurant selection, and post-trip record-keeping. Current systems require managing each of these elements individually, resulting in cumbersome operation and a burden on users. Therefore, the challenge is to provide a system that consistently supports the entire travel process and significantly improves user convenience.

[1463] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1464] In this invention, the server includes means for the user to input the travel destination, itinerary, and budget; means for automatically generating an optimal travel plan based on the input information; means for presenting the automatically generated travel plan to the user; means for the user to confirm and modify the presented travel plan; means for the user to input the user's current location and destination; means for calculating the optimal route based on the input information; means for presenting the calculated route to the user; means for inputting information about tourist destinations the user wishes to visit; means for collecting and presenting detailed information about the tourist destinations; means for inputting the user's desired souvenir and restaurant conditions; means for collecting and presenting store information that matches the conditions; means for automatically generating the user's travel record; and means for presenting and modifying the automatically generated travel record to the user. This makes it possible to consistently support the user from planning and booking a trip to transportation, referencing tourist information, selecting souvenirs and restaurants, and creating a post-trip record, thereby greatly improving user convenience.

[1465] A "user" is an individual or group that uses this system to plan and execute a trip.

[1466] A "destination" refers to a geographical location that a user sets as their travel destination.

[1467] "Schedule" refers to the period from the user's start date to the end date of their trip.

[1468] "Budget" refers to the amount of money a user can spend on a trip.

[1469] "Means" refers to equipment, software, or processes used to perform a specific operation or function.

[1470] A "database" is an organized collection of data used to manage user input information and other related information.

[1471] An "API" refers to an application programming interface used to access external services and data and achieve interoperability.

[1472] A "travel plan" refers to a travel itinerary that is planned based on the destination, dates, and budget.

[1473] "Accommodation" refers to hotels and other residential facilities that users book for their stay during their travels.

[1474] A "booking site" refers to a website or service that allows users to make online reservations for accommodations, transportation, and other services.

[1475] "Current location" refers to the user's physical location at that moment.

[1476] A "route" refers to the optimal route or means of transportation from your current location to your destination.

[1477] A "tourist destination" refers to a place that users would like to visit during their travels, and which has historical, cultural, or natural attractions.

[1478] "Souvenirs" refer to goods or items purchased during a trip and taken home.

[1479] "Restaurant" refers to a facility that users visit to eat.

[1480] A "travel log" refers to documents or data that record events experienced and places visited by a user during a trip.

[1481] The travel support system of this invention is a system that allows users to centrally manage everything from planning and booking trips to transportation, accessing tourist information, selecting souvenirs and restaurants, and creating post-trip records. This system is realized by a terminal with a user interface, a server that processes data, and by linking with external databases and APIs.

[1482] First, the user enters their travel destination, dates, and budget through the terminal's input interface. This allows the user to easily send basic travel information to the server. For example, the user might set the destination to "Kyoto," the dates to "October 10th to October 12th," and the budget to "50,000 yen." This information is then sent from the terminal to the server.

[1483] Based on the information received, the server collects relevant information from databases and external APIs (e.g., map service API, hotel reservation API). Using this information, the server automatically generates an optimal travel plan using a generative AI model. For example, a 3-night, 4-day travel plan within Kyoto city limits, costing under 50,000 yen, with accommodation in a 3-star hotel in the city center.

[1484] The generated travel plan is sent from the server to the terminal and presented to the user. The user can review this plan on the terminal and make modifications as needed. For example, it can flexibly accommodate requests such as "I want a more luxurious hotel" or "I want to change the order of the sightseeing spots."

[1485] When a user specifies their desired accommodation conditions, such as "3-star hotel," "city center," and "under 10,000 yen per night," the server uses the API of a partner booking site to search for accommodations that match those conditions. The retrieved information is displayed on the terminal, and the user selects their desired accommodation and proceeds with the booking process. The server confirms the booking through the booking site's API and sends the confirmation information to the terminal.

[1486] During travel, users enter their current location and destination into their device and request route information from the server. For example, if they enter "Current location: Kyoto Station" and "Destination: Kinkaku-ji Temple," the server uses a map service API to calculate the optimal route and sends detailed route information (map, distance, estimated travel time, public transport usage, etc.) to their device. Users can then use this information to travel smoothly.

[1487] Furthermore, when a user searches for information on a tourist destination they wish to visit, selecting a specific destination triggers the server to collect detailed information about the destination (history, points of interest, opening hours, admission fees, etc.) from its internal database and external APIs, and display it on the user's device. For example, selecting "Kiyomizu-dera Temple" will immediately display detailed information about Kiyomizu-dera.

[1488] When a user searches for souvenirs or restaurants during their trip, they enter their desired criteria. For example, if they enter conditions such as "souvenirs under 1,000 yen" or "restaurants serving local cuisine," the server will collect information on relevant establishments based on these criteria and display it as a list on their device. The user can then select from this list and obtain detailed information.

[1489] After the trip ends, users can choose to have their travel diary automatically generated. The server uses an AI model to automatically generate the travel diary based on data accumulated during the trip (visited tourist spots, activities experienced, accommodations, meals, etc.). The generated diary is sent to the user's device, where they can review and revise it as needed.

[1490] Examples of prompt statements:

[1491] "I would like to travel to Kyoto from October 10th to October 12th. My budget is 50,000 yen. Please suggest the best travel plan based on this information."

[1492] This system allows users to efficiently manage the entire travel process within a single integrated system. It provides consistent support for everything from travel planning, booking, transportation, access to tourist information, souvenir and meal selection, to post-trip record-keeping, significantly improving user convenience.

[1493] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1494] Step 1:

[1495] The user enters their travel destination, dates, and budget into the device. Specific examples of input fields include "Destination: Kyoto," "Dates: October 10th to October 12th," and "Budget: 50,000 yen." The device then sends this information to the server.

[1496] input:

[1497] destination

[1498] schedule

[1499] budget

[1500] output:

[1501] User input data is sent to the server.

[1502] Specific actions:

[1503] When a user enters information into the input form on their device and presses the "Submit" button, this information is sent to the server as an HTTP request.

[1504] Step 2:

[1505] Based on the user information received by the server, it collects relevant information from the database and external APIs. For example, it retrieves hotel information from the database and transportation and tourist information from external APIs (map service API, accommodation reservation API).

[1506] input:

[1507] User input data (destination, dates, budget)

[1508] output:

[1509] Relevant information collected from databases and external APIs

[1510] Specific actions:

[1511] The server analyzes the received input data, issues queries to its internal database, and sends requests to external APIs to collect information. The collected information is then integrated within the server.

[1512] Step 3:

[1513] Based on the information collected by the server, an AI model is used to automatically generate the optimal travel plan.

[1514] input:

[1515] Collected relevant information (hotel information, transportation information, tourist information, etc.)

[1516] output:

[1517] Automatically generated travel plan

[1518] Specific actions:

[1519] The collected information is input into the AI ​​model on the server, and the prompt "Destination: Kyoto, Dates: October 10th to October 12th, Budget: Please propose the best travel plan based on 50,000 yen" is used. The generated travel plan is saved on the server.

[1520] Step 4:

[1521] The server generates a travel plan and sends it to the device. The device then presents it to the user, who can review and modify it.

[1522] input:

[1523] Automatically generated travel plan

[1524] output:

[1525] Travel plans presented to the user

[1526] Specific actions:

[1527] The server sends the generated travel plan to the terminal, which then displays its contents to the user. The user can review the displayed plan and make any necessary modifications.

[1528] Step 5:

[1529] The user enters their desired accommodation criteria. For example, "3-star hotel," "city center," and "under 10,000 yen per night." The device then sends these criteria to the server.

[1530] input:

[1531] Desired conditions for the remitter

[1532] output:

[1533] Preferred conditions of the hotel sent to the server

[1534] Specific actions:

[1535] When a user enters criteria into the accommodation search form on their device and presses the "Search" button, these criteria are sent to the server as an HTTP request.

[1536] Step 6:

[1537] The server searches for accommodations that match the user's desired criteria using the API of partner booking sites, and sends the results to the user's device.

[1538] input:

[1539] Desired conditions for the remitter

[1540] output:

[1541] List of accommodations that meet the criteria

[1542] Specific actions:

[1543] The server sends a request to the reservation site API based on the received request conditions, performs a search, and receives the results.

[1544] Step 7:

[1545] The terminal displays a list of accommodation information received by the user, who then selects their preferred accommodation. The user confirms their selection and proceeds with the booking process.

[1546] input:

[1547] List of accommodations that meet the criteria

[1548] output:

[1549] Reservation information for the accommodation selected by the user

[1550] Specific actions:

[1551] The user selects their desired hotel from the list of accommodations displayed on their device and presses the "Confirm Reservation" button, which sends the reservation information to the server.

[1552] Step 8:

[1553] The server confirms the reservation process through the API of the partnered reservation site and sends the reservation information to the terminal.

[1554] input:

[1555] Reservation information for the accommodation selected by the user

[1556] output:

[1557] Confirmed reservation information

[1558] Specific actions:

[1559] The server uses the reservation site API to confirm the reservation and sends the confirmation information to the terminal.

[1560] Step 9:

[1561] The user enters their current location and destination, and requests route information from the server. For example, the user might enter "Kyoto Station" as their current location and "Kinkaku-ji Temple" as their destination.

[1562] input:

[1563] Current location and destination

[1564] output:

[1565] Route information request sent to the server

[1566] Specific actions:

[1567] When a user enters their current location and destination into the route search form on their device and presses the "Search" button, this information is sent to the server.

[1568] Step 10:

[1569] Based on the current location and destination information received by the server, the optimal route is calculated using a map service API, and detailed route information is sent to the terminal.

[1570] input:

[1571] Current location and destination

[1572] output:

[1573] Optimal route information

[1574] Specific actions:

[1575] The server inputs the current location and destination information into a map service API and calculates the optimal route. The resulting route information (map, distance, estimated travel time, information on using public transportation, etc.) is then sent to the terminal.

[1576] Step 11:

[1577] The user enters information about the tourist destination they want to visit into the terminal and requests that information from the server. For example, they might select "Kiyomizu-dera Temple".

[1578] input:

[1579] Tourist destinations I want to visit

[1580] output:

[1581] Tourist destination information request sent to the server

[1582] Specific actions:

[1583] When a user enters the name of a tourist destination they want to visit into the tourist destination search form on their device and presses the "Search" button, this information is sent to the server.

[1584] Step 12:

[1585] The server uses internal databases and external APIs to collect detailed information about tourist destinations and transmit it to the terminal.

[1586] input:

[1587] Tourist destinations I want to visit

[1588] output:

[1589] Detailed information about tourist attractions

[1590] Specific actions:

[1591] The server inputs information about the tourist destination you wish to visit into its internal database and external APIs, collects detailed information such as the history, attractions, opening hours, and admission fees of the tourist destination, and sends it to your device.

[1592] Step 13:

[1593] The user enters their desired souvenir or restaurant criteria into a terminal and requests that information from the server. For example, "souvenirs under 1,000 yen" or "restaurants serving local cuisine."

[1594] input:

[1595] Conditions for souvenirs and restaurants

[1596] output:

[1597] Souvenir and restaurant information request sent to the server

[1598] Specific actions:

[1599] When a user enters their desired criteria into the search form on their device and presses the "Search" button, this information is sent to the server.

[1600] Step 14:

[1601] The server searches for relevant stores from its partner store information database based on the user's preferences and sends that information to the terminal.

[1602] input:

[1603] Conditions for souvenirs and restaurants

[1604] output:

[1605] List of relevant store information

[1606] Specific actions:

[1607] The server inputs the desired criteria into a partner store information database and performs a search. It retrieves a list of matching stores and sends it to the terminal.

[1608] Step 15:

[1609] The user selects the option to automatically generate a travel diary and sends a request to the server. The travel diary is then generated based on the data collected during the trip.

[1610] input:

[1611] Request for automatic generation of travel diary

[1612] output:

[1613] Travel diary generation request sent to the server

[1614] Specific actions:

[1615] When the user selects "Automatically generate travel diary" from the terminal's menu and presses the "Generate" button, this request is sent to the server.

[1616] Step 16:

[1617] The server automatically generates a travel diary using a generative AI model based on data collected during the trip, and then sends the results to the device.

[1618] input:

[1619] Data collected during travel

[1620] output:

[1621] Automatically generated travel diary

[1622] Specific actions:

[1623] The server inputs data collected during the trip (visited tourist spots, activities experienced, accommodations, meals, etc.) into an AI model to automatically generate a travel diary. The generated travel diary is sent to the user's device, and the user can modify and save it as needed.

[1624] (Application Example 1)

[1625] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1626] Traditional travel support systems provided functions such as user travel plan creation, accommodation booking, directions, tourist guides, and automatic generation of travel diaries. However, these functions were specialized for travel and difficult to apply to other uses. Furthermore, there was a need for a system that could comprehensively manage and optimize operations in a logistics center within a single system. In particular, the challenge was to integrate and process functions such as delivery route optimization, inventory management, pallet placement, picking list generation, worker movement optimization, and automatic generation of inventory inflow and outflow reports.

[1627] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1628] In this invention, the server includes means for the user to input the travel destination, itinerary, and budget; means for automatically generating an optimal travel plan based on the input information; means for presenting the automatically generated travel plan to the user; means for the user to confirm and modify the presented travel plan; means for centrally managing and optimizing operations within the logistics center; means for optimizing delivery routes; means for managing inventory within the warehouse; means for optimally arranging pallets and shelves; means for generating picking lists; means for optimizing worker movement; and means for automatically generating inventory inflow and outflow reports. This enables comprehensive optimization of operations within a logistics center using a single system, resulting in efficient operation.

[1629] "Travel destination" refers to information indicating the place the user wants to go.

[1630] "Schedule" refers to information that indicates the period during which the user will be traveling.

[1631] "Budget" refers to the amount of money a user plans to spend on their trip.

[1632] An "optimal travel plan" is the most efficient and satisfying travel plan, calculated and generated based on the user's input information.

[1633] A "logistics center" is a facility where operations such as the storage, sorting, and distribution of goods and materials are carried out in a centralized manner.

[1634] "Means for centrally managing and optimizing operations" refers to methods for comprehensively managing and streamlining the entire business process within a logistics center.

[1635] "Methods for optimizing delivery routes" refer to methods for calculating and optimizing the delivery route of goods to achieve the shortest distance and shortest time.

[1636] "Means of managing inventory within a warehouse" refers to methods for efficiently managing the quantity and location of inventory stored within a warehouse.

[1637] "Methods for optimally arranging pallets and shelves" refers to methods for efficiently arranging pallets and shelves and making the most of available space.

[1638] "Methods for generating picking lists" refer to methods for listing the items needed for orders and shipments, and for efficiently picking them.

[1639] "Methods for optimizing worker movement" refer to methods for optimizing the routes workers take within warehouses and logistics centers, thereby reducing unnecessary movement.

[1640] "Methods for automatically generating inventory inflow and outflow reports" refers to methods for automatically generating reports based on information about inventory inflows and outflows.

[1641] Modes for carrying out the invention

[1642] System Overview

[1643] The system according to the present invention provides multiple functions in an integrated manner to streamline operations within a logistics center. This system applies travel support system technology to logistics operations and includes the following main functions:

[1644] 1. Optimizing delivery routes

[1645] 2. Inventory management within the warehouse

[1646] 3. Optimal placement of pallets and shelves

[1647] 4. Generating a picking list

[1648] 5. Optimizing worker movement patterns

[1649] 6. Automatic generation of inventory in / out reports

[1650] Hardware and software used

[1651] The system consists of devices such as servers, terminals, and robots. The specific hardware and software used include the following:

[1652] Server: The central component that processes data and performs optimization calculations based on user input.

[1653] Device: A device used by a user to input information and display results. Examples: smartphone, tablet.

[1654] Robot: A device that performs picking and placement tasks within a logistics center.

[1655] Software: Programming languages ​​such as Python and JavaScript, libraries for API requests (e.g., requests), and database management systems (e.g., MySQL).

[1656] Process Overview

[1657] 1. Optimizing delivery routes

[1658] The server calculates the optimal delivery route based on the current location and destination. A map API is used to suggest the shortest distance or shortest time route. The calculation results are sent to the terminal or robot for execution.

[1659] Example prompt:

[1660] "Please generate the optimal picking route within the warehouse."

[1661] 2. Inventory management within the warehouse

[1662] The server manages the quantity and location information of inventory items. When inbound and outbound information is entered by users, the inventory database is updated. This makes it possible to monitor inventory status in real time.

[1663] Example prompt:

[1664] "Please display the current stock quantity and location of item ID 001."

[1665] 3. Optimal placement of pallets and shelves

[1666] The server calculates the optimal placement of pallets and shelves to maximize space utilization within the warehouse. This reduces wasted space and enables efficient storage.

[1667] 4. Generating a picking list

[1668] The server automatically generates a picking list based on the order information. The picking list is sent to terminals or robots, enabling efficient picking operations.

[1669] 5. Optimizing worker movement patterns

[1670] The server calculates the optimal movement path based on the worker's current task and travel route. This reduces unnecessary movement and improves work efficiency.

[1671] 6. Automatic generation of inventory in / out reports

[1672] The server automatically generates periodic inventory inflow and outflow reports based on inventory inflow and outflow information. This ensures transparency in inventory management and enables efficient operation.

[1673] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1674] Step 1:

[1675] Users input warehouse inventory information into a terminal. This includes information such as the ID, quantity, and location of each item. The input data is sent to a server, which stores the data in a database. The inventory management system updates this data in real time and uses it for subsequent processing.

[1676] Step 2:

[1677] The user requests optimization of a specific delivery route. They enter their current location and destination on their device and send this information to the server. The server uses a map API to calculate the optimal route based on this input data. The calculation results generate the shortest distance or shortest time route information, which is then sent to the device and the robot. The robot operates based on this route information.

[1678] Step 3:

[1679] The server optimizes the placement of pallets and shelves within the warehouse. In this step, it runs an algorithm based on inventory information and warehouse space data to calculate the most efficient placement plan. The calculation results are output to the terminal as a proposed placement.

[1680] Step 4:

[1681] The user requests the generation of a picking list for a specific order. They enter the order ID into a terminal and send that information to the server. The server generates a list of necessary items based on the order data, and creates a picking list that also includes information about the shelves where those items are located. The picking list is sent to the terminal or robot, and the picking operation is carried out efficiently.

[1682] Step 5:

[1683] The server optimizes the worker's movement. It collects information on the worker's current location and the task they are currently performing, and runs an algorithm to calculate the most efficient movement path. The calculation result is output to the terminal as the optimal travel path, and the worker performs their work according to that path.

[1684] Step 6:

[1685] The server automatically generates inventory inflow and outflow reports on a regular basis. It collects inventory inflow and outflow information, performs data analysis, and creates reports. The generated reports are sent to terminals, where users can view them. This improves the transparency and efficiency of inventory management.

[1686] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1687] The travel support system according to the present invention generates an optimal travel plan, makes accommodation reservations, provides directions, guides tourists, recommends souvenirs and restaurants, and automatically generates a travel diary, based on user input information and emotional information recognized by an emotion engine. This system is realized by a terminal with a user interface, a server that processes data, and by linking with external databases and APIs.

[1688] 1. User travel plan creation

[1689] The user enters their travel destination, dates, and budget into their device. The server receives the input information and collects relevant information from databases and external APIs. For example, if the user enters "Kyoto" as the destination, "October 10th to October 12th" as the dates, and "50,000 yen" as the budget, the server automatically generates the most suitable hotels, sightseeing spots, and transportation options based on this information. Furthermore, an emotion engine recognizes the user's emotional state and customizes the travel plan, for example, suggesting a relaxing itinerary if the user is feeling stressed. The generated plan is sent to the device, where the user can review and modify it.

[1690] 2. Hotel Reservation

[1691] The user enters their desired accommodation criteria. For example, if the user enters "3-star hotel," "city center," and "under 10,000 yen per night," the server searches affiliated booking sites and lists hotels that match the criteria. Based on the emotional information recognized by the emotion engine, if, for example, the user is detected as tired, it will suggest hotels with ample relaxation facilities. Information on the relevant hotels is displayed on the terminal, and the user selects their preferred hotel and proceeds with the booking process. The server confirms the booking process through the booking site's API.

[1692] 3. Directions

[1693] The user enters their current location and destination. For example, if the current location is "Kyoto Station" and the destination is "Kinkaku-ji Temple," the server uses a map API to calculate the optimal route. The emotion engine suggests routes that reduce the user's current fatigue and stress levels, such as routes that avoid crowds and include rest stops. The calculated route information is sent to the device and displayed to the user. Details such as the map, distance, estimated travel time, and how to use public transport are displayed.

[1694] 4. Tourist Guide

[1695] The user selects a tourist destination they wish to visit. For example, if they select "Kiyomizu-dera Temple," the server gathers detailed information about Kiyomizu-dera from its internal database and external APIs. An emotion engine then customizes the information based on the user's interests and emotions, for example, highlighting natural attractions for users who want to relax. The collected information is displayed on the device for easy access by the user.

[1696] 5. Recommendations for souvenirs and restaurants

[1697] The user enters their desired souvenir or restaurant criteria. For example, if they enter "souvenirs under 1,000 yen" and "restaurant serving local cuisine," the server collects information on stores that match the criteria. An emotion engine customizes the information based on the user's preferences and mood; for example, if the user is tired, it might suggest a relaxing cafe. A list of suitable stores is displayed on the terminal, and the user can select the souvenir or restaurant that best suits their needs.

[1698] 6. Automatic generation of travel diaries

[1699] At the end of the trip, the user can choose to have a travel diary automatically generated. The server automatically generates the travel diary based on the data collected during the trip. For example, details such as the tourist spots visited, activities experienced, accommodations, and meals are automatically generated as text. An emotion engine reflects the user's emotional changes during the trip, customizing the diary content by highlighting important emotional moments. The generated travel diary is sent to the device, where the user can review and edit it as needed.

[1700] In this way, by combining user input information with emotional information recognized by the emotion engine, this system can seamlessly manage the entire travel process and provide the user with the optimal travel experience.

[1701] The following describes the processing flow.

[1702] User travel plan creation

[1703] Step 1:

[1704] The user enters their travel destination, dates, and budget. For example, they might enter "Kyoto," "October 10th to October 12th," and "50,000 yen."

[1705] Step 2:

[1706] The terminal sends the entered information to the server.

[1707] Step 3:

[1708] The server activates the emotion engine to recognize the user's current emotional state. If the user is feeling stressed, it retrieves that information.

[1709] Step 4:

[1710] The server retrieves the necessary data for generating travel plans from databases and external APIs. For example, this includes tourist attractions in Kyoto, accommodations, and transportation options.

[1711] Step 5:

[1712] Based on data acquired by the server, the system automatically generates an optimal travel plan tailored to the user's emotional state. For example, if the user is feeling stressed, it will suggest a plan that includes many relaxing activities.

[1713] Step 6:

[1714] The server sends the generated travel plan to the device.

[1715] Step 7:

[1716] The device displays the travel plan to the user. The user can review the plan details and modify them as needed.

[1717] Hotel Reservations

[1718] Step 1:

[1719] The user enters their desired accommodation criteria. For example, they might enter "3-star hotel," "city center," and "under 10,000 yen per night."

[1720] Step 2:

[1721] The terminal sends the entered conditions to the server.

[1722] Step 3:

[1723] The server uses an emotion engine to recognize the user's emotional state. For example, it might recognize that the user is tired.

[1724] Step 4:

[1725] The server calls the API of a partner booking site to search for hotels that meet the specified criteria.

[1726] Step 5:

[1727] The server organizes the search results and lists suitable hotels based on the results of the sentiment engine. For example, it might prioritize hotels with ample relaxation facilities.

[1728] Step 6:

[1729] The server sends the hotel list to the terminal.

[1730] Step 7:

[1731] The terminal displays a list of hotels to the user. The user selects their desired hotel and proceeds with the booking process.

[1732] Step 8:

[1733] The server uses the booking site's API to complete the booking process and confirm the reservation for the selected hotel.

[1734] Directions

[1735] Step 1:

[1736] The user enters their current location and destination. For example, they might enter "Kyoto Station" and "Kinkaku-ji Temple".

[1737] Step 2:

[1738] The terminal sends the entered information to the server.

[1739] Step 3:

[1740] The server uses an emotion engine to recognize the user's emotional state. For example, it might recognize that the user is tired.

[1741] Step 4:

[1742] The server calls a map API to calculate the optimal route. Depending on the user's emotional state, it suggests routes that avoid congestion or include rest stops.

[1743] Step 5:

[1744] The server sends the calculation results to the terminal.

[1745] Step 6:

[1746] The device displays route information to the user. Detailed information such as maps, distance, estimated travel time, and instructions on using public transportation are shown.

[1747] Tourist guide

[1748] Step 1:

[1749] The user selects a tourist destination they want to visit. Example: Select "Kiyomizu-dera Temple".

[1750] Step 2:

[1751] The device sends information about the selected tourist destination to the server.

[1752] Step 3:

[1753] The server uses an emotion engine to recognize the user's emotional state. For example, it recognizes that the user wants to relax.

[1754] Step 4:

[1755] The server retrieves information about tourist destinations from internal databases and external APIs.

[1756] Step 5:

[1757] The server organizes the information it has gathered and customizes it based on the user's emotional state, highlighting relaxing sights and activities.

[1758] Step 6:

[1759] The server sends tourist guide information to the terminal.

[1760] Step 7:

[1761] The device displays tourist guide information to the user, including history, points of interest, opening hours, and admission fees.

[1762] Recommended souvenirs and restaurants

[1763] Step 1:

[1764] The user enters their desired souvenir or restaurant criteria. For example, they might enter "Souvenirs under 1,000 yen" or "Restaurant serving local cuisine."

[1765] Step 2:

[1766] The terminal sends the entered conditions to the server.

[1767] Step 3:

[1768] The server uses an emotion engine to recognize the user's emotional state. For example, it recognizes that the user wants to relax.

[1769] Step 4:

[1770] The server searches for store information that matches the specified criteria from the database or affiliated APIs.

[1771] Step 5:

[1772] The server organizes search results and suggests the most suitable stores based on the user's emotional state, prioritizing relaxing cafes and shops.

[1773] Step 6:

[1774] The server sends the store list to the terminal.

[1775] Step 7:

[1776] The device displays a list of stores to the user. This list includes store names, addresses, opening hours, and details about products and menus.

[1777] Automatic generation of travel diaries

[1778] Step 1:

[1779] The user chooses to automatically generate a travel diary at the end of their trip.

[1780] Step 2:

[1781] The device sends the user's selection to the server.

[1782] Step 3:

[1783] The server collects data during the trip (such as tourist destinations visited, activities experienced, accommodations, and meals eaten).

[1784] Step 4:

[1785] The server uses an emotion engine to analyze the user's emotional changes during their trip.

[1786] Step 5:

[1787] The server automatically generates a travel diary based on collected data and emotional information. It highlights important emotional moments and creates a detailed diary.

[1788] Step 6:

[1789] The server sends the generated travel diary to the device.

[1790] Step 7:

[1791] The device displays the generated travel diary to the user and provides an interface that allows the user to modify it as needed.

[1792] (Example 2)

[1793] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1794] Traditional travel support systems provide simple plans without considering the user's emotional state, lacking customization to suit individual feelings and preferences. Furthermore, they lacked sufficient integrated support for users to seamlessly plan trips, book accommodations, and get directions. As a result, users often had to expend considerable time and effort to achieve a better travel experience.

[1795] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server is

[1796] A means for users to input their travel destination, dates, and budget,

[1797] A means for automatically generating an optimal travel plan based on the input information,

[1798] A means for presenting the automatically generated travel plan to the user,

[1799] A means for the user to review and modify the aforementioned travel plan,

[1800] A means of recognizing the user's emotional state using an emotion engine and customizing travel plans,

[1801] This includes providing optimal travel plans that take into account the user's emotional state.

[1802] Also, the server,

[1803] A means for users to enter their desired accommodation conditions,

[1804] A means of obtaining information from affiliated reservation sites based on the aforementioned entered conditions,

[1805] A means of presenting the acquired information to the user and confirming the reservation,

[1806] A means of suggesting accommodations based on the user's emotional state using an emotion engine,

[1807] This includes enabling accommodation suggestions and bookings based on user sentiment.

[1808] Furthermore, the server,

[1809] A means for the user to input their current location and destination,

[1810] A means for calculating the optimal route based on the input information,

[1811] Means for presenting the calculated route to the user,

[1812] A means of customizing the path based on the user's emotional state using an emotion engine,

[1813] This includes providing the optimal path tailored to the user's emotional state.

[1814] These measures provide an integrated travel support system that utilizes an emotion engine to consider the user's emotional state, allowing users to have a more satisfying travel experience.

[1815] A "user" is an individual or group that uses the system to create, review, or modify travel plans.

[1816] A "terminal" is an electronic device used by a user to input information and receive information from a system.

[1817] A "server" is a central processing unit that receives input information from users and performs tasks such as generating travel plans, collecting data, and analyzing it using an emotion engine.

[1818] A "travel plan" refers to information such as itineraries, accommodations, and sightseeing spots that are automatically generated based on the user's input information and the results of the emotion engine's analysis.

[1819] An "emotion engine" is software or an algorithm that analyzes user input data and past data to recognize the user's emotional state and customize the plan accordingly.

[1820] "Customization" refers to individually adjusting the plans and information provided based on the user's emotional state and preferences.

[1821] A "database" is a digital storage system that stores travel-related information and allows it to be searched and retrieved as needed.

[1822] An "API" is an interface that enables communication with external services and databases, and is used for integration with partner reservation sites and map services.

[1823] A "booking site" is an online platform for booking accommodations, transportation, activities, and other similar services.

[1824] "Route" refers to the optimal means of transportation and route from the user's specified starting point to the destination.

[1825] "Recommendations" refer to the optimal options presented by the system based on the user's input information and emotional state.

[1826] A "travel diary" is a record of places visited, activities, and emotional changes during a trip, compiled in an automatically generated text format.

[1827] The travel support system according to the present invention is a system that generates an optimal travel plan, makes accommodation reservations, provides directions, guides tourists, recommends souvenirs and restaurants, and automatically generates a travel diary based on user input information and emotional information recognized by an emotion engine. This system is realized by a terminal with a user interface, a server that processes data, and by linking with external databases and APIs.

[1828] Users input information such as their travel destination, dates, and budget using their device. For example, if a user enters information such as "Kyoto," "October 10th to October 12th," and "50,000 yen," the server receives this information and collects relevant information from its database and external APIs. Based on the user's input, the server automatically generates a plan of the most suitable accommodations, sightseeing spots, and transportation. This system also uses an emotion engine to recognize the user's emotional state and can suggest plans that promote relaxation, for example.

[1829] Furthermore, it also has a function to search for accommodations based on conditions entered by the user. For example, if the user enters conditions such as "3-star hotel," "city center," and "under 10,000 yen per night," the server retrieves information through the API of partner booking sites and presents that information to the user. An emotion engine analyzes the user's emotional state and suggests relaxing hotels for tired users. Once the user selects a desired hotel and proceeds with the booking process, the server confirms the reservation through the booking site's API.

[1830] Furthermore, when a user enters their current location and destination, the server uses a map API to calculate the optimal route. For example, if the current location is entered as "Kyoto Station" and the destination as "Kinkaku-ji Temple," the server will suggest a route that avoids congestion and includes rest stops. This is also a result of the emotion engine taking the user's emotional state into consideration. The calculated route information is sent to the device, where a map, distance, estimated travel time, and information on using public transportation are displayed in detail.

[1831] The app also includes a tourist guide function; when a user selects a tourist destination they wish to visit, the server collects detailed information from an internal database and external APIs. For example, if "Kiyomizu-dera Temple" is selected, the emotion engine customizes the information based on the user's interests and emotions, providing users who want to relax with a focus on natural attractions. The collected information is displayed on the device for easy reference.

[1832] Furthermore, it also has a function to guide users to souvenirs and restaurants. When a user enters conditions such as "souvenirs under 1,000 yen" or "restaurants serving local cuisine," the server collects information on stores that match the conditions, and an emotion engine customizes the information based on the user's preferences and mood. For example, it suggests a relaxing cafe to a tired user. A list of relevant stores is displayed on the device, and the user can select souvenirs or restaurants that suit their needs.

[1833] At the end of the trip, if the user chooses to automatically generate a travel diary, the server will automatically generate a travel diary based on the data collected during the trip. For example, details such as the tourist attractions visited, activities experienced, accommodations, and meals eaten will be automatically generated as text. An emotion engine will reflect the user's emotional changes during the trip, customizing the diary content by highlighting important emotional moments. The generated travel diary is sent to the device, where the user can review and edit it as needed.

[1834] Example of a prompt

[1835] "Please create a sightseeing plan for a visit to Kyoto from October 10th to October 12th. The budget is 50,000 yen."

[1836] "Could you please give me directions from Kyoto Station to Kinkaku-ji Temple? I'd like to avoid the crowds."

[1837] "Could you tell me about some relaxing sights at Kiyomizu-dera Temple?"

[1838] In this way, by combining user input information with emotional information recognized by the emotion engine, the system seamlessly manages the entire travel process and provides the user with the optimal travel experience.

[1839] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1840] Step 1:

[1841] The user enters their travel destination, dates, and budget using the device's interface.

[1842] Specific action: The user enters "Kyoto," "October 10th to October 12th," and "50,000 yen" into the search field on their device and presses the send button.

[1843] Input: Travel destination, dates, budget

[1844] Output: Data sent from the terminal to the server based on user input.

[1845] Step 2:

[1846] The server receives user input and collects relevant information from databases and external APIs.

[1847] Specific operation: The server uses the entered information "Kyoto," "October 10th to October 12th," and "50,000 yen" to collect data on accommodations, tourist attractions, and transportation.

[1848] Input: User-entered travel destination, dates, and budget information.

[1849] Output: Information on the best accommodations, tourist attractions, and transportation options.

[1850] Step 3:

[1851] The server uses an emotion engine to analyze user input and past data to recognize the user's emotional state.

[1852] Specific operation: The emotion engine analyzes whether the user is feeling stressed and suggests a relaxation plan that can reduce stress.

[1853] Input: User input information, historical data

[1854] Output: Recognition results of the user's emotional state

[1855] Step 4:

[1856] The server automatically generates the optimal travel plan based on the user's input information and the results of the emotion engine's analysis.

[1857] Specific operation: The server will create a plan that includes a stay at a three-star hotel in Kyoto, sightseeing at Kiyomizu-dera and Kinkaku-ji temples, and a visit to relaxing cafes.

[1858] Input: User input information, emotion engine analysis results, information from databases and external APIs.

[1859] Output: Auto-generated travel plan

[1860] Step 5:

[1861] The server generates a travel plan and sends it to the user's device, which then displays it.

[1862] Specific action: The plan details will be displayed as a pop-up on the device for the user to review.

[1863] Input: Auto-generated travel plan

[1864] Output: Display of travel plan

[1865] Step 6:

[1866] The user enters their desired accommodation criteria.

[1867] Specific action: The user enters "3-star hotel," "city center," and "under 10,000 yen per night," and presses the submit button.

[1868] Input: Desired accommodation conditions

[1869] Output: Data sent from the terminal to the server based on the conditions entered by the user.

[1870] Step 7:

[1871] The server uses the API of partner booking sites to collect hotel information that matches the specified criteria.

[1872] Specific operation: The server sends a query to partner sites and lists hotels that meet the criteria of "3-star hotel," "city center," and "under 10,000 yen per night."

[1873] Input: Desired accommodation conditions

[1874] Output: List of suggested hotels

[1875] Step 8:

[1876] The server uses an emotion engine to suggest hotels that take into account the user's emotional state.

[1877] Specific action: The emotion engine recognizes that the user is tired and suggests a hotel with a spa.

[1878] Input: Desired accommodation conditions, user's emotional state

[1879] Output: Hotel recommendations that reflect the user's emotional state.

[1880] Step 9:

[1881] The server sends suggested hotel information to the terminal, which then displays it.

[1882] Specific action: A list of suggested hotels is displayed on the device.

[1883] Input: Hotel suggestions that reflect the user's emotional state.

[1884] Output: List of hotels

[1885] Step 10:

[1886] The user selects their desired hotel and completes the booking process on their device. The server confirms the booking through the booking site's API.

[1887] Specific operation: When the user selects their desired hotel and presses the book button, the server processes the booking confirmation.

[1888] Input: Hotel information selected by the user

[1889] Output: Hotel reservation confirmed

[1890] Step 11:

[1891] The user enters their current location and destination.

[1892] Specific action: The user enters "Kyoto Station" and "Kinkaku-ji Temple".

[1893] Input: Current location and destination

[1894] Output: Data sent from the terminal to the server based on user input.

[1895] Step 12:

[1896] The server uses a map API to calculate the optimal route.

[1897] Specific operation: The server queries the map API and calculates the route.

[1898] Input: Current location and destination

[1899] Output: Optimal route information

[1900] Step 13:

[1901] The server uses an emotion engine to customize the route based on the user's emotional state.

[1902] Specific action: Suggest a route that includes rest stops to avoid congestion.

[1903] Input: User's emotional state, optimal route information

[1904] Output: Customized route information

[1905] Step 14:

[1906] The server sends the calculated route information to the terminal, and the terminal displays it.

[1907] Specific actions: The device displays a map, distance, estimated travel time, and instructions on using public transportation.

[1908] Input: Customized route information

[1909] Output: Display of route information

[1910] Step 15:

[1911] The user selects the tourist destination they want to visit.

[1912] Specific action: The user selects "Kiyomizu-dera Temple".

[1913] Input: Selection of tourist destination

[1914] Output: Data sent from the terminal to the server based on the information selected by the user.

[1915] Step 16:

[1916] The server collects detailed information about tourist destinations from internal databases and external APIs.

[1917] Specific operation: The server collects information about Kiyomizu-dera Temple from a database and external APIs.

[1918] Input: Tourist destination selection information

[1919] Output: Detailed information about tourist attractions

[1920] Step 17:

[1921] The server uses an emotion engine to provide information based on the user's interests and emotions.

[1922] Specific action: Provide users who want to enjoy nature with information about natural attractions that emphasize the natural environment.

[1923] Input: User's interests and emotional state, detailed information about tourist destinations.

[1924] Output: Customized tourist information

[1925] Step 18:

[1926] The server sends the collected guide information to the terminal, and the terminal displays it.

[1927] Specific action: Detailed tourist information will be displayed on the device.

[1928] Input: Customized tourist destination information

[1929] Output: Display of tourist information

[1930] Step 19:

[1931] The user enters their desired souvenirs and restaurant preferences.

[1932] Specific action: The user enters "souvenirs under 1,000 yen" and "restaurant serving local cuisine".

[1933] Input: Conditions for souvenirs and restaurants

[1934] Output: Data sent from the terminal to the server based on the conditions entered by the user.

[1935] Step 20:

[1936] The server collects store information that matches the specified criteria from an external API.

[1937] Specific operation: The server sends a query to the partner API and retrieves store information that matches the criteria.

[1938] Input: Conditions for souvenirs and restaurants

[1939] Output: Relevant store information

[1940] Step 21:

[1941] The server uses an emotion engine to provide recommendations based on the user's preferences and mood.

[1942] Specific action: Suggest a relaxing cafe to tired users.

[1943] Input: User preferences and mood, store information

[1944] Output: Customized store information

[1945] Step 22:

[1946] The server sends the collected store information to the terminal, which then displays it.

[1947] Specific action: A list of recommended stores will be displayed on the device.

[1948] Input: Customized store information

[1949] Output: Display of store information

[1950] Step 23:

[1951] At the end of the trip, the user can choose to have a travel diary automatically generated.

[1952] Specific action: After the trip ends, the user selects "Automatically generate travel diary".

[1953] Input: Select option for automatic generation of travel diary

[1954] Output: Data sent from the terminal to the server containing user selection information.

[1955] Step 24:

[1956] The server automatically generates a travel diary based on data collected during the trip.

[1957] Specific operation: The server generates text based on information about tourist destinations, accommodations, and restaurants visited.

[1958] Input: Data collected during the trip

[1959] Output: Auto-generated travel diary

[1960] Step 25:

[1961] The server uses an emotion engine to customize the travel diary, highlighting important emotional moments and generating content.

[1962] Specific actions: Highlight and record in your diary moments that you particularly enjoyed.

[1963] Input: Data collected during the trip, results of emotion engine analysis

[1964] Output: Customized travel diary

[1965] Step 26:

[1966] The server generates a travel diary and sends it to the device, which then displays it.

[1967] Specific operation: A detailed travel diary is displayed on the device for the user to review.

[1968] Input: Customized travel diary

[1969] Output: Display of travel diary

[1970] (Application Example 2)

[1971] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1972] Traditional travel support systems required users to manually select and book travel plans and accommodations individually, which was a cumbersome process. Furthermore, they struggled to automatically adjust plans to suit the user's mood and fatigue level, and offered insufficient suggestions to reduce user fatigue, especially during long journeys and sightseeing. Additionally, real-time navigation and tourist information were not provided during vehicle travel, limiting user convenience.

[1973] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[1974] In this invention, the server includes means for the user to input the travel destination, itinerary, and budget; means for automatically generating an optimal travel plan based on the input information; means for presenting the automatically generated travel plan to the user; means for the user to confirm and modify the presented travel plan; means for providing route information to an autonomous vehicle and guiding it to the destination; means for collecting and presenting information on tourist destinations the user will visit; and means for suggesting optimal sightseeing plans and rest spots based on the user's emotional state. This allows the user to manage all aspects of their trip in one place and enables an optimal travel experience and fatigue recovery based on their emotional state.

[1975] A "travel destination" is a place that a user plans to visit during their trip.

[1976] "Itinerary" refers to the period of time that includes the start and end dates of a trip.

[1977] "Budget" refers to the total cost of the trip, which is the amount the user plans to spend.

[1978] A "travel plan" is a plan that includes the travel itinerary, places to visit, means of transportation, and accommodations, which are automatically generated based on the user's input information.

[1979] An "autonomous vehicle" is a vehicle that can travel autonomously to its destination without the need for a human driver.

[1980] "Route information" refers to data about the travel route from the current location to the destination.

[1981] A "tourist destination" refers to a tourist spot or famous place that a user would like to visit.

[1982] "Emotional state" refers to the user's current psychological and physiological state, including fatigue levels and stress levels.

[1983] A "rest stop" is a place where travelers can take a short break or refresh themselves during their trip.

[1984] "Accommodation facilities" refer to facilities such as hotels and inns where users stay during their travels.

[1985] A "booking site" is a website used to make online reservations for accommodations and other travel-related facilities.

[1986] A "navigation system" is a system that calculates the optimal route to a destination and provides real-time directions.

[1987] This invention is a system for improving the user's travel experience, and this system is realized by the following means and processes: The user inputs information such as travel destination, itinerary, and budget through a user interface. This information is sent from the terminal to a server, which automatically generates an optimal travel plan based on the above information. The generated plan is then sent back to the terminal and presented to the user.

[1988] The server first receives user input information and then collects relevant information through external databases and APIs. For example, if a user enters "City A" as the "travel destination," "January 1st to January 3rd" as the "dates," and "50,000 yen" as the "budget," the server automatically selects the most suitable accommodations, tourist attractions, and modes of transportation to generate a travel plan.

[1989] Furthermore, the system includes an emotion engine that detects the user's emotional state. The emotion engine analyzes the user's voice and facial expressions to assess their current psychological and physiological condition. Based on this information, the server dynamically customizes the travel plan, for example, suggesting relaxing activities if the user is feeling stressed.

[1990] During their trip, users can utilize self-driving vehicles. These vehicles provide directions to their destinations based on route information provided by a server. For example, if a user enters "Departure Point B" as their current location and "Tourist Spot C" as their destination, the server calculates the optimal route and sends it to the self-driving vehicle. At this time, an emotion engine can sense the user's fatigue level and suggest a route that includes rest stops along the way, for example.

[1991] As the vehicle approaches a tourist destination, information about that destination is provided to the user through monitors and audio systems inside the autonomous vehicle. The server collects detailed tourist destination information from internal databases and external APIs, and displays information customized according to the user's interests and feelings.

[1992] Furthermore, users can input information about restaurants they want to visit and souvenirs they want to buy during their trip. The server provides optimal store information based on the user's conditions and preferences. For example, by searching for "souvenirs under 1,000 yen" or "restaurants serving local cuisine," stores that match the criteria will be listed.

[1993] At the end of the trip, the server automatically generates a travel diary based on the data collected during the trip. This travel diary includes information on the tourist attractions visited, the activities experienced, and the accommodations, and also reflects the user's emotional changes. The generated travel diary is sent to the user's device, where they can review and edit it.

[1994] The program uses Python to communicate with APIs and perform data collection and calculations. The emotion engine utilizes speech analysis and facial recognition technologies, specifically OpenCV and Google Cloud's Emotional Analytics API. Google Maps API and OpenStreetMap API are used for navigation.

[1995] As a concrete example, the following prompt sentences can be input into the generating AI model:

[1996] "I would like to travel to City A between October 10th and October 12th, 2023, with a budget of 50,000 yen. Please suggest the best travel plan, including places where I can relax."

[1997] Therefore, this system can manage every aspect of a trip in one place and provide an optimal travel experience based on the user's emotional state.

[1998] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1999] Step 1:

[2000] The user enters their travel destination, dates, and budget into the device. Once the user enters this information, the device sends the data to the server. The entered information is provided to the server as text data.

[2001] Step 2:

[2002] The server collects relevant information from external databases and APIs based on the destination, dates, and budget received from the user. Specifically, it retrieves data such as hotel availability, tourist attraction details, and transportation options. Data processing at this stage involves tagging and formatting the collected data. As a result, a list of integrated travel plan candidates is generated.

[2003] Step 3:

[2004] The emotion engine analyzes the user's voice input and facial expression data to recognize the user's current emotional state. This recognized emotional information is used to customize the travel plan. For example, if the user is fatigued, relaxing activities will be included in the plan. After the emotional data is entered into the server, it is analyzed and tagged with the corresponding emotion.

[2005] Step 4:

[2006] The server generates an optimal travel plan based on the user's input information and emotional state. This plan includes accommodations, sightseeing spots, and transportation. The plan is generated using a generative AI model. Specifically, information that matches the user's preferences and emotional state is automatically selected. The generated travel plan is sent to the device in text format.

[2007] Step 5:

[2008] The terminal displays a generated travel plan to the user. The user reviews this plan and makes modifications as needed, such as changing accommodations or adding tourist attractions. The modified plan is sent back to the server for final confirmation. The user's modification information is sent to the server and reflected in the database.

[2009] Step 6:

[2010] When a user uses an autonomous vehicle, the server provides route information. The user enters their current location and destination into a terminal, and this data is sent to the server. Based on the entered information, the server calculates the optimal route and suggests a route that includes rest stops, depending on the user's emotional state. The calculated route is then sent to the autonomous vehicle.

[2011] Step 7:

[2012] Autonomous vehicles navigate to their destinations based on route information received from a server. Real-time directions are provided to the user through in-vehicle monitors and voice systems. As the vehicle approaches a tourist destination, information about that destination is displayed. Route information and tourist destination data are entered into the vehicle's navigation system and provided to the user.

[2013] Step 8:

[2014] At the end of the trip, if the user chooses to automatically generate a travel diary, the server will generate a diary based on the data collected during the trip. The diary will include information about the tourist spots the user visited, the activities they experienced, their accommodations, and a reflection of their emotional changes. The generated travel diary will be sent to the user's device in text format, where they can review and edit it.

[2015] Example of a prompt:

[2016] "I would like to travel to City A between October 10th and October 12th, 2023, with a budget of 50,000 yen. Please suggest the best travel plan, including places where I can relax."

[2017] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[2018] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include those described above. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions shown by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2019] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[2020] [Fourth Embodiment]

[2021] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[2022] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[2023] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[2024] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[2025] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[2026] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[2027] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[2028] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[2029] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[2030] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[2031] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[2032] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[2033] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[2034] The travel support system according to the present invention generates an optimal travel plan, makes accommodation reservations, provides directions, tourist information, souvenir and restaurant recommendations, and automatically generates a travel diary, all based on the user's input of necessary information such as travel destination, itinerary, and budget. The system of the present invention is realized by a terminal with a user interface, a server that processes data, and by linking with an external database or API.

[2035] 1. User travel plan creation

[2036] The user enters their travel destination, dates, and budget into their device. The server receives this information and collects relevant data from its database and external APIs. For example, if the user enters "Kyoto" as the destination, "October 10th to October 12th" as the dates, and "50,000 yen" as the budget, the server automatically generates the most suitable hotel, sightseeing spots, and transportation options based on this information. The generated plan is sent to the user's device, where they can review and modify it.

[2037] 2. Hotel Reservation

[2038] The user enters their desired accommodation criteria. For example, if the user enters criteria such as "3-star hotel," "city center," and "under 10,000 yen per night," the server searches affiliated booking sites and lists hotels that match the criteria. The information of the relevant hotels is displayed on the terminal, and the user selects their desired hotel from the list and proceeds with the booking process. The server confirms the booking process through the booking site's API.

[2039] 3. Directions

[2040] The user enters their current location and destination. For example, if the current location is "Kyoto Station" and the destination is "Kinkaku-ji Temple," the server uses a map API to calculate the optimal route. The calculated route information is sent to the device and displayed to the user. Details such as the map, distance, estimated travel time, and information on using public transportation are displayed.

[2041] 4. Tourist Guide

[2042] The user selects a tourist destination they wish to visit. For example, if they select "Kiyomizu-dera Temple," the server collects detailed information about Kiyomizu-dera from its internal database and external APIs. This information includes the history of the tourist destination, its highlights, opening hours, and admission fees. The collected information is displayed on the device for easy access by the user.

[2043] 5. Recommendations for souvenirs and restaurants

[2044] The user enters their desired souvenir or restaurant criteria. For example, if they enter criteria such as "souvenirs under 1,000 yen" or "restaurant serving local cuisine," the server collects information on stores that match those criteria. A list of matching stores is displayed on the terminal, and the user can select the souvenir or restaurant that suits their needs.

[2045] 6. Automatic generation of travel diaries

[2046] At the end of the trip, the user can choose to have a travel diary automatically generated. The server automatically generates the travel diary based on the data collected during the trip. For example, details such as the tourist spots visited, activities experienced, accommodations, and meals are automatically generated as text and sent to the device. The user can review the generated diary and make corrections as needed.

[2047] This allows users to efficiently manage the entire travel process within a single integrated system. A key feature of this system is its consistent support for everything from travel planning, booking, transportation, access to tourist information, souvenir and meal selection, to creating travel records after the trip.

[2048] The following describes the processing flow.

[2049] User travel plan creation

[2050] Step 1:

[2051] The user enters their travel destination, dates, and budget. For example, they might enter "Kyoto," "October 10th to October 12th," and "50,000 yen."

[2052] Step 2:

[2053] The terminal sends the entered information to the server.

[2054] Step 3:

[2055] The server retrieves the necessary data for generating travel plans (e.g., popularity of tourist destinations, accommodation availability, transportation options, etc.) from a database or external API.

[2056] Step 4:

[2057] Based on data acquired by the server, the system automatically generates travel plans optimized for the user's conditions. Specifically, it creates plans that include combinations of tourist destinations, modes of transportation, and accommodations.

[2058] Step 5:

[2059] The server sends the generated travel plan to the device.

[2060] Step 6:

[2061] The device displays the travel plan to the user. The user can review the plan details and modify them as needed.

[2062] Hotel Reservations

[2063] Step 1:

[2064] The user enters their desired accommodation criteria. For example, they might enter "3-star hotel," "city center," and "under 10,000 yen per night."

[2065] Step 2:

[2066] The terminal sends the entered conditions to the server.

[2067] Step 3:

[2068] The server calls the API of a partner booking site to search for hotels that meet the specified criteria.

[2069] Step 4:

[2070] The server organizes the search results and creates a list of hotels that best match the criteria.

[2071] Step 5:

[2072] The server sends the hotel list to the terminal.

[2073] Step 6:

[2074] The device displays a list of hotels to the user. The user selects their desired hotel and makes a reservation.

[2075] Step 7:

[2076] The server uses the booking site's API to complete the booking process and confirm the reservation for the selected hotel.

[2077] Directions

[2078] Step 1:

[2079] The user enters their current location and destination. For example, they might enter "Kyoto Station" and "Kinkaku-ji Temple".

[2080] Step 2:

[2081] The terminal sends the entered information to the server.

[2082] Step 3:

[2083] The server calls a map API to calculate the optimal route.

[2084] Step 4:

[2085] The server sends the calculation results (route, distance, travel time, mode of transport, etc.) to the terminal.

[2086] Step 5:

[2087] The device displays route information to the user. The user can then view detailed directions (e.g., maps, instructions on using public transportation, etc.).

[2088] Tourist guide

[2089] Step 1:

[2090] The user selects a tourist destination they want to visit. Example: Select "Kiyomizu-dera Temple".

[2091] Step 2:

[2092] The device sends information about the selected tourist destination to the server.

[2093] Step 3:

[2094] The server retrieves detailed information about tourist destinations from an internal database or an external API.

[2095] Step 4:

[2096] The server organizes the information it has acquired and sends tourist guide information to the terminal.

[2097] Step 5:

[2098] The device displays tourist information to the user, such as history, points of interest, opening hours, and admission fees.

[2099] Recommended souvenirs and restaurants

[2100] Step 1:

[2101] The user enters their desired souvenir or restaurant criteria. For example, they might enter "Souvenirs under 1,000 yen" or "Restaurant serving local cuisine."

[2102] Step 2:

[2103] The terminal sends the entered conditions to the server.

[2104] Step 3:

[2105] The server searches for stores that meet the specified criteria from its database or partner APIs.

[2106] Step 4:

[2107] The server organizes the search results and creates a list of the best stores.

[2108] Step 5:

[2109] The server sends the store list to the terminal.

[2110] Step 6:

[2111] The device displays a list of stores to the user. The user selects the desired souvenir or restaurant and checks the details.

[2112] Automatic generation of travel diaries

[2113] Step 1:

[2114] The user chooses to automatically generate a travel diary at the end of their trip.

[2115] Step 2:

[2116] The device sends the user's selection to the server.

[2117] Step 3:

[2118] The server collects data gathered during the trip (for example, tourist destinations visited, activities experienced, accommodations, meals eaten, etc.).

[2119] Step 4:

[2120] The server automatically generates a travel diary based on the collected data.

[2121] Step 5:

[2122] The server sends the generated travel diary to the device.

[2123] Step 6:

[2124] The device displays the generated travel diary to the user and provides an interface for making corrections as needed.

[2125] (Example 1)

[2126] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[2127] There is a need for a single, integrated system that can efficiently manage everything from travel planning and booking to transportation, access to tourist information, souvenir and restaurant selection, and post-trip record-keeping. Current systems require managing each of these elements individually, resulting in cumbersome operation and a burden on users. Therefore, the challenge is to provide a system that consistently supports the entire travel process and significantly improves user convenience.

[2128] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[2129] In this invention, the server includes means for the user to input the travel destination, itinerary, and budget; means for automatically generating an optimal travel plan based on the input information; means for presenting the automatically generated travel plan to the user; means for the user to confirm and modify the presented travel plan; means for the user to input the user's current location and destination; means for calculating the optimal route based on the input information; means for presenting the calculated route to the user; means for inputting information about tourist destinations the user wishes to visit; means for collecting and presenting detailed information about the tourist destinations; means for inputting the user's desired souvenir and restaurant conditions; means for collecting and presenting store information that matches the conditions; means for automatically generating the user's travel record; and means for presenting and modifying the automatically generated travel record to the user. This makes it possible to consistently support the user from planning and booking a trip to transportation, referencing tourist information, selecting souvenirs and restaurants, and creating a post-trip record, thereby greatly improving user convenience.

[2130] A "user" is an individual or group that uses this system to plan and execute a trip.

[2131] A "destination" refers to a geographical location that a user sets as their travel destination.

[2132] "Schedule" refers to the period from the user's start date to the end date of their trip.

[2133] "Budget" refers to the amount of money a user can spend on a trip.

[2134] "Means" refers to equipment, software, or processes used to perform a specific operation or function.

[2135] A "database" is an organized collection of data used to manage user input information and other related information.

[2136] An "API" refers to an application programming interface used to access external services and data and achieve interoperability.

[2137] A "travel plan" refers to a travel itinerary that is planned based on the destination, dates, and budget.

[2138] "Accommodation" refers to hotels and other residential facilities that users book for their stay during their travels.

[2139] A "booking site" refers to a website or service that allows users to make online reservations for accommodations, transportation, and other services.

[2140] "Current location" refers to the user's physical location at that moment.

[2141] A "route" refers to the optimal route or means of transportation from your current location to your destination.

[2142] A "tourist destination" refers to a place that users would like to visit during their travels, and which has historical, cultural, or natural attractions.

[2143] "Souvenirs" refer to goods or items purchased during a trip and taken home.

[2144] "Restaurant" refers to a facility that users visit to eat.

[2145] A "travel log" refers to documents or data that record events experienced and places visited by a user during a trip.

[2146] The travel support system of this invention is a system that allows users to centrally manage everything from planning and booking trips to transportation, accessing tourist information, selecting souvenirs and restaurants, and creating post-trip records. This system is realized by a terminal with a user interface, a server that processes data, and by linking with external databases and APIs.

[2147] First, the user enters their travel destination, dates, and budget through the terminal's input interface. This allows the user to easily send basic travel information to the server. For example, the user might set the destination to "Kyoto," the dates to "October 10th to October 12th," and the budget to "50,000 yen." This information is then sent from the terminal to the server.

[2148] Based on the information received, the server collects relevant information from databases and external APIs (e.g., map service API, hotel reservation API). Using this information, the server automatically generates an optimal travel plan using a generative AI model. For example, a 3-night, 4-day travel plan within Kyoto city limits, costing under 50,000 yen, with accommodation in a 3-star hotel in the city center.

[2149] The generated travel plan is sent from the server to the terminal and presented to the user. The user can review this plan on the terminal and make modifications as needed. For example, it can flexibly accommodate requests such as "I want a more luxurious hotel" or "I want to change the order of the sightseeing spots."

[2150] When a user specifies their desired accommodation conditions, such as "3-star hotel," "city center," and "under 10,000 yen per night," the server uses the API of a partner booking site to search for accommodations that match those conditions. The retrieved information is displayed on the terminal, and the user selects their desired accommodation and proceeds with the booking process. The server confirms the booking through the booking site's API and sends the confirmation information to the terminal.

[2151] During travel, users enter their current location and destination into their device and request route information from the server. For example, if they enter "Current location: Kyoto Station" and "Destination: Kinkaku-ji Temple," the server uses a map service API to calculate the optimal route and sends detailed route information (map, distance, estimated travel time, public transport usage, etc.) to their device. Users can then use this information to travel smoothly.

[2152] Furthermore, when a user searches for information on a tourist destination they wish to visit, selecting a specific destination triggers the server to collect detailed information about the destination (history, points of interest, opening hours, admission fees, etc.) from its internal database and external APIs, and display it on the user's device. For example, selecting "Kiyomizu-dera Temple" will immediately display detailed information about Kiyomizu-dera.

[2153] When a user searches for souvenirs or restaurants during their trip, they enter their desired criteria. For example, if they enter conditions such as "souvenirs under 1,000 yen" or "restaurants serving local cuisine," the server will collect information on relevant establishments based on these criteria and display it as a list on their device. The user can then select from this list and obtain detailed information.

[2154] After the trip ends, users can choose to have their travel diary automatically generated. The server uses an AI model to automatically generate the travel diary based on data accumulated during the trip (visited tourist spots, activities experienced, accommodations, meals, etc.). The generated diary is sent to the user's device, where they can review and revise it as needed.

[2155] Examples of prompt statements:

[2156] "I would like to travel to Kyoto from October 10th to October 12th. My budget is 50,000 yen. Please suggest the best travel plan based on this information."

[2157] This system allows users to efficiently manage the entire travel process within a single integrated system. It provides consistent support for everything from travel planning, booking, transportation, access to tourist information, souvenir and meal selection, to post-trip record-keeping, significantly improving user convenience.

[2158] The flow of the specific processing in Example 1 will be explained using Figure 11.

[2159] Step 1:

[2160] The user enters their travel destination, dates, and budget into the device. Specific examples of input fields include "Destination: Kyoto," "Dates: October 10th to October 12th," and "Budget: 50,000 yen." The device then sends this information to the server.

[2161] input:

[2162] destination

[2163] schedule

[2164] budget

[2165] output:

[2166] User input data is sent to the server.

[2167] Specific actions:

[2168] When a user enters information into the input form on their device and presses the "Submit" button, this information is sent to the server as an HTTP request.

[2169] Step 2:

[2170] Based on the user information received by the server, it collects relevant information from the database and external APIs. For example, it retrieves hotel information from the database and transportation and tourist information from external APIs (map service API, accommodation reservation API).

[2171] input:

[2172] User input data (destination, dates, budget)

[2173] output:

[2174] Relevant information collected from databases and external APIs

[2175] Specific actions:

[2176] The server analyzes the received input data, issues queries to its internal database, and sends requests to external APIs to collect information. The collected information is then integrated within the server.

[2177] Step 3:

[2178] Based on the information collected by the server, an AI model is used to automatically generate the optimal travel plan.

[2179] input:

[2180] Collected relevant information (hotel information, transportation information, tourist information, etc.)

[2181] output:

[2182] Automatically generated travel plan

[2183] Specific actions:

[2184] The collected information is input into the AI ​​model on the server, and the prompt "Destination: Kyoto, Dates: October 10th to October 12th, Budget: Please propose the best travel plan based on 50,000 yen" is used. The generated travel plan is saved on the server.

[2185] Step 4:

[2186] The server generates a travel plan and sends it to the device. The device then presents it to the user, who can review and modify it.

[2187] input:

[2188] Automatically generated travel plan

[2189] output:

[2190] Travel plans presented to the user

[2191] Specific actions:

[2192] The server sends the generated travel plan to the terminal, which then displays its contents to the user. The user can review the displayed plan and make any necessary modifications.

[2193] Step 5:

[2194] The user enters their desired accommodation criteria. For example, "3-star hotel," "city center," and "under 10,000 yen per night." The device then sends these criteria to the server.

[2195] input:

[2196] Desired conditions for the remitter

[2197] output:

[2198] Preferred conditions of the hotel sent to the server

[2199] Specific actions:

[2200] When a user enters criteria into the accommodation search form on their device and presses the "Search" button, these criteria are sent to the server as an HTTP request.

[2201] Step 6:

[2202] The server searches for accommodations that match the user's desired criteria using the API of partner booking sites, and sends the results to the user's device.

[2203] input:

[2204] Desired conditions for the remitter

[2205] output:

[2206] List of accommodations that meet the criteria

[2207] Specific actions:

[2208] The server sends a request to the reservation site API based on the received request conditions, performs a search, and receives the results.

[2209] Step 7:

[2210] The terminal displays a list of accommodation information received by the user, who then selects their preferred accommodation. The user confirms their selection and proceeds with the booking process.

[2211] input:

[2212] List of accommodations that meet the criteria

[2213] output:

[2214] Reservation information for the accommodation selected by the user

[2215] Specific actions:

[2216] The user selects their desired hotel from the list of accommodations displayed on their device and presses the "Confirm Reservation" button, which sends the reservation information to the server.

[2217] Step 8:

[2218] The server confirms the reservation process through the API of the partnered reservation site and sends the reservation information to the terminal.

[2219] input:

[2220] Reservation information for the accommodation selected by the user

[2221] output:

[2222] Confirmed reservation information

[2223] Specific actions:

[2224] The server uses the reservation site API to confirm the reservation and sends the confirmation information to the terminal.

[2225] Step 9:

[2226] The user enters their current location and destination, and requests route information from the server. For example, the user might enter "Kyoto Station" as their current location and "Kinkaku-ji Temple" as their destination.

[2227] input:

[2228] Current location and destination

[2229] output:

[2230] Route information request sent to the server

[2231] Specific actions:

[2232] When a user enters their current location and destination into the route search form on their device and presses the "Search" button, this information is sent to the server.

[2233] Step 10:

[2234] Based on the current location and destination information received by the server, the optimal route is calculated using a map service API, and detailed route information is sent to the terminal.

[2235] input:

[2236] Current location and destination

[2237] output:

[2238] Optimal route information

[2239] Specific actions:

[2240] The server inputs the current location and destination information into a map service API and calculates the optimal route. The resulting route information (map, distance, estimated travel time, information on using public transportation, etc.) is then sent to the terminal.

[2241] Step 11:

[2242] The user enters information about the tourist destination they want to visit into the terminal and requests that information from the server. For example, they might select "Kiyomizu-dera Temple".

[2243] input:

[2244] Tourist destinations I want to visit

[2245] output:

[2246] Tourist destination information request sent to the server

[2247] Specific actions:

[2248] When a user enters the name of a tourist destination they want to visit into the tourist destination search form on their device and presses the "Search" button, this information is sent to the server.

[2249] Step 12:

[2250] The server uses internal databases and external APIs to collect detailed information about tourist destinations and transmit it to the terminal.

[2251] input:

[2252] Tourist destinations I want to visit

[2253] output:

[2254] Detailed information about tourist attractions

[2255] Specific actions:

[2256] The server inputs information about the tourist destination you wish to visit into its internal database and external APIs, collects detailed information such as the history, attractions, opening hours, and admission fees of the tourist destination, and sends it to your device.

[2257] Step 13:

[2258] The user enters their desired souvenir or restaurant criteria into a terminal and requests that information from the server. For example, "souvenirs under 1,000 yen" or "restaurants serving local cuisine."

[2259] input:

[2260] Conditions for souvenirs and restaurants

[2261] output:

[2262] Souvenir and restaurant information request sent to the server

[2263] Specific actions:

[2264] When a user enters their desired criteria into the search form on their device and presses the "Search" button, this information is sent to the server.

[2265] Step 14:

[2266] The server searches for relevant stores from its partner store information database based on the user's preferences and sends that information to the terminal.

[2267] input:

[2268] Conditions for souvenirs and restaurants

[2269] output:

[2270] List of relevant store information

[2271] Specific actions:

[2272] The server inputs the desired criteria into a partner store information database and performs a search. It retrieves a list of matching stores and sends it to the terminal.

[2273] Step 15:

[2274] The user selects the option to automatically generate a travel diary and sends a request to the server. The travel diary is then generated based on the data collected during the trip.

[2275] input:

[2276] Request for automatic generation of travel diary

[2277] output:

[2278] Travel diary generation request sent to the server

[2279] Specific actions:

[2280] When the user selects "Automatically generate travel diary" from the terminal's menu and presses the "Generate" button, this request is sent to the server.

[2281] Step 16:

[2282] The server automatically generates a travel diary using a generative AI model based on data collected during the trip, and then sends the results to the device.

[2283] input:

[2284] Data collected during travel

[2285] output:

[2286] Automatically generated travel diary

[2287] Specific actions:

[2288] The server inputs data collected during the trip (visited tourist spots, activities experienced, accommodations, meals, etc.) into an AI model to automatically generate a travel diary. The generated travel diary is sent to the user's device, and the user can modify and save it as needed.

[2289] (Application Example 1)

[2290] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[2291] Traditional travel support systems provided functions such as user travel plan creation, accommodation booking, directions, tourist guides, and automatic generation of travel diaries. However, these functions were specialized for travel and difficult to apply to other uses. Furthermore, there was a need for a system that could comprehensively manage and optimize operations in a logistics center within a single system. In particular, the challenge was to integrate and process functions such as delivery route optimization, inventory management, pallet placement, picking list generation, worker movement optimization, and automatic generation of inventory inflow and outflow reports.

[2292] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[2293] In this invention, the server includes means for the user to input the travel destination, itinerary, and budget; means for automatically generating an optimal travel plan based on the input information; means for presenting the automatically generated travel plan to the user; means for the user to confirm and modify the presented travel plan; means for centrally managing and optimizing operations within the logistics center; means for optimizing delivery routes; means for managing inventory within the warehouse; means for optimally arranging pallets and shelves; means for generating picking lists; means for optimizing worker movement; and means for automatically generating inventory inflow and outflow repo...

Claims

1. A means for users to input their travel destination, dates, and budget, A means for automatically generating an optimal travel plan based on the input information, A means for presenting the automatically generated travel plan to the user, A means for the user to review and modify the aforementioned travel plan, A system that includes this.

2. A means for users to enter their desired accommodation conditions, A means of obtaining information from affiliated reservation sites based on the aforementioned entered conditions, A means of presenting the acquired information to the user and confirming the reservation, The system according to claim 1, including the following:

3. A means for the user to input their current location and destination, A means for calculating the optimal route based on the input information, Means for presenting the calculated route to the user, The system according to claim 1, including the following:

4. A means for users to select the tourist destinations they want to visit, Means for obtaining information about the selected tourist destination, A means for presenting the acquired information to the user, The system according to claim 1, including the following:

5. A means for users to input their desired souvenirs and restaurant conditions, A means for collecting information based on the input conditions and proposing the most suitable store, The proposed means for presenting store information to the user, The system according to claim 1, including the following:

6. Means of collecting user travel data, A means for automatically generating a travel diary based on the aforementioned collected data, The generated travel diary is presented to the user and a means is provided to allow for editing, The system according to claim 1, including the following:

Images