System

Abstract

A system is provided.SOLUTION: A system comprising: means for providing a user interface for inputting request information; means for automatically generating a travel plan on the basis of the input request information; means for presenting the generated travel plan to a user and allowing the user to confirm and adjust the travel plan; means for automatically making reservations for accommodation, transportation, and activities on the basis of the travel plan determined by the user; and means for automatically generating and providing the user with a detailed reservation status report.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Conventional tour planning apps have difficulty in designing tours that fully reflect the user's detailed request information, requiring manual design and reservation procedures. Therefore, there is a need for a system that can efficiently and seamlessly execute the entire process from tour planning to reservation and report creation. The present invention aims to solve these problems by providing a tour planning app that is easy for users to use and achieves a high level of automation. [Means for solving the problem]

[0005] In order to solve the above problems, the present invention provides the following means. First, a means for providing a user interface for inputting request information is provided. Next, a means for automatically generating a travel plan based on the input request information is provided. A means for presenting the generated travel plan to the user and allowing the user to confirm and adjust it is also provided. Furthermore, a means for automatically reserving accommodations, transportation, and activities based on the travel plan confirmed by the user is provided. Finally, a means for automatically generating a detailed report on the reservation status and providing it to the user is provided. This allows users to easily design a tour and complete all reservation procedures.

[0006] A "user interface" is the means by which a user interacts with a system and inputs request information.

[0007] "Request information" refers to information such as the destination, travel period, budget, number of participants, and special requirements that the user inputs to design a tour.

[0008] "Travel Plan" refers to a travel schedule or proposal that is automatically generated based on request information provided by a user.

[0009] "Means for automatic generation" refers to the function of analyzing the request information provided by the user and creating the optimal travel plan using AI algorithms and databases.

[0010] The "means for presenting" refers to a function for displaying the generated travel plan to the user and allowing the user to confirm and adjust it.

[0011] "Means for automatically making reservations" refers to a function that automatically makes reservations for accommodation, transportation, activities, etc. based on confirmed travel plans.

[0012] "Detailed Report" means a report provided to a User that includes travel schedule, reservation confirmation information, contact information, etc.

[0013] "AI algorithm" refers to the artificial intelligence calculation method used to generate optimal travel plans based on past data and patterns.

[0014] "Database" refers to a collection of information that stores and manages travel-related information (such as accommodation, transportation, activities, etc.).

[0015] "Accommodation" refers to hotels, resorts, and other facilities where users can stay during their trip.

[0016] "Transportation" refers to the means of transportation, such as airplane, train, or bus, that a user uses to reach or travel to a travel destination.

[0017] "Activities" refer to tours, experience programs, events, etc. that users participate in during their trip.

[0018] "Means for confirmation and adjustment" refers to a function that allows the user to confirm the presented travel plan and change the contents if necessary. [Brief explanation of the drawings]

[0019] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0020] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0021] First, the terms used in the following description will be explained.

[0022] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0023] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0024] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0025] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0026] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0027] [First embodiment]

[0028] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0029] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0030] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0031] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0032] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0033] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0034] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0035] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0036] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0037] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0038] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0039] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0040] The present invention relates to a system for consistently and efficiently designing and booking travel tours, and embodiments thereof will be described in detail below.

[0041] System configuration

[0042] The system consists of the following main components:

[0043] 1. User Interface

[0044] The user interface is a means for a user to input request information. This interface is provided, for example, as a form on a web browser or a smartphone app.

[0045] 2. Request Information Processing Section

[0046] The request information processing unit is a server-side function that receives and analyzes request information sent from a user, and extracts data that serves as the basis for automatically generating a travel plan.

[0047] 3. Travel Plan Generation Unit

[0048] The travel plan generator is a server-side function that uses AI algorithms and databases to generate optimal travel plans based on the analyzed request information. This generated plan is then presented to the user.

[0049] 4. Plan Presentation and Coordination Department

[0050] The plan presentation and adjustment section presents the generated travel plan to the user, and allows the user to confirm and adjust the plan. Here, the user can provide feedback and corrections to the plan and finalize the plan.

[0051] 5. Reservation Execution Department

[0052] The reservation execution unit is a server-side function that automatically makes reservations for accommodations, transportation, and activities based on the confirmed travel plan. This unit calls various reservation APIs and checks the reservation status.

[0053] 6. Report Generation

[0054] The report generator is a server-side function that creates a detailed travel report based on the completed reservation information and provides it to the user. This report includes the travel schedule and reservation confirmation information.

[0055] A natural language description of the program's operation

[0056] 1. Enter information

[0057] The user interface displays a tour request form to the user. When the user enters the necessary information and presses the send button, this information is sent in real time to the request information processing unit of the server.

[0058] 2. Automatic generation of travel plans

[0059] The server's request information processing unit receives and analyzes the request information sent by the user. Based on this information, the travel plan generation unit uses an AI algorithm to generate multiple optimal travel plans.

[0060] 3. Present and adjust the plan

[0061] The generated travel plan is sent to the user's device and displayed on the user's screen. The user can review it and make adjustments as necessary. Once the adjustments are complete, the user presses the confirm button to send the final plan to the server.

[0062] 4. Making a reservation

[0063] The server's reservation execution unit automatically makes reservations for accommodation, transportation, and activities based on the confirmed travel plan. Successful reservation data is saved on the server in real time.

[0064] 5. Creating a detailed report

[0065] After all reservations are completed, the server's report generator automatically creates a detailed report and sends it to the user's device, allowing the user to receive their travel schedule and reservation confirmation information in a single report.

[0066] Specific examples

[0067] For example, if a user wants to take a family trip to Tokyo for 4 nights and 5 days, the flow would be as follows:

[0068] 1. The user enters information such as "Tokyo," "4 nights, 5 days," and "family trip" into the tour request form and submits it.

[0069] 2. The server receives and analyzes this information and uses an AI algorithm to generate an optimal travel plan (for example, a plan that includes sightseeing in Asakusa, visiting Tokyo Disneyland, and Tokyo Tower).

[0070] 3. The plan will be displayed on the user's screen and the user can confirm it. If they want to add a hot spring inn, they can add it and submit again.

[0071] 4. The server automatically books accommodation, flights, and activities based on the confirmed plan and stores confirmation information for each reservation.

[0072] 5. A detailed trip report is created based on the completed reservation information and provided to the user, who can then review it and begin preparing for their trip.

[0073] In this way, the present invention allows the user to easily design a tour based on detailed request information and to perform all steps from reservation to report creation in one go.

[0074] The processing flow will be explained below.

[0075] Step 1:

[0076] The user interface displays a tour request form to the user, which includes input fields for "Destination," "Trip Length," "Budget," "Number of Participants," and "Special Requirements."

[0077] Step 2:

[0078] The user enters the necessary information into the request form, such as "Destination: Tokyo," "Travel duration: 4 nights, 5 days," "Budget: 200,000 yen," "Number of participants: 4," and "Special requirements: Hot spring inn," and then presses the submit button.

[0079] Step 3:

[0080] The device collects the input request information and sends it to the server's request information processing unit in real time. The data is sent in a standard format such as JSON.

[0081] Step 4:

[0082] The server receives the request information, and the request information processing section of the server analyzes it and extracts various items such as the destination, travel period, and budget.

[0083] Step 5:

[0084] The server's travel plan generation unit automatically generates multiple travel plans based on the received request information using an AI algorithm and database. Specifically, the AI ​​algorithm considers past travel data and user preferences to suggest optimal combinations of hotels, flights, and activities.

[0085] Step 6:

[0086] The server transmits the generated travel plans to the user's terminal, and the transmitted plans are displayed in a list on the user interface of the terminal.

[0087] Step 7:

[0088] The user reviews each itinerary displayed, including details about the itinerary, such as hotel options, flight times, and activities.

[0089] Step 8:

[0090] If the user adjusts the plan as needed, for example, by selecting a different hotel or adding a particular activity, the plan is adjusted and sent back to the server.

[0091] Step 9:

[0092] The server receives the retransmitted information, and again uses the travel plan generator to generate an adjusted plan, which is then presented to the user again, and the steps are repeated.

[0093] Step 10:

[0094] The user finalizes the travel plan and presses the confirmation button. The confirmed plan information is sent from the terminal to the server.

[0095] Step 11:

[0096] The server's reservation execution unit starts the reservation process based on the confirmed travel plan. Specifically, it calls the APIs of each service to automatically reserve accommodation, transportation, and activities.

[0097] Step 12:

[0098] The server receives confirmation information from each reservation service, checks whether the reservation was successful, and stores the necessary information in a database.

[0099] Step 13:

[0100] After all reservations are completed, the server's report generator creates a detailed report that includes the travel schedule, confirmation information for each reservation, and contact information.

[0101] Step 14:

[0102] The server sends the generated report to the user's device, where the user can check the report and proceed with travel preparations.

[0103] The above are the processing steps in the tour planning application of the present invention. Information is processed efficiently at each step, realizing a system that is easy for users to use.

[0104] Example 1

[0105] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0106] Conventional travel planning systems have the drawback of requiring users to manually design plans and make each reservation individually, which is time-consuming. Furthermore, the user experience can be compromised because it is difficult to smoothly optimize or change travel plans. Furthermore, information management after a reservation is completed is cumbersome, making it difficult for users to efficiently prepare for their trip.

[0107] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0108] In this invention, the server includes means for providing a user interface for inputting request information, means for generating multiple optimal travel plans using an AI algorithm to automatically generate a travel plan based on the input request information, means for presenting the generated travel plans to the user and saving the finalized travel plan after the user confirms and adjusts it, means for automatically making reservations for accommodations, transportation, and activities based on the travel plan finalized by the user, and means for automatically generating a detailed report based on all completed reservation information and providing it to the user. This enables consistent and efficient processing from travel plan design to reservations and information management.

[0109] A "user interface" is a software or hardware component that provides a display screen and input means for a user to enter information.

[0110] "Request information" refers to information such as the travel destination, period, purpose of travel, and budget that the user inputs as information necessary to create a travel plan.

[0111] An "AI algorithm" is an algorithm that uses artificial intelligence technology to perform complex calculations and data analysis, in this case used to automatically generate travel plans.

[0112] The "travel plan generation means" is a component that has the function of automatically generating multiple optimal travel plans using an AI algorithm based on request information entered by the user.

[0113] A "presentation means" is a software or hardware component that displays the generated travel plan to the user and provides the user with the ability to confirm and adjust it.

[0114] An "adjustment tool" is a software or hardware component that provides functionality through which a user can make changes or modifications to the generated itinerary.

[0115] A "confirmation means" is a software or hardware component that provides a function for a user to finalize a travel plan and save it in the system.

[0116] The "reservation execution means" is a component that has the function of automatically making reservations for accommodations, transportation, and activities based on a confirmed travel plan, and obtaining reservation confirmation information.

[0117] The "detailed report generating means" is a component that has the function of automatically creating a detailed report including travel schedules and reservation confirmation information based on all information on completed reservations, and providing it to the user.

[0118] The present invention relates to a system for consistently and efficiently designing and reserving travel plans, and specific embodiments thereof will be described in detail below.

[0119] The system consists of the following main components:

[0120] 1. User Interface

[0121] The user interface is a means for users to input their request information. This interface is provided, for example, as a form on a web browser or a smartphone app. This allows users to easily input their request information, such as travel destination, duration, purpose, and budget.

[0122] 2. Request Information Processing Section

[0123] The request information processing section is a server-side function that receives and analyzes the request information sent by the user. This information processing section uses natural language processing tools (e.g., spaCy or NLTK) to extract necessary data from the input information and use it as basic data for generating travel plans.

[0124] 3. Travel Plan Generation Unit

[0125] The travel plan generation unit is a server-side function that uses an AI algorithm (for example, TensorFlow or PyTorch) to generate multiple optimal travel plans based on the analyzed request information. This function uses past travel data to suggest optimal travel routes and tourist spots tailored to the user's requests.

[0126] 4. Plan Presentation and Coordination Department

[0127] The plan presentation and adjustment section presents the generated travel plan to the user's device, allowing the user to review and adjust it. The user can review the plan on the screen, make additions or corrections as necessary, and finalize it as the final plan.

[0128] 5. Reservation Execution Department

[0129] The reservation execution unit is a server-side function that automatically executes reservations for accommodation, transportation, and activities based on the confirmed travel plan. To do this, it uses external reservation APIs (e.g., accommodation reservation API and transportation reservation API) to obtain each reservation information.

[0130] 6. Report Generation

[0131] The report generator is a server-side function that creates a detailed trip report based on the information of completed reservations and provides it to the user. This report includes the travel schedule and reservation confirmation information, helping the user to efficiently prepare for their trip.

[0132] Specific examples

[0133] For example, the specific operation flow when a user wishes to take a "four-night, five-day family trip to Tokyo" is shown below.

[0134] 1. Enter information

[0135] The user enters information such as "Tokyo," "4 nights, 5 days," and "family trip" into the tour request form and presses the send button.

[0136] 2. Analysis of request information

[0137] The server receives this information and performs the analysis.

[0138] 3. Automatic generation of travel plans

[0139] The server uses an AI algorithm to generate multiple optimal travel plans (for example, a plan that includes sightseeing in Asakusa, visiting Tokyo Disneyland, and Tokyo Tower).

[0140] 4. Present and adjust the plan

[0141] The generated travel plan is displayed on the user's device and the user confirms it. For example, if the user wants to add a hot spring inn, they add it and submit it again.

[0142] 5. Finalize your travel plans

[0143] The confirmed travel plan is stored on the server.

[0144] 6. Making a reservation

[0145] The server automatically makes reservations for accommodation, flights, and activities based on the confirmed travel plans.

[0146] 7. Creating a detailed report

[0147] A detailed trip report is created based on the completed reservation information and provided to the user, who can then review it and begin preparing for their trip.

[0148] Prompt Sentence Examples

[0149] Below are some example prompts for using a generative AI model to generate travel itinerary suggestions:

[0150] Generate the best travel plan based on the following criteria: Location: Tokyo, Duration: 4 nights, 5 days, Purpose of trip: Family trip, Main activity: Sightseeing, Accommodation: Hotel or Ryokan, Transportation: Train or bus, Budget: 20,000 yen per person per day

[0151] In this way, the present invention provides a system that allows users to easily design a travel plan based on detailed request information and to perform all processes from reservation to report creation in one go.

[0152] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0153] Step 1:

[0154] Enter information

[0155] The server receives request information entered by the user through a user interface. The user enters request information such as "Tokyo," "four nights and five days," and "family trip," and presses the send button. The input is done through a web form or a smartphone app. The server saves this input data in a database in real time.

[0156] Input: The user enters information such as travel destination, duration, purpose, and budget.

[0157] Output: The entered information is saved in the database.

[0158] Specific behavior:

[0159] When a user enters information such as "Tokyo," "4 nights, 5 days," and "family trip" into the tour request form and presses the send button, the server receives this and stores it in the database.

[0160] Step 2:

[0161] Parsing request information

[0162] The server's request information processing unit analyzes the received request information. Using natural language processing tools (e.g., spaCy or NLTK), it extracts necessary information (e.g., travel destination, duration, purpose, etc.) from the input data. The server uses the analysis results as data to proceed to the next step.

[0163] Input: Saved request information.

[0164] Output: Parsed necessary information (travel destination, duration, purpose, etc.).

[0165] Specific behavior:

[0166] The server retrieves the request information stored in the database and analyzes it using natural language processing tools, extracting necessary information such as "Tokyo," "four nights and five days," and "family trip."

[0167] Step 3:

[0168] Automatic travel plan generation

[0169] The server's travel plan generation unit uses an AI algorithm (for example, TensorFlow or PyTorch) to generate multiple optimal travel plans based on the analyzed request information. It also retrieves past travel data from other databases and proposes the plan that best suits the requested conditions.

[0170] Input: Parsed request information and historical trip data.

[0171] Output: A list of optimal itineraries.

[0172] Specific behavior:

[0173] The server runs an AI algorithm based on the analyzed request information to generate multiple itineraries, including "Sightseeing in Asakusa," "Visiting Tokyo Disneyland," and "Visiting Tokyo Tower," and outputs these itineraries as a single list.

[0174] Step 4:

[0175] Presenting and adjusting plans

[0176] The generated travel plan is sent to the user's device. The user can check the plan on the screen and make additions or modifications as necessary. For example, if the user wishes to add a hot spring inn, the user can update the plan after checking it and resend it.

[0177] Input: The generated itinerary.

[0178] Output: The final plan that you review and adjust.

[0179] Specific behavior:

[0180] The user checks the proposed travel plan, adds a hot spring inn, or makes other changes. For example, the user presses the "Add Hot Spring Inn" button, selects "Hakone Hot Springs" to add it to the plan, and submits it again.

[0181] Step 5:

[0182] Confirming travel plans

[0183] The user finalizes the travel plan. When the user presses the confirm button, the adjusted travel plan is sent to the server, which stores this final plan in its database.

[0184] Input: A travel plan confirmed by the user.

[0185] Output: The finalized itinerary is saved in the database.

[0186] Specific behavior:

[0187] The user presses the "confirm" button, the confirmed plan is sent to the server, and the server saves the plan data in a database.

[0188] Step 6:

[0189] Making a reservation

[0190] The server's reservation execution unit automatically makes reservations for accommodation, transportation, and activities based on the confirmed travel plan. It uses external reservation APIs (e.g., accommodation reservation API, transportation reservation API) to obtain reservation confirmation information and saves it in a database.

[0191] Input: Confirmed travel plans.

[0192] Output: The reservation information is saved in the database.

[0193] Specific behavior:

[0194] The server uses booking APIs to automatically book accommodations, flights, etc. For example, it uses Booking.com's API to complete hotel reservations and Skyscanner's API to book flights.

[0195] Step 7:

[0196] Creating detailed reports

[0197] The server's report generator creates a detailed trip report based on all the information from the completed reservation and sends it to the user's device. This report includes the travel schedule and reservation confirmation information, allowing the user to efficiently prepare for their trip.

[0198] Input: Information with which the reservation was completed.

[0199] Output: A detailed trip report.

[0200] Specific behavior:

[0201] The server aggregates all reservation information and generates a PDF report that is emailed to the user, including the travel schedule and accommodation and transportation reservation confirmation.

[0202] The above is the specific processing procedure of the program for this system. Because the operations, inputs, and outputs performed at each step are clearly defined, the function of the entire system is achieved efficiently.

[0203] (Application example 1)

[0204] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0205] Conventional travel planning systems focus on booking accommodation, transportation, and activities, and lack comprehensive suggestions that include meal plans during travel. Meals during travel are an important part of the travel experience, and if meal plans are not properly incorporated, the quality of the travel experience may be reduced. Therefore, there is a need for a system that can incorporate meal plans, including local specialty dishes and special food delivery services, into travel plans.

[0206] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0207] In this invention, the server includes means for providing a user interface for inputting request information, means for automatically generating a travel plan based on the input request information, means for presenting the generated travel plan to the user and allowing the user to confirm and adjust it, means for automatically reserving accommodations, transportation, and activities based on the travel plan confirmed by the user, means for automatically generating a meal plan and making food delivery and restaurant reservations, and means for automatically generating a detailed report on the reservation status and providing it to the user. This enables the user to consistently design and reserve a comprehensive travel plan, including plans to enjoy local specialty meals during their trip.

[0208] The "means for providing a user interface for inputting request information" refers to a means for providing an interface for a user to input requests and information regarding a trip.

[0209] The "means for automatically generating a travel plan based on input request information" refers to a means for analyzing the request information input by the user and automatically generating a travel plan based on the information.

[0210] "Means for presenting the generated travel plan to the user and allowing the user to confirm and adjust" refers to means for displaying the generated travel plan to the user, allowing the user to confirm the plan and make adjustments as necessary.

[0211] "Means for automatically making reservations for accommodation, transportation, and activities based on a travel plan confirmed by a user" refers to means for automatically making reservations for accommodation, transportation, and activities based on a travel plan confirmed by a user.

[0212] "Means for automatically generating meal plans and making food delivery and restaurant reservations" refers to means for automatically generating meal plans for travel and automatically making food delivery and restaurant reservations.

[0213] The "means for automatically generating a detailed report on the reservation status and providing it to the user" is a means for automatically generating a detailed report on the reservation status and travel and providing it to the user.

[0214] The present invention relates to a system that can comprehensively design meal plans along with travel plans and can also perform reservation procedures. An embodiment of the present invention will be described in detail below.

[0215] System configuration and program contents

[0216] The system consists of the following main components:

[0217] 1. User Interface:

[0218] It is a means for users to input travel request information via a smartphone app or web browser.

[0219] For example, you enter information such as your travel destination, length of stay, food preferences (Japanese, French, Chinese, etc.), meal type (breakfast, lunch, dinner), and desired budget.

[0220] 2. Request information processing section:

[0221] It runs on the server side and receives and analyzes request information sent by users in real time.

[0222] Flask is used to process requests from clients and store information in JSON format on the server.

[0223] 3. Travel Plan Generation Unit:

[0224] Using AI algorithms such as TensorFlow, it generates optimal travel plans based on past travel data and user request information.

[0225] For example, it suggests the optimal combination of tourist destinations, accommodations, and transportation methods.

[0226] 4. Meal Plan Generator:

[0227] It uses an AI algorithm to generate the optimal meal plan for your trip based on your food preferences and budget.

[0228] Consider highly rated local restaurants and food delivery services.

[0229] 5. Planning and Coordination Department:

[0230] It is a means for presenting the generated travel and meal plans to the user, allowing the user to confirm and adjust them.

[0231] The generated plan is displayed on a smartphone app or web browser, and the user can review it and adjust it as necessary.

[0232] 6. Reservation Execution Department:

[0233] Automatically book accommodations, transportation, activities and meals based on your confirmed travel and meal plans.

[0234] Call various reservation APIs, check reservation status in real time, and save it in a MySQL database.

[0235] 7. Report Generation:

[0236] After all reservations are completed, a detailed report is automatically generated and provided to the user.

[0237] The report includes travel itinerary, booking confirmation information, and meal plan details.

[0238] Use the ReportLab library to create PDF reports and provide them to users.

[0239] Prompt Sentence Examples

[0240] "Generate the best local food delivery and restaurant reservations plan for your trip. Input information: destination, length of stay, food preference (Japanese, French, Chinese, etc.), meal type (breakfast, lunch, dinner), and desired budget."

[0241] The system of the present invention allows users to design and book comprehensive travel plans, including plans to enjoy local cuisine during their trip. As a concrete example, if a user wishes to take a "five-day, four-night family trip to Tokyo," the system can generate an optimal plan that includes famous local restaurants and delivery services, covering the entire trip. This can significantly improve the quality of the trip.

[0242] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0243] Step 1:

[0244] The user enters request information through a smartphone app or web browser. The request information includes travel destination, length of stay, food preferences (e.g., Japanese, French, Chinese, etc.), meal type (breakfast, lunch, dinner), desired budget, etc. Once the input is complete, the user presses the send button to send the information to the server. The entered data is sent to the server in JSON format.

[0245] Step 2:

[0246] The server's request information processing unit receives and analyzes request information sent by the user in real time. Flask processes the request from the client, analyzes the JSON format data, and extracts the necessary information. The extracted data is stored in the server's memory or database.

[0247] Step 3:

[0248] The travel plan generation unit uses AI algorithms such as TensorFlow to generate an optimal travel plan based on the extracted request information. Using a model trained on past travel data, it proposes the optimal combination of tourist destinations, accommodations, and transportation methods. The generated travel plan is temporarily stored in the server's memory.

[0249] Step 4:

[0250] The meal plan generator uses an AI algorithm to automatically generate the optimal meal plan based on the food preferences and budget provided in the request information. It references a database of highly rated local restaurants and food delivery services to select the best meal options. The generated meal plan is stored in the server's memory.

[0251] Step 5:

[0252] The plan presentation and adjustment unit sends the generated travel and meal plans to the user's device and displays them. The user can check the plans on a smartphone app or web browser and make adjustments as necessary. User feedback is sent to the server in real time, and the travel and meal plans are regenerated or revised.

[0253] Step 6:

[0254] Once the user finalizes the plan, the server's reservation execution unit automatically makes reservations for accommodation, transportation, activities, restaurants, and food delivery. It calls various reservation APIs, receives confirmation of successful reservations in real time, and stores them in a database.

[0255] Step 7:

[0256] After all reservations are completed, the server's report generator creates a detailed trip report. It uses the ReportLab library to generate a PDF report that includes the trip schedule, reservation confirmation information, meal plan details, etc. The completed report is sent to the user's device, allowing them to continue preparing for their trip.

[0257] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0258] The present invention relates to a system for recognizing a user's emotions and designing and booking travel tours in a more personalized manner, and embodiments thereof will be described in detail below.

[0259] System configuration

[0260] The system consists of the following main components:

[0261] 1. User Interface

[0262] The user interface is a means for a user to input request information. This interface is provided, for example, as a form on a web browser or a smartphone app.

[0263] 2. Request Information Processing Section

[0264] The request information processing unit is a server-side function that receives and analyzes request information sent from a user, and extracts data that serves as the basis for automatically generating a travel plan.

[0265] 3. Travel Plan Generation Unit

[0266] The travel plan generator is a server-side function that uses AI algorithms and databases to generate optimal travel plans based on the analyzed request information. This generated plan is then presented to the user.

[0267] 4. Emotion Engine

[0268] The emotion engine is a means of analyzing emotions from user input and interactions and reflecting them in request information and travel plans. For example, emotions can be analyzed using user text input, voice input, and even facial expression recognition technology.

[0269] 5. Plan Presentation and Coordination Department

[0270] The plan presentation and adjustment section presents the generated travel plan to the user, and allows the user to confirm and adjust the plan. Here, the user can provide feedback and corrections to the plan and finalize the plan.

[0271] 6. Reservation Execution Department

[0272] The reservation execution unit is a server-side function that automatically makes reservations for accommodations, transportation, and activities based on the confirmed travel plan. This unit calls various reservation APIs and checks the reservation status.

[0273] 7. Report Generation

[0274] The report generator is a server-side function that creates a detailed travel report based on the completed reservation information and provides it to the user. This report includes the travel schedule and reservation confirmation information.

[0275] A natural language description of the program's operation

[0276] 1. Enter information

[0277] The user interface displays a tour request form to the user. When the user enters the necessary information and presses the send button, this information is sent in real time to the request information processing unit of the server.

[0278] 2. Emotion recognition

[0279] When a user inputs information, the emotion engine analyzes the input text, voice, and even the user's facial expression data to understand the user's emotional state. For example, if the user inputs "I'm tired," the engine will prioritize plans that will help the user relax.

[0280] 3. Automatic generation of travel plans

[0281] The server's request information processing unit receives and analyzes the request information sent by the user. Then, based on this information and the analysis results of the emotion engine, the travel plan generation unit generates multiple optimal travel plans.

[0282] 4. Present and adjust the plan

[0283] The generated travel plan is sent to the user's device and displayed on the user's screen. The user can review it and make adjustments as necessary. Once the adjustments are complete, the user presses the confirm button to send the final plan to the server.

[0284] 5. Making a reservation

[0285] The server's reservation execution unit automatically makes reservations for accommodation, transportation, and activities based on the confirmed travel plan. Successful reservation data is saved on the server in real time.

[0286] 6. Creating a detailed report

[0287] After all reservations are completed, the server's report generator automatically creates a detailed report and sends it to the user's device, allowing the user to receive their travel schedule and reservation confirmation information in a single report.

[0288] Specific examples

[0289] For example, if a user wishes to take a solo trip to Hokkaido for 2 nights and 3 days, the process would be as follows:

[0290] 1. The user fills in the tour request form with information such as "Hokkaido," "2 nights, 3 days," and "solo trip," and then adds "I want to relax."

[0291] 2. The server receives the request information, and the emotion engine analyzes the keyword "I want to relax" to determine that the user is feeling stressed.

[0292] 3. Based on this, the travel plan generation unit will prioritize and suggest plans that include hot springs and quiet tourist spots.

[0293] 4. The plan is displayed on the user's screen, and the user can confirm and adjust the hot spring inn.

[0294] 5. The server automatically makes reservations for hotels, transportation, and activities based on the confirmed plan.

[0295] 6. A detailed trip report is generated based on the completed booking information and provided to the user.

[0296] In this way, by combining the emotion engine, it becomes possible to generate and book a personalized travel plan according to the user's emotional state. This invention allows users to design a comfortable trip that is more suited to their own circumstances.

[0297] The processing flow will be explained below.

[0298] Step 1:

[0299] The user interface displays a tour request form to the user, which includes input fields for "Destination," "Trip Length," "Budget," "Number of Participants," and "Special Requirements."

[0300] Step 2:

[0301] The user enters the necessary information into the request form, such as "Destination: Hokkaido," "Travel duration: 2 nights, 3 days," "Budget: 100,000 yen," "Number of participants: 1 person," and "Special requirement: I want to relax," and then presses the submit button.

[0302] Step 3:

[0303] The device collects the input request information and sends it to the server's request information processing unit in real time. The data is sent in a standard format such as JSON.

[0304] Step 4:

[0305] The server receives the request information, and the request information processing unit analyzes it and extracts various items such as the destination, travel period, and budget.

[0306] Step 5:

[0307] The emotion engine analyzes the user's emotions from their input information and interactions. For example, it determines that the user needs to relax based on the specific requirement "I want to relax."

[0308] Step 6:

[0309] The server's travel plan generation unit uses an AI algorithm to generate multiple optimal travel plans based on the received request information and the analysis results of the emotion engine, prioritizing the inclusion of relaxing elements such as hot springs and quiet tourist spots.

[0310] Step 7:

[0311] The server sends the generated travel plans to the user's terminal, where they are displayed in a list on the user interface of the terminal.

[0312] Step 8:

[0313] The user reviews each itinerary displayed, including details about the itinerary, such as hotel options, flight times, and activities.

[0314] Step 9:

[0315] If the user adjusts the plan as needed, for example, to select a different hot spring resort or add a specific activity, the plan is adjusted and sent back to the server.

[0316] Step 10:

[0317] The server receives the retransmitted adjusted information and again uses the travel plan generator to generate an adjusted plan, which is then presented to the user again, and the confirmation and adjustment process is repeated.

[0318] Step 11:

[0319] The user finalizes the travel plan and presses the confirmation button. The confirmed plan information is sent from the terminal to the server.

[0320] Step 12:

[0321] The server's reservation execution unit starts the reservation procedure based on the confirmed travel plan. Specifically, it calls the APIs of each service (hotel, flight, activity) to automatically make the reservation.

[0322] Step 13:

[0323] The server receives confirmation information from each reservation service, checks whether the reservation was successful, and stores the necessary information in a database.

[0324] Step 14:

[0325] After all reservations are completed, the server's report generator automatically generates a detailed report that includes the travel schedule, confirmation information for each reservation, and contact information.

[0326] Step 15:

[0327] The server sends the generated report to the user's device, where the user can check the report and proceed with travel preparations.

[0328] Example 2

[0329] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0330] Conventional travel plan generation systems are unable to provide plans that fully reflect the user's individual feelings and specific needs, making it difficult to design a travel plan that satisfies the user. In addition, the process from generating a travel plan to confirming a reservation is complicated, requiring the user to perform many manual tasks, resulting in a poor user experience.

[0331] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for providing a user interface for inputting request information, means for automatically generating a travel plan based on the input request information, means for presenting the generated travel plan to the user and allowing the user to confirm and adjust it, means for automatically reserving accommodations, transportation, and activities based on the travel plan confirmed by the user, means for automatically generating a detailed report on the reservation status and providing it to the user, and means for recognizing the user's emotions from the information input and interactions and reflecting them in the travel plan. This makes it possible to generate and reserve a personalized travel plan based on the user's emotions and needs.

[0332] "Request information" refers to specific information such as the destination, number of days, number of people, and purpose that a user inputs when requesting the creation of a travel plan.

[0333] "User interface" refers to the form on a web browser or the interface of a smartphone app through which a user enters request information.

[0334] The "request information processing unit" is a server-side component that receives request information entered by the user, analyzes it, and extracts the necessary data.

[0335] The "travel plan generation unit" is a server-side component that automatically generates an appropriate travel plan based on the analysis results obtained from the request information processing unit.

[0336] The "emotion engine" is a server-side function that analyzes emotions from user input information and interactions, and reflects the analysis results in request information and travel plans.

[0337] The "plan presentation and adjustment unit" is a server-side and terminal-side component that presents the generated travel plan to the user and allows the user to confirm and adjust the plan.

[0338] The "reservation execution unit" is a server-side function that automatically executes reservations for accommodations, transportation, and activities based on the confirmed travel plan.

[0339] The "report generation unit" is a server-side function that creates a detailed travel report based on completed reservation information and provides it to the user.

[0340] A "travel plan" is a specific travel itinerary and activity plan generated based on the user's request information and emotion data.

[0341] "Generative AI model" refers to the artificial intelligence algorithm used by the travel plan generation unit, and is a model for automatically generating optimal plans based on various data.

[0342] A "prompt sentence" is a free-form text message that a user enters to make a specific request or instruction to the system.

[0343] The present invention relates to a system for recognizing a user's emotions and designing and booking a travel tour in a more personalized manner, and specific embodiments thereof will be described in detail below.

[0344] System configuration

[0345] This system mainly consists of the following components:

[0346] 1. User Interface

[0347] The user interface (UI) is the means by which a user inputs request information. This interface is provided as a form on a web browser or a smartphone app.

[0348] The user inputs the destination, number of days, number of people, and purpose of the trip (e.g., "I want to relax").

[0349] 2. Request Information Processing Section

[0350] The request information processing unit is a server-side function that receives and analyzes request information sent from a user.

[0351] This information processing unit extracts basic data for automatically generating a travel plan.

[0352] 3. Emotion Engine

[0353] The emotion engine is a means of analyzing emotions from user input information and interactions and reflecting them in travel plans.

[0354] Emotions are recognized using user text input, voice input, facial expression recognition, etc.

[0355] 4. Travel Plan Generation Unit

[0356] The travel plan generator is a server-side function that generates an optimal travel plan based on the input request information and the results of the emotion engine.

[0357] Automatically generate multiple plans using artificial intelligence algorithms (generative AI models) and databases.

[0358] 5. Plan Presentation and Coordination Department

[0359] The plan presentation and adjustment unit is a means for presenting the generated travel plan to the user and allowing the user to confirm and adjust it.

[0360] The user checks the proposed plan, makes any modifications, and then finalizes the plan.

[0361] 6. Reservation Execution Department

[0362] The reservation execution unit is a server-side function that automatically executes reservations for accommodation, transportation, and activities based on the confirmed travel plan.

[0363] Call various reservation APIs and check the reservation status.

[0364] 7. Report Generation

[0365] The report generation unit is a server-side function that creates a detailed travel report based on the completed reservation information and provides it to the user.

[0366] The report includes travel schedule and reservation confirmation information.

[0367] Specific examples

[0368] For example, if a user wishes to take a solo trip to Hokkaido for 2 nights and 3 days, the process would be as follows:

[0369] 1. The user fills in the tour request form with information such as "Hokkaido," "2 nights, 3 days," and "solo trip," and then adds "I want to relax."

[0370] 2. The server receives the request information, and the emotion engine analyzes the keyword "I want to relax" to determine that the user is feeling stressed.

[0371] 3. Based on this, the travel plan generation unit will prioritize and suggest plans that include hot springs and quiet tourist spots.

[0372] 4. The plan is displayed on the user's screen, and the user can confirm and adjust the hot spring inn.

[0373] 5. The server automatically makes reservations for hotels, transportation, and activities based on the confirmed plan.

[0374] 6. A detailed trip report is generated based on the completed booking information and provided to the user.

[0375] Prompt Sentence Examples

[0376] For example, by entering a prompt such as, "Create a 2-night, 3-day Hokkaido travel plan. Please include relaxing spots as an emphasis," the system will automatically generate a travel plan tailored to the user's needs.

[0377] In this way, the system enables personalized travel plans and bookings that reflect the user's emotions and specific travel needs.

[0378] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0379] Step 1: Enter your information

[0380] Input: The user inputs travel request information (destination, number of days, number of people, purpose of travel, etc.) via a user interface (UI).

[0381] How it works: The user enters information such as "Hokkaido," "2 nights and 3 days," "solo trip," and "want to relax" into the form and presses the submit button.

[0382] Output: The input request information is sent to the server.

[0383] Specific operation: The user's input information is sent to the request information processing unit of the server in real time.

[0384] Step 2: Emotion Recognition

[0385] Input: Request information received by the server, as well as text, voice, and facial expression data entered by the user.

[0386] How it works: The server's emotion engine analyzes the user's text, voice, and possibly facial expression data via a camera.

[0387] Output: User's emotional state (e.g., "I want to relax" is interpreted as stress).

[0388] Specific operation: The emotion engine analyzes the user's emotions from the text "I want to relax" and passes the results to the request information processing unit.

[0389] Step 3: Automatically generate a travel plan

[0390] Input: Request information from the request information processing unit and the analysis results of the emotion engine.

[0391] How it works: The server's travel plan generation unit uses a generative AI model to generate multiple travel plans based on this data.

[0392] Output: Multiple suggested itineraries.

[0393] Specific operation: The plan generation unit creates plans that include hot springs and quiet tourist spots. Specifically, plans that include farm stays and forest bathing activities are also proposed.

[0394] Step 4: Present and adjust the plan

[0395] Input: Multiple generated itineraries.

[0396] How it works: The server sends these plans to the user's device.

[0397] Output: User reviews and adjusts plan.

[0398] Specific operation: The travel plan is displayed on the user's device, and the user makes specific modifications such as "I would like to choose this accommodation" and finalizes the plan.

[0399] Step 5: Making a reservation

[0400] Input: Final confirmed plan.

[0401] Operation: The server's reservation execution unit calls various reservation APIs and makes reservations for accommodations, transportation, activities, etc.

[0402] Output: Successful reservation information.

[0403] Specific operation: The reservation execution unit checks the reservation status of the accommodation and automatically executes the reservation. Airline and train tickets are also arranged at the same time.

[0404] Step 6: Create a detailed report

[0405] Input: Completed reservation information.

[0406] Operation: The server's report generator creates a detailed trip report based on this reservation information.

[0407] Output: A detailed trip report provided to the user.

[0408] Specific operation: The report generator creates a report that summarizes the travel schedule, accommodation confirmation information, and transportation details. The user receives this report and can check the schedule and reservation information during the trip.

[0409] (Application example 2)

[0410] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0411] When designing and booking travel plans, it is difficult to provide a personalized experience that reflects the user's emotional state. Conventional travel plan creation systems do not take the user's emotions into account, so they are unable to propose plans that are appropriate for the user's current situation or psychological state, resulting in a decrease in user satisfaction.

[0412] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for providing a user interface for inputting request information, means for automatically generating a travel plan based on the input request information, means for presenting the generated travel plan to the user so that the user can confirm and adjust it, means for analyzing the user's emotions in real time, means for suggesting optimal products and services based on the emotion analysis results, means for automatically reserving accommodations, transportation, and activities based on the travel plan confirmed by the user, and means for automatically generating a detailed report on the reservation status and providing it to the user. This makes it possible to generate and reserve a personalized travel plan that takes the user's emotional state into consideration.

[0413] The "user interface for inputting request information" refers to an interface provided for users to input travel plan request information, and may consist of a web browser form, a smartphone app, or the like.

[0414] "Means for automatically generating a travel plan based on input request information" refers to algorithms or software that analyzes the request information input by the user and automatically creates a travel plan.

[0415] "Means for presenting the generated travel plan to the user and allowing the user to confirm and adjust it" refers to an interface that displays the travel plan to the user and allows the user to confirm and change the contents.

[0416] "Means for analyzing user emotions in real time" refers to technologies and algorithms that analyze emotions from a user's facial expressions and voice and reflect the results immediately.

[0417] "Means for proposing optimal products and services based on the results of sentiment analysis" refers to software or algorithms for recommending optimal products and services to individual users based on the results of sentiment analysis of the users.

[0418] "Means for automatically reserving accommodation, transportation, and activities based on a travel plan finalized by a user" refers to a system for automatically reserving accommodation, transportation, and activities based on a travel plan finalized by a user.

[0419] "Means for automatically generating detailed reports on reservation status and providing them to users" refers to technology or software for automatically creating detailed travel reports based on information on completed reservations and providing them to users.

[0420] The present invention is a system that analyzes a user's emotional state in real time, automatically generates and proposes travel plans based on the analysis, and makes reservations. The following describes in detail the embodiments of the present invention.

[0421] System configuration

[0422] This system consists of the following main components:

[0423] 1. User Interface

[0424] This interface is a means for users to input request information, and is typically provided as a form on a web browser or as a smartphone app.

[0425] The hardware that can be used includes smartphones (e.g., iPhone, Android devices) and PCs (e.g., Windows, Mac).

[0426] 2. Request Information Processing Section

[0427] This part has the function of receiving and analyzing request information sent by the user. It operates on the server side and extracts the data that will be the basis for automatically generating a travel plan.

[0428] The software used will be data analysis algorithms and databases (e.g., MySQL, PostgreSQL).

[0429] 3. Travel Plan Generation Unit

[0430] Based on the analyzed request information, the system uses AI algorithms and databases to generate optimal travel plans, which are then presented to the user.

[0431] As AI algorithms, machine learning models (e.g., Scikit-learn, TensorFlow) are used.

[0432] 4. Emotion Engine

[0433] This is a means of analyzing emotions from user input and interactions and reflecting them in request information and travel plans. Emotion analysis uses facial recognition technology (e.g., OpenCV) and voice analysis technology (e.g., Watson Tone Analyzer).

[0434] The device uses a camera and microphone (e.g., a webcam, a smartphone's built-in camera and microphone).

[0435] 5. Plan Presentation and Coordination Department

[0436] The generated travel plan is presented to the user, who can confirm and adjust it. The adjusted plan is then sent to the server.

[0437] The interface utilizes the user interface of a web browser or smartphone app.

[0438] 6. Reservation Execution Department

[0439] It has the function to automatically make reservations for accommodation, transportation, and activities based on confirmed travel plans, and calls various reservation APIs (e.g., Booking.com API, Expedia API).

[0440] It runs on the server backend and connects to external services.

[0441] 7. Report Generation

[0442] Once a reservation is completed, a detailed trip report is generated and provided to the user, including the trip schedule and reservation confirmation information.

[0443] Use a PDF generation library (e.g. FPDF, ReportLab) to create reports.

[0444] Specific examples of processing

[0445] For example, if a user wishes to take a "solo trip to Hokkaido for 2 nights and 3 days," the system operates as follows.

[0446] 1. Enter information

[0447] The user enters information such as "Hokkaido," "2 nights and 3 days," "solo trip," and "want to relax" into the tour request form.

[0448] This information is sent to the server in real time.

[0449] 2. Emotion recognition

[0450] The emotion engine analyzes the user's emotional state based on the keyword "I want to relax."

[0451] 3. Automatic generation of travel plans

[0452] The server generates an optimal travel plan based on the request information and the results of sentiment analysis.

[0453] Example prompt for a generative AI model:

[0454] The user wants to take a 3-day, 2-night trip to Hokkaido, but also wants to relax. Based on the user's feelings, suggest tourist spots and accommodations where they can relax.

[0455] 4. Present and adjust the plan

[0456] The generated travel plan is displayed on the user's screen, and the user can further add and adjust the hot spring inn by confirming it.

[0457] 5. Making a reservation

[0458] Based on the confirmed plan, the server automatically makes reservations for accommodation, transportation, and activities.

[0459] 6. Creating a detailed report

[0460] A detailed trip report is created based on the completed reservation information and provided to the user.

[0461] The present invention allows for the generation and booking of personalized travel plans that take into account the user's emotional state.

[0462] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0463] Step 1:

[0464] The user uses a device such as a smartphone or PC to enter request information via a form on a web browser or a smartphone app. Specifically, the user enters information such as the travel destination, duration, purpose, and desired activity, and then presses the send button. The entered information is sent to the server in real time.

[0465] Step 2:

[0466] The server uses the request information processing unit to receive request information sent from the user. The received information is stored in a database and used as basic data for generating travel plans. The server also analyzes the content of the information to extract the user's requests and constraints.

[0467] Step 3:

[0468] When a user inputs their request information, the emotion engine analyzes their text input, voice input, and even facial expression data in real time. Based on the data collected using a camera and microphone, the emotion engine can understand the user's emotional state from keywords such as "I want to relax." The analysis results are then stored in a database by the emotion engine.

[0469] Step 4:

[0470] On the server, the travel plan generation unit automatically generates a travel plan based on the analysis results of the request information processing unit and emotion engine. It analyzes the data using AI algorithms (e.g., TensorFlow and Scikit-learn) and generates multiple optimal travel plans that take into account the user's emotional state. The generated plans are stored on the server.

[0471] Step 5:

[0472] The generated itinerary is sent to the user's device and displayed on the screen. The user can review the plan and make adjustments as needed. For example, they can add or remove specific accommodations or activities. This adjustment information is sent back to the server and finalized as the itinerary.

[0473] Step 6:

[0474] The server's reservation execution unit automatically reserves accommodation, transportation, and activities based on the confirmed travel plan. It calls various reservation APIs (e.g., Booking.com API and Expedia API) to check and confirm the reservation status. The completed reservation data is saved in a database.

[0475] Step 7:

[0476] After all reservations are completed, the server's report generation unit automatically generates a detailed report, which includes the travel schedule, reservation confirmation information, important notes, etc. The generated report is sent to the user's device in PDF format or other format and can be viewed.

[0477] Through this process, personalized travel plans and reservations that take into account the user's emotional state are generated and booked.

[0478] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0479] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0480] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0481] [Second embodiment]

[0482] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0483] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0484] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0485] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0486] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0487] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0488] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0489] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0490] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0491] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0492] In the smart glasses 214, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0493] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0494] The present invention relates to a system for consistently and efficiently designing and booking travel tours, and embodiments thereof will be described in detail below.

[0495] System configuration

[0496] The system consists of the following main components:

[0497] 1. User Interface

[0498] The user interface is a means for a user to input request information. This interface is provided, for example, as a form on a web browser or a smartphone app.

[0499] 2. Request Information Processing Section

[0500] The request information processing unit is a server-side function that receives and analyzes request information sent from a user, and extracts data that serves as the basis for automatically generating a travel plan.

[0501] 3. Travel Plan Generation Unit

[0502] The travel plan generator is a server-side function that uses AI algorithms and databases to generate optimal travel plans based on the analyzed request information. This generated plan is then presented to the user.

[0503] 4. Plan Presentation and Coordination Department

[0504] The plan presentation and adjustment section presents the generated travel plan to the user, and allows the user to confirm and adjust the plan. Here, the user can provide feedback and corrections to the plan and finalize the plan.

[0505] 5. Reservation Execution Department

[0506] The reservation execution unit is a server-side function that automatically makes reservations for accommodations, transportation, and activities based on the confirmed travel plan. This unit calls various reservation APIs and checks the reservation status.

[0507] 6. Report Generation

[0508] The report generator is a server-side function that creates a detailed travel report based on the completed reservation information and provides it to the user. This report includes the travel schedule and reservation confirmation information.

[0509] A natural language description of the program's operation

[0510] 1. Enter information

[0511] The user interface displays a tour request form to the user. When the user enters the necessary information and presses the send button, this information is sent in real time to the request information processing unit of the server.

[0512] 2. Automatic generation of travel plans

[0513] The server's request information processing unit receives and analyzes the request information sent by the user. Based on this information, the travel plan generation unit uses an AI algorithm to generate multiple optimal travel plans.

[0514] 3. Present and adjust the plan

[0515] The generated travel plan is sent to the user's device and displayed on the user's screen. The user can review it and make adjustments as necessary. Once the adjustments are complete, the user presses the confirm button to send the final plan to the server.

[0516] 4. Making a reservation

[0517] The server's reservation execution unit automatically makes reservations for accommodation, transportation, and activities based on the confirmed travel plan. Successful reservation data is saved on the server in real time.

[0518] 5. Creating a detailed report

[0519] After all reservations are completed, the server's report generator automatically creates a detailed report and sends it to the user's device, allowing the user to receive their travel schedule and reservation confirmation information in a single report.

[0520] Specific examples

[0521] For example, if a user wants to take a family trip to Tokyo for 4 nights and 5 days, the flow would be as follows:

[0522] 1. The user enters information such as "Tokyo," "4 nights, 5 days," and "family trip" into the tour request form and submits it.

[0523] 2. The server receives and analyzes this information and uses an AI algorithm to generate an optimal travel plan (for example, a plan that includes sightseeing in Asakusa, visiting Tokyo Disneyland, and Tokyo Tower).

[0524] 3. The plan will be displayed on the user's screen and the user can confirm it. If they want to add a hot spring inn, they can add it and submit again.

[0525] 4. The server automatically books accommodation, flights, and activities based on the confirmed plan and stores confirmation information for each reservation.

[0526] 5. A detailed trip report is created based on the completed reservation information and provided to the user, who can then review it and begin preparing for their trip.

[0527] In this way, the present invention allows the user to easily design a tour based on detailed request information and to perform all steps from reservation to report creation in one go.

[0528] The processing flow will be explained below.

[0529] Step 1:

[0530] The user interface displays a tour request form to the user, which includes input fields for "Destination," "Trip Length," "Budget," "Number of Participants," and "Special Requirements."

[0531] Step 2:

[0532] The user enters the necessary information into the request form, such as "Destination: Tokyo," "Travel duration: 4 nights, 5 days," "Budget: 200,000 yen," "Number of participants: 4," and "Special requirements: Hot spring inn," and then presses the submit button.

[0533] Step 3:

[0534] The device collects the input request information and sends it to the server's request information processing unit in real time. The data is sent in a standard format such as JSON.

[0535] Step 4:

[0536] The server receives the request information, and the request information processing section of the server analyzes it and extracts various items such as the destination, travel period, and budget.

[0537] Step 5:

[0538] The server's travel plan generation unit automatically generates multiple travel plans based on the received request information using an AI algorithm and database. Specifically, the AI ​​algorithm considers past travel data and user preferences to suggest optimal combinations of hotels, flights, and activities.

[0539] Step 6:

[0540] The server transmits the generated travel plans to the user's terminal, and the transmitted plans are displayed in a list on the user interface of the terminal.

[0541] Step 7:

[0542] The user reviews each itinerary displayed, including details about the itinerary, such as hotel options, flight times, and activities.

[0543] Step 8:

[0544] If the user adjusts the plan as needed, for example, by selecting a different hotel or adding a particular activity, the plan is adjusted and sent back to the server.

[0545] Step 9:

[0546] The server receives the retransmitted information, and again uses the travel plan generator to generate an adjusted plan, which is then presented to the user again, and the steps are repeated.

[0547] Step 10:

[0548] The user finalizes the travel plan and presses the confirmation button. The confirmed plan information is sent from the terminal to the server.

[0549] Step 11:

[0550] The server's reservation execution unit starts the reservation process based on the confirmed travel plan. Specifically, it calls the APIs of each service to automatically reserve accommodation, transportation, and activities.

[0551] Step 12:

[0552] The server receives confirmation information from each reservation service, checks whether the reservation was successful, and stores the necessary information in a database.

[0553] Step 13:

[0554] After all reservations are completed, the server's report generator creates a detailed report that includes the travel schedule, confirmation information for each reservation, and contact information.

[0555] Step 14:

[0556] The server sends the generated report to the user's device, where the user can check the report and proceed with travel preparations.

[0557] The above are the processing steps in the tour planning application of the present invention. Information is processed efficiently at each step, realizing a system that is easy for users to use.

[0558] Example 1

[0559] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0560] Conventional travel planning systems have the drawback of requiring users to manually design plans and make each reservation individually, which is time-consuming. Furthermore, the user experience can be compromised because it is difficult to smoothly optimize or change travel plans. Furthermore, information management after a reservation is completed is cumbersome, making it difficult for users to efficiently prepare for their trip.

[0561] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0562] In this invention, the server includes means for providing a user interface for inputting request information, means for generating multiple optimal travel plans using an AI algorithm to automatically generate a travel plan based on the input request information, means for presenting the generated travel plans to the user and saving the finalized travel plan after the user confirms and adjusts it, means for automatically making reservations for accommodations, transportation, and activities based on the travel plan finalized by the user, and means for automatically generating a detailed report based on all completed reservation information and providing it to the user. This enables consistent and efficient processing from travel plan design to reservations and information management.

[0563] A "user interface" is a software or hardware component that provides a display screen and input means for a user to enter information.

[0564] "Request information" refers to information such as the travel destination, period, purpose of travel, and budget that the user inputs as information necessary to create a travel plan.

[0565] An "AI algorithm" is an algorithm that uses artificial intelligence technology to perform complex calculations and data analysis, in this case used to automatically generate travel plans.

[0566] The "travel plan generation means" is a component that has the function of automatically generating multiple optimal travel plans using an AI algorithm based on request information entered by the user.

[0567] A "presentation means" is a software or hardware component that displays the generated travel plan to the user and provides the user with the ability to confirm and adjust it.

[0568] An "adjustment tool" is a software or hardware component that provides functionality through which a user can make changes or modifications to the generated itinerary.

[0569] A "confirmation means" is a software or hardware component that provides a function for a user to finalize a travel plan and save it in the system.

[0570] The "reservation execution means" is a component that has the function of automatically making reservations for accommodations, transportation, and activities based on a confirmed travel plan, and obtaining reservation confirmation information.

[0571] The "detailed report generating means" is a component that has the function of automatically creating a detailed report including travel schedules and reservation confirmation information based on all information on completed reservations, and providing it to the user.

[0572] The present invention relates to a system for consistently and efficiently designing and reserving travel plans, and specific embodiments thereof will be described in detail below.

[0573] The system consists of the following main components:

[0574] 1. User Interface

[0575] The user interface is a means for users to input their request information. This interface is provided, for example, as a form on a web browser or a smartphone app. This allows users to easily input their request information, such as travel destination, duration, purpose, and budget.

[0576] 2. Request Information Processing Section

[0577] The request information processing section is a server-side function that receives and analyzes the request information sent by the user. This information processing section uses natural language processing tools (e.g., spaCy or NLTK) to extract necessary data from the input information and use it as basic data for generating travel plans.

[0578] 3. Travel Plan Generation Unit

[0579] The travel plan generation unit is a server-side function that uses an AI algorithm (for example, TensorFlow or PyTorch) to generate multiple optimal travel plans based on the analyzed request information. This function uses past travel data to suggest optimal travel routes and tourist spots tailored to the user's requests.

[0580] 4. Plan Presentation and Coordination Department

[0581] The plan presentation and adjustment section presents the generated travel plan to the user's device, allowing the user to review and adjust it. The user can review the plan on the screen, make additions or corrections as necessary, and finalize it as the final plan.

[0582] 5. Reservation Execution Department

[0583] The reservation execution unit is a server-side function that automatically executes reservations for accommodation, transportation, and activities based on the confirmed travel plan. To do this, it uses external reservation APIs (e.g., accommodation reservation API and transportation reservation API) to obtain each reservation information.

[0584] 6. Report Generation

[0585] The report generator is a server-side function that creates a detailed trip report based on the information of completed reservations and provides it to the user. This report includes the travel schedule and reservation confirmation information, helping the user to efficiently prepare for their trip.

[0586] Specific examples

[0587] For example, the specific operation flow when a user wishes to take a "four-night, five-day family trip to Tokyo" is shown below.

[0588] 1. Enter information

[0589] The user enters information such as "Tokyo," "4 nights, 5 days," and "family trip" into the tour request form and presses the send button.

[0590] 2. Analysis of request information

[0591] The server receives this information and performs the analysis.

[0592] 3. Automatic generation of travel plans

[0593] The server uses an AI algorithm to generate multiple optimal travel plans (for example, a plan that includes sightseeing in Asakusa, visiting Tokyo Disneyland, and Tokyo Tower).

[0594] 4. Present and adjust the plan

[0595] The generated travel plan is displayed on the user's device and the user confirms it. For example, if the user wants to add a hot spring inn, they add it and submit it again.

[0596] 5. Finalize your travel plans

[0597] The confirmed travel plan is stored on the server.

[0598] 6. Making a reservation

[0599] The server automatically makes reservations for accommodation, flights, and activities based on the confirmed travel plans.

[0600] 7. Creating a detailed report

[0601] A detailed trip report is created based on the completed reservation information and provided to the user, who can then review it and begin preparing for their trip.

[0602] Prompt Sentence Examples

[0603] Below are some example prompts for using a generative AI model to generate travel itinerary suggestions:

[0604] Generate the best travel plan based on the following criteria: Location: Tokyo, Duration: 4 nights, 5 days, Purpose of trip: Family trip, Main activity: Sightseeing, Accommodation: Hotel or Ryokan, Transportation: Train or bus, Budget: 20,000 yen per person per day

[0605] In this way, the present invention provides a system that allows users to easily design a travel plan based on detailed request information and to perform all processes from reservation to report creation in one go.

[0606] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0607] Step 1:

[0608] Enter information

[0609] The server receives request information entered by the user through a user interface. The user enters request information such as "Tokyo," "four nights and five days," and "family trip," and presses the send button. The input is done through a web form or a smartphone app. The server saves this input data in a database in real time.

[0610] Input: The user enters information such as travel destination, duration, purpose, and budget.

[0611] Output: The entered information is saved in the database.

[0612] Specific behavior:

[0613] When a user enters information such as "Tokyo," "4 nights, 5 days," and "family trip" into the tour request form and presses the send button, the server receives this and stores it in the database.

[0614] Step 2:

[0615] Parsing request information

[0616] The server's request information processing unit analyzes the received request information. Using natural language processing tools (e.g., spaCy or NLTK), it extracts necessary information (e.g., travel destination, duration, purpose, etc.) from the input data. The server uses the analysis results as data to proceed to the next step.

[0617] Input: Saved request information.

[0618] Output: Parsed necessary information (travel destination, duration, purpose, etc.).

[0619] Specific behavior:

[0620] The server retrieves the request information stored in the database and analyzes it using natural language processing tools, extracting necessary information such as "Tokyo," "four nights and five days," and "family trip."

[0621] Step 3:

[0622] Automatic travel plan generation

[0623] The server's travel plan generation unit uses an AI algorithm (for example, TensorFlow or PyTorch) to generate multiple optimal travel plans based on the analyzed request information. It also retrieves past travel data from other databases and proposes the plan that best suits the requested conditions.

[0624] Input: Parsed request information and historical trip data.

[0625] Output: A list of optimal itineraries.

[0626] Specific behavior:

[0627] The server runs an AI algorithm based on the analyzed request information to generate multiple itineraries, including "Sightseeing in Asakusa," "Visiting Tokyo Disneyland," and "Visiting Tokyo Tower," and outputs these itineraries as a single list.

[0628] Step 4:

[0629] Presenting and adjusting plans

[0630] The generated travel plan is sent to the user's device. The user can check the plan on the screen and make additions or modifications as necessary. For example, if the user wishes to add a hot spring inn, the user can update the plan after checking it and resend it.

[0631] Input: The generated itinerary.

[0632] Output: The final plan that you review and adjust.

[0633] Specific behavior:

[0634] The user checks the proposed travel plan, adds a hot spring inn, or makes other changes. For example, the user presses the "Add Hot Spring Inn" button, selects "Hakone Hot Springs" to add it to the plan, and submits it again.

[0635] Step 5:

[0636] Confirming travel plans

[0637] The user finalizes the travel plan. When the user presses the confirm button, the adjusted travel plan is sent to the server, which stores this final plan in its database.

[0638] Input: A travel plan confirmed by the user.

[0639] Output: The finalized itinerary is saved in the database.

[0640] Specific behavior:

[0641] The user presses the "confirm" button, the confirmed plan is sent to the server, and the server saves the plan data in a database.

[0642] Step 6:

[0643] Making a reservation

[0644] The server's reservation execution unit automatically makes reservations for accommodation, transportation, and activities based on the confirmed travel plan. It uses external reservation APIs (e.g., accommodation reservation API, transportation reservation API) to obtain reservation confirmation information and saves it in a database.

[0645] Input: Confirmed travel plans.

[0646] Output: The reservation information is saved in the database.

[0647] Specific behavior:

[0648] The server uses booking APIs to automatically book accommodations, flights, etc. For example, it uses Booking.com's API to complete hotel reservations and Skyscanner's API to book flights.

[0649] Step 7:

[0650] Creating detailed reports

[0651] The server's report generator creates a detailed trip report based on all the information from the completed reservation and sends it to the user's device. This report includes the travel schedule and reservation confirmation information, allowing the user to efficiently prepare for their trip.

[0652] Input: Information with which the reservation was completed.

[0653] Output: A detailed trip report.

[0654] Specific behavior:

[0655] The server aggregates all reservation information and generates a PDF report that is emailed to the user, including the travel schedule and accommodation and transportation reservation confirmation.

[0656] The above is the specific processing procedure of the program for this system. Because the operations, inputs, and outputs performed at each step are clearly defined, the function of the entire system is achieved efficiently.

[0657] (Application example 1)

[0658] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0659] Conventional travel planning systems focus on booking accommodation, transportation, and activities, and lack comprehensive suggestions that include meal plans during travel. Meals during travel are an important part of the travel experience, and if meal plans are not properly incorporated, the quality of the travel experience may be reduced. Therefore, there is a need for a system that can incorporate meal plans, including local specialty dishes and special food delivery services, into travel plans.

[0660] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0661] In this invention, the server includes means for providing a user interface for inputting request information, means for automatically generating a travel plan based on the input request information, means for presenting the generated travel plan to the user and allowing the user to confirm and adjust it, means for automatically reserving accommodations, transportation, and activities based on the travel plan confirmed by the user, means for automatically generating a meal plan and making food delivery and restaurant reservations, and means for automatically generating a detailed report on the reservation status and providing it to the user. This enables the user to consistently design and reserve a comprehensive travel plan, including plans to enjoy local specialty meals during their trip.

[0662] The "means for providing a user interface for inputting request information" refers to a means for providing an interface for a user to input requests and information regarding a trip.

[0663] The "means for automatically generating a travel plan based on input request information" refers to a means for analyzing the request information input by the user and automatically generating a travel plan based on the information.

[0664] "Means for presenting the generated travel plan to the user and allowing the user to confirm and adjust" refers to means for displaying the generated travel plan to the user, allowing the user to confirm the plan and make adjustments as necessary.

[0665] "Means for automatically making reservations for accommodation, transportation, and activities based on a travel plan confirmed by a user" refers to means for automatically making reservations for accommodation, transportation, and activities based on a travel plan confirmed by a user.

[0666] "Means for automatically generating meal plans and making food delivery and restaurant reservations" refers to means for automatically generating meal plans for travel and automatically making food delivery and restaurant reservations.

[0667] The "means for automatically generating a detailed report on the reservation status and providing it to the user" is a means for automatically generating a detailed report on the reservation status and travel and providing it to the user.

[0668] The present invention relates to a system that can comprehensively design meal plans along with travel plans and can also perform reservation procedures. An embodiment of the present invention will be described in detail below.

[0669] System configuration and program contents

[0670] The system consists of the following main components:

[0671] 1. User Interface:

[0672] It is a means for users to input travel request information via a smartphone app or web browser.

[0673] For example, you enter information such as your travel destination, length of stay, food preferences (Japanese, French, Chinese, etc.), meal type (breakfast, lunch, dinner), and desired budget.

[0674] 2. Request information processing section:

[0675] It runs on the server side and receives and analyzes request information sent by users in real time.

[0676] Flask is used to process requests from clients and store information in JSON format on the server.

[0677] 3. Travel Plan Generation Unit:

[0678] Using AI algorithms such as TensorFlow, it generates optimal travel plans based on past travel data and user request information.

[0679] For example, it suggests the optimal combination of tourist destinations, accommodations, and transportation methods.

[0680] 4. Meal Plan Generator:

[0681] It uses an AI algorithm to generate the optimal meal plan for your trip based on your food preferences and budget.

[0682] Consider highly rated local restaurants and food delivery services.

[0683] 5. Planning and Coordination Department:

[0684] It is a means for presenting the generated travel and meal plans to the user, allowing the user to confirm and adjust them.

[0685] The generated plan is displayed on a smartphone app or web browser, and the user can review it and adjust it as necessary.

[0686] 6. Reservation Execution Department:

[0687] Automatically book accommodations, transportation, activities and meals based on your confirmed travel and meal plans.

[0688] Call various reservation APIs, check reservation status in real time, and save it in a MySQL database.

[0689] 7. Report Generation:

[0690] After all reservations are completed, a detailed report is automatically generated and provided to the user.

[0691] The report includes travel itinerary, booking confirmation information, and meal plan details.

[0692] Use the ReportLab library to create PDF reports and provide them to users.

[0693] Prompt Sentence Examples

[0694] "Generate the best local food delivery and restaurant reservations plan for your trip. Input information: destination, length of stay, food preference (Japanese, French, Chinese, etc.), meal type (breakfast, lunch, dinner), and desired budget."

[0695] The system of the present invention allows users to design and book comprehensive travel plans, including plans to enjoy local cuisine during their trip. As a concrete example, if a user wishes to take a "five-day, four-night family trip to Tokyo," the system can generate an optimal plan that includes famous local restaurants and delivery services, covering the entire trip. This can significantly improve the quality of the trip.

[0696] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0697] Step 1:

[0698] The user enters request information through a smartphone app or web browser. The request information includes travel destination, length of stay, food preferences (e.g., Japanese, French, Chinese, etc.), meal type (breakfast, lunch, dinner), desired budget, etc. Once the input is complete, the user presses the send button to send the information to the server. The entered data is sent to the server in JSON format.

[0699] Step 2:

[0700] The server's request information processing unit receives and analyzes request information sent by the user in real time. Flask processes the request from the client, analyzes the JSON format data, and extracts the necessary information. The extracted data is stored in the server's memory or database.

[0701] Step 3:

[0702] The travel plan generation unit uses AI algorithms such as TensorFlow to generate an optimal travel plan based on the extracted request information. Using a model trained on past travel data, it proposes the optimal combination of tourist destinations, accommodations, and transportation methods. The generated travel plan is temporarily stored in the server's memory.

[0703] Step 4:

[0704] The meal plan generator uses an AI algorithm to automatically generate the optimal meal plan based on the food preferences and budget provided in the request information. It references a database of highly rated local restaurants and food delivery services to select the best meal options. The generated meal plan is stored in the server's memory.

[0705] Step 5:

[0706] The plan presentation and adjustment unit sends the generated travel and meal plans to the user's device and displays them. The user can check the plans on a smartphone app or web browser and make adjustments as necessary. User feedback is sent to the server in real time, and the travel and meal plans are regenerated or revised.

[0707] Step 6:

[0708] Once the user finalizes the plan, the server's reservation execution unit automatically makes reservations for accommodation, transportation, activities, restaurants, and food delivery. It calls various reservation APIs, receives confirmation of successful reservations in real time, and stores them in a database.

[0709] Step 7:

[0710] After all reservations are completed, the server's report generator creates a detailed trip report. It uses the ReportLab library to generate a PDF report that includes the trip schedule, reservation confirmation information, meal plan details, etc. The completed report is sent to the user's device, allowing them to continue preparing for their trip.

[0711] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0712] The present invention relates to a system for recognizing a user's emotions and designing and booking travel tours in a more personalized manner, and embodiments thereof will be described in detail below.

[0713] System configuration

[0714] The system consists of the following main components:

[0715] 1. User Interface

[0716] The user interface is a means for a user to input request information. This interface is provided, for example, as a form on a web browser or a smartphone app.

[0717] 2. Request Information Processing Section

[0718] The request information processing unit is a server-side function that receives and analyzes request information sent from a user, and extracts data that serves as the basis for automatically generating a travel plan.

[0719] 3. Travel Plan Generation Unit

[0720] The travel plan generator is a server-side function that uses AI algorithms and databases to generate optimal travel plans based on the analyzed request information. This generated plan is then presented to the user.

[0721] 4. Emotion Engine

[0722] The emotion engine is a means of analyzing emotions from user input and interactions and reflecting them in request information and travel plans. For example, emotions can be analyzed using user text input, voice input, and even facial expression recognition technology.

[0723] 5. Plan Presentation and Coordination Department

[0724] The plan presentation and adjustment section presents the generated travel plan to the user, and allows the user to confirm and adjust the plan. Here, the user can provide feedback and corrections to the plan and finalize the plan.

[0725] 6. Reservation Execution Department

[0726] The reservation execution unit is a server-side function that automatically makes reservations for accommodations, transportation, and activities based on the confirmed travel plan. This unit calls various reservation APIs and checks the reservation status.

[0727] 7. Report Generation

[0728] The report generator is a server-side function that creates a detailed travel report based on the completed reservation information and provides it to the user. This report includes the travel schedule and reservation confirmation information.

[0729] A natural language description of the program's operation

[0730] 1. Enter information

[0731] The user interface displays a tour request form to the user. When the user enters the necessary information and presses the send button, this information is sent in real time to the request information processing unit of the server.

[0732] 2. Emotion recognition

[0733] When a user inputs information, the emotion engine analyzes the input text, voice, and even the user's facial expression data to understand the user's emotional state. For example, if the user inputs "I'm tired," the engine will prioritize plans that will help the user relax.

[0734] 3. Automatic generation of travel plans

[0735] The server's request information processing unit receives and analyzes the request information sent by the user. Then, based on this information and the analysis results of the emotion engine, the travel plan generation unit generates multiple optimal travel plans.

[0736] 4. Present and adjust the plan

[0737] The generated travel plan is sent to the user's device and displayed on the user's screen. The user can review it and make adjustments as necessary. Once the adjustments are complete, the user presses the confirm button to send the final plan to the server.

[0738] 5. Making a reservation

[0739] The server's reservation execution unit automatically makes reservations for accommodation, transportation, and activities based on the confirmed travel plan. Successful reservation data is saved on the server in real time.

[0740] 6. Creating a detailed report

[0741] After all reservations are completed, the server's report generator automatically creates a detailed report and sends it to the user's device, allowing the user to receive their travel schedule and reservation confirmation information in a single report.

[0742] Specific examples

[0743] For example, if a user wishes to take a solo trip to Hokkaido for 2 nights and 3 days, the process would be as follows:

[0744] 1. The user fills in the tour request form with information such as "Hokkaido," "2 nights, 3 days," and "solo trip," and then adds "I want to relax."

[0745] 2. The server receives the request information, and the emotion engine analyzes the keyword "I want to relax" to determine that the user is feeling stressed.

[0746] 3. Based on this, the travel plan generation unit will prioritize and suggest plans that include hot springs and quiet tourist spots.

[0747] 4. The plan is displayed on the user's screen, and the user can confirm and adjust the hot spring inn.

[0748] 5. The server automatically makes reservations for hotels, transportation, and activities based on the confirmed plan.

[0749] 6. A detailed trip report is generated based on the completed booking information and provided to the user.

[0750] In this way, by combining the emotion engine, it becomes possible to generate and book a personalized travel plan according to the user's emotional state. This invention allows users to design a comfortable trip that is more suited to their own circumstances.

[0751] The processing flow will be explained below.

[0752] Step 1:

[0753] The user interface displays a tour request form to the user, which includes input fields for "Destination," "Trip Length," "Budget," "Number of Participants," and "Special Requirements."

[0754] Step 2:

[0755] The user enters the necessary information into the request form, such as "Destination: Hokkaido," "Travel duration: 2 nights, 3 days," "Budget: 100,000 yen," "Number of participants: 1 person," and "Special requirement: I want to relax," and then presses the submit button.

[0756] Step 3:

[0757] The device collects the input request information and sends it to the server's request information processing unit in real time. The data is sent in a standard format such as JSON.

[0758] Step 4:

[0759] The server receives the request information, and the request information processing unit analyzes it and extracts various items such as the destination, travel period, and budget.

[0760] Step 5:

[0761] The emotion engine analyzes the user's emotions from their input information and interactions. For example, it determines that the user needs to relax based on the specific requirement "I want to relax."

[0762] Step 6:

[0763] The server's travel plan generation unit uses an AI algorithm to generate multiple optimal travel plans based on the received request information and the analysis results of the emotion engine, prioritizing the inclusion of relaxing elements such as hot springs and quiet tourist spots.

[0764] Step 7:

[0765] The server sends the generated travel plans to the user's terminal, where they are displayed in a list on the user interface of the terminal.

[0766] Step 8:

[0767] The user reviews each itinerary displayed, including details about the itinerary, such as hotel options, flight times, and activities.

[0768] Step 9:

[0769] If the user adjusts the plan as needed, for example, to select a different hot spring resort or add a specific activity, the plan is adjusted and sent back to the server.

[0770] Step 10:

[0771] The server receives the retransmitted adjusted information and again uses the travel plan generator to generate an adjusted plan, which is then presented to the user again, and the confirmation and adjustment process is repeated.

[0772] Step 11:

[0773] The user finalizes the travel plan and presses the confirmation button. The confirmed plan information is sent from the terminal to the server.

[0774] Step 12:

[0775] The server's reservation execution unit starts the reservation procedure based on the confirmed travel plan. Specifically, it calls the APIs of each service (hotel, flight, activity) to automatically make the reservation.

[0776] Step 13:

[0777] The server receives confirmation information from each reservation service, checks whether the reservation was successful, and stores the necessary information in a database.

[0778] Step 14:

[0779] After all reservations are completed, the server's report generator automatically generates a detailed report that includes the travel schedule, confirmation information for each reservation, and contact information.

[0780] Step 15:

[0781] The server sends the generated report to the user's device, where the user can check the report and proceed with travel preparations.

[0782] Example 2

[0783] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0784] Conventional travel plan generation systems are unable to provide plans that fully reflect the user's individual feelings and specific needs, making it difficult to design a travel plan that satisfies the user. In addition, the process from generating a travel plan to confirming a reservation is complicated, requiring the user to perform many manual tasks, resulting in a poor user experience.

[0785] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for providing a user interface for inputting request information, means for automatically generating a travel plan based on the input request information, means for presenting the generated travel plan to the user and allowing the user to confirm and adjust it, means for automatically reserving accommodations, transportation, and activities based on the travel plan confirmed by the user, means for automatically generating a detailed report on the reservation status and providing it to the user, and means for recognizing the user's emotions from the information input and interactions and reflecting them in the travel plan. This makes it possible to generate and reserve a personalized travel plan based on the user's emotions and needs.

[0786] "Request information" refers to specific information such as the destination, number of days, number of people, and purpose that a user inputs when requesting the creation of a travel plan.

[0787] "User interface" refers to the form on a web browser or the interface of a smartphone app through which a user enters request information.

[0788] The "request information processing unit" is a server-side component that receives request information entered by the user, analyzes it, and extracts the necessary data.

[0789] The "travel plan generation unit" is a server-side component that automatically generates an appropriate travel plan based on the analysis results obtained from the request information processing unit.

[0790] The "emotion engine" is a server-side function that analyzes emotions from user input information and interactions, and reflects the analysis results in request information and travel plans.

[0791] The "plan presentation and adjustment unit" is a server-side and terminal-side component that presents the generated travel plan to the user and allows the user to confirm and adjust the plan.

[0792] The "reservation execution unit" is a server-side function that automatically executes reservations for accommodations, transportation, and activities based on the confirmed travel plan.

[0793] The "report generation unit" is a server-side function that creates a detailed travel report based on completed reservation information and provides it to the user.

[0794] A "travel plan" is a specific travel itinerary and activity plan generated based on the user's request information and emotion data.

[0795] "Generative AI model" refers to the artificial intelligence algorithm used by the travel plan generation unit, and is a model for automatically generating optimal plans based on various data.

[0796] A "prompt sentence" is a free-form text message that a user enters to make a specific request or instruction to the system.

[0797] The present invention relates to a system for recognizing a user's emotions and designing and booking a travel tour in a more personalized manner, and specific embodiments thereof will be described in detail below.

[0798] System configuration

[0799] This system mainly consists of the following components:

[0800] 1. User Interface

[0801] The user interface (UI) is the means by which a user inputs request information. This interface is provided as a form on a web browser or a smartphone app.

[0802] The user inputs the destination, number of days, number of people, and purpose of the trip (e.g., "I want to relax").

[0803] 2. Request Information Processing Section

[0804] The request information processing unit is a server-side function that receives and analyzes request information sent from a user.

[0805] This information processing unit extracts basic data for automatically generating a travel plan.

[0806] 3. Emotion Engine

[0807] The emotion engine is a means of analyzing emotions from user input information and interactions and reflecting them in travel plans.

[0808] Emotions are recognized using user text input, voice input, facial expression recognition, etc.

[0809] 4. Travel Plan Generation Unit

[0810] The travel plan generator is a server-side function that generates an optimal travel plan based on the input request information and the results of the emotion engine.

[0811] Automatically generate multiple plans using artificial intelligence algorithms (generative AI models) and databases.

[0812] 5. Plan Presentation and Coordination Department

[0813] The plan presentation and adjustment unit is a means for presenting the generated travel plan to the user and allowing the user to confirm and adjust it.

[0814] The user checks the proposed plan, makes any modifications, and then finalizes the plan.

[0815] 6. Reservation Execution Department

[0816] The reservation execution unit is a server-side function that automatically executes reservations for accommodation, transportation, and activities based on the confirmed travel plan.

[0817] Call various reservation APIs and check the reservation status.

[0818] 7. Report Generation

[0819] The report generation unit is a server-side function that creates a detailed travel report based on the completed reservation information and provides it to the user.

[0820] The report includes travel schedule and reservation confirmation information.

[0821] Specific examples

[0822] For example, if a user wishes to take a solo trip to Hokkaido for 2 nights and 3 days, the process would be as follows:

[0823] 1. The user fills in the tour request form with information such as "Hokkaido," "2 nights, 3 days," and "solo trip," and then adds "I want to relax."

[0824] 2. The server receives the request information, and the emotion engine analyzes the keyword "I want to relax" to determine that the user is feeling stressed.

[0825] 3. Based on this, the travel plan generation unit will prioritize and suggest plans that include hot springs and quiet tourist spots.

[0826] 4. The plan is displayed on the user's screen, and the user can confirm and adjust the hot spring inn.

[0827] 5. The server automatically makes reservations for hotels, transportation, and activities based on the confirmed plan.

[0828] 6. A detailed trip report is generated based on the completed booking information and provided to the user.

[0829] Prompt Sentence Examples

[0830] For example, by entering a prompt such as, "Create a 2-night, 3-day Hokkaido travel plan. Please include relaxing spots as an emphasis," the system will automatically generate a travel plan tailored to the user's needs.

[0831] In this way, the system enables personalized travel plans and bookings that reflect the user's emotions and specific travel needs.

[0832] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0833] Step 1: Enter your information

[0834] Input: The user inputs travel request information (destination, number of days, number of people, purpose of travel, etc.) via a user interface (UI).

[0835] How it works: The user enters information such as "Hokkaido," "2 nights and 3 days," "solo trip," and "want to relax" into the form and presses the submit button.

[0836] Output: The input request information is sent to the server.

[0837] Specific operation: The user's input information is sent to the request information processing unit of the server in real time.

[0838] Step 2: Emotion Recognition

[0839] Input: Request information received by the server, as well as text, voice, and facial expression data entered by the user.

[0840] How it works: The server's emotion engine analyzes the user's text, voice, and possibly facial expression data via a camera.

[0841] Output: User's emotional state (e.g., "I want to relax" is interpreted as stress).

[0842] Specific operation: The emotion engine analyzes the user's emotions from the text "I want to relax" and passes the results to the request information processing unit.

[0843] Step 3: Automatically generate a travel plan

[0844] Input: Request information from the request information processing unit and the analysis results of the emotion engine.

[0845] How it works: The server's travel plan generation unit uses a generative AI model to generate multiple travel plans based on this data.

[0846] Output: Multiple suggested itineraries.

[0847] Specific operation: The plan generation unit creates plans that include hot springs and quiet tourist spots. Specifically, plans that include farm stays and forest bathing activities are also proposed.

[0848] Step 4: Present and adjust the plan

[0849] Input: Multiple generated itineraries.

[0850] How it works: The server sends these plans to the user's device.

[0851] Output: User reviews and adjusts plan.

[0852] Specific operation: The travel plan is displayed on the user's device, and the user makes specific modifications such as "I would like to choose this accommodation" and finalizes the plan.

[0853] Step 5: Making a reservation

[0854] Input: Final confirmed plan.

[0855] Operation: The server's reservation execution unit calls various reservation APIs and makes reservations for accommodations, transportation, activities, etc.

[0856] Output: Successful reservation information.

[0857] Specific operation: The reservation execution unit checks the reservation status of the accommodation and automatically executes the reservation. Airline and train tickets are also arranged at the same time.

[0858] Step 6: Create a detailed report

[0859] Input: Completed reservation information.

[0860] Operation: The server's report generator creates a detailed trip report based on this reservation information.

[0861] Output: A detailed trip report provided to the user.

[0862] Specific operation: The report generator creates a report that summarizes the travel schedule, accommodation confirmation information, and transportation details. The user receives this report and can check the schedule and reservation information during the trip.

[0863] (Application example 2)

[0864] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0865] When designing and booking travel plans, it is difficult to provide a personalized experience that reflects the user's emotional state. Conventional travel plan creation systems do not take the user's emotions into account, so they are unable to propose plans that are appropriate for the user's current situation or psychological state, resulting in a decrease in user satisfaction.

[0866] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for providing a user interface for inputting request information, means for automatically generating a travel plan based on the input request information, means for presenting the generated travel plan to the user so that the user can confirm and adjust it, means for analyzing the user's emotions in real time, means for suggesting optimal products and services based on the emotion analysis results, means for automatically reserving accommodations, transportation, and activities based on the travel plan confirmed by the user, and means for automatically generating a detailed report on the reservation status and providing it to the user. This makes it possible to generate and reserve a personalized travel plan that takes the user's emotional state into consideration.

[0867] The "user interface for inputting request information" refers to an interface provided for users to input travel plan request information, and may consist of a web browser form, a smartphone app, or the like.

[0868] "Means for automatically generating a travel plan based on input request information" refers to algorithms or software that analyzes the request information input by the user and automatically creates a travel plan.

[0869] "Means for presenting the generated travel plan to the user and allowing the user to confirm and adjust it" refers to an interface that displays the travel plan to the user and allows the user to confirm and change the contents.

[0870] "Means for analyzing user emotions in real time" refers to technologies and algorithms that analyze emotions from a user's facial expressions and voice and reflect the results immediately.

[0871] "Means for proposing optimal products and services based on the results of sentiment analysis" refers to software or algorithms for recommending optimal products and services to individual users based on the results of sentiment analysis of the users.

[0872] "Means for automatically reserving accommodation, transportation, and activities based on a travel plan finalized by a user" refers to a system for automatically reserving accommodation, transportation, and activities based on a travel plan finalized by a user.

[0873] "Means for automatically generating detailed reports on reservation status and providing them to users" refers to technology or software for automatically creating detailed travel reports based on information on completed reservations and providing them to users.

[0874] The present invention is a system that analyzes a user's emotional state in real time, automatically generates and proposes travel plans based on the analysis, and makes reservations. The following describes in detail the embodiments of the present invention.

[0875] System configuration

[0876] This system consists of the following main components:

[0877] 1. User Interface

[0878] This interface is a means for users to input request information, and is typically provided as a form on a web browser or as a smartphone app.

[0879] The hardware that can be used includes smartphones (e.g., iPhone, Android devices) and PCs (e.g., Windows, Mac).

[0880] 2. Request Information Processing Section

[0881] This part has the function of receiving and analyzing request information sent by the user. It operates on the server side and extracts the data that will be the basis for automatically generating a travel plan.

[0882] The software used will be data analysis algorithms and databases (e.g., MySQL, PostgreSQL).

[0883] 3. Travel Plan Generation Unit

[0884] Based on the analyzed request information, the system uses AI algorithms and databases to generate optimal travel plans, which are then presented to the user.

[0885] As AI algorithms, machine learning models (e.g., Scikit-learn, TensorFlow) are used.

[0886] 4. Emotion Engine

[0887] This is a means of analyzing emotions from user input and interactions and reflecting them in request information and travel plans. Emotion analysis uses facial recognition technology (e.g., OpenCV) and voice analysis technology (e.g., Watson Tone Analyzer).

[0888] The device uses a camera and microphone (e.g., a webcam, a smartphone's built-in camera and microphone).

[0889] 5. Plan Presentation and Coordination Department

[0890] The generated travel plan is presented to the user, who can confirm and adjust it. The adjusted plan is then sent to the server.

[0891] The interface utilizes the user interface of a web browser or smartphone app.

[0892] 6. Reservation Execution Department

[0893] It has the function to automatically make reservations for accommodation, transportation, and activities based on confirmed travel plans, and calls various reservation APIs (e.g., Booking.com API, Expedia API).

[0894] It runs on the server backend and connects to external services.

[0895] 7. Report Generation

[0896] Once a reservation is completed, a detailed trip report is generated and provided to the user, including the trip schedule and reservation confirmation information.

[0897] Use a PDF generation library (e.g. FPDF, ReportLab) to create reports.

[0898] Specific examples of processing

[0899] For example, if a user wishes to take a "solo trip to Hokkaido for 2 nights and 3 days," the system operates as follows.

[0900] 1. Enter information

[0901] The user enters information such as "Hokkaido," "2 nights and 3 days," "solo trip," and "want to relax" into the tour request form.

[0902] This information is sent to the server in real time.

[0903] 2. Emotion recognition

[0904] The emotion engine analyzes the user's emotional state based on the keyword "I want to relax."

[0905] 3. Automatic generation of travel plans

[0906] The server generates an optimal travel plan based on the request information and the results of sentiment analysis.

[0907] Example prompt for a generative AI model:

[0908] The user wants to take a 3-day, 2-night trip to Hokkaido, but also wants to relax. Based on the user's feelings, suggest tourist spots and accommodations where they can relax.

[0909] 4. Present and adjust the plan

[0910] The generated travel plan is displayed on the user's screen, and the user can further add and adjust the hot spring inn by confirming it.

[0911] 5. Making a reservation

[0912] Based on the confirmed plan, the server automatically makes reservations for accommodation, transportation, and activities.

[0913] 6. Creating a detailed report

[0914] A detailed trip report is created based on the completed reservation information and provided to the user.

[0915] The present invention allows for the generation and booking of personalized travel plans that take into account the user's emotional state.

[0916] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0917] Step 1:

[0918] The user uses a device such as a smartphone or PC to enter request information via a form on a web browser or a smartphone app. Specifically, the user enters information such as the travel destination, duration, purpose, and desired activity, and then presses the send button. The entered information is sent to the server in real time.

[0919] Step 2:

[0920] The server uses the request information processing unit to receive request information sent from the user. The received information is stored in a database and used as basic data for generating travel plans. The server also analyzes the content of the information to extract the user's requests and constraints.

[0921] Step 3:

[0922] When a user inputs their request information, the emotion engine analyzes their text input, voice input, and even facial expression data in real time. Based on the data collected using a camera and microphone, the emotion engine can understand the user's emotional state from keywords such as "I want to relax." The analysis results are then stored in a database by the emotion engine.

[0923] Step 4:

[0924] On the server, the travel plan generation unit automatically generates a travel plan based on the analysis results of the request information processing unit and emotion engine. It analyzes the data using AI algorithms (e.g., TensorFlow and Scikit-learn) and generates multiple optimal travel plans that take into account the user's emotional state. The generated plans are stored on the server.

[0925] Step 5:

[0926] The generated itinerary is sent to the user's device and displayed on the screen. The user can review the plan and make adjustments as needed. For example, they can add or remove specific accommodations or activities. This adjustment information is sent back to the server and finalized as the itinerary.

[0927] Step 6:

[0928] The server's reservation execution unit automatically reserves accommodation, transportation, and activities based on the confirmed travel plan. It calls various reservation APIs (e.g., Booking.com API and Expedia API) to check and confirm the reservation status. The completed reservation data is saved in a database.

[0929] Step 7:

[0930] After all reservations are completed, the server's report generation unit automatically generates a detailed report, which includes the travel schedule, reservation confirmation information, important notes, etc. The generated report is sent to the user's device in PDF format or other format and can be viewed.

[0931] Through this process, personalized travel plans and reservations that take into account the user's emotional state are generated and booked.

[0932] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0933] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0934] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0935] [Third embodiment]

[0936] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0937] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0938] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0939] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0940] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0941] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0942] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0943] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0944] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0945] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0946] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0947] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0948] The present invention relates to a system for consistently and efficiently designing and booking travel tours, and embodiments thereof will be described in detail below.

[0949] System configuration

[0950] The system consists of the following main components:

[0951] 1. User Interface

[0952] The user interface is a means for a user to input request information. This interface is provided, for example, as a form on a web browser or a smartphone app.

[0953] 2. Request Information Processing Section

[0954] The request information processing unit is a server-side function that receives and analyzes request information sent from a user, and extracts data that serves as the basis for automatically generating a travel plan.

[0955] 3. Travel Plan Generation Unit

[0956] The travel plan generator is a server-side function that uses AI algorithms and databases to generate optimal travel plans based on the analyzed request information. This generated plan is then presented to the user.

[0957] 4. Plan Presentation and Coordination Department

[0958] The plan presentation and adjustment section presents the generated travel plan to the user, and allows the user to confirm and adjust the plan. Here, the user can provide feedback and corrections to the plan and finalize the plan.

[0959] 5. Reservation Execution Department

[0960] The reservation execution unit is a server-side function that automatically makes reservations for accommodations, transportation, and activities based on the confirmed travel plan. This unit calls various reservation APIs and checks the reservation status.

[0961] 6. Report Generation

[0962] The report generator is a server-side function that creates a detailed travel report based on the completed reservation information and provides it to the user. This report includes the travel schedule and reservation confirmation information.

[0963] A natural language description of the program's operation

[0964] 1. Enter information

[0965] The user interface displays a tour request form to the user. When the user enters the necessary information and presses the send button, this information is sent in real time to the request information processing unit of the server.

[0966] 2. Automatic generation of travel plans

[0967] The server's request information processing unit receives and analyzes the request information sent by the user. Based on this information, the travel plan generation unit uses an AI algorithm to generate multiple optimal travel plans.

[0968] 3. Present and adjust the plan

[0969] The generated travel plan is sent to the user's device and displayed on the user's screen. The user can review it and make adjustments as necessary. Once the adjustments are complete, the user presses the confirm button to send the final plan to the server.

[0970] 4. Making a reservation

[0971] The server's reservation execution unit automatically makes reservations for accommodation, transportation, and activities based on the confirmed travel plan. Successful reservation data is saved on the server in real time.

[0972] 5. Creating a detailed report

[0973] After all reservations are completed, the server's report generator automatically creates a detailed report and sends it to the user's device, allowing the user to receive their travel schedule and reservation confirmation information in a single report.

[0974] Specific examples

[0975] For example, if a user wants to take a family trip to Tokyo for 4 nights and 5 days, the flow would be as follows:

[0976] 1. The user enters information such as "Tokyo," "4 nights, 5 days," and "family trip" into the tour request form and submits it.

[0977] 2. The server receives and analyzes this information and uses an AI algorithm to generate an optimal travel plan (for example, a plan that includes sightseeing in Asakusa, visiting Tokyo Disneyland, and Tokyo Tower).

[0978] 3. The plan will be displayed on the user's screen and the user can confirm it. If they want to add a hot spring inn, they can add it and submit again.

[0979] 4. The server automatically books accommodation, flights, and activities based on the confirmed plan and stores confirmation information for each reservation.

[0980] 5. A detailed trip report is created based on the completed reservation information and provided to the user, who can then review it and begin preparing for their trip.

[0981] In this way, the present invention allows the user to easily design a tour based on detailed request information and to perform all steps from reservation to report creation in one go.

[0982] The processing flow will be explained below.

[0983] Step 1:

[0984] The user interface displays a tour request form to the user, which includes input fields for "Destination," "Trip Length," "Budget," "Number of Participants," and "Special Requirements."

[0985] Step 2:

[0986] The user enters the necessary information into the request form, such as "Destination: Tokyo," "Travel duration: 4 nights, 5 days," "Budget: 200,000 yen," "Number of participants: 4," and "Special requirements: Hot spring inn," and then presses the submit button.

[0987] Step 3:

[0988] The device collects the input request information and sends it to the server's request information processing unit in real time. The data is sent in a standard format such as JSON.

[0989] Step 4:

[0990] The server receives the request information, and the request information processing section of the server analyzes it and extracts various items such as the destination, travel period, and budget.

[0991] Step 5:

[0992] The server's travel plan generation unit automatically generates multiple travel plans based on the received request information using an AI algorithm and database. Specifically, the AI ​​algorithm considers past travel data and user preferences to suggest optimal combinations of hotels, flights, and activities.

[0993] Step 6:

[0994] The server transmits the generated travel plans to the user's terminal, and the transmitted plans are displayed in a list on the user interface of the terminal.

[0995] Step 7:

[0996] The user reviews each itinerary displayed, including details about the itinerary, such as hotel options, flight times, and activities.

[0997] Step 8:

[0998] If the user adjusts the plan as needed, for example, by selecting a different hotel or adding a particular activity, the plan is adjusted and sent back to the server.

[0999] Step 9:

[1000] The server receives the retransmitted information, and again uses the travel plan generator to generate an adjusted plan, which is then presented to the user again, and the steps are repeated.

[1001] Step 10:

[1002] The user finalizes the travel plan and presses the confirmation button. The confirmed plan information is sent from the terminal to the server.

[1003] Step 11:

[1004] The server's reservation execution unit starts the reservation process based on the confirmed travel plan. Specifically, it calls the APIs of each service to automatically reserve accommodation, transportation, and activities.

[1005] Step 12:

[1006] The server receives confirmation information from each reservation service, checks whether the reservation was successful, and stores the necessary information in a database.

[1007] Step 13:

[1008] After all reservations are completed, the server's report generator creates a detailed report that includes the travel schedule, confirmation information for each reservation, and contact information.

[1009] Step 14:

[1010] The server sends the generated report to the user's device, where the user can check the report and proceed with travel preparations.

[1011] The above are the processing steps in the tour planning application of the present invention. Information is processed efficiently at each step, realizing a system that is easy for users to use.

[1012] Example 1

[1013] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1014] Conventional travel planning systems have the drawback of requiring users to manually design plans and make each reservation individually, which is time-consuming. Furthermore, the user experience can be compromised because it is difficult to smoothly optimize or change travel plans. Furthermore, information management after a reservation is completed is cumbersome, making it difficult for users to efficiently prepare for their trip.

[1015] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1016] In this invention, the server includes means for providing a user interface for inputting request information, means for generating multiple optimal travel plans using an AI algorithm to automatically generate a travel plan based on the input request information, means for presenting the generated travel plans to the user and saving the finalized travel plan after the user confirms and adjusts it, means for automatically making reservations for accommodations, transportation, and activities based on the travel plan finalized by the user, and means for automatically generating a detailed report based on all completed reservation information and providing it to the user. This enables consistent and efficient processing from travel plan design to reservations and information management.

[1017] A "user interface" is a software or hardware component that provides a display screen and input means for a user to enter information.

[1018] "Request information" refers to information such as the travel destination, period, purpose of travel, and budget that the user inputs as information necessary to create a travel plan.

[1019] An "AI algorithm" is an algorithm that uses artificial intelligence technology to perform complex calculations and data analysis, in this case used to automatically generate travel plans.

[1020] The "travel plan generation means" is a component that has the function of automatically generating multiple optimal travel plans using an AI algorithm based on request information entered by the user.

[1021] A "presentation means" is a software or hardware component that displays the generated travel plan to the user and provides the user with the ability to confirm and adjust it.

[1022] An "adjustment tool" is a software or hardware component that provides functionality through which a user can make changes or modifications to the generated itinerary.

[1023] A "confirmation means" is a software or hardware component that provides a function for a user to finalize a travel plan and save it in the system.

[1024] The "reservation execution means" is a component that has the function of automatically making reservations for accommodations, transportation, and activities based on a confirmed travel plan, and obtaining reservation confirmation information.

[1025] The "detailed report generating means" is a component that has the function of automatically creating a detailed report including travel schedules and reservation confirmation information based on all information on completed reservations, and providing it to the user.

[1026] The present invention relates to a system for consistently and efficiently designing and reserving travel plans, and specific embodiments thereof will be described in detail below.

[1027] The system consists of the following main components:

[1028] 1. User Interface

[1029] The user interface is a means for users to input their request information. This interface is provided, for example, as a form on a web browser or a smartphone app. This allows users to easily input their request information, such as travel destination, duration, purpose, and budget.

[1030] 2. Request Information Processing Section

[1031] The request information processing section is a server-side function that receives and analyzes the request information sent by the user. This information processing section uses natural language processing tools (e.g., spaCy or NLTK) to extract necessary data from the input information and use it as basic data for generating travel plans.

[1032] 3. Travel Plan Generation Unit

[1033] The travel plan generation unit is a server-side function that uses an AI algorithm (for example, TensorFlow or PyTorch) to generate multiple optimal travel plans based on the analyzed request information. This function uses past travel data to suggest optimal travel routes and tourist spots tailored to the user's requests.

[1034] 4. Plan Presentation and Coordination Department

[1035] The plan presentation and adjustment section presents the generated travel plan to the user's device, allowing the user to review and adjust it. The user can review the plan on the screen, make additions or corrections as necessary, and finalize it as the final plan.

[1036] 5. Reservation Execution Department

[1037] The reservation execution unit is a server-side function that automatically executes reservations for accommodation, transportation, and activities based on the confirmed travel plan. To do this, it uses external reservation APIs (e.g., accommodation reservation API and transportation reservation API) to obtain each reservation information.

[1038] 6. Report Generation

[1039] The report generator is a server-side function that creates a detailed trip report based on the information of completed reservations and provides it to the user. This report includes the travel schedule and reservation confirmation information, helping the user to efficiently prepare for their trip.

[1040] Specific examples

[1041] For example, the specific operation flow when a user wishes to take a "four-night, five-day family trip to Tokyo" is shown below.

[1042] 1. Enter information

[1043] The user enters information such as "Tokyo," "4 nights, 5 days," and "family trip" into the tour request form and presses the send button.

[1044] 2. Analysis of request information

[1045] The server receives this information and performs the analysis.

[1046] 3. Automatic generation of travel plans

[1047] The server uses an AI algorithm to generate multiple optimal travel plans (for example, a plan that includes sightseeing in Asakusa, visiting Tokyo Disneyland, and Tokyo Tower).

[1048] 4. Present and adjust the plan

[1049] The generated travel plan is displayed on the user's device and the user confirms it. For example, if the user wants to add a hot spring inn, they add it and submit it again.

[1050] 5. Finalize your travel plans

[1051] The confirmed travel plan is stored on the server.

[1052] 6. Making a reservation

[1053] The server automatically makes reservations for accommodation, flights, and activities based on the confirmed travel plans.

[1054] 7. Creating a detailed report

[1055] A detailed trip report is created based on the completed reservation information and provided to the user, who can then review it and begin preparing for their trip.

[1056] Prompt Sentence Examples

[1057] Below are some example prompts for using a generative AI model to generate travel itinerary suggestions:

[1058] Generate the best travel plan based on the following criteria: Location: Tokyo, Duration: 4 nights, 5 days, Purpose of trip: Family trip, Main activity: Sightseeing, Accommodation: Hotel or Ryokan, Transportation: Train or bus, Budget: 20,000 yen per person per day

[1059] In this way, the present invention provides a system that allows users to easily design a travel plan based on detailed request information and to perform all processes from reservation to report creation in one go.

[1060] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1061] Step 1:

[1062] Enter information

[1063] The server receives request information entered by the user through a user interface. The user enters request information such as "Tokyo," "four nights and five days," and "family trip," and presses the send button. The input is done through a web form or a smartphone app. The server saves this input data in a database in real time.

[1064] Input: The user enters information such as travel destination, duration, purpose, and budget.

[1065] Output: The entered information is saved in the database.

[1066] Specific behavior:

[1067] When a user enters information such as "Tokyo," "4 nights, 5 days," and "family trip" into the tour request form and presses the send button, the server receives this and stores it in the database.

[1068] Step 2:

[1069] Parsing request information

[1070] The server's request information processing unit analyzes the received request information. Using natural language processing tools (e.g., spaCy or NLTK), it extracts necessary information (e.g., travel destination, duration, purpose, etc.) from the input data. The server uses the analysis results as data to proceed to the next step.

[1071] Input: Saved request information.

[1072] Output: Parsed necessary information (travel destination, duration, purpose, etc.).

[1073] Specific behavior:

[1074] The server retrieves the request information stored in the database and analyzes it using natural language processing tools, extracting necessary information such as "Tokyo," "four nights and five days," and "family trip."

[1075] Step 3:

[1076] Automatic travel plan generation

[1077] The server's travel plan generation unit uses an AI algorithm (for example, TensorFlow or PyTorch) to generate multiple optimal travel plans based on the analyzed request information. It also retrieves past travel data from other databases and proposes the plan that best suits the requested conditions.

[1078] Input: Parsed request information and historical trip data.

[1079] Output: A list of optimal itineraries.

[1080] Specific behavior:

[1081] The server runs an AI algorithm based on the analyzed request information to generate multiple itineraries, including "Sightseeing in Asakusa," "Visiting Tokyo Disneyland," and "Visiting Tokyo Tower," and outputs these itineraries as a single list.

[1082] Step 4:

[1083] Presenting and adjusting plans

[1084] The generated travel plan is sent to the user's device. The user can check the plan on the screen and make additions or modifications as necessary. For example, if the user wishes to add a hot spring inn, the user can update the plan after checking it and resend it.

[1085] Input: The generated itinerary.

[1086] Output: The final plan that you review and adjust.

[1087] Specific behavior:

[1088] The user checks the proposed travel plan, adds a hot spring inn, or makes other changes. For example, the user presses the "Add Hot Spring Inn" button, selects "Hakone Hot Springs" to add it to the plan, and submits it again.

[1089] Step 5:

[1090] Confirming travel plans

[1091] The user finalizes the travel plan. When the user presses the confirm button, the adjusted travel plan is sent to the server, which stores this final plan in its database.

[1092] Input: A travel plan confirmed by the user.

[1093] Output: The finalized itinerary is saved in the database.

[1094] Specific behavior:

[1095] The user presses the "confirm" button, the confirmed plan is sent to the server, and the server saves the plan data in a database.

[1096] Step 6:

[1097] Making a reservation

[1098] The server's reservation execution unit automatically makes reservations for accommodation, transportation, and activities based on the confirmed travel plan. It uses external reservation APIs (e.g., accommodation reservation API, transportation reservation API) to obtain reservation confirmation information and saves it in a database.

[1099] Input: Confirmed travel plans.

[1100] Output: The reservation information is saved in the database.

[1101] Specific behavior:

[1102] The server uses booking APIs to automatically book accommodations, flights, etc. For example, it uses Booking.com's API to complete hotel reservations and Skyscanner's API to book flights.

[1103] Step 7:

[1104] Creating detailed reports

[1105] The server's report generator creates a detailed trip report based on all the information from the completed reservation and sends it to the user's device. This report includes the travel schedule and reservation confirmation information, allowing the user to efficiently prepare for their trip.

[1106] Input: Information with which the reservation was completed.

[1107] Output: A detailed trip report.

[1108] Specific behavior:

[1109] The server aggregates all reservation information and generates a PDF report that is emailed to the user, including the travel schedule and accommodation and transportation reservation confirmation.

[1110] The above is the specific processing procedure of the program for this system. Because the operations, inputs, and outputs performed at each step are clearly defined, the function of the entire system is achieved efficiently.

[1111] (Application example 1)

[1112] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1113] Conventional travel planning systems focus on booking accommodation, transportation, and activities, and lack comprehensive suggestions that include meal plans during travel. Meals during travel are an important part of the travel experience, and if meal plans are not properly incorporated, the quality of the travel experience may be reduced. Therefore, there is a need for a system that can incorporate meal plans, including local specialty dishes and special food delivery services, into travel plans.

[1114] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1115] In this invention, the server includes means for providing a user interface for inputting request information, means for automatically generating a travel plan based on the input request information, means for presenting the generated travel plan to the user and allowing the user to confirm and adjust it, means for automatically reserving accommodations, transportation, and activities based on the travel plan confirmed by the user, means for automatically generating a meal plan and making food delivery and restaurant reservations, and means for automatically generating a detailed report on the reservation status and providing it to the user. This enables the user to consistently design and reserve a comprehensive travel plan, including plans to enjoy local specialty meals during their trip.

[1116] The "means for providing a user interface for inputting request information" refers to a means for providing an interface for a user to input requests and information regarding a trip.

[1117] The "means for automatically generating a travel plan based on input request information" refers to a means for analyzing the request information input by the user and automatically generating a travel plan based on the information.

[1118] "Means for presenting the generated travel plan to the user and allowing the user to confirm and adjust" refers to means for displaying the generated travel plan to the user, allowing the user to confirm the plan and make adjustments as necessary.

[1119] "Means for automatically making reservations for accommodation, transportation, and activities based on a travel plan confirmed by a user" refers to means for automatically making reservations for accommodation, transportation, and activities based on a travel plan confirmed by a user.

[1120] "Means for automatically generating meal plans and making food delivery and restaurant reservations" refers to means for automatically generating meal plans for travel and automatically making food delivery and restaurant reservations.

[1121] The "means for automatically generating a detailed report on the reservation status and providing it to the user" is a means for automatically generating a detailed report on the reservation status and travel and providing it to the user.

[1122] The present invention relates to a system that can comprehensively design meal plans along with travel plans and can also perform reservation procedures. An embodiment of the present invention will be described in detail below.

[1123] System configuration and program contents

[1124] The system consists of the following main components:

[1125] 1. User Interface:

[1126] It is a means for users to input travel request information via a smartphone app or web browser.

[1127] For example, you enter information such as your travel destination, length of stay, food preferences (Japanese, French, Chinese, etc.), meal type (breakfast, lunch, dinner), and desired budget.

[1128] 2. Request information processing section:

[1129] It runs on the server side and receives and analyzes request information sent by users in real time.

[1130] Flask is used to process requests from clients and store information in JSON format on the server.

[1131] 3. Travel Plan Generation Unit:

[1132] Using AI algorithms such as TensorFlow, it generates optimal travel plans based on past travel data and user request information.

[1133] For example, it suggests the optimal combination of tourist destinations, accommodations, and transportation methods.

[1134] 4. Meal Plan Generator:

[1135] It uses an AI algorithm to generate the optimal meal plan for your trip based on your food preferences and budget.

[1136] Consider highly rated local restaurants and food delivery services.

[1137] 5. Planning and Coordination Department:

[1138] It is a means for presenting the generated travel and meal plans to the user, allowing the user to confirm and adjust them.

[1139] The generated plan is displayed on a smartphone app or web browser, and the user can review it and adjust it as necessary.

[1140] 6. Reservation Execution Department:

[1141] Automatically book accommodations, transportation, activities and meals based on your confirmed travel and meal plans.

[1142] Call various reservation APIs, check reservation status in real time, and save it in a MySQL database.

[1143] 7. Report Generation:

[1144] After all reservations are completed, a detailed report is automatically generated and provided to the user.

[1145] The report includes travel itinerary, booking confirmation information, and meal plan details.

[1146] Use the ReportLab library to create PDF reports and provide them to users.

[1147] Prompt Sentence Examples

[1148] "Generate the best local food delivery and restaurant reservations plan for your trip. Input information: destination, length of stay, food preference (Japanese, French, Chinese, etc.), meal type (breakfast, lunch, dinner), and desired budget."

[1149] The system of the present invention allows users to design and book comprehensive travel plans, including plans to enjoy local cuisine during their trip. As a concrete example, if a user wishes to take a "five-day, four-night family trip to Tokyo," the system can generate an optimal plan that includes famous local restaurants and delivery services, covering the entire trip. This can significantly improve the quality of the trip.

[1150] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1151] Step 1:

[1152] The user enters request information through a smartphone app or web browser. The request information includes travel destination, length of stay, food preferences (e.g., Japanese, French, Chinese, etc.), meal type (breakfast, lunch, dinner), desired budget, etc. Once the input is complete, the user presses the send button to send the information to the server. The entered data is sent to the server in JSON format.

[1153] Step 2:

[1154] The server's request information processing unit receives and analyzes request information sent by the user in real time. Flask processes the request from the client, analyzes the JSON format data, and extracts the necessary information. The extracted data is stored in the server's memory or database.

[1155] Step 3:

[1156] The travel plan generation unit uses AI algorithms such as TensorFlow to generate an optimal travel plan based on the extracted request information. Using a model trained on past travel data, it proposes the optimal combination of tourist destinations, accommodations, and transportation methods. The generated travel plan is temporarily stored in the server's memory.

[1157] Step 4:

[1158] The meal plan generator uses an AI algorithm to automatically generate the optimal meal plan based on the food preferences and budget provided in the request information. It references a database of highly rated local restaurants and food delivery services to select the best meal options. The generated meal plan is stored in the server's memory.

[1159] Step 5:

[1160] The plan presentation and adjustment unit sends the generated travel and meal plans to the user's device and displays them. The user can check the plans on a smartphone app or web browser and make adjustments as necessary. User feedback is sent to the server in real time, and the travel and meal plans are regenerated or revised.

[1161] Step 6:

[1162] Once the user finalizes the plan, the server's reservation execution unit automatically makes reservations for accommodation, transportation, activities, restaurants, and food delivery. It calls various reservation APIs, receives confirmation of successful reservations in real time, and stores them in a database.

[1163] Step 7:

[1164] After all reservations are completed, the server's report generator creates a detailed trip report. It uses the ReportLab library to generate a PDF report that includes the trip schedule, reservation confirmation information, meal plan details, etc. The completed report is sent to the user's device, allowing them to continue preparing for their trip.

[1165] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1166] The present invention relates to a system for recognizing a user's emotions and designing and booking travel tours in a more personalized manner, and embodiments thereof will be described in detail below.

[1167] System configuration

[1168] The system consists of the following main components:

[1169] 1. User Interface

[1170] The user interface is a means for a user to input request information. This interface is provided, for example, as a form on a web browser or a smartphone app.

[1171] 2. Request Information Processing Section

[1172] The request information processing unit is a server-side function that receives and analyzes request information sent from a user, and extracts data that serves as the basis for automatically generating a travel plan.

[1173] 3. Travel Plan Generation Unit

[1174] The travel plan generator is a server-side function that uses AI algorithms and databases to generate optimal travel plans based on the analyzed request information. This generated plan is then presented to the user.

[1175] 4. Emotion Engine

[1176] The emotion engine is a means of analyzing emotions from user input and interactions and reflecting them in request information and travel plans. For example, emotions can be analyzed using user text input, voice input, and even facial expression recognition technology.

[1177] 5. Plan Presentation and Coordination Department

[1178] The plan presentation and adjustment section presents the generated travel plan to the user, and allows the user to confirm and adjust the plan. Here, the user can provide feedback and corrections to the plan and finalize the plan.

[1179] 6. Reservation Execution Department

[1180] The reservation execution unit is a server-side function that automatically makes reservations for accommodations, transportation, and activities based on the confirmed travel plan. This unit calls various reservation APIs and checks the reservation status.

[1181] 7. Report Generation

[1182] The report generator is a server-side function that creates a detailed travel report based on the completed reservation information and provides it to the user. This report includes the travel schedule and reservation confirmation information.

[1183] A natural language description of the program's operation

[1184] 1. Enter information

[1185] The user interface displays a tour request form to the user. When the user enters the necessary information and presses the send button, this information is sent in real time to the request information processing unit of the server.

[1186] 2. Emotion recognition

[1187] When a user inputs information, the emotion engine analyzes the input text, voice, and even the user's facial expression data to understand the user's emotional state. For example, if the user inputs "I'm tired," the engine will prioritize plans that will help the user relax.

[1188] 3. Automatic generation of travel plans

[1189] The server's request information processing unit receives and analyzes the request information sent by the user. Then, based on this information and the analysis results of the emotion engine, the travel plan generation unit generates multiple optimal travel plans.

[1190] 4. Present and adjust the plan

[1191] The generated travel plan is sent to the user's device and displayed on the user's screen. The user can review it and make adjustments as necessary. Once the adjustments are complete, the user presses the confirm button to send the final plan to the server.

[1192] 5. Making a reservation

[1193] The server's reservation execution unit automatically makes reservations for accommodation, transportation, and activities based on the confirmed travel plan. Successful reservation data is saved on the server in real time.

[1194] 6. Creating a detailed report

[1195] After all reservations are completed, the server's report generator automatically creates a detailed report and sends it to the user's device, allowing the user to receive their travel schedule and reservation confirmation information in a single report.

[1196] Specific examples

[1197] For example, if a user wishes to take a solo trip to Hokkaido for 2 nights and 3 days, the process would be as follows:

[1198] 1. The user fills in the tour request form with information such as "Hokkaido," "2 nights, 3 days," and "solo trip," and then adds "I want to relax."

[1199] 2. The server receives the request information, and the emotion engine analyzes the keyword "I want to relax" to determine that the user is feeling stressed.

[1200] 3. Based on this, the travel plan generation unit will prioritize and suggest plans that include hot springs and quiet tourist spots.

[1201] 4. The plan is displayed on the user's screen, and the user can confirm and adjust the hot spring inn.

[1202] 5. The server automatically makes reservations for hotels, transportation, and activities based on the confirmed plan.

[1203] 6. A detailed trip report is generated based on the completed booking information and provided to the user.

[1204] In this way, by combining the emotion engine, it becomes possible to generate and book a personalized travel plan according to the user's emotional state. This invention allows users to design a comfortable trip that is more suited to their own circumstances.

[1205] The processing flow will be explained below.

[1206] Step 1:

[1207] The user interface displays a tour request form to the user, which includes input fields for "Destination," "Trip Length," "Budget," "Number of Participants," and "Special Requirements."

[1208] Step 2:

[1209] The user enters the necessary information into the request form, such as "Destination: Hokkaido," "Travel duration: 2 nights, 3 days," "Budget: 100,000 yen," "Number of participants: 1 person," and "Special requirement: I want to relax," and then presses the submit button.

[1210] Step 3:

[1211] The device collects the input request information and sends it to the server's request information processing unit in real time. The data is sent in a standard format such as JSON.

[1212] Step 4:

[1213] The server receives the request information, and the request information processing unit analyzes it and extracts various items such as the destination, travel period, and budget.

[1214] Step 5:

[1215] The emotion engine analyzes the user's emotions from their input information and interactions. For example, it determines that the user needs to relax based on the specific requirement "I want to relax."

[1216] Step 6:

[1217] The server's travel plan generation unit uses an AI algorithm to generate multiple optimal travel plans based on the received request information and the analysis results of the emotion engine, prioritizing the inclusion of relaxing elements such as hot springs and quiet tourist spots.

[1218] Step 7:

[1219] The server sends the generated travel plans to the user's terminal, where they are displayed in a list on the user interface of the terminal.

[1220] Step 8:

[1221] The user reviews each itinerary displayed, including details about the itinerary, such as hotel options, flight times, and activities.

[1222] Step 9:

[1223] If the user adjusts the plan as needed, for example, to select a different hot spring resort or add a specific activity, the plan is adjusted and sent back to the server.

[1224] Step 10:

[1225] The server receives the retransmitted adjusted information and again uses the travel plan generator to generate an adjusted plan, which is then presented to the user again, and the confirmation and adjustment process is repeated.

[1226] Step 11:

[1227] The user finalizes the travel plan and presses the confirmation button. The confirmed plan information is sent from the terminal to the server.

[1228] Step 12:

[1229] The server's reservation execution unit starts the reservation procedure based on the confirmed travel plan. Specifically, it calls the APIs of each service (hotel, flight, activity) to automatically make the reservation.

[1230] Step 13:

[1231] The server receives confirmation information from each reservation service, checks whether the reservation was successful, and stores the necessary information in a database.

[1232] Step 14:

[1233] After all reservations are completed, the server's report generator automatically generates a detailed report that includes the travel schedule, confirmation information for each reservation, and contact information.

[1234] Step 15:

[1235] The server sends the generated report to the user's device, where the user can check the report and proceed with travel preparations.

[1236] Example 2

[1237] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1238] Conventional travel plan generation systems are unable to provide plans that fully reflect the user's individual feelings and specific needs, making it difficult to design a travel plan that satisfies the user. In addition, the process from generating a travel plan to confirming a reservation is complicated, requiring the user to perform many manual tasks, resulting in a poor user experience.

[1239] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for providing a user interface for inputting request information, means for automatically generating a travel plan based on the input request information, means for presenting the generated travel plan to the user and allowing the user to confirm and adjust it, means for automatically reserving accommodations, transportation, and activities based on the travel plan confirmed by the user, means for automatically generating a detailed report on the reservation status and providing it to the user, and means for recognizing the user's emotions from the information input and interactions and reflecting them in the travel plan. This makes it possible to generate and reserve a personalized travel plan based on the user's emotions and needs.

[1240] "Request information" refers to specific information such as the destination, number of days, number of people, and purpose that a user inputs when requesting the creation of a travel plan.

[1241] "User interface" refers to the form on a web browser or the interface of a smartphone app through which a user enters request information.

[1242] The "request information processing unit" is a server-side component that receives request information entered by the user, analyzes it, and extracts the necessary data.

[1243] The "travel plan generation unit" is a server-side component that automatically generates an appropriate travel plan based on the analysis results obtained from the request information processing unit.

[1244] The "emotion engine" is a server-side function that analyzes emotions from user input information and interactions, and reflects the analysis results in request information and travel plans.

[1245] The "plan presentation and adjustment unit" is a server-side and terminal-side component that presents the generated travel plan to the user and allows the user to confirm and adjust the plan.

[1246] The "reservation execution unit" is a server-side function that automatically executes reservations for accommodations, transportation, and activities based on the confirmed travel plan.

[1247] The "report generation unit" is a server-side function that creates a detailed travel report based on completed reservation information and provides it to the user.

[1248] A "travel plan" is a specific travel itinerary and activity plan generated based on the user's request information and emotion data.

[1249] "Generative AI model" refers to the artificial intelligence algorithm used by the travel plan generation unit, and is a model for automatically generating optimal plans based on various data.

[1250] A "prompt sentence" is a free-form text message that a user enters to make a specific request or instruction to the system.

[1251] The present invention relates to a system for recognizing a user's emotions and designing and booking a travel tour in a more personalized manner, and specific embodiments thereof will be described in detail below.

[1252] System configuration

[1253] This system mainly consists of the following components:

[1254] 1. User Interface

[1255] The user interface (UI) is the means by which a user inputs request information. This interface is provided as a form on a web browser or a smartphone app.

[1256] The user inputs the destination, number of days, number of people, and purpose of the trip (e.g., "I want to relax").

[1257] 2. Request Information Processing Section

[1258] The request information processing unit is a server-side function that receives and analyzes request information sent from a user.

[1259] This information processing unit extracts basic data for automatically generating a travel plan.

[1260] 3. Emotion Engine

[1261] The emotion engine is a means of analyzing emotions from user input information and interactions and reflecting them in travel plans.

[1262] Emotions are recognized using user text input, voice input, facial expression recognition, etc.

[1263] 4. Travel Plan Generation Unit

[1264] The travel plan generator is a server-side function that generates an optimal travel plan based on the input request information and the results of the emotion engine.

[1265] Automatically generate multiple plans using artificial intelligence algorithms (generative AI models) and databases.

[1266] 5. Plan Presentation and Coordination Department

[1267] The plan presentation and adjustment unit is a means for presenting the generated travel plan to the user and allowing the user to confirm and adjust it.

[1268] The user checks the proposed plan, makes any modifications, and then finalizes the plan.

[1269] 6. Reservation Execution Department

[1270] The reservation execution unit is a server-side function that automatically executes reservations for accommodation, transportation, and activities based on the confirmed travel plan.

[1271] Call various reservation APIs and check the reservation status.

[1272] 7. Report Generation

[1273] The report generation unit is a server-side function that creates a detailed travel report based on the completed reservation information and provides it to the user.

[1274] The report includes travel schedule and reservation confirmation information.

[1275] Specific examples

[1276] For example, if a user wishes to take a solo trip to Hokkaido for 2 nights and 3 days, the process would be as follows:

[1277] 1. The user fills in the tour request form with information such as "Hokkaido," "2 nights, 3 days," and "solo trip," and then adds "I want to relax."

[1278] 2. The server receives the request information, and the emotion engine analyzes the keyword "I want to relax" to determine that the user is feeling stressed.

[1279] 3. Based on this, the travel plan generation unit will prioritize and suggest plans that include hot springs and quiet tourist spots.

[1280] 4. The plan is displayed on the user's screen, and the user can confirm and adjust the hot spring inn.

[1281] 5. The server automatically makes reservations for hotels, transportation, and activities based on the confirmed plan.

[1282] 6. A detailed trip report is generated based on the completed booking information and provided to the user.

[1283] Prompt Sentence Examples

[1284] For example, by entering a prompt such as, "Create a 2-night, 3-day Hokkaido travel plan. Please include relaxing spots as an emphasis," the system will automatically generate a travel plan tailored to the user's needs.

[1285] In this way, the system enables personalized travel plans and bookings that reflect the user's emotions and specific travel needs.

[1286] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1287] Step 1: Enter your information

[1288] Input: The user inputs travel request information (destination, number of days, number of people, purpose of travel, etc.) via a user interface (UI).

[1289] How it works: The user enters information such as "Hokkaido," "2 nights and 3 days," "solo trip," and "want to relax" into the form and presses the submit button.

[1290] Output: The input request information is sent to the server.

[1291] Specific operation: The user's input information is sent to the request information processing unit of the server in real time.

[1292] Step 2: Emotion Recognition

[1293] Input: Request information received by the server, as well as text, voice, and facial expression data entered by the user.

[1294] How it works: The server's emotion engine analyzes the user's text, voice, and possibly facial expression data via a camera.

[1295] Output: User's emotional state (e.g., "I want to relax" is interpreted as stress).

[1296] Specific operation: The emotion engine analyzes the user's emotions from the text "I want to relax" and passes the results to the request information processing unit.

[1297] Step 3: Automatically generate a travel plan

[1298] Input: Request information from the request information processing unit and the analysis results of the emotion engine.

[1299] How it works: The server's travel plan generation unit uses a generative AI model to generate multiple travel plans based on this data.

[1300] Output: Multiple suggested itineraries.

[1301] Specific operation: The plan generation unit creates plans that include hot springs and quiet tourist spots. Specifically, plans that include farm stays and forest bathing activities are also proposed.

[1302] Step 4: Present and adjust the plan

[1303] Input: Multiple generated itineraries.

[1304] How it works: The server sends these plans to the user's device.

[1305] Output: User reviews and adjusts plan.

[1306] Specific operation: The travel plan is displayed on the user's device, and the user makes specific modifications such as "I would like to choose this accommodation" and finalizes the plan.

[1307] Step 5: Making a reservation

[1308] Input: Final confirmed plan.

[1309] Operation: The server's reservation execution unit calls various reservation APIs and makes reservations for accommodations, transportation, activities, etc.

[1310] Output: Successful reservation information.

[1311] Specific operation: The reservation execution unit checks the reservation status of the accommodation and automatically executes the reservation. Airline and train tickets are also arranged at the same time.

[1312] Step 6: Create a detailed report

[1313] Input: Completed reservation information.

[1314] Operation: The server's report generator creates a detailed trip report based on this reservation information.

[1315] Output: A detailed trip report provided to the user.

[1316] Specific operation: The report generator creates a report that summarizes the travel schedule, accommodation confirmation information, and transportation details. The user receives this report and can check the schedule and reservation information during the trip.

[1317] (Application example 2)

[1318] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1319] When designing and booking travel plans, it is difficult to provide a personalized experience that reflects the user's emotional state. Conventional travel plan creation systems do not take the user's emotions into account, so they are unable to propose plans that are appropriate for the user's current situation or psychological state, resulting in a decrease in user satisfaction.

[1320] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for providing a user interface for inputting request information, means for automatically generating a travel plan based on the input request information, means for presenting the generated travel plan to the user so that the user can confirm and adjust it, means for analyzing the user's emotions in real time, means for suggesting optimal products and services based on the emotion analysis results, means for automatically reserving accommodations, transportation, and activities based on the travel plan confirmed by the user, and means for automatically generating a detailed report on the reservation status and providing it to the user. This makes it possible to generate and reserve a personalized travel plan that takes the user's emotional state into consideration.

[1321] The "user interface for inputting request information" refers to an interface provided for users to input travel plan request information, and may consist of a web browser form, a smartphone app, or the like.

[1322] "Means for automatically generating a travel plan based on input request information" refers to algorithms or software that analyzes the request information input by the user and automatically creates a travel plan.

[1323] "Means for presenting the generated travel plan to the user and allowing the user to confirm and adjust it" refers to an interface that displays the travel plan to the user and allows the user to confirm and change the contents.

[1324] "Means for analyzing user emotions in real time" refers to technologies and algorithms that analyze emotions from a user's facial expressions and voice and reflect the results immediately.

[1325] "Means for proposing optimal products and services based on the results of sentiment analysis" refers to software or algorithms for recommending optimal products and services to individual users based on the results of sentiment analysis of the users.

[1326] "Means for automatically reserving accommodation, transportation, and activities based on a travel plan finalized by a user" refers to a system for automatically reserving accommodation, transportation, and activities based on a travel plan finalized by a user.

[1327] "Means for automatically generating detailed reports on reservation status and providing them to users" refers to technology or software for automatically creating detailed travel reports based on information on completed reservations and providing them to users.

[1328] The present invention is a system that analyzes a user's emotional state in real time, automatically generates and proposes travel plans based on the analysis, and makes reservations. The following describes in detail the embodiments of the present invention.

[1329] System configuration

[1330] This system consists of the following main components:

[1331] 1. User Interface

[1332] This interface is a means for users to input request information, and is typically provided as a form on a web browser or as a smartphone app.

[1333] The hardware that can be used includes smartphones (e.g., iPhone, Android devices) and PCs (e.g., Windows, Mac).

[1334] 2. Request Information Processing Section

[1335] This part has the function of receiving and analyzing request information sent by the user. It operates on the server side and extracts the data that will be the basis for automatically generating a travel plan.

[1336] The software used will be data analysis algorithms and databases (e.g., MySQL, PostgreSQL).

[1337] 3. Travel Plan Generation Unit

[1338] Based on the analyzed request information, the system uses AI algorithms and databases to generate optimal travel plans, which are then presented to the user.

[1339] As AI algorithms, machine learning models (e.g., Scikit-learn, TensorFlow) are used.

[1340] 4. Emotion Engine

[1341] This is a means of analyzing emotions from user input and interactions and reflecting them in request information and travel plans. Emotion analysis uses facial recognition technology (e.g., OpenCV) and voice analysis technology (e.g., Watson Tone Analyzer).

[1342] The device uses a camera and microphone (e.g., a webcam, a smartphone's built-in camera and microphone).

[1343] 5. Plan Presentation and Coordination Department

[1344] The generated travel plan is presented to the user, who can confirm and adjust it. The adjusted plan is then sent to the server.

[1345] The interface utilizes the user interface of a web browser or smartphone app.

[1346] 6. Reservation Execution Department

[1347] It has the function to automatically make reservations for accommodation, transportation, and activities based on confirmed travel plans, and calls various reservation APIs (e.g., Booking.com API, Expedia API).

[1348] It runs on the server backend and connects to external services.

[1349] 7. Report Generation

[1350] Once a reservation is completed, a detailed trip report is generated and provided to the user, including the trip schedule and reservation confirmation information.

[1351] Use a PDF generation library (e.g. FPDF, ReportLab) to create reports.

[1352] Specific examples of processing

[1353] For example, if a user wishes to take a "solo trip to Hokkaido for 2 nights and 3 days," the system operates as follows.

[1354] 1. Enter information

[1355] The user enters information such as "Hokkaido," "2 nights and 3 days," "solo trip," and "want to relax" into the tour request form.

[1356] This information is sent to the server in real time.

[1357] 2. Emotion recognition

[1358] The emotion engine analyzes the user's emotional state based on the keyword "I want to relax."

[1359] 3. Automatic generation of travel plans

[1360] The server generates an optimal travel plan based on the request information and the results of sentiment analysis.

[1361] Example prompt for a generative AI model:

[1362] The user wants to take a 3-day, 2-night trip to Hokkaido, but also wants to relax. Based on the user's feelings, suggest tourist spots and accommodations where they can relax.

[1363] 4. Present and adjust the plan

[1364] The generated travel plan is displayed on the user's screen, and the user can further add and adjust the hot spring inn by confirming it.

[1365] 5. Making a reservation

[1366] Based on the confirmed plan, the server automatically makes reservations for accommodation, transportation, and activities.

[1367] 6. Creating a detailed report

[1368] A detailed trip report is created based on the completed reservation information and provided to the user.

[1369] The present invention allows for the generation and booking of personalized travel plans that take into account the user's emotional state.

[1370] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1371] Step 1:

[1372] The user uses a device such as a smartphone or PC to enter request information via a form on a web browser or a smartphone app. Specifically, the user enters information such as the travel destination, duration, purpose, and desired activity, and then presses the send button. The entered information is sent to the server in real time.

[1373] Step 2:

[1374] The server uses the request information processing unit to receive request information sent from the user. The received information is stored in a database and used as basic data for generating travel plans. The server also analyzes the content of the information to extract the user's requests and constraints.

[1375] Step 3:

[1376] When a user inputs their request information, the emotion engine analyzes their text input, voice input, and even facial expression data in real time. Based on the data collected using a camera and microphone, the emotion engine can understand the user's emotional state from keywords such as "I want to relax." The analysis results are then stored in a database by the emotion engine.

[1377] Step 4:

[1378] On the server, the travel plan generation unit automatically generates a travel plan based on the analysis results of the request information processing unit and emotion engine. It analyzes the data using AI algorithms (e.g., TensorFlow and Scikit-learn) and generates multiple optimal travel plans that take into account the user's emotional state. The generated plans are stored on the server.

[1379] Step 5:

[1380] The generated itinerary is sent to the user's device and displayed on the screen. The user can review the plan and make adjustments as needed. For example, they can add or remove specific accommodations or activities. This adjustment information is sent back to the server and finalized as the itinerary.

[1381] Step 6:

[1382] The server's reservation execution unit automatically reserves accommodation, transportation, and activities based on the confirmed travel plan. It calls various reservation APIs (e.g., Booking.com API and Expedia API) to check and confirm the reservation status. The completed reservation data is saved in a database.

[1383] Step 7:

[1384] After all reservations are completed, the server's report generation unit automatically generates a detailed report, which includes the travel schedule, reservation confirmation information, important notes, etc. The generated report is sent to the user's device in PDF format or other format and can be viewed.

[1385] Through this process, personalized travel plans and reservations that take into account the user's emotional state are generated and booked.

[1386] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1387] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1388] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1389] [Fourth embodiment]

[1390] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1391] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1392] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1393] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1394] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1395] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1396] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1397] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1398] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1399] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1400] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1401] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1402] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1403] The present invention relates to a system for consistently and efficiently designing and booking travel tours, and embodiments thereof will be described in detail below.

[1404] System configuration

[1405] The system consists of the following main components:

[1406] 1. User Interface

[1407] The user interface is a means for a user to input request information. This interface is provided, for example, as a form on a web browser or a smartphone app.

[1408] 2. Request Information Processing Section

[1409] The request information processing unit is a server-side function that receives and analyzes request information sent from a user, and extracts data that serves as the basis for automatically generating a travel plan.

[1410] 3. Travel Plan Generation Unit

[1411] The travel plan generator is a server-side function that uses AI algorithms and databases to generate optimal travel plans based on the analyzed request information. This generated plan is then presented to the user.

[1412] 4. Plan Presentation and Coordination Department

[1413] The plan presentation and adjustment section presents the generated travel plan to the user, and allows the user to confirm and adjust the plan. Here, the user can provide feedback and corrections to the plan and finalize the plan.

[1414] 5. Reservation Execution Department

[1415] The reservation execution unit is a server-side function that automatically makes reservations for accommodations, transportation, and activities based on the confirmed travel plan. This unit calls various reservation APIs and checks the reservation status.

[1416] 6. Report Generation

[1417] The report generator is a server-side function that creates a detailed travel report based on the completed reservation information and provides it to the user. This report includes the travel schedule and reservation confirmation information.

[1418] A natural language description of the program's operation

[1419] 1. Enter information

[1420] The user interface displays a tour request form to the user. When the user enters the necessary information and presses the send button, this information is sent in real time to the request information processing unit of the server.

[1421] 2. Automatic generation of travel plans

[1422] The server's request information processing unit receives and analyzes the request information sent by the user. Based on this information, the travel plan generation unit uses an AI algorithm to generate multiple optimal travel plans.

[1423] 3. Present and adjust the plan

[1424] The generated travel plan is sent to the user's device and displayed on the user's screen. The user can review it and make adjustments as necessary. Once the adjustments are complete, the user presses the confirm button to send the final plan to the server.

[1425] 4. Making a reservation

[1426] The server's reservation execution unit automatically makes reservations for accommodation, transportation, and activities based on the confirmed travel plan. Successful reservation data is saved on the server in real time.

[1427] 5. Creating a detailed report

[1428] After all reservations are completed, the server's report generator automatically creates a detailed report and sends it to the user's device, allowing the user to receive their travel schedule and reservation confirmation information in a single report.

[1429] Specific examples

[1430] For example, if a user wants to take a family trip to Tokyo for 4 nights and 5 days, the flow would be as follows:

[1431] 1. The user enters information such as "Tokyo," "4 nights, 5 days," and "family trip" into the tour request form and submits it.

[1432] 2. The server receives and analyzes this information and uses an AI algorithm to generate an optimal travel plan (for example, a plan that includes sightseeing in Asakusa, visiting Tokyo Disneyland, and Tokyo Tower).

[1433] 3. The plan will be displayed on the user's screen and the user can confirm it. If they want to add a hot spring inn, they can add it and submit again.

[1434] 4. The server automatically books accommodation, flights, and activities based on the confirmed plan and stores confirmation information for each reservation.

[1435] 5. A detailed trip report is created based on the completed reservation information and provided to the user, who can then review it and begin preparing for their trip.

[1436] In this way, the present invention allows the user to easily design a tour based on detailed request information and to perform all steps from reservation to report creation in one go.

[1437] The processing flow will be explained below.

[1438] Step 1:

[1439] The user interface displays a tour request form to the user, which includes input fields for "Destination," "Trip Length," "Budget," "Number of Participants," and "Special Requirements."

[1440] Step 2:

[1441] The user enters the necessary information into the request form, such as "Destination: Tokyo," "Travel duration: 4 nights, 5 days," "Budget: 200,000 yen," "Number of participants: 4," and "Special requirements: Hot spring inn," and then presses the submit button.

[1442] Step 3:

[1443] The device collects the input request information and sends it to the server's request information processing unit in real time. The data is sent in a standard format such as JSON.

[1444] Step 4:

[1445] The server receives the request information, and the request information processing section of the server analyzes it and extracts various items such as the destination, travel period, and budget.

[1446] Step 5:

[1447] The server's travel plan generation unit automatically generates multiple travel plans based on the received request information using an AI algorithm and database. Specifically, the AI ​​algorithm considers past travel data and user preferences to suggest optimal combinations of hotels, flights, and activities.

[1448] Step 6:

[1449] The server transmits the generated travel plans to the user's terminal, and the transmitted plans are displayed in a list on the user interface of the terminal.

[1450] Step 7:

[1451] The user reviews each itinerary displayed, including details about the itinerary, such as hotel options, flight times, and activities.

[1452] Step 8:

[1453] If the user adjusts the plan as needed, for example, by selecting a different hotel or adding a particular activity, the plan is adjusted and sent back to the server.

[1454] Step 9:

[1455] The server receives the retransmitted information, and again uses the travel plan generator to generate an adjusted plan, which is then presented to the user again, and the steps are repeated.

[1456] Step 10:

[1457] The user finalizes the travel plan and presses the confirmation button. The confirmed plan information is sent from the terminal to the server.

[1458] Step 11:

[1459] The server's reservation execution unit starts the reservation process based on the confirmed travel plan. Specifically, it calls the APIs of each service to automatically reserve accommodation, transportation, and activities.

[1460] Step 12:

[1461] The server receives confirmation information from each reservation service, checks whether the reservation was successful, and stores the necessary information in a database.

[1462] Step 13:

[1463] After all reservations are completed, the server's report generator creates a detailed report that includes the travel schedule, confirmation information for each reservation, and contact information.

[1464] Step 14:

[1465] The server sends the generated report to the user's device, where the user can check the report and proceed with travel preparations.

[1466] The above are the processing steps in the tour planning application of the present invention. Information is processed efficiently at each step, realizing a system that is easy for users to use.

[1467] Example 1

[1468] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1469] Conventional travel planning systems have the drawback of requiring users to manually design plans and make each reservation individually, which is time-consuming. Furthermore, the user experience can be compromised because it is difficult to smoothly optimize or change travel plans. Furthermore, information management after a reservation is completed is cumbersome, making it difficult for users to efficiently prepare for their trip.

[1470] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1471] In this invention, the server includes means for providing a user interface for inputting request information, means for generating multiple optimal travel plans using an AI algorithm to automatically generate a travel plan based on the input request information, means for presenting the generated travel plans to the user and saving the finalized travel plan after the user confirms and adjusts it, means for automatically making reservations for accommodations, transportation, and activities based on the travel plan finalized by the user, and means for automatically generating a detailed report based on all completed reservation information and providing it to the user. This enables consistent and efficient processing from travel plan design to reservations and information management.

[1472] A "user interface" is a software or hardware component that provides a display screen and input means for a user to enter information.

[1473] "Request information" refers to information such as the travel destination, period, purpose of travel, and budget that the user inputs as information necessary to create a travel plan.

[1474] An "AI algorithm" is an algorithm that uses artificial intelligence technology to perform complex calculations and data analysis, in this case used to automatically generate travel plans.

[1475] The "travel plan generation means" is a component that has the function of automatically generating multiple optimal travel plans using an AI algorithm based on request information entered by the user.

[1476] A "presentation means" is a software or hardware component that displays the generated travel plan to the user and provides the user with the ability to confirm and adjust it.

[1477] An "adjustment tool" is a software or hardware component that provides functionality through which a user can make changes or modifications to the generated itinerary.

[1478] A "confirmation means" is a software or hardware component that provides a function for a user to finalize a travel plan and save it in the system.

[1479] The "reservation execution means" is a component that has the function of automatically making reservations for accommodations, transportation, and activities based on a confirmed travel plan, and obtaining reservation confirmation information.

[1480] The "detailed report generating means" is a component that has the function of automatically creating a detailed report including travel schedules and reservation confirmation information based on all information on completed reservations, and providing it to the user.

[1481] The present invention relates to a system for consistently and efficiently designing and reserving travel plans, and specific embodiments thereof will be described in detail below.

[1482] The system consists of the following main components:

[1483] 1. User Interface

[1484] The user interface is a means for users to input their request information. This interface is provided, for example, as a form on a web browser or a smartphone app. This allows users to easily input their request information, such as travel destination, duration, purpose, and budget.

[1485] 2. Request Information Processing Section

[1486] The request information processing section is a server-side function that receives and analyzes the request information sent by the user. This information processing section uses natural language processing tools (e.g., spaCy or NLTK) to extract necessary data from the input information and use it as basic data for generating travel plans.

[1487] 3. Travel Plan Generation Unit

[1488] The travel plan generation unit is a server-side function that uses an AI algorithm (for example, TensorFlow or PyTorch) to generate multiple optimal travel plans based on the analyzed request information. This function uses past travel data to suggest optimal travel routes and tourist spots tailored to the user's requests.

[1489] 4. Plan Presentation and Coordination Department

[1490] The plan presentation and adjustment section presents the generated travel plan to the user's device, allowing the user to review and adjust it. The user can review the plan on the screen, make additions or corrections as necessary, and finalize it as the final plan.

[1491] 5. Reservation Execution Department

[1492] The reservation execution unit is a server-side function that automatically executes reservations for accommodation, transportation, and activities based on the confirmed travel plan. To do this, it uses external reservation APIs (e.g., accommodation reservation API and transportation reservation API) to obtain each reservation information.

[1493] 6. Report Generation

[1494] The report generator is a server-side function that creates a detailed trip report based on the information of completed reservations and provides it to the user. This report includes the travel schedule and reservation confirmation information, helping the user to efficiently prepare for their trip.

[1495] Specific examples

[1496] For example, the specific operation flow when a user wishes to take a "four-night, five-day family trip to Tokyo" is shown below.

[1497] 1. Enter information

[1498] The user enters information such as "Tokyo," "4 nights, 5 days," and "family trip" into the tour request form and presses the send button.

[1499] 2. Analysis of request information

[1500] The server receives this information and performs the analysis.

[1501] 3. Automatic generation of travel plans

[1502] The server uses an AI algorithm to generate multiple optimal travel plans (for example, a plan that includes sightseeing in Asakusa, visiting Tokyo Disneyland, and Tokyo Tower).

[1503] 4. Present and adjust the plan

[1504] The generated travel plan is displayed on the user's device and the user confirms it. For example, if the user wants to add a hot spring inn, they add it and submit it again.

[1505] 5. Finalize your travel plans

[1506] The confirmed travel plan is stored on the server.

[1507] 6. Making a reservation

[1508] The server automatically makes reservations for accommodation, flights, and activities based on the confirmed travel plans.

[1509] 7. Creating a detailed report

[1510] A detailed trip report is created based on the completed reservation information and provided to the user, who can then review it and begin preparing for their trip.

[1511] Prompt Sentence Examples

[1512] Below are some example prompts for using a generative AI model to generate travel itinerary suggestions:

[1513] Generate the best travel plan based on the following criteria: Location: Tokyo, Duration: 4 nights, 5 days, Purpose of trip: Family trip, Main activity: Sightseeing, Accommodation: Hotel or Ryokan, Transportation: Train or bus, Budget: 20,000 yen per person per day

[1514] In this way, the present invention provides a system that allows users to easily design a travel plan based on detailed request information and to perform all processes from reservation to report creation in one go.

[1515] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1516] Step 1:

[1517] Enter information

[1518] The server receives request information entered by the user through a user interface. The user enters request information such as "Tokyo," "four nights and five days," and "family trip," and presses the send button. The input is done through a web form or a smartphone app. The server saves this input data in a database in real time.

[1519] Input: The user enters information such as travel destination, duration, purpose, and budget.

[1520] Output: The entered information is saved in the database.

[1521] Specific behavior:

[1522] When a user enters information such as "Tokyo," "4 nights, 5 days," and "family trip" into the tour request form and presses the send button, the server receives this and stores it in the database.

[1523] Step 2:

[1524] Parsing request information

[1525] The server's request information processing unit analyzes the received request information. Using natural language processing tools (e.g., spaCy or NLTK), it extracts necessary information (e.g., travel destination, duration, purpose, etc.) from the input data. The server uses the analysis results as data to proceed to the next step.

[1526] Input: Saved request information.

[1527] Output: Parsed necessary information (travel destination, duration, purpose, etc.).

[1528] Specific behavior:

[1529] The server retrieves the request information stored in the database and analyzes it using natural language processing tools, extracting necessary information such as "Tokyo," "four nights and five days," and "family trip."

[1530] Step 3:

[1531] Automatic travel plan generation

[1532] The server's travel plan generation unit uses an AI algorithm (for example, TensorFlow or PyTorch) to generate multiple optimal travel plans based on the analyzed request information. It also retrieves past travel data from other databases and proposes the plan that best suits the requested conditions.

[1533] Input: Parsed request information and historical trip data.

[1534] Output: A list of optimal itineraries.

[1535] Specific behavior:

[1536] The server runs an AI algorithm based on the analyzed request information to generate multiple itineraries, including "Sightseeing in Asakusa," "Visiting Tokyo Disneyland," and "Visiting Tokyo Tower," and outputs these itineraries as a single list.

[1537] Step 4:

[1538] Presenting and adjusting plans

[1539] The generated travel plan is sent to the user's device. The user can check the plan on the screen and make additions or modifications as necessary. For example, if the user wishes to add a hot spring inn, the user can update the plan after checking it and resend it.

[1540] Input: The generated itinerary.

[1541] Output: The final plan that you review and adjust.

[1542] Specific behavior:

[1543] The user checks the proposed travel plan, adds a hot spring inn, or makes other changes. For example, the user presses the "Add Hot Spring Inn" button, selects "Hakone Hot Springs" to add it to the plan, and submits it again.

[1544] Step 5:

[1545] Confirming travel plans

[1546] The user finalizes the travel plan. When the user presses the confirm button, the adjusted travel plan is sent to the server, which stores this final plan in its database.

[1547] Input: A travel plan confirmed by the user.

[1548] Output: The finalized itinerary is saved in the database.

[1549] Specific behavior:

[1550] The user presses the "confirm" button, the confirmed plan is sent to the server, and the server saves the plan data in a database.

[1551] Step 6:

[1552] Making a reservation

[1553] The server's reservation execution unit automatically makes reservations for accommodation, transportation, and activities based on the confirmed travel plan. It uses external reservation APIs (e.g., accommodation reservation API, transportation reservation API) to obtain reservation confirmation information and saves it in a database.

[1554] Input: Confirmed travel plans.

[1555] Output: The reservation information is saved in the database.

[1556] Specific behavior:

[1557] The server uses booking APIs to automatically book accommodations, flights, etc. For example, it uses Booking.com's API to complete hotel reservations and Skyscanner's API to book flights.

[1558] Step 7:

[1559] Creating detailed reports

[1560] The server's report generator creates a detailed trip report based on all the information from the completed reservation and sends it to the user's device. This report includes the travel schedule and reservation confirmation information, allowing the user to efficiently prepare for their trip.

[1561] Input: Information with which the reservation was completed.

[1562] Output: A detailed trip report.

[1563] Specific behavior:

[1564] The server aggregates all reservation information and generates a PDF report that is emailed to the user, including the travel schedule and accommodation and transportation reservation confirmation.

[1565] The above is the specific processing procedure of the program for this system. Because the operations, inputs, and outputs performed at each step are clearly defined, the function of the entire system is achieved efficiently.

[1566] (Application example 1)

[1567] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1568] Conventional travel planning systems focus on booking accommodation, transportation, and activities, and lack comprehensive suggestions that include meal plans during travel. Meals during travel are an important part of the travel experience, and if meal plans are not properly incorporated, the quality of the travel experience may be reduced. Therefore, there is a need for a system that can incorporate meal plans, including local specialty dishes and special food delivery services, into travel plans.

[1569] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1570] In this invention, the server includes means for providing a user interface for inputting request information, means for automatically generating a travel plan based on the input request information, means for presenting the generated travel plan to the user and allowing the user to confirm and adjust it, means for automatically reserving accommodations, transportation, and activities based on the travel plan confirmed by the user, means for automatically generating a meal plan and making food delivery and restaurant reservations, and means for automatically generating a detailed report on the reservation status and providing it to the user. This enables the user to consistently design and reserve a comprehensive travel plan, including plans to enjoy local specialty meals during their trip.

[1571] The "means for providing a user interface for inputting request information" refers to a means for providing an interface for a user to input requests and information regarding a trip.

[1572] The "means for automatically generating a travel plan based on input request information" refers to a means for analyzing the request information input by the user and automatically generating a travel plan based on the information.

[1573] "Means for presenting the generated travel plan to the user and allowing the user to confirm and adjust" refers to means for displaying the generated travel plan to the user, allowing the user to confirm the plan and make adjustments as necessary.

[1574] "Means for automatically making reservations for accommodation, transportation, and activities based on a travel plan confirmed by a user" refers to means for automatically making reservations for accommodation, transportation, and activities based on a travel plan confirmed by a user.

[1575] "Means for automatically generating meal plans and making food delivery and restaurant reservations" refers to means for automatically generating meal plans for travel and automatically making food delivery and restaurant reservations.

[1576] The "means for automatically generating a detailed report on the reservation status and providing it to the user" is a means for automatically generating a detailed report on the reservation status and travel and providing it to the user.

[1577] The present invention relates to a system that can comprehensively design meal plans along with travel plans and can also perform reservation procedures. An embodiment of the present invention will be described in detail below.

[1578] System configuration and program contents

[1579] The system consists of the following main components:

[1580] 1. User Interface:

[1581] It is a means for users to input travel request information via a smartphone app or web browser.

[1582] For example, you enter information such as your travel destination, length of stay, food preferences (Japanese, French, Chinese, etc.), meal type (breakfast, lunch, dinner), and desired budget.

[1583] 2. Request information processing section:

[1584] It runs on the server side and receives and analyzes request information sent by users in real time.

[1585] Flask is used to process requests from clients and store information in JSON format on the server.

[1586] 3. Travel Plan Generation Unit:

[1587] Using AI algorithms such as TensorFlow, it generates optimal travel plans based on past travel data and user request information.

[1588] For example, it suggests the optimal combination of tourist destinations, accommodations, and transportation methods.

[1589] 4. Meal Plan Generator:

[1590] It uses an AI algorithm to generate the optimal meal plan for your trip based on your food preferences and budget.

[1591] Consider highly rated local restaurants and food delivery services.

[1592] 5. Planning and Coordination Department:

[1593] It is a means for presenting the generated travel and meal plans to the user, allowing the user to confirm and adjust them.

[1594] The generated plan is displayed on a smartphone app or web browser, and the user can review it and adjust it as necessary.

[1595] 6. Reservation Execution Department:

[1596] Automatically book accommodations, transportation, activities and meals based on your confirmed travel and meal plans.

[1597] Call various reservation APIs, check reservation status in real time, and save it in a MySQL database.

[1598] 7. Report Generation:

[1599] After all reservations are completed, a detailed report is automatically generated and provided to the user.

[1600] The report includes travel itinerary, booking confirmation information, and meal plan details.

[1601] Use the ReportLab library to create PDF reports and provide them to users.

[1602] Prompt Sentence Examples

[1603] "Generate the best local food delivery and restaurant reservations plan for your trip. Input information: destination, length of stay, food preference (Japanese, French, Chinese, etc.), meal type (breakfast, lunch, dinner), and desired budget."

[1604] The system of the present invention allows users to design and book comprehensive travel plans, including plans to enjoy local cuisine during their trip. As a concrete example, if a user wishes to take a "five-day, four-night family trip to Tokyo," the system can generate an optimal plan that includes famous local restaurants and delivery services, covering the entire trip. This can significantly improve the quality of the trip.

[1605] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1606] Step 1:

[1607] The user enters request information through a smartphone app or web browser. The request information includes travel destination, length of stay, food preferences (e.g., Japanese, French, Chinese, etc.), meal type (breakfast, lunch, dinner), desired budget, etc. Once the input is complete, the user presses the send button to send the information to the server. The entered data is sent to the server in JSON format.

[1608] Step 2:

[1609] The server's request information processing unit receives and analyzes request information sent by the user in real time. Flask processes the request from the client, analyzes the JSON format data, and extracts the necessary information. The extracted data is stored in the server's memory or database.

[1610] Step 3:

[1611] The travel plan generation unit uses AI algorithms such as TensorFlow to generate an optimal travel plan based on the extracted request information. Using a model trained on past travel data, it proposes the optimal combination of tourist destinations, accommodations, and transportation methods. The generated travel plan is temporarily stored in the server's memory.

[1612] Step 4:

[1613] The meal plan generator uses an AI algorithm to automatically generate the optimal meal plan based on the food preferences and budget provided in the request information. It references a database of highly rated local restaurants and food delivery services to select the best meal options. The generated meal plan is stored in the server's memory.

[1614] Step 5:

[1615] The plan presentation and adjustment unit sends the generated travel and meal plans to the user's device and displays them. The user can check the plans on a smartphone app or web browser and make adjustments as necessary. User feedback is sent to the server in real time, and the travel and meal plans are regenerated or revised.

[1616] Step 6:

[1617] Once the user finalizes the plan, the server's reservation execution unit automatically makes reservations for accommodation, transportation, activities, restaurants, and food delivery. It calls various reservation APIs, receives confirmation of successful reservations in real time, and stores them in a database.

[1618] Step 7:

[1619] After all reservations are completed, the server's report generator creates a detailed trip report. It uses the ReportLab library to generate a PDF report that includes the trip schedule, reservation confirmation information, meal plan details, etc. The completed report is sent to the user's device, allowing them to continue preparing for their trip.

[1620] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1621] The present invention relates to a system for recognizing a user's emotions and designing and booking a travel tour in a more personalized manner, and embodiments thereof will be described in detail below.

[1622] System configuration

[1623] The system consists of the following main components:

[1624] 1. User Interface

[1625] The user interface is a means for a user to input request information. This interface is provided, for example, as a form on a web browser or a smartphone app.

[1626] 2. Request Information Processing Section

[1627] The request information processing unit is a server-side function that receives and analyzes request information sent from a user, and extracts data that serves as the basis for automatically generating a travel plan.

[1628] 3. Travel Plan Generation Unit

[1629] The travel plan generator is a server-side function that uses AI algorithms and databases to generate optimal travel plans based on the analyzed request information. This generated plan is then presented to the user.

[1630] 4. Emotion Engine

[1631] The emotion engine is a means of analyzing emotions from user input and interactions and reflecting them in request information and travel plans. For example, emotions can be analyzed using user text input, voice input, and even facial expression recognition technology.

[1632] 5. Plan Presentation and Coordination Department

[1633] The plan presentation and adjustment section presents the generated travel plan to the user, and allows the user to confirm and adjust the plan. Here, the user can provide feedback and corrections to the plan and finalize the plan.

[1634] 6. Reservation Execution Department

[1635] The reservation execution unit is a server-side function that automatically makes reservations for accommodations, transportation, and activities based on the confirmed travel plan. This unit calls various reservation APIs and checks the reservation status.

[1636] 7. Report Generation

[1637] The report generator is a server-side function that creates a detailed travel report based on the completed reservation information and provides it to the user. This report includes the travel schedule and reservation confirmation information.

[1638] A natural language description of the program's operation

[1639] 1. Enter information

[1640] The user interface displays a tour request form to the user. When the user enters the necessary information and presses the send button, this information is sent in real time to the request information processing unit of the server.

[1641] 2. Emotion recognition

[1642] When a user inputs information, the emotion engine analyzes the input text, voice, and even the user's facial expression data to understand the user's emotional state. For example, if the user inputs "I'm tired," the engine will prioritize plans that will help the user relax.

[1643] 3. Automatic generation of travel plans

[1644] The server's request information processing unit receives and analyzes the request information sent by the user. Then, based on this information and the analysis results of the emotion engine, the travel plan generation unit generates multiple optimal travel plans.

[1645] 4. Present and adjust the plan

[1646] The generated travel plan is sent to the user's device and displayed on the user's screen. The user can review it and make adjustments as necessary. Once the adjustments are complete, the user presses the confirm button to send the final plan to the server.

[1647] 5. Making a reservation

[1648] The server's reservation execution unit automatically makes reservations for accommodation, transportation, and activities based on the confirmed travel plan. Successful reservation data is saved on the server in real time.

[1649] 6. Creating a detailed report

[1650] After all reservations are completed, the server's report generator automatically creates a detailed report and sends it to the user's device, allowing the user to receive their travel schedule and reservation confirmation information in a single report.

[1651] Specific examples

[1652] For example, if a user wishes to take a solo trip to Hokkaido for 2 nights and 3 days, the process would be as follows:

[1653] 1. The user fills in the tour request form with information such as "Hokkaido," "2 nights, 3 days," and "solo trip," and then adds "I want to relax."

[1654] 2. The server receives the request information, and the emotion engine analyzes the keyword "I want to relax" to determine that the user is feeling stressed.

[1655] 3. Based on this, the travel plan generation unit will prioritize and suggest plans that include hot springs and quiet tourist spots.

[1656] 4. The plan is displayed on the user's screen, and the user can confirm and adjust the hot spring inn.

[1657] 5. The server automatically makes reservations for hotels, transportation, and activities based on the confirmed plan.

[1658] 6. A detailed trip report is generated based on the completed booking information and provided to the user.

[1659] In this way, by combining the emotion engine, it becomes possible to generate and book a personalized travel plan according to the user's emotional state. This invention allows users to design a comfortable trip that is more suited to their own circumstances.

[1660] The processing flow will be explained below.

[1661] Step 1:

[1662] The user interface displays a tour request form to the user, which includes input fields for "Destination," "Trip Length," "Budget," "Number of Participants," and "Special Requirements."

[1663] Step 2:

[1664] The user enters the necessary information into the request form, such as "Destination: Hokkaido," "Travel duration: 2 nights, 3 days," "Budget: 100,000 yen," "Number of participants: 1 person," and "Special requirement: I want to relax," and then presses the submit button.

[1665] Step 3:

[1666] The device collects the input request information and sends it to the server's request information processing unit in real time. The data is sent in a standard format such as JSON.

[1667] Step 4:

[1668] The server receives the request information, which the request information processing unit analyzes and extracts various items such as the destination, travel period, and budget.

[1669] Step 5:

[1670] The emotion engine analyzes the user's emotions from their input information and interactions. For example, it determines that the user needs to relax based on a specific requirement such as "I want to relax."

[1671] Step 6:

[1672] The server's travel plan generation unit uses an AI algorithm to generate multiple optimal travel plans based on the received request information and the analysis results of the emotion engine, prioritizing the inclusion of relaxing elements such as hot springs and quiet tourist spots.

[1673] Step 7:

[1674] The server sends the generated travel plans to the user's terminal, where they are displayed in a list on the user interface of the terminal.

[1675] Step 8:

[1676] The user reviews each itinerary displayed, including details about the itinerary, such as hotel options, flight times, and activities.

[1677] Step 9:

[1678] If the user adjusts the plan as needed, for example, to select a different hot spring resort or add a specific activity, the plan is adjusted and sent back to the server.

[1679] Step 10:

[1680] The server receives the retransmitted adjusted information and again uses the travel plan generator to generate an adjusted plan, which is then presented to the user again, and the confirmation and adjustment process is repeated.

[1681] Step 11:

[1682] The user finalizes the travel plan and presses the confirmation button. The confirmed plan information is sent from the terminal to the server.

[1683] Step 12:

[1684] The server's reservation execution unit starts the reservation procedure based on the confirmed travel plan. Specifically, it calls the APIs of each service (hotel, flight, activity) to automatically make the reservation.

[1685] Step 13:

[1686] The server receives confirmation information from each reservation service, checks whether the reservation was successful, and stores the necessary information in a database.

[1687] Step 14:

[1688] After all reservations are completed, the server's report generator automatically generates a detailed report that includes the travel schedule, confirmation information for each reservation, and contact information.

[1689] Step 15:

[1690] The server sends the generated report to the user's device, where the user can check the report and proceed with travel preparations.

[1691] Example 2

[1692] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1693] Conventional travel plan generation systems are unable to provide plans that fully reflect the user's individual feelings and specific needs, making it difficult to design a travel plan that satisfies the user. In addition, the process from generating a travel plan to confirming a reservation is complicated, requiring the user to perform many manual tasks, resulting in a poor user experience.

[1694] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes means for providing a user interface for inputting request information, means for automatically generating a travel plan based on the input request information, means for presenting the generated travel plan to the user and allowing the user to confirm and adjust it, means for automatically reserving accommodations, transportation, and activities based on the travel plan confirmed by the user, means for automatically generating a detailed report on the reservation status and providing it to the user, and means for recognizing the user's emotions from the information input and interactions and reflecting them in the travel plan. This makes it possible to generate and reserve a personalized travel plan based on the user's emotions and needs.

[1695] "Request information" refers to specific information such as the destination, number of days, number of people, and purpose that a user inputs when requesting the creation of a travel plan.

[1696] "User interface" refers to the form on a web browser or the interface of a smartphone app through which a user enters request information.

[1697] The "request information processing unit" is a server-side component that receives request information entered by the user, analyzes it, and extracts the necessary data.

[1698] The "travel plan generation unit" is a server-side component that automatically generates an appropriate travel plan based on the analysis results obtained from the request information processing unit.

[1699] The "emotion engine" is a server-side function that analyzes emotions from user input information and interactions, and reflects the analysis results in request information and travel plans.

[1700] The "plan presentation and adjustment unit" is a server-side and terminal-side component that presents the generated travel plan to the user and allows the user to confirm and adjust the plan.

[1701] The "reservation execution unit" is a server-side function that automatically executes reservations for accommodations, transportation, and activities based on the confirmed travel plan.

[1702] The "report generation unit" is a server-side function that creates a detailed travel report based on completed reservation information and provides it to the user.

[1703] A "travel plan" is a specific travel itinerary and activity plan generated based on the user's request information and emotion data.

[1704] "Generative AI model" refers to the artificial intelligence algorithm used by the travel plan generation unit, and is a model for automatically generating optimal plans based on various data.

[1705] A "prompt sentence" is a free-form text message that a user enters to make a specific request or instruction to the system.

[1706] The present invention relates to a system for recognizing a user's emotions and designing and booking travel tours in a more personalized manner, and specific embodiments thereof will be described in detail below.

[1707] System configuration

[1708] This system mainly consists of the following components:

[1709] 1. User Interface

[1710] The user interface (UI) is the means by which a user inputs request information. This interface is provided as a form on a web browser or a smartphone app.

[1711] The user inputs the destination, number of days, number of people, and purpose of the trip (e.g., "I want to relax").

[1712] 2. Request Information Processing Section

[1713] The request information processing unit is a server-side function that receives and analyzes request information sent from a user.

[1714] This information processing unit extracts basic data for automatically generating a travel plan.

[1715] 3. Emotion Engine

[1716] The emotion engine is a means of analyzing emotions from user input information and interactions and reflecting them in travel plans.

[1717] Emotions are recognized using user text input, voice input, facial expression recognition, etc.

[1718] 4. Travel Plan Generation Unit

[1719] The travel plan generator is a server-side function that generates an optimal travel plan based on the input request information and the results of the emotion engine.

[1720] Automatically generate multiple plans using artificial intelligence algorithms (generative AI models) and databases.

[1721] 5. Plan Presentation and Coordination Department

[1722] The plan presentation and adjustment unit is a means for presenting the generated travel plan to the user and allowing the user to confirm and adjust it.

[1723] The user checks the proposed plan, makes any modifications, and then finalizes the plan.

[1724] 6. Reservation Execution Department

[1725] The reservation execution unit is a server-side function that automatically executes reservations for accommodation, transportation, and activities based on the confirmed travel plan.

[1726] Call various reservation APIs and check the reservation status.

[1727] 7. Report Generation

[1728] The report generation unit is a server-side function that creates a detailed travel report based on the completed reservation information and provides it to the user.

[1729] The report includes travel schedule and reservation confirmation information.

[1730] Specific examples

[1731] For example, if a user wishes to take a solo trip to Hokkaido for 2 nights and 3 days, the process would be as follows:

[1732] 1. The user fills in the tour request form with information such as "Hokkaido," "2 nights, 3 days," and "solo trip," and then adds "I want to relax."

[1733] 2. The server receives the request information, and the emotion engine analyzes the keyword "I want to relax" to determine that the user is feeling stressed.

[1734] 3. Based on this, the travel plan generation unit will prioritize and suggest plans that include hot springs and quiet tourist spots.

[1735] 4. The plan is displayed on the user's screen, and the user can confirm and adjust the hot spring inn.

[1736] 5. The server automatically makes reservations for hotels, transportation, and activities based on the confirmed plan.

[1737] 6. A detailed trip report is generated based on the completed booking information and provided to the user.

[1738] Prompt Sentence Examples

[1739] For example, by entering a prompt such as, "Create a 2-night, 3-day Hokkaido travel plan. Please include relaxing spots as an emphasis," the system will automatically generate a travel plan tailored to the user's needs.

[1740] In this way, the system enables personalized travel plans and bookings that reflect the user's emotions and specific travel needs.

[1741] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1742] Step 1: Enter your information

[1743] Input: The user inputs travel request information (destination, number of days, number of people, purpose of travel, etc.) via a user interface (UI).

[1744] How it works: The user enters information such as "Hokkaido," "2 nights and 3 days," "solo trip," and "want to relax" into the form and presses the submit button.

[1745] Output: The input request information is sent to the server.

[1746] Specific operation: The user's input information is sent to the request information processing unit of the server in real time.

[1747] Step 2: Emotion Recognition

[1748] Input: Request information received by the server, as well as text, voice, and facial expression data entered by the user.

[1749] How it works: The server's emotion engine analyzes the user's text, voice, and possibly facial expression data via a camera.

[1750] Output: User's emotional state (e.g., "I want to relax" is interpreted as stress).

[1751] Specific operation: The emotion engine analyzes the user's emotions from the text "I want to relax" and passes the results to the request information processing unit.

[1752] Step 3: Automatically generate a travel plan

[1753] Input: Request information from the request information processing unit and the analysis results of the emotion engine.

[1754] How it works: The server's travel plan generation unit uses a generative AI model to generate multiple travel plans based on this data.

[1755] Output: Multiple suggested itineraries.

[1756] Specific operation: The plan generation unit creates plans that include hot springs and quiet tourist spots. Specifically, plans that include farm stays and forest bathing activities are also proposed.

[1757] Step 4: Present and adjust the plan

[1758] Input: Multiple generated itineraries.

[1759] How it works: The server sends these plans to the user's device.

[1760] Output: User reviews and adjusts plan.

[1761] Specific operation: The travel plan is displayed on the user's device, and the user makes specific modifications such as "I would like to choose this accommodation" and finalizes the plan.

[1762] Step 5: Making a reservation

[1763] Input: Final confirmed plan.

[1764] Operation: The server's reservation execution unit calls various reservation APIs and makes reservations for accommodations, transportation, activities, etc.

[1765] Output: Successful reservation information.

[1766] Specific operation: The reservation execution unit checks the reservation status of the accommodation and automatically executes the reservation. Airline and train tickets are also arranged at the same time.

[1767] Step 6: Create a detailed report

[1768] Input: Completed reservation information.

[1769] Operation: The server's report generator creates a detailed trip report based on this reservation information.

[1770] Output: A detailed trip report provided to the user.

[1771] Specific operation: The report generator creates a report that summarizes the travel schedule, accommodation confirmation information, and transportation details. The user receives this report and can check the schedule and reservation information during the trip.

[1772] (Application example 2)

[1773] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1774] When designing and booking travel plans, it is difficult to provide a personalized experience that reflects the user's emotional state. Conventional travel plan creation systems do not take the user's emotions into account, so they are unable to propose plans that are appropriate for the user's current situation or psychological state, resulting in a decrease in user satisfaction.

[1775] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for providing a user interface for inputting request information, means for automatically generating a travel plan based on the input request information, means for presenting the generated travel plan to the user so that the user can confirm and adjust it, means for analyzing the user's emotions in real time, means for suggesting optimal products and services based on the emotion analysis results, means for automatically reserving accommodations, transportation, and activities based on the travel plan confirmed by the user, and means for automatically generating a detailed report on the reservation status and providing it to the user. This makes it possible to generate and reserve a personalized travel plan that takes the user's emotional state into consideration.

[1776] The "user interface for inputting request information" refers to an interface provided for users to input travel plan request information, and may consist of a web browser form, a smartphone app, or the like.

[1777] "Means for automatically generating a travel plan based on input request information" refers to algorithms or software that analyzes the request information input by the user and automatically creates a travel plan.

[1778] "Means for presenting the generated travel plan to the user and allowing the user to confirm and adjust it" refers to an interface that displays the travel plan to the user and allows the user to confirm and change the contents.

[1779] "Means for analyzing user emotions in real time" refers to technologies and algorithms that analyze emotions from a user's facial expressions and voice and reflect the results immediately.

[1780] "Means for proposing optimal products and services based on the results of sentiment analysis" refers to software or algorithms for recommending optimal products and services to individual users based on the results of sentiment analysis of the users.

[1781] "Means for automatically reserving accommodation, transportation, and activities based on a travel plan finalized by a user" refers to a system for automatically reserving accommodation, transportation, and activities based on a travel plan finalized by a user.

[1782] "Means for automatically generating detailed reports on reservation status and providing them to users" refers to technology or software for automatically creating detailed travel reports based on information on completed reservations and providing them to users.

[1783] The present invention is a system that analyzes a user's emotional state in real time, automatically generates and proposes travel plans based on the analysis, and makes reservations. The following describes in detail the embodiments of the present invention.

[1784] System configuration

[1785] This system consists of the following main components:

[1786] 1. User Interface

[1787] This interface is a means for users to input request information, and is typically provided as a form on a web browser or as a smartphone app.

[1788] The hardware that can be used includes smartphones (e.g., iPhone, Android devices) and PCs (e.g., Windows, Mac).

[1789] 2. Request Information Processing Section

[1790] This part has the function of receiving and analyzing request information sent by the user. It operates on the server side and extracts the data that will be the basis for automatically generating a travel plan.

[1791] The software used will be data analysis algorithms and databases (e.g., MySQL, PostgreSQL).

[1792] 3. Travel Plan Generation Unit

[1793] Based on the analyzed request information, the system uses AI algorithms and databases to generate optimal travel plans, which are then presented to the user.

[1794] As AI algorithms, machine learning models (e.g., Scikit-learn, TensorFlow) are used.

[1795] 4. Emotion Engine

[1796] This is a means of analyzing emotions from user input and interactions and reflecting them in request information and travel plans. Emotion analysis uses facial recognition technology (e.g., OpenCV) and voice analysis technology (e.g., Watson Tone Analyzer).

[1797] The device uses a camera and microphone (e.g., a webcam, a smartphone's built-in camera and microphone).

[1798] 5. Plan Presentation and Coordination Department

[1799] The generated travel plan is presented to the user, who can confirm and adjust it. The adjusted plan is then sent to the server.

[1800] The interface utilizes the user interface of a web browser or smartphone app.

[1801] 6. Reservation Execution Department

[1802] It has the function to automatically make reservations for accommodation, transportation, and activities based on confirmed travel plans, and calls various reservation APIs (e.g., Booking.com API, Expedia API).

[1803] It runs on the server backend and connects to external services.

[1804] 7. Report Generation

[1805] Once a reservation is completed, a detailed trip report is generated and provided to the user, including the trip schedule and reservation confirmation information.

[1806] Use a PDF generation library (e.g. FPDF, ReportLab) to create reports.

[1807] Specific examples of processing

[1808] For example, if a user wishes to take a "solo trip to Hokkaido for 2 nights and 3 days," the system operates as follows.

[1809] 1. Enter information

[1810] The user enters information such as "Hokkaido," "2 nights and 3 days," "solo trip," and "want to relax" into the tour request form.

[1811] This information is sent to the server in real time.

[1812] 2. Emotion recognition

[1813] The emotion engine analyzes the user's emotional state based on the keyword "I want to relax."

[1814] 3. Automatic generation of travel plans

[1815] The server generates an optimal travel plan based on the request information and the results of sentiment analysis.

[1816] Example prompt for a generative AI model:

[1817] The user wants to take a 3-day, 2-night trip to Hokkaido, but also wants to relax. Based on the user's feelings, suggest tourist spots and accommodations where they can relax.

[1818] 4. Present and adjust the plan

[1819] The generated travel plan is displayed on the user's screen, and the user can further add and adjust the hot spring inn by confirming it.

[1820] 5. Making a reservation

[1821] Based on the confirmed plan, the server automatically makes reservations for accommodation, transportation, and activities.

[1822] 6. Creating a detailed report

[1823] A detailed trip report is created based on the completed reservation information and provided to the user.

[1824] The present invention allows for the generation and booking of personalized travel plans that take into account the user's emotional state.

[1825] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1826] Step 1:

[1827] The user uses a device such as a smartphone or PC to enter request information via a form on a web browser or a smartphone app. Specifically, the user enters information such as the travel destination, duration, purpose, and desired activity, and then presses the send button. The entered information is sent to the server in real time.

[1828] Step 2:

[1829] The server uses the request information processing unit to receive request information sent from the user. The received information is stored in a database and used as basic data for generating travel plans. The server also analyzes the content of the information to extract the user's requests and constraints.

[1830] Step 3:

[1831] When a user inputs their request information, the emotion engine analyzes their text input, voice input, and even facial expression data in real time. Based on the data collected using a camera and microphone, the emotion engine can understand the user's emotional state from keywords such as "I want to relax." The analysis results are then stored in a database by the emotion engine.

[1832] Step 4:

[1833] On the server, the travel plan generation unit automatically generates a travel plan based on the analysis results of the request information processing unit and emotion engine. It analyzes the data using AI algorithms (e.g., TensorFlow and Scikit-learn) and generates multiple optimal travel plans that take into account the user's emotional state. The generated plans are stored on the server.

[1834] Step 5:

[1835] The generated itinerary is sent to the user's device and displayed on the screen. The user can review the plan and make adjustments as needed. For example, they can add or remove specific accommodations or activities. This adjustment information is sent back to the server and finalized as the itinerary.

[1836] Step 6:

[1837] The server's reservation execution unit automatically reserves accommodation, transportation, and activities based on the confirmed travel plan. It calls various reservation APIs (e.g., Booking.com API and Expedia API) to check and confirm the reservation status. The completed reservation data is saved in a database.

[1838] Step 7:

[1839] After all reservations are completed, the server's report generation unit automatically generates a detailed report, which includes the travel schedule, reservation confirmation information, important notes, etc. The generated report is sent to the user's device in PDF format or other format and can be viewed.

[1840] Through this process, personalized travel plans and reservations that take into account the user's emotional state are generated and booked.

[1841] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1842] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1843] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1844] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1845] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1846] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1847] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1848] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1849] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1850] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1851] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1852] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1853] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1854] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1855] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1856] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1857] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1858] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1859] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1860] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1861] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1862] The following is further disclosed regarding the above embodiment.

[1863] (Claim 1)

[1864] means for providing a user interface for inputting request information;

[1865] A means for automatically generating a travel plan based on input request information;

[1866] means for presenting the generated travel plan to a user and allowing the user to confirm and adjust the plan;

[1867] means for automatically making reservations for accommodation, transportation, and activities based on the user's confirmed travel plans;

[1868] A means for automatically generating and providing detailed reservation status reports to users;

[1869] A system including:

[1870] (Claim 2)

[1871] 10. The system of claim 1, further comprising means for using past travel data and AI algorithms to suggest optimal options when automatically generating a travel plan.

[1872] (Claim 3)

[1873] 10. The system according to claim 1, further comprising means for generating and again suggesting other options to the user if the reservation is not completed.

[1874] "Example 1"

[1875] (Claim 1)

[1876] means for providing a user interface for inputting request information;

[1877] A means for generating multiple optimal travel plans using an AI algorithm to automatically generate travel plans based on input request information;

[1878] A means for presenting the generated travel plan to the user, and for saving the finalized travel plan after the user has confirmed and adjusted it;

[1879] means for automatically making reservations for accommodation, transportation, and activities based on the user's confirmed travel plans;

[1880] A means to automatically generate detailed reports based on all completed booking information and provide them to users;

[1881] A system including:

[1882] (Claim 2)

[1883] 10. The system of claim 1, further comprising means for using past travel data and AI algorithms to suggest optimal options when automatically generating a travel plan.

[1884] (Claim 3)

[1885] 10. The system according to claim 1, further comprising means for generating and again suggesting other options to the user if the reservation is not completed.

[1886] "Application Example 1"

[1887] (Claim 1)

[1888] means for providing a user interface for inputting request information;

[1889] A means for automatically generating a travel plan based on input request information;

[1890] means for presenting the generated travel plan to a user and allowing the user to confirm and adjust the plan;

[1891] means for automatically making reservations for accommodation, transportation, and activities based on the user's confirmed travel plans;

[1892] A way to automatically generate meal plans, order food delivery, and make restaurant reservations,

[1893] A means for automatically generating and providing detailed reservation status reports to users;

[1894] A system including:

[1895] (Claim 2)

[1896] 10. The system of claim 1, further comprising means for using past travel data and AI algorithms to suggest optimal options when automatically generating travel and meal plans.

[1897] (Claim 3)

[1898] 10. The system according to claim 1, further comprising means for generating and again suggesting other options to the user if the reservation is not completed.

[1899] "Example 2: Combining Emotion Engines"

[1900] (Claim 1)

[1901] means for providing a user interface for inputting request information;

[1902] A means for automatically generating a travel plan based on input request information;

[1903] means for presenting the generated travel plan to a user and allowing the user to confirm and adjust the plan;

[1904] means for automatically making reservations for accommodation, transportation, and activities based on the user's confirmed travel plans;

[1905] A means for automatically generating and providing detailed reservation status reports to users;

[1906] A means to recognize emotions from user input and interactions and reflect them in travel plans;

[1907] A system including:

[1908] (Claim 2)

[1909] 10. The system of claim 1, further comprising means for using past travel data and artificial intelligence algorithms to suggest optimal options when automatically generating a travel plan.

[1910] (Claim 3)

[1911] 10. The system according to claim 1, further comprising means for generating and again suggesting other options to the user if the reservation is not completed.

[1912] "Application example 2 when combining emotion engines"

[1913] (Claim 1)

[1914] means for providing a user interface for inputting request information;

[1915] A means for automatically generating a travel plan based on input request information;

[1916] means for presenting the generated travel plan to a user and all...

Claims

1. means for providing a user interface for inputting request information; A means for automatically generating a travel plan based on input request information; means for presenting the generated travel plan to a user and allowing the user to confirm and adjust the plan; means for automatically making reservations for accommodation, transportation, and activities based on the user's confirmed travel plans; A means for automatically generating and providing detailed reservation status reports to users; A system including:

2. 10. The system of claim 1, further comprising means for using past travel data and AI algorithms to suggest optimal options when automatically generating a travel plan.

3. The system according to claim 1 , further comprising means for generating and again suggesting other options to the user if the reservation is not completed.

Images