System

Abstract

A system is provided.SOLUTION: A system comprising: means for a user to input a travel destination, a budget, the number of persons, a departure date, and a return date; a server for receiving the inputted information; a generation AI module means for generating a travel plan based on the received information by the server; means for returning a plurality of plans generated by the generation AI module to the user; means for selecting one of the plurality of plans by the user; means for automatically executing a necessary reservation procedure based on the selected plan; and means for notifying completion of the reservation.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Generally, when planning a trip, travelers need to search for tourist attractions, accommodations, restaurants, etc. based on basic information such as the destination, budget, number of people, departure date, and return date, and then make reservations. However, these procedures are extensive and place a significant burden on travelers. As a result, many travelers find planning a trip cumbersome, making it difficult for them to enjoy a casual trip. In light of this current situation, the present invention aims to provide a system that automatically generates a travel plan based on information entered by the traveler and automates the reservation process, thereby reducing the burden of planning a trip and allowing travelers to enjoy a casual trip. [Means for solving the problem]

[0005] The present invention is a system including: a means for a user to input a travel destination, budget, number of people, departure date, and return date; a server that receives the input information; a generation AI module that generates a travel plan based on the received information; a means for returning multiple plans generated by the generation AI module to the user; a means for the user to select one of the multiple plans; a means for automatically performing the necessary reservation procedures based on the selected plan; and a means for notifying the user that the reservation is complete. In particular, the generation AI module analyzes data from social media and review sites to generate multiple optimal travel plans, and the server analyzes information on the plan selected by the user to identify items that require reservation, and connects to various reservation APIs and partner systems to automate the reservation procedures, allowing the user to complete travel planning without having to go through complicated procedures.

[0006] A "user" is an individual or group that uses the travel plan creation agent system to make travel plans.

[0007] A "terminal" is a device used by a user, such as a smartphone, PC, or tablet, which is used to input basic travel information and send it to the system.

[0008] The "server" is a computer system that performs the core calculations and data processing of the travel plan creation agency system, stores information received from users, works in conjunction with the generation AI module to generate optimal travel plans, and automates the reservation process.

[0009] The "generative AI module" is an artificial intelligence program built into the server that analyzes data from social media and rating sites to generate optimal travel plans.

[0010] A "travel plan" is a comprehensive plan including travel itinerary, tourist attractions, accommodation, places to eat, transportation, etc., proposed by the generation AI module based on the travel destination, budget, number of people, and duration.

[0011] The "reservation procedure" refers to the overall operations performed to secure the services required by the user in advance, such as plane tickets, accommodation reservations, and restaurant reservations, based on a travel plan.

[0012] "SNS" is an abbreviation for social networking service, and refers to all online services in which users participate, share information, and exchange opinions.

[0013] A "rating site" is a website that lists user reviews and ratings of tourist attractions, restaurants, accommodations, etc. at travel destinations.

[0014] "Data analytics" is the process of analyzing data collected from multiple sources using statistical methods and machine learning techniques to extract meaningful information and insights.

[0015] A "booking API" is an application programming interface used to automate the reservation procedures required for travel plans, and is a set of rules for connecting to and operating external reservation systems.

[0016] "Cooperating System" refers to a third-party reservation system or service provider that cooperates with this system to process reservations. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5]FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0018] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0021] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0022] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0023] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0025] [First embodiment]

[0026] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0027] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0030] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0033] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0037] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0038] Overall system overview

[0039] This invention relates to a travel plan creation agent system in which users simply input basic travel information, and a generation AI analyzes data from social media and review sites to create an optimal travel plan, and then automatically handles the necessary reservation procedures. This system simplifies users' travel planning and allows them to enjoy traveling more easily.

[0040] User's initial operation

[0041] The user launches the "Travel Butler" application using a device (such as a smartphone or PC). The application interface displays a form for entering basic trip information (destination, budget, number of people, departure date, and return date). The user enters the necessary information and presses the "Submit" button.

[0042] Receiving and analyzing input information on the server

[0043] The information sent from the device is received by the server. The server analyzes this information and requests the generation AI module to generate a travel plan. The generation AI module analyzes data from social media and rating sites and generates multiple travel plans (e.g., Plan A, Plan B, Plan C).

[0044] Generate a travel plan and present it to the user

[0045] The generated travel plans are sent to the terminal via the server. The terminal receives them and displays the details of each plan to the user. The travel plans include information on tourist spots, accommodations, restaurants, etc., and the features of each plan are presented in an easy-to-understand manner.

[0046] User selection and confirmation

[0047] The user compares and considers the multiple plans presented and selects the most attractive one. Once the selection is complete, the user presses the "Confirm" button. This operation sends the information of the selected travel plan to the server.

[0048] Execute automatic reservation procedures

[0049] The server analyzes the information of the plan selected by the user and identifies the necessary reservations (e.g., plane tickets, accommodations, restaurants). For each reservation, it accesses the appropriate reservation API or partner system and automatically processes the reservation.

[0050] Notification of reservation completion

[0051] Once all the booking procedures are completed, the server compiles the booking confirmation and related ticket information and notifies the user, who can then confirm the booking.

[0052] Specific examples

[0053] For example, when a user plans a trip to Tokyo, the following operations are performed. First, the user enters and submits information such as "Tokyo," "100,000 yen," "2 people," "November 10, 2023," and "November 15, 2023." The server receives this information and requests analysis from the generation AI module. Based on data from social media and review sites, the generation AI module creates a travel plan (Plan A) that includes a visit to Sensoji Temple and Skytree and dinner in Ginza, and a travel plan (Plan B) that includes a visit to Ueno Zoo and Tokyo Tower and shopping in Shibuya. These plans are presented to the user, and the user selects Plan B. Based on Plan B, the server automatically arranges airfare, reserves admission tickets to Ueno Zoo, arranges tickets to the Tokyo Tower observation deck, and generates a shopping mall guide, and notifies the user that all reservations are complete. In this way, the user can complete their travel planning without any complicated procedures.

[0054] The above is an embodiment of the "travel plan creation agent system" of the present invention. This system allows users to easily and efficiently complete a series of procedures from planning a trip to making reservations.

[0055] The processing flow will be explained below.

[0056] Step 1:

[0057] The user launches the "Travel Butler" application using a device (such as a smartphone or PC). The application interface displays a form for entering basic trip information (destination, budget, number of people, departure date, and return date). The user enters the necessary information and presses the "Submit" button.

[0058] Step 2:

[0059] The device compiles the information entered by the user and creates an HTTP request to send to the server. This request includes the trip destination, budget, number of people, departure date, and return date. Once the request is complete, it is sent to the server.

[0060] Step 3:

[0061] The server analyzes the request received from the user and extracts basic information about the trip, including the destination, budget, number of people, departure date, and return date, and is then ready to proceed to the next step.

[0062] Step 4:

[0063] The server sends the analyzed basic information as a request to the generation AI module. Upon receiving this request, the generation AI module collects data from social media and rating sites based on the input information and begins analysis.

[0064] Step 5:

[0065] The generative AI module analyzes the collected data using statistical methods and machine learning algorithms to generate multiple optimal travel plans. This generation process includes information on tourist attractions, accommodations, restaurants, etc. The generative AI creates at least three travel plans (e.g., Plan A, Plan B, and Plan C).

[0066] Step 6:

[0067] The multiple travel plans generated by the generation AI module are sent back to the server, which analyzes the received travel plans and creates a response to present them to the user.

[0068] Step 7:

[0069] The server sends multiple travel plans to the user as an HTTP response, which includes details of Plan A, Plan B, and Plan C.

[0070] Step 8:

[0071] The terminal displays multiple travel plans received from the server to the user, who then checks the details of each plan and considers which one is most suitable.

[0072] Step 9:

[0073] The user selects the most attractive plan from the multiple plans presented and presses the "Confirm" button. This selection operation sends information about the selected travel plan to the server.

[0074] Step 10:

[0075] The server analyzes the selected plan information received from the user and identifies the necessary reservation procedures, including airfare, accommodation, and restaurant reservations.

[0076] Step 11:

[0077] The server connects to each reservation API and partner system to automate each reservation procedure. After connecting, the server sends reservation requests and completes the necessary reservations.

[0078] Step 12:

[0079] Once all booking procedures are completed, the server compiles the booking confirmation and related ticket information into a response to notify the user.

[0080] Step 13:

[0081] The server sends a response to the user's terminal, including a reservation completion notice and ticket information. The user confirms the reservation on the terminal and confirms that the travel plan is complete.

[0082] This is the specific process flow of the "Travel Butler" travel planning agent system. At each step, the user, device, and server play different roles, working together to automate the entire process from planning to booking a trip.

[0083] Example 1

[0084] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0085] Current travel planning is complex and time-consuming, requiring a lot of effort. Users must create an optimal plan based on basic information such as the destination, budget, number of people, and departure and return dates, and then make all the necessary reservations individually. This creates a need for a way to simplify and streamline travel planning.

[0086] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0087] In this invention, the server includes: means for a user to input a travel destination, budget, number of people, departure date, and return date; an information processing device that receives the input information; machine learning module means that generates a travel plan based on the received information; means for returning multiple plans generated by the machine learning module to the user; means for the user to select one of the multiple plans; service linkage means that automatically executes the necessary reservation procedures based on the selected plan; and display means that notifies the user that the reservation is complete. This enables the user to simply and efficiently complete a series of travel planning and reservation procedures.

[0088] A "user" is an individual or group that inputs basic information such as the travel destination, budget, number of people, departure date, and return date, and selects and confirms a travel plan.

[0089] An "information processing device" is a device that receives and analyzes information sent from a user, and includes a server or cloud computer that generates travel plans and executes various reservation procedures.

[0090] "Machine learning module" refers to an algorithm or program that analyzes data from social media and rating sites based on the information it receives and generates optimal travel plans.

[0091] "Social media" means online platforms for user communication, including sites and applications where travel reviews and opinions are posted.

[0092] A "review site" refers to a website where users can rate specific travel destinations or services and provide the data necessary to generate travel plans.

[0093] The "service linking means" is a means for connecting to various reservation application program interfaces and partner systems in order to automatically execute the necessary reservation procedures based on the travel plan.

[0094] "Display means" refers to a method for notifying the user that the reservation procedure has been completed, and includes an interface or notification function that is visually displayed on the user's terminal.

[0095] System Overview

[0096] The travel plan creation agent system of this invention is a system in which users simply input basic travel information, and a generative AI model analyzes data from social media and review sites to create an optimal travel plan, and then automatically handles the necessary reservation procedures. Users interface with the system using devices such as smartphones or personal computers.

[0097] User operations

[0098] The user installs the "Travel Butler" application and launches it. The application interface displays a form for entering the travel destination, budget, number of people, departure date, and return date. The user enters the necessary information and presses the "Submit" button to send the information to the server. For example, the user enters the following:

[0099] Please tell me your plans for a trip to Tokyo. The budget is 100,000 yen, there are two people, the departure date is November 10, 2023, and the return date is November 15, 2023.

[0100] Information analysis on the server

[0101] The information sent from the device reaches the server via the Internet. The server is a high-performance information processing device that utilizes technologies such as Python and Django. The server analyzes the received information and sends a request to the generation AI module to generate a travel plan.

[0102] Generate a travel plan

[0103] The generative AI model collects and analyzes data from social media and rating sites. It uses BeautifulSoup and Scrapy as scraping tools and natural language processing (NLP) techniques for analysis. The generated travel plans are presented to the user as multiple options.

[0104] Presenting your travel plan

[0105] The server sends the generated travel plan to the user's device. The device receives it and displays the details of each plan. For example, the following plan is presented to the user:

[0106] Plan A: Visit Sensoji Temple and Skytree, and dinner in Ginza

[0107] Plan B: Visit Ueno Zoo, Tokyo Tower, and shopping in Shibuya

[0108] User selection of plan

[0109] The user compares and considers the plans presented and selects the most attractive one. Once the selection is complete, the user presses the "Confirm" button and sends the information of the selected plan to the server.

[0110] Automated booking process

[0111] The server analyzes the information of the plan selected by the user and accesses various reservation application program interfaces (APIs) to automate the necessary reservation procedures, such as reserving airline tickets, accommodations, and restaurants.

[0112] Notification of reservation completion

[0113] Once all reservation procedures are complete, the server compiles the reservation confirmation information and notifies the user's device, where the user can confirm the completion of the reservation and smoothly prepare for their trip.

[0114] Specific examples

[0115] For example, when a user plans a trip to Tokyo, they perform the following operations. The user enters and submits the information "Tokyo," "100,000 yen," "2 people," "November 10, 2023," and "November 15, 2023." Based on this, the generation AI module generates and presents Plan A, which includes visiting Sensoji Temple and Skytree, and Plan B, which includes visiting Ueno Zoo and Tokyo Tower. If the user selects Plan B, the server automatically performs the necessary reservation procedures and notifies the user once they are complete.

[0116] The above is an embodiment of the "Travel Planning Agent System" of the present invention. This system allows users to easily plan and book their trips, further enhancing their travel experience.

[0117] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0118] Step 1:

[0119] The user launches the "Travel Butler" application on their smartphone or personal computer. The application displays an interface for user input and provides a form for entering basic trip information (destination, budget, number of people, departure date, and return date). The user enters this information and presses the "Submit" button.

[0120] Input: Destination, budget, number of people, departure date, return date

[0121] Output: Request to send input information

[0122] Step 2:

[0123] The device packages the information entered by the user and sends it over the internet to a server, using the HTTPS protocol to ensure data security.

[0124] Input: Request to send input information

[0125] Output: Send data to the server

[0126] Step 3:

[0127] The server analyzes the data received from the device. The technologies used here are Python scripts and the Django framework. The server decodes the received JSON format data and extracts the necessary information. Then, based on the analysis results, it sends a request to the generative AI model to generate a travel plan.

[0128] Input: Send data to the server

[0129] Output: Travel plan generation request

[0130] Step 4:

[0131] The generative AI model collects relevant data from social media and review sites using web scraping tools like BeautifulSoup and Scrapy, and analyzes it using natural language processing (NLP) techniques. The resulting itinerary includes lists of tourist attractions, accommodations, and restaurants.

[0132] Input: Travel plan generation request

[0133] Output: Generated itinerary (Plan A, Plan B, Plan C)

[0134] Step 5:

[0135] The server sends the generated travel plan to the device, which receives it and displays the plan details to the user in a visually easy-to-understand format using HTML and CSS.

[0136] Input: Generated itinerary

[0137] Output: Plan details

[0138] Step 6:

[0139] The user compares and considers the multiple travel plans presented and selects the most attractive one. Once the selection is complete, the user presses the "Confirm" button and the information about the selected plan is sent to the server.

[0140] Input: Plan details

[0141] Output: Notification of selected plan

[0142] Step 7:

[0143] The server analyzes the information of the plan selected by the user. As a result of the analysis, it identifies the necessary reservation procedures and automatically performs the reservation procedures by accessing various reservation APIs and partner systems. Examples include reservations for airline tickets, accommodations, and restaurants.

[0144] Input: Confirmation of selected plan

[0145] Output: Reservation request

[0146] Step 8:

[0147] Once all the reservation procedures are completed, the server compiles the reservation confirmation information. The server sends this information to the user's device and notifies the user that the reservation is complete. The device receives the notification and displays it visually to the user.

[0148] Input: Reservation request

[0149] Output: Reservation completion notification

[0150] This is the specific program processing flow of the travel plan creation agent system. This system allows users to easily create travel plans and automatically complete the necessary reservation procedures.

[0151] (Application example 1)

[0152] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0153] The process of planning and booking a trip is complicated and time-consuming, which can be frustrating for many users. It's also not easy to find photo spots, video guides, or blog post ideas while traveling. There's a need to efficiently solve these problems and enable users to enjoy their trips more.

[0154] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0155] In this invention, the server includes: means for a user to input a travel destination, budget, number of people, departure date, and return date; a server that receives the input information; a generation AI module that generates a travel plan based on the received information; a means for returning multiple plans generated by the generation AI module to the user; a means for the user to select one of the multiple plans; a means for automatically performing the necessary reservation procedures based on the selected plan; a means for notifying the user that the reservation is complete; and a means for suggesting photo spots, video guides, and ideas for blog posts based on the user's location information. This makes it possible to perform all processes, from planning a trip to the reservation procedures and support for creating content during the trip, all in one place.

[0156] A "travel destination" is a place where a user wishes to travel.

[0157] A "budget" is the total amount of money available for travel.

[0158] "Number of people" is the total number of people participating in the trip.

[0159] "Departure Date" means the date on which a trip begins.

[0160] The "return date" is the date on which you plan to return home after your trip ends.

[0161] "Means" refers to the methods or techniques used to achieve a particular goal.

[0162] The "server that receives the input information" is a server that receives basic information about the trip that the user inputs.

[0163] "Generative AI module means" means a module that uses artificial intelligence techniques to generate a travel plan based on received information.

[0164] "Generating a travel plan" means making a travel plan based on the information entered by the user.

[0165] "Multiple plans" refers to travel plans with multiple options presented to the user.

[0166] "Means for automatically performing the necessary reservation procedures based on the selected plan" refers to methods or technologies that enable the automatic making of necessary reservations (e.g., transportation, accommodation, etc.) based on the travel plan selected by the user.

[0167] The "means for notifying the user that the reservation has been completed" is a means for notifying the user that all reservation procedures have been completed.

[0168] "Location information" is geographical information about the user's current location.

[0169] A "photo spot" refers to a place suitable for taking photos.

[0170] A "videography guide" provides advice and guidance for videography.

[0171] "Blog Post Ideas" are suggestions for topics and content for users to create blog posts about while traveling.

[0172] This invention relates to a travel plan creation agent system, in which a user simply inputs basic travel information, and a generation AI generates an optimal travel plan and automatically performs the necessary reservation procedures.

[0173] Overall system overview

[0174] The purpose of this system is to simplify users' travel planning and provide a consistent process from planning to booking, as well as support for content creation during the trip.The main components of the system are the user's device, a server, a generation AI module, a reservation API, and a content generation support tool.

[0175] User's initial operation

[0176] The user launches the "Travel Butler" application using a device (such as a smartphone or PC). The application interface displays a form for entering basic trip information (destination, budget, number of people, departure date, and return date). The user enters the necessary information and presses the "Submit" button.

[0177] Receiving and analyzing input information on the server

[0178] The information sent from the device is received by the server. The server analyzes this information and requests the generation AI module to generate a travel plan. The generation AI module analyzes data from social media and rating sites and generates multiple travel plans (e.g., Plan A, Plan B, Plan C).

[0179] Generate a travel plan and present it to the user

[0180] The generated travel plans are sent to the terminal via the server. The terminal receives them and displays the details of each plan to the user. The travel plans include information on tourist spots, accommodations, restaurants, etc., and the features of each plan are presented in an easy-to-understand manner.

[0181] User selection and confirmation

[0182] The user compares and considers the multiple plans presented and selects the most attractive one. Once the selection is complete, the user presses the "Confirm" button. This operation sends the information of the selected travel plan to the server.

[0183] Execute automatic reservation procedures

[0184] The server analyzes the information of the plan selected by the user and identifies the necessary reservations (e.g., plane tickets, accommodations, restaurants). For each reservation, it accesses the appropriate reservation API or partner system and automatically processes the reservation.

[0185] Notification of reservation completion

[0186] Once all the booking procedures are completed, the server compiles the booking confirmation and related ticket information and notifies the user, who can then confirm the booking.

[0187] Content Creation Support

[0188] Additionally, a content generation support tool will be activated that will provide photo spots, video shooting guides, and blog post ideas based on the location information of places the user visits during their trip. This tool will analyze the collected location information and suggest appropriate content.

[0189] For example, when a user plans a trip to Tokyo, the following steps are performed. First, the user enters and submits information such as "Tokyo," "100,000 yen," "2 people," "November 10, 2023," and "November 15, 2023." The server receives this information and requests analysis from the generation AI module. Based on data from social media and review sites, the generation AI module creates a travel plan that includes visiting Sensoji Temple and Tokyo Skytree, dinner in Ginza, and visiting Ueno Zoo and Tokyo Tower, and shopping in Shibuya. These plans are presented to the user, who selects Plan B. Based on Plan B, the server automatically arranges airfare, reserves admission tickets to Ueno Zoo, and arranges tickets to the Tokyo Tower observation deck, and generates a shopping mall guide. The server then notifies the user that all reservations are complete. Furthermore, when visiting Tokyo Skytree during the trip, the server also provides suitable photo spots, video guides, and blog post ideas.

[0190] In this way, the user can complete the travel plan without complicated procedures and enjoy the trip. Specific examples of prompt sentences are shown below.

[0191] Example prompt sentence:

[0192] "I want to create an app that generates travel plans for Tokyo, automates bookings, and helps me create content while traveling."

[0193] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0194] Step 1:

[0195] The user enters basic information about the trip. Using the application interface, the user enters the destination, budget, number of people, departure date, and return date, and then presses the "Submit" button. The application sends the entered information to the server.

[0196] Step 2:

[0197] The server receives the input information. The server receives the basic trip information (destination, budget, number of people, departure date, and return date) sent by the user and stores it in a database. It then analyzes this information and prepares it for making a request to the generation AI module.

[0198] Step 3:

[0199] The generative AI module generates a travel plan. The server sends a request to the generative AI model based on the received information. The generative AI model analyzes data from social media and rating sites to generate multiple travel plans (e.g., Plan A, Plan B, Plan C). This generation process calculates the optimal combination of tourist attractions, accommodations, restaurants, etc. based on the input information.

[0200] Step 4:

[0201] The generated plan is sent to the user. The server receives multiple travel plans returned from the generation AI module and sends them to the user's device. The details of each plan are displayed on the user's device, allowing the user to compare them.

[0202] Step 5:

[0203] The user selects a travel plan. The user compares the presented travel plans and selects the most attractive one. Information about the selected plan is then sent from the terminal to the server.

[0204] Step 6:

[0205] The server automatically performs the reservation procedure. The server analyzes the detailed information of the plan selected by the user and automatically makes the necessary reservations (e.g., plane tickets, accommodation, restaurant). The server accesses each reservation API and partner company system and performs the necessary reservation procedures.

[0206] Step 7:

[0207] A reservation completion notification is sent to the user. Once all reservation procedures are completed, the server compiles the reservation confirmation and related ticket information and sends a notification to the user's device, allowing the user to confirm that the reservation was successfully completed.

[0208] Step 8:

[0209] Supports content creation during travel. Based on location information of places the user visits during their trip, the server suggests photo spots, video shooting guides, and blog post ideas. In this process, the server receives the user's current location information and supports the creation of appropriate content based on that information. These suggestions are displayed on the user's device, supporting content creation during their trip.

[0210] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0211] Overall system overview

[0212] This invention relates to a travel plan creation agent system that proposes more optimal travel plans and automates the booking process by combining an emotion engine that recognizes the user's emotions. By using emotion data in addition to inputting basic travel information, the system can propose travel plans that are more suited to the user's emotional state.

[0213] User's initial operation and emotion recognition

[0214] The user launches the "Travel Butler" application using a device (such as a smartphone or PC). The application interface displays a form for entering basic trip information (destination, budget, number of people, departure date, and return date). The user enters the necessary information and presses the "Submit" button. In parallel, the emotion engine analyzes the user's facial expressions, voice, and text input to obtain emotional data.

[0215] Receiving and analyzing input information on the server

[0216] The information sent from the device is received by the server. The server analyzes this information and extracts basic information about the entered trip and emotional data from the emotion engine. The extracted information includes the destination, budget, number of people, departure date, return date, emotional data, etc.

[0217] Generative AI module generates travel plans

[0218] The server sends the analyzed basic information and emotional data as a request to the generation AI module. The generation AI module begins analysis based on data from social media and rating sites and the acquired emotional data, and generates multiple travel plans that are optimal for the user's emotional state (e.g., Plan A, Plan B, Plan C).

[0219] Generate a travel plan and present it to the user

[0220] The generated travel plans are sent to the terminal via the server. The terminal receives them and displays the details of each plan to the user. The travel plans include information on tourist spots, accommodations, restaurants, etc., and the features of each plan are presented in an easy-to-understand manner.

[0221] User selection and confirmation

[0222] The user compares and considers the multiple plans presented and selects the most attractive one. Once the selection is complete, the user presses the "Confirm" button. This operation sends the information of the selected travel plan to the server.

[0223] Execute automatic reservation procedures

[0224] The server analyzes the information of the plan selected by the user and identifies the necessary reservation procedures. This analysis includes booking airline tickets, accommodations, and restaurants. For each reservation, the server accesses the appropriate reservation API or partner system and automatically completes the reservation procedures.

[0225] Notification of reservation completion

[0226] Once all the booking procedures are completed, the server compiles the booking confirmation and related ticket information and notifies the user, who can then confirm the booking.

[0227] Specific examples

[0228] For example, when a user plans a trip to Tokyo, the following steps are performed. First, the user enters and submits information such as "Tokyo," "100,000 yen," "2 people," "November 10, 2023," and "November 15, 2023." In parallel, the emotion engine analyzes the user's facial expressions and voice to obtain emotional data. The server receives this information and requests analysis from the generative AI module. Based on data from social media and review sites and the emotional data, the generative AI module creates a travel plan (Plan A) that includes a visit to Sensoji Temple and Tokyo Skytree and dinner in Ginza, and a travel plan (Plan B) that includes a visit to Ueno Zoo and Tokyo Tower and shopping in Shibuya. These plans are presented to the user, and the user selects Plan B. Based on Plan B, the server automatically arranges airfare, reserves admission tickets to Ueno Zoo, arranges tickets to the Tokyo Tower observation deck, and generates a shopping mall guide, and notifies the user that all reservations are complete. Because the plan is based on emotional data, it provides a plan that will result in higher user satisfaction.

[0229] The above is an embodiment of the "travel plan creation agent system incorporating an emotion engine." This system allows users to easily and efficiently carry out a series of procedures from planning to booking a trip in a way that is optimized based on their emotions.

[0230] The processing flow will be explained below.

[0231] Step 1:

[0232] The user launches the "Travel Butler" application using a device (such as a smartphone or PC). The application interface displays a form for entering basic trip information (destination, budget, number of people, departure date, and return date). The user enters the necessary information and presses the "Submit" button. In parallel, the emotion engine analyzes the user's facial expressions, voice, and text input to obtain emotion data.

[0233] Step 2:

[0234] The device compiles the information entered by the user and creates an HTTP request to send to the server. This request includes the trip destination, budget, number of people, departure and return dates, and emotional data. Once the request is complete, it is sent to the server.

[0235] Step 3:

[0236] The server analyzes the request received from the user and extracts the basic information and emotion data of the entered trip. The extracted information includes the destination, budget, number of people, departure date, return date, and emotion data. This completes the preparation for the next step of the process.

[0237] Step 4:

[0238] The server sends the analyzed basic information and emotion data as a request to the generation AI module. Upon receiving this request, the generation AI module collects data from social media and rating sites based on the input information and begins analysis.

[0239] Step 5:

[0240] The generative AI module analyzes the collected data and acquired emotional data using statistical methods and machine learning algorithms to generate multiple travel plans that are optimal for the user's emotional state. The generative AI creates at least three travel plans (e.g., Plan A, Plan B, and Plan C).

[0241] Step 6:

[0242] The multiple travel plans generated by the generation AI module are sent back to the server, which analyzes the received travel plans and creates a response to present them to the user.

[0243] Step 7:

[0244] The server sends multiple travel plans to the user as an HTTP response, which includes details of Plan A, Plan B, and Plan C.

[0245] Step 8:

[0246] The terminal displays multiple travel plans received from the server to the user, who then checks the details of each plan and considers which one is most suitable.

[0247] Step 9:

[0248] The user selects the most attractive plan from the multiple plans presented and presses the "Confirm" button. This selection operation sends information about the selected travel plan to the server.

[0249] Step 10:

[0250] The server analyzes the selected plan information received from the user and identifies the necessary reservation procedures, including airfare, accommodation, and restaurant reservations.

[0251] Step 11:

[0252] The server connects to each reservation API and partner system to automate each reservation procedure. After connecting, the server sends reservation requests and completes the necessary reservations.

[0253] Step 12:

[0254] Once all booking procedures are completed, the server compiles the booking confirmation and related ticket information into a response to notify the user.

[0255] Step 13:

[0256] The server sends a response to the user's terminal, including a reservation completion notice and ticket information. The user confirms the reservation on the terminal and confirms that the travel plan is complete.

[0257] Specific examples

[0258] For example, when a user plans a trip to Tokyo, the following steps are performed. First, the user enters and submits information such as "Tokyo," "100,000 yen," "2 people," "November 10, 2023," and "November 15, 2023." In parallel, the emotion engine analyzes the user's facial expressions and voice to obtain emotional data. The server receives this information and requests analysis from the generative AI module. Based on data from social media and review sites and the emotional data, the generative AI module creates a travel plan (Plan A) that includes a visit to Sensoji Temple and Tokyo Skytree and dinner in Ginza, and a travel plan (Plan B) that includes a visit to Ueno Zoo and Tokyo Tower and shopping in Shibuya. These plans are presented to the user, and the user selects Plan B. Based on Plan B, the server automatically arranges airfare, reserves admission tickets to Ueno Zoo, arranges tickets to the Tokyo Tower observation deck, and generates a shopping mall guide, and notifies the user that all reservations are complete. Because the plan is based on emotional data, it provides a plan that will result in higher user satisfaction.

[0259] Example 2

[0260] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0261] Conventional travel plan creation systems generate travel plans based on basic user information (destination, budget, number of people, departure date, return date), but because they do not take the user's emotional state into account, it is difficult to maximize user satisfaction. Furthermore, there is also the issue of not guaranteeing that the reservation process will be carried out appropriately based on the user's selections, even when automating the reservation process.

[0262] The specification process by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for the user to input the travel destination, budget, number of people, departure date, and return date, means for receiving the input information including the user's emotional data, a generation AI module means for generating a travel plan based on the received information and emotional data, means for returning multiple plans generated by the generation AI module to the user, means for the user to select one of the multiple plans, means for automatically performing the necessary reservation procedures based on the selected plan, and means for notifying the completion of the reservation. This enables the generation of a travel plan optimal for the user's emotional state and consistent automatic management of each reservation procedure.

[0263] "User" refers to an individual or organization that uses the travel plan creation agent system.

[0264] A "terminal" is a device such as a smartphone, personal computer, or tablet that is used to access the travel planning agency system.

[0265] A "travel destination" is a geographic location that a user selects as a travel destination.

[0266] A "budget" is a limit on the total amount of expenses a user can spend on a trip.

[0267] "Number of people" is the total number of people participating in the trip.

[0268] "Departure date" is the date on which the user begins their trip.

[0269] The "return date" is the date on which the user returns from their trip.

[0270] "Emotion data" is information that indicates the emotional state of a user analyzed from facial expressions, voice, text input, and the like.

[0271] A "server" is a computer system that receives data sent by users, analyzes, stores, and processes the data in cooperation with other systems.

[0272] The "generative AI module" is an artificial intelligence module that analyzes the received information and emotional data to generate the optimal travel plan.

[0273] A "prompt sentence" is an instruction sentence that instructs the generation AI module to generate a travel plan based on input information.

[0274] A "travel plan" is a detailed travel itinerary that includes tourist attractions, accommodations, restaurants, etc. at a destination.

[0275] The "reservation procedure" refers to the procedure for making reservations for airline tickets, accommodations, restaurants, etc. based on a travel plan.

[0276] "Reservation API" means an application programming interface used to automate the reservation process.

[0277] A "partner system" is a system of an external company or organization that provides travel-related services.

[0278] "Notification" is the act or method of conveying information to a user.

[0279] The present invention relates to a travel plan creation agent system that proposes more optimal travel plans and automates reservation procedures by combining an emotion engine that recognizes user emotions. Detailed embodiments are described below.

[0280] User's initial operation and emotion recognition

[0281] The user launches the "travel planning agent system" application using a device (such as a smartphone or personal computer). The application interface displays a form for entering basic trip information (destination, budget, number of people, departure date, and return date). The user enters this information and presses the "send" button. At the same time, the device's built-in emotion engine analyzes and acquires emotion data from the user's facial expressions, voice, and text input. This emotion engine operates in real time using the user's camera and microphone.

[0282] Receiving and analyzing input information on the server

[0283] The basic travel information and emotion data sent from the device are received by the server. The server analyzes the received data and extracts the necessary information. This information includes the destination, budget, number of people, departure date, return date, and emotion data. Based on this information, the server makes a request to the generation AI module in the next step.

[0284] Generative AI module generates travel plans

[0285] The server sends the analyzed basic information and emotional data to the generation AI module. The generation AI module generates multiple travel plans that best fit the user's emotional state, referencing data from external social media and rating sites. The generation AI module performs its analysis using prompts such as the following:

[0286] "User emotions are excited. Destination is Tokyo, budget is 100,000 yen, number of people is 2, departure date is November 10, 2023, and return date is November 15, 2023. Create the optimal travel plan based on emotions."

[0287] The generated travel plans include information on tourist attractions, accommodations, restaurants, etc., and each travel plan (e.g., Plan A, Plan B, Plan C) has detailed descriptions of its features.

[0288] Presenting and selecting a travel plan

[0289] The generated travel plan is sent to the terminal via the server. The terminal displays detailed information about each plan to the user. The user compares the multiple plans presented and selects the most suitable one. When the "Confirm" button is pressed, information about the selected plan is sent to the server.

[0290] Automatic booking process and notification of booking completion

[0291] The server analyzes the information of the plan selected by the user and identifies the necessary reservation procedures. This analysis includes booking airline tickets, accommodations, and restaurants. The server accesses the appropriate reservation API or partner system and automatically executes the reservation procedures. Once all reservation procedures are completed, the server compiles the reservation confirmation and related ticket information and notifies the user's device. The user can then confirm the reservation on their device.

[0292] Specific examples

[0293] For example, when a user plans a trip to Tokyo, the following operations are performed. The user enters and submits information such as "Tokyo," "100,000 yen," "2 people," "November 10, 2023," and "November 15, 2023." The application uses the camera and microphone to capture emotion data and sends it to the server. The generation AI module analyzes the prompt text and generates multiple travel plans. The generated plans are displayed on the device, and the user selects Plan B. The server automatically reserves flights, accommodation, and restaurants based on Plan B and notifies the user that the reservation is complete.

[0294] The above is a specific embodiment of the "travel plan creation agent system incorporating an emotion engine" of the present invention. This system allows users to easily and efficiently carry out the entire process from outlining their travel plans to booking procedures in a way that is optimized for their emotions.

[0295] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0296] Step 1:

[0297] The user launches the "Travel Planning Agent System" application using a terminal. The application interface displays a form for entering basic information about the trip (destination, budget, number of people, departure date, and return date).

[0298] Input: User's travel information (destination, budget, number of people, departure date, return date)

[0299] Output: Trip information entered by the user

[0300] Step 2:

[0301] The user enters the necessary information and presses the "Send" button. At the same time, the emotion engine uses the device's camera and microphone to analyze the user's facial expressions, voice, and text input to obtain emotional data.

[0302] Input: Click of the send button, user voice and facial expression data

[0303] Output: Emotion data (e.g., excitement, joy, etc.)

[0304] Step 3:

[0305] The device sends travel information and emotion data to the server, which analyzes the received data and extracts the necessary information.

[0306] Input: Travel information, emotion data

[0307] Output: Extracted basic information (destination, budget, number of people, departure date, return date), emotion data

[0308] Step 4:

[0309] The server sends the analysis results to the generation AI module, which generates a prompt sentence and then generates a travel plan based on the prompt sentence.

[0310] Input: Basic information, emotion data

[0311] Output: Prompt sentence to be passed to the generation AI module (e.g., "The user is excited. The destination is Tokyo, the budget is 100,000 yen, the number of people is 2, the departure date is November 10, 2023, and the return date is November 15, 2023. Please create the optimal travel plan based on the user's emotions.")

[0312] Step 5:

[0313] The generative AI module analyzes data from external social media and rating sites based on the prompt text and generates multiple travel plans (e.g., Plan A, Plan B, Plan C).

[0314] Input: prompt statement, external data

[0315] Output: Multiple travel plans (Plan A, Plan B, Plan C)

[0316] Step 6:

[0317] The server sends the generated travel plans to the device, where each plan is displayed on the device interface for the user to compare and consider.

[0318] Input: Travel Plan

[0319] Output: Trip plan displayed on the device

[0320] Step 7:

[0321] The user compares the multiple plans presented and selects the most attractive one. Once the selection is complete, the user presses the "Confirm" button.

[0322] Input: User's plan selection

[0323] Output: Selected plan

[0324] Step 8:

[0325] The terminal sends the selected plan information to the server, which analyzes the information and identifies the necessary reservation procedures.

[0326] Input: Selected travel plan

[0327] Output: Identifying items requiring reservations

[0328] Step 9:

[0329] The server executes the specified reservation procedure, accessing each reservation API and partner company system to automatically complete the reservation procedure.

[0330] Input: Items that require reservation

[0331] Output: Completed booking process

[0332] Step 10:

[0333] After all reservation procedures are completed, the server compiles the reservation confirmation and related ticket information and notifies the user's terminal.

[0334] Input: Completed reservation procedure

[0335] Output: Booking confirmation and ticket information sent to the device

[0336] The above are the specific processing steps in the "travel plan creation agent system combined with an emotion engine."

[0337] (Application example 2)

[0338] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0339] Conventional travel plan creation systems generate travel plans based only on basic information entered by the user, making it difficult to provide an optimal plan based on the user's feelings and preferences. Furthermore, they lacked efficient methods for comparing and considering multiple travel plans at once, and systems for automatically completing reservation procedures. This resulted in low user satisfaction and left the process cumbersome.

[0340] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0341] In this invention, the server includes a means for the user to input the travel destination, budget, number of people, departure date, and return date, a means for acquiring and receiving the user's emotional data, and a means for generating a travel plan based on the received information and emotional data. This makes it possible to generate multiple travel plans that best suit the user's emotional state and allow the user to select one. Furthermore, the server automatically executes the necessary reservation procedures based on the selected plan and notifies the user of completion, thereby improving the efficiency of the procedure and increasing user satisfaction.

[0342] The "means for the user to input the travel destination, budget, number of people, departure date and return date" provides an interface that allows the user to input basic information about the trip into the system.

[0343] "Means for acquiring and receiving user emotional data" refers to a mechanism for analyzing emotions from the user's facial expressions, voice, text, etc., and incorporating that data into the system.

[0344] The "means for generating a travel plan based on received information and emotional data" is a component that has the function of analyzing the basic travel information and emotional data input and automatically generating an optimal travel plan based on that information.

[0345] The "generative AI module" is a module equipped with artificial intelligence that analyzes input data and emotional data from users, and automatically generates multiple optimal travel plans using data from social networking services and rating websites.

[0346] A "social network service" is an online platform that enables users to share information and interact with others via the Internet.

[0347] A "rating website" is a website where users can post ratings and reviews of specific services or products, and other users can use these as a reference.

[0348] A "reservation application program interface" is an interface that allows the reservation system and other application software to communicate with each other and automate the reservation procedure.

[0349] A "cooperating company system" is a reservation management system owned by a provider of various services (air tickets, accommodation, activities, etc.) necessary for implementing a travel plan.

[0350] "Means for automatic execution" are functions or modules designed to allow a program to automatically perform necessary processes or procedures.

[0351] The "means for notifying completion" is a system for notifying the user when the reservation procedure is completed.

[0352] This invention is a travel plan creation agent system that allows users to input basic travel information and emotion data, generates an optimal travel plan based on that information, and automates the reservation procedure. The following describes in detail the system that realizes this application example.

[0353] The system provides an interface on devices such as smartphones and personal computers for users to input their travel destination, budget, number of people, departure date, and return date. When the user inputs this basic information and presses the send button, the device sends the information to a server. At the same time, an emotion engine is used to analyze the user's facial expressions, voice, and text input to obtain emotion data, which is also sent to the server.

[0354] The server analyzes the received basic information and emotional data and sends a request to the generation AI module. The generation AI module analyzes data from social networking services and rating websites to generate multiple travel plans that are optimal for the user's emotional state. The generated travel plans are then sent back to the device via the server.

[0355] The terminal displays the received travel plans to the user, allowing the user to select a plan. The user selects one plan from multiple plans and presses the confirm button. This operation sends the information of the selected plan to the server.

[0356] The server analyzes the information of the selected plan and identifies the necessary reservation procedures, such as reserving airline tickets, accommodations, and restaurants. The server accesses each reservation application program interface and partner company systems to automatically complete the reservation procedures. Once all reservation procedures are complete, the server compiles a reservation confirmation and related ticket information and notifies the user.

[0357] As a specific example of this system, consider a user planning a trip to Tokyo. The user enters and submits information such as "Tokyo," "100,000 yen," "2 people," "November 10, 2023," and "November 15, 2023." The emotion engine analyzes the user's facial expressions and voice and obtains emotional data such as "I want to relax." The server then requests an analysis of this information from a generation AI module. The generation AI module then creates a travel plan (Plan A) that includes a visit to Sensoji Temple and Skytree and dinner in Ginza, and a travel plan (Plan B) that includes a visit to Ueno Zoo and Tokyo Tower and shopping in Shibuya. These plans are presented to the user, and the user selects Plan B. Based on Plan B, the server automatically arranges airfare, reserves admission tickets to Ueno Zoo, arranges tickets to the Tokyo Tower observation deck, and generates a shopping mall guide, and notifies the user that all reservations have been completed.

[0358] Examples of prompts to input to the generative AI model include:

[0359] "Travel Planner API:

[0360] {

[0361] "basic_info": {

[0362] "destination": "Tokyo",

[0363] "budget": 100000,

[0364] "number_of_people": 2,

[0365] "departure_date": "2023-11-10",

[0366] "return_date": "2023-11-15"

[0367] },

[0368] "emotion_data": {

[0369] "emotion": "I want to relax",

[0370] "intensity": "high"

[0371] }

[0372] }"

[0373] There is.

[0374] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0375] Step 1:

[0376] The user (using a smartphone or personal computer) enters the travel destination, budget, number of people, departure date, and return date into the input form and presses the send button. This operation sends basic information from the device to the server. At the same time, the emotion engine analyzes the user's facial expressions, voice, and text input to obtain emotion data.

[0377] (Input) Travel destination, budget, number of people, departure date, return date, user emotional data (facial expression, voice, text)

[0378] (Output) Basic information and emotion data sent to the server

[0379] Step 2:

[0380] The server receives the basic information and emotion data sent from the device. The received data is stored in a database and analyzed as needed. The server analyzes the received data and converts it into the data format required to generate a travel plan.

[0381] (Input) Basic information and emotion data sent

[0382] (Output) Data format for generating travel plans

[0383] Step 3:

[0384] The server then sends a request to the generative AI module based on the converted data. This request includes the user's basic information and emotional data. The generative AI module analyzes data from social networking services and rating websites to generate multiple travel plans that best fit the user's emotional state.

[0385] (Input) Converted data (data format for generating travel plans)

[0386] (Output) Multiple travel plans (Plan A, Plan B, Plan C, etc.)

[0387] Step 4:

[0388] The multiple plans generated by the generation AI module are sent to the server, which analyzes the received plan data and converts it into a data format for sending back to the user.

[0389] (Input) Travel plan data sent from the generation AI module

[0390] (Output) Data format for sending back to the user

[0391] Step 5:

[0392] The terminal receives multiple travel plans sent from the server and displays them to the user. The user compares and considers these plans and selects the most attractive one. When the user presses the select button, information about the selected plan is sent to the server.

[0393] (Input) Multiple travel plans sent from the server

[0394] (Output) User selection information (selected plan)

[0395] Step 6:

[0396] The server receives and analyzes the information of the plan selected by the user. Based on the analyzed information, it identifies items that require reservation and accesses each reservation application program interface or partner company system to automatically carry out the reservation procedure.

[0397] (Input) Information about the plan selected by the user

[0398] (Output) Completed reservation procedures (airline tickets, accommodation, restaurant reservations)

[0399] Step 7:

[0400] Once all the booking procedures are completed, the server compiles the booking confirmation and related ticket information and notifies the user, who can then confirm the booking.

[0401] (Input) Information on completed reservation procedures

[0402] (Output) Reservation confirmation notification and ticket information to the user

[0403] The above is a detailed description of each processing step in this system.

[0404] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0405] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0406] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0407] [Second embodiment]

[0408] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0409] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0410] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0411] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0412] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0413] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0414] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0415] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0416] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0417] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0418] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0419] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0420] Overall system overview

[0421] This invention relates to a travel plan creation agent system in which users simply input basic travel information, and a generation AI analyzes data from social media and review sites to create an optimal travel plan, and then automatically handles the necessary reservation procedures. This system simplifies users' travel planning and allows them to enjoy traveling more easily.

[0422] User's initial operation

[0423] The user launches the "Travel Butler" application using a device (such as a smartphone or PC). The application interface displays a form for entering basic trip information (destination, budget, number of people, departure date, and return date). The user enters the necessary information and presses the "Submit" button.

[0424] Receiving and analyzing input information on the server

[0425] The information sent from the device is received by the server. The server analyzes this information and requests the generation AI module to generate a travel plan. The generation AI module analyzes data from social media and rating sites and generates multiple travel plans (e.g., Plan A, Plan B, Plan C).

[0426] Generate a travel plan and present it to the user

[0427] The generated travel plans are sent to the terminal via the server. The terminal receives them and displays the details of each plan to the user. The travel plans include information on tourist spots, accommodations, restaurants, etc., and the features of each plan are presented in an easy-to-understand manner.

[0428] User selection and confirmation

[0429] The user compares and considers the multiple plans presented and selects the most attractive one. Once the selection is complete, the user presses the "Confirm" button. This operation sends the information of the selected travel plan to the server.

[0430] Execute automatic reservation procedures

[0431] The server analyzes the information of the plan selected by the user and identifies the necessary reservations (e.g., plane tickets, accommodations, restaurants). For each reservation, it accesses the appropriate reservation API or partner system and automatically processes the reservation.

[0432] Notification of reservation completion

[0433] Once all the booking procedures are completed, the server compiles the booking confirmation and related ticket information and notifies the user, who can then confirm the booking.

[0434] Specific examples

[0435] For example, when a user plans a trip to Tokyo, the following operations are performed. First, the user enters and submits information such as "Tokyo," "100,000 yen," "2 people," "November 10, 2023," and "November 15, 2023." The server receives this information and requests analysis from the generation AI module. Based on data from social media and review sites, the generation AI module creates a travel plan (Plan A) that includes a visit to Sensoji Temple and Skytree and dinner in Ginza, and a travel plan (Plan B) that includes a visit to Ueno Zoo and Tokyo Tower and shopping in Shibuya. These plans are presented to the user, and the user selects Plan B. Based on Plan B, the server automatically arranges airfare, reserves admission tickets to Ueno Zoo, arranges tickets to the Tokyo Tower observation deck, and generates a shopping mall guide, and notifies the user that all reservations are complete. In this way, the user can complete their travel planning without any complicated procedures.

[0436] The above is an embodiment of the "travel plan creation agent system" of the present invention. This system allows users to easily and efficiently complete a series of procedures from planning a trip to making reservations.

[0437] The processing flow will be explained below.

[0438] Step 1:

[0439] The user launches the "Travel Butler" application using a device (such as a smartphone or PC). The application interface displays a form for entering basic trip information (destination, budget, number of people, departure date, and return date). The user enters the necessary information and presses the "Submit" button.

[0440] Step 2:

[0441] The device compiles the information entered by the user and creates an HTTP request to send to the server. This request includes the trip destination, budget, number of people, departure date, and return date. Once the request is complete, it is sent to the server.

[0442] Step 3:

[0443] The server analyzes the request received from the user and extracts basic information about the trip, including the destination, budget, number of people, departure date, and return date, and is then ready to proceed to the next step.

[0444] Step 4:

[0445] The server sends the analyzed basic information as a request to the generation AI module. Upon receiving this request, the generation AI module collects data from social media and rating sites based on the input information and begins analysis.

[0446] Step 5:

[0447] The generative AI module analyzes the collected data using statistical methods and machine learning algorithms to generate multiple optimal travel plans. This generation process includes information on tourist attractions, accommodations, restaurants, etc. The generative AI creates at least three travel plans (e.g., Plan A, Plan B, and Plan C).

[0448] Step 6:

[0449] The multiple travel plans generated by the generation AI module are sent back to the server, which analyzes the received travel plans and creates a response to present them to the user.

[0450] Step 7:

[0451] The server sends multiple travel plans to the user as an HTTP response, which includes details of Plan A, Plan B, and Plan C.

[0452] Step 8:

[0453] The terminal displays multiple travel plans received from the server to the user, who then checks the details of each plan and considers which one is most suitable.

[0454] Step 9:

[0455] The user selects the most attractive plan from the multiple plans presented and presses the "Confirm" button. This selection operation sends information about the selected travel plan to the server.

[0456] Step 10:

[0457] The server analyzes the selected plan information received from the user and identifies the necessary reservation procedures, including airfare, accommodation, and restaurant reservations.

[0458] Step 11:

[0459] The server connects to each reservation API and partner system to automate each reservation procedure. After connecting, the server sends reservation requests and completes the necessary reservations.

[0460] Step 12:

[0461] Once all booking procedures are completed, the server compiles the booking confirmation and related ticket information into a response to notify the user.

[0462] Step 13:

[0463] The server sends a response to the user's terminal, including a reservation completion notice and ticket information. The user confirms the reservation on the terminal and confirms that the travel plan is complete.

[0464] This is the specific process flow of the "Travel Butler" travel planning agent system. At each step, the user, device, and server play different roles, working together to automate the entire process from planning to booking a trip.

[0465] Example 1

[0466] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0467] Current travel planning is complex and time-consuming, requiring a lot of effort. Users must create an optimal plan based on basic information such as the destination, budget, number of people, and departure and return dates, and then make all the necessary reservations individually. This creates a need for a way to simplify and streamline travel planning.

[0468] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0469] In this invention, the server includes: means for a user to input a travel destination, budget, number of people, departure date, and return date; an information processing device that receives the input information; machine learning module means that generates a travel plan based on the received information; means for returning multiple plans generated by the machine learning module to the user; means for the user to select one of the multiple plans; service linkage means that automatically executes the necessary reservation procedures based on the selected plan; and display means that notifies the user that the reservation is complete. This enables the user to simply and efficiently complete a series of travel planning and reservation procedures.

[0470] A "user" is an individual or group that inputs basic information such as the travel destination, budget, number of people, departure date, and return date, and selects and confirms a travel plan.

[0471] An "information processing device" is a device that receives and analyzes information sent from a user, and includes a server or cloud computer that generates travel plans and executes various reservation procedures.

[0472] "Machine learning module" refers to an algorithm or program that analyzes data from social media and rating sites based on the information it receives and generates optimal travel plans.

[0473] "Social media" means online platforms for user communication, including sites and applications where travel reviews and opinions are posted.

[0474] A "review site" refers to a website where users can rate specific travel destinations or services and provide the data necessary to generate travel plans.

[0475] The "service linking means" is a means for connecting to various reservation application program interfaces and partner systems in order to automatically execute the necessary reservation procedures based on the travel plan.

[0476] "Display means" refers to a method for notifying the user that the reservation procedure has been completed, and includes an interface or notification function that is visually displayed on the user's terminal.

[0477] System Overview

[0478] The travel plan creation agent system of this invention is a system in which users simply input basic travel information, and a generative AI model analyzes data from social media and review sites to create an optimal travel plan, and then automatically handles the necessary reservation procedures. Users interface with the system using devices such as smartphones or personal computers.

[0479] User operations

[0480] The user installs the "Travel Butler" application and launches it. The application interface displays a form for entering the travel destination, budget, number of people, departure date, and return date. The user enters the necessary information and presses the "Submit" button to send the information to the server. For example, the user enters the following:

[0481] Please tell me your plans for a trip to Tokyo. The budget is 100,000 yen, there are two people, the departure date is November 10, 2023, and the return date is November 15, 2023.

[0482] Information analysis on the server

[0483] The information sent from the device reaches the server via the Internet. The server is a high-performance information processing device that utilizes technologies such as Python and Django. The server analyzes the received information and sends a request to the generation AI module to generate a travel plan.

[0484] Generate a travel plan

[0485] The generative AI model collects and analyzes data from social media and rating sites. It uses BeautifulSoup and Scrapy as scraping tools and natural language processing (NLP) techniques for analysis. The generated travel plans are presented to the user as multiple options.

[0486] Presenting your travel plan

[0487] The server sends the generated travel plan to the user's device. The device receives it and displays the details of each plan. For example, the following plan is presented to the user:

[0488] Plan A: Visit Sensoji Temple and Skytree, and dinner in Ginza

[0489] Plan B: Visit Ueno Zoo, Tokyo Tower, and shopping in Shibuya

[0490] User selection of plan

[0491] The user compares and considers the plans presented and selects the most attractive one. Once the selection is complete, the user presses the "Confirm" button and sends the information of the selected plan to the server.

[0492] Automated booking process

[0493] The server analyzes the information of the plan selected by the user and accesses various reservation application program interfaces (APIs) to automate the necessary reservation procedures, such as reserving airline tickets, accommodations, and restaurants.

[0494] Notification of reservation completion

[0495] Once all reservation procedures are complete, the server compiles the reservation confirmation information and notifies the user's device, where the user can confirm the completion of the reservation and smoothly prepare for their trip.

[0496] Specific examples

[0497] For example, when a user plans a trip to Tokyo, they perform the following operations. The user enters and submits the information "Tokyo," "100,000 yen," "2 people," "November 10, 2023," and "November 15, 2023." Based on this, the generation AI module generates and presents Plan A, which includes visiting Sensoji Temple and Skytree, and Plan B, which includes visiting Ueno Zoo and Tokyo Tower. If the user selects Plan B, the server automatically performs the necessary reservation procedures and notifies the user once they are complete.

[0498] The above is an embodiment of the "Travel Planning Agent System" of the present invention. This system allows users to easily plan and book their trips, further enhancing their travel experience.

[0499] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0500] Step 1:

[0501] The user launches the "Travel Butler" application on their smartphone or personal computer. The application displays an interface for user input and provides a form for entering basic trip information (destination, budget, number of people, departure date, and return date). The user enters this information and presses the "Submit" button.

[0502] Input: Destination, budget, number of people, departure date, return date

[0503] Output: Request to send input information

[0504] Step 2:

[0505] The device packages the information entered by the user and sends it over the internet to a server, using the HTTPS protocol to ensure data security.

[0506] Input: Request to send input information

[0507] Output: Send data to the server

[0508] Step 3:

[0509] The server analyzes the data received from the device. The technologies used here are Python scripts and the Django framework. The server decodes the received JSON format data and extracts the necessary information. Then, based on the analysis results, it sends a request to the generative AI model to generate a travel plan.

[0510] Input: Send data to the server

[0511] Output: Travel plan generation request

[0512] Step 4:

[0513] The generative AI model collects relevant data from social media and review sites using web scraping tools like BeautifulSoup and Scrapy, and analyzes it using natural language processing (NLP) techniques. The resulting itinerary includes lists of tourist attractions, accommodations, and restaurants.

[0514] Input: Travel plan generation request

[0515] Output: Generated itinerary (Plan A, Plan B, Plan C)

[0516] Step 5:

[0517] The server sends the generated travel plan to the device, which receives it and displays the plan details to the user in a visually easy-to-understand format using HTML and CSS.

[0518] Input: Generated itinerary

[0519] Output: Plan details

[0520] Step 6:

[0521] The user compares and considers the multiple travel plans presented and selects the most attractive one. Once the selection is complete, the user presses the "Confirm" button and the information about the selected plan is sent to the server.

[0522] Input: Plan details

[0523] Output: Notification of selected plan

[0524] Step 7:

[0525] The server analyzes the information of the plan selected by the user. As a result of the analysis, it identifies the necessary reservation procedures and automatically performs the reservation procedures by accessing various reservation APIs and partner systems. Examples include reservations for airline tickets, accommodations, and restaurants.

[0526] Input: Confirmation of selected plan

[0527] Output: Reservation request

[0528] Step 8:

[0529] Once all the reservation procedures are completed, the server compiles the reservation confirmation information. The server sends this information to the user's device and notifies the user that the reservation is complete. The device receives the notification and displays it visually to the user.

[0530] Input: Reservation request

[0531] Output: Reservation completion notification

[0532] This is the specific program processing flow of the travel plan creation agent system. This system allows users to easily create travel plans and automatically complete the necessary reservation procedures.

[0533] (Application example 1)

[0534] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0535] The process of planning and booking a trip is complicated and time-consuming, which can be frustrating for many users. It's also not easy to find photo spots, video guides, or blog post ideas while traveling. There's a need to efficiently solve these problems and enable users to enjoy their trips more.

[0536] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0537] In this invention, the server includes: means for a user to input a travel destination, budget, number of people, departure date, and return date; a server that receives the input information; a generation AI module that generates a travel plan based on the received information; a means for returning multiple plans generated by the generation AI module to the user; a means for the user to select one of the multiple plans; a means for automatically performing the necessary reservation procedures based on the selected plan; a means for notifying the user that the reservation is complete; and a means for suggesting photo spots, video guides, and ideas for blog posts based on the user's location information. This makes it possible to perform all processes, from planning a trip to the reservation procedures and support for creating content during the trip, all in one place.

[0538] A "travel destination" is a place where a user wishes to travel.

[0539] A "budget" is the total amount of money available for travel.

[0540] "Number of people" is the total number of people participating in the trip.

[0541] "Departure Date" means the date on which a trip begins.

[0542] The "return date" is the date on which you plan to return home after your trip ends.

[0543] "Means" refers to the methods or techniques used to achieve a particular goal.

[0544] The "server that receives the input information" is a server that receives basic information about the trip that the user inputs.

[0545] "Generative AI module means" means a module that uses artificial intelligence techniques to generate a travel plan based on received information.

[0546] "Generating a travel plan" means making a travel plan based on the information entered by the user.

[0547] "Multiple plans" refers to travel plans with multiple options presented to the user.

[0548] "Means for automatically performing the necessary reservation procedures based on the selected plan" refers to methods or technologies that enable the automatic making of necessary reservations (e.g., transportation, accommodation, etc.) based on the travel plan selected by the user.

[0549] The "means for notifying the user that the reservation has been completed" is a means for notifying the user that all reservation procedures have been completed.

[0550] "Location information" is geographical information about the user's current location.

[0551] A "photo spot" refers to a place suitable for taking photos.

[0552] A "videography guide" provides advice and guidance for videography.

[0553] "Blog Post Ideas" are suggestions for topics and content for users to create blog posts about while traveling.

[0554] This invention relates to a travel plan creation agent system, in which a user simply inputs basic travel information, and a generation AI generates an optimal travel plan and automatically performs the necessary reservation procedures.

[0555] Overall system overview

[0556] The purpose of this system is to simplify users' travel planning and provide a consistent process from planning to booking, as well as support for content creation during the trip.The main components of the system are the user's device, a server, a generation AI module, a reservation API, and a content generation support tool.

[0557] User's initial operation

[0558] The user launches the "Travel Butler" application using a device (such as a smartphone or PC). The application interface displays a form for entering basic trip information (destination, budget, number of people, departure date, and return date). The user enters the necessary information and presses the "Submit" button.

[0559] Receiving and analyzing input information on the server

[0560] The information sent from the device is received by the server. The server analyzes this information and requests the generation AI module to generate a travel plan. The generation AI module analyzes data from social media and rating sites and generates multiple travel plans (e.g., Plan A, Plan B, Plan C).

[0561] Generate a travel plan and present it to the user

[0562] The generated travel plans are sent to the terminal via the server. The terminal receives them and displays the details of each plan to the user. The travel plans include information on tourist spots, accommodations, restaurants, etc., and the features of each plan are presented in an easy-to-understand manner.

[0563] User selection and confirmation

[0564] The user compares and considers the multiple plans presented and selects the most attractive one. Once the selection is complete, the user presses the "Confirm" button. This operation sends the information of the selected travel plan to the server.

[0565] Execute automatic reservation procedures

[0566] The server analyzes the information of the plan selected by the user and identifies the necessary reservations (e.g., plane tickets, accommodations, restaurants). For each reservation, it accesses the appropriate reservation API or partner system and automatically processes the reservation.

[0567] Notification of reservation completion

[0568] Once all the booking procedures are completed, the server compiles the booking confirmation and related ticket information and notifies the user, who can then confirm the booking.

[0569] Content Creation Support

[0570] Additionally, a content generation support tool will be activated that will provide photo spots, video shooting guides, and blog post ideas based on the location information of places the user visits during their trip. This tool will analyze the collected location information and suggest appropriate content.

[0571] For example, when a user plans a trip to Tokyo, the following steps are performed. First, the user enters and submits information such as "Tokyo," "100,000 yen," "2 people," "November 10, 2023," and "November 15, 2023." The server receives this information and requests analysis from the generation AI module. Based on data from social media and review sites, the generation AI module creates a travel plan that includes visiting Sensoji Temple and Tokyo Skytree, dinner in Ginza, and visiting Ueno Zoo and Tokyo Tower, and shopping in Shibuya. These plans are presented to the user, who selects Plan B. Based on Plan B, the server automatically arranges airfare, reserves admission tickets to Ueno Zoo, and arranges tickets to the Tokyo Tower observation deck, and generates a shopping mall guide. The server then notifies the user that all reservations are complete. Furthermore, when visiting Tokyo Skytree during the trip, the server also provides suitable photo spots, video guides, and blog post ideas.

[0572] In this way, the user can complete the travel plan without complicated procedures and enjoy the trip. Specific examples of prompt sentences are shown below.

[0573] Example prompt sentence:

[0574] "I want to create an app that generates travel plans for Tokyo, automates bookings, and helps me create content while traveling."

[0575] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0576] Step 1:

[0577] The user enters basic information about the trip. Using the application interface, the user enters the destination, budget, number of people, departure date, and return date, and then presses the "Submit" button. The application sends the entered information to the server.

[0578] Step 2:

[0579] The server receives the input information. The server receives the basic trip information (destination, budget, number of people, departure date, and return date) sent by the user and stores it in a database. It then analyzes this information and prepares it for making a request to the generation AI module.

[0580] Step 3:

[0581] The generative AI module generates a travel plan. The server sends a request to the generative AI model based on the received information. The generative AI model analyzes data from social media and rating sites to generate multiple travel plans (e.g., Plan A, Plan B, Plan C). This generation process calculates the optimal combination of tourist attractions, accommodations, restaurants, etc. based on the input information.

[0582] Step 4:

[0583] The generated plan is sent to the user. The server receives multiple travel plans returned from the generation AI module and sends them to the user's device. The details of each plan are displayed on the user's device, allowing the user to compare them.

[0584] Step 5:

[0585] The user selects a travel plan. The user compares the presented travel plans and selects the most attractive one. Information about the selected plan is then sent from the terminal to the server.

[0586] Step 6:

[0587] The server automatically performs the reservation procedure. The server analyzes the detailed information of the plan selected by the user and automatically makes the necessary reservations (e.g., plane tickets, accommodation, restaurant). The server accesses each reservation API and partner company system and performs the necessary reservation procedures.

[0588] Step 7:

[0589] A reservation completion notification is sent to the user. Once all reservation procedures are completed, the server compiles the reservation confirmation and related ticket information and sends a notification to the user's device, allowing the user to confirm that the reservation was successfully completed.

[0590] Step 8:

[0591] Supports content creation during travel. Based on location information of places the user visits during their trip, the server suggests photo spots, video shooting guides, and blog post ideas. In this process, the server receives the user's current location information and supports the creation of appropriate content based on that information. These suggestions are displayed on the user's device, supporting content creation during their trip.

[0592] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0593] Overall system overview

[0594] This invention relates to a travel plan creation agent system that proposes more optimal travel plans and automates the booking process by combining an emotion engine that recognizes the user's emotions. By using emotion data in addition to inputting basic travel information, the system can propose travel plans that are more suited to the user's emotional state.

[0595] User's initial operation and emotion recognition

[0596] The user launches the "Travel Butler" application using a device (such as a smartphone or PC). The application interface displays a form for entering basic trip information (destination, budget, number of people, departure date, and return date). The user enters the necessary information and presses the "Submit" button. In parallel, the emotion engine analyzes the user's facial expressions, voice, and text input to obtain emotional data.

[0597] Receiving and analyzing input information on the server

[0598] The information sent from the device is received by the server. The server analyzes this information and extracts basic information about the entered trip and emotional data from the emotion engine. The extracted information includes the destination, budget, number of people, departure date, return date, emotional data, etc.

[0599] Generative AI module generates travel plans

[0600] The server sends the analyzed basic information and emotional data as a request to the generation AI module. The generation AI module begins analysis based on data from social media and rating sites and the acquired emotional data, and generates multiple travel plans that are optimal for the user's emotional state (e.g., Plan A, Plan B, Plan C).

[0601] Generate a travel plan and present it to the user

[0602] The generated travel plans are sent to the terminal via the server. The terminal receives them and displays the details of each plan to the user. The travel plans include information on tourist spots, accommodations, restaurants, etc., and the features of each plan are presented in an easy-to-understand manner.

[0603] User selection and confirmation

[0604] The user compares and considers the multiple plans presented and selects the most attractive one. Once the selection is complete, the user presses the "Confirm" button. This operation sends the information of the selected travel plan to the server.

[0605] Execute automatic reservation procedures

[0606] The server analyzes the information of the plan selected by the user and identifies the necessary reservation procedures. This analysis includes booking airline tickets, accommodations, and restaurants. For each reservation, the server accesses the appropriate reservation API or partner system and automatically completes the reservation procedures.

[0607] Notification of reservation completion

[0608] Once all the booking procedures are completed, the server compiles the booking confirmation and related ticket information and notifies the user, who can then confirm the booking.

[0609] Specific examples

[0610] For example, when a user plans a trip to Tokyo, the following steps are performed. First, the user enters and submits information such as "Tokyo," "100,000 yen," "2 people," "November 10, 2023," and "November 15, 2023." In parallel, the emotion engine analyzes the user's facial expressions and voice to obtain emotional data. The server receives this information and requests analysis from the generative AI module. Based on data from social media and review sites and the emotional data, the generative AI module creates a travel plan (Plan A) that includes a visit to Sensoji Temple and Tokyo Skytree and dinner in Ginza, and a travel plan (Plan B) that includes a visit to Ueno Zoo and Tokyo Tower and shopping in Shibuya. These plans are presented to the user, and the user selects Plan B. Based on Plan B, the server automatically arranges airfare, reserves admission tickets to Ueno Zoo, arranges tickets to the Tokyo Tower observation deck, and generates a shopping mall guide, and notifies the user that all reservations are complete. Because the plan is based on emotional data, it provides a plan that will result in higher user satisfaction.

[0611] The above is an embodiment of the "travel plan creation agent system incorporating an emotion engine." This system allows users to easily and efficiently carry out a series of procedures from planning to booking a trip in a way that is optimized based on their emotions.

[0612] The processing flow will be explained below.

[0613] Step 1:

[0614] The user launches the "Travel Butler" application using a device (such as a smartphone or PC). The application interface displays a form for entering basic trip information (destination, budget, number of people, departure date, and return date). The user enters the necessary information and presses the "Submit" button. In parallel, the emotion engine analyzes the user's facial expressions, voice, and text input to obtain emotion data.

[0615] Step 2:

[0616] The device compiles the information entered by the user and creates an HTTP request to send to the server. This request includes the trip destination, budget, number of people, departure and return dates, and emotional data. Once the request is complete, it is sent to the server.

[0617] Step 3:

[0618] The server analyzes the request received from the user and extracts the basic information and emotion data of the entered trip. The extracted information includes the destination, budget, number of people, departure date, return date, and emotion data. This completes the preparation for the next step of the process.

[0619] Step 4:

[0620] The server sends the analyzed basic information and emotion data as a request to the generation AI module. Upon receiving this request, the generation AI module collects data from social media and rating sites based on the input information and begins analysis.

[0621] Step 5:

[0622] The generative AI module analyzes the collected data and acquired emotional data using statistical methods and machine learning algorithms to generate multiple travel plans that are optimal for the user's emotional state. The generative AI creates at least three travel plans (e.g., Plan A, Plan B, and Plan C).

[0623] Step 6:

[0624] The multiple travel plans generated by the generation AI module are sent back to the server, which analyzes the received travel plans and creates a response to present them to the user.

[0625] Step 7:

[0626] The server sends multiple travel plans to the user as an HTTP response, which includes details of Plan A, Plan B, and Plan C.

[0627] Step 8:

[0628] The terminal displays multiple travel plans received from the server to the user, who then checks the details of each plan and considers which one is most suitable.

[0629] Step 9:

[0630] The user selects the most attractive plan from the multiple plans presented and presses the "Confirm" button. This selection operation sends information about the selected travel plan to the server.

[0631] Step 10:

[0632] The server analyzes the selected plan information received from the user and identifies the necessary reservation procedures, including airfare, accommodation, and restaurant reservations.

[0633] Step 11:

[0634] The server connects to each reservation API and partner system to automate each reservation procedure. After connecting, the server sends reservation requests and completes the necessary reservations.

[0635] Step 12:

[0636] Once all booking procedures are completed, the server compiles the booking confirmation and related ticket information into a response to notify the user.

[0637] Step 13:

[0638] The server sends a response to the user's terminal, including a reservation completion notice and ticket information. The user confirms the reservation on the terminal and confirms that the travel plan is complete.

[0639] Specific examples

[0640] For example, when a user plans a trip to Tokyo, the following steps are performed. First, the user enters and submits information such as "Tokyo," "100,000 yen," "2 people," "November 10, 2023," and "November 15, 2023." In parallel, the emotion engine analyzes the user's facial expressions and voice to obtain emotional data. The server receives this information and requests analysis from the generative AI module. Based on data from social media and review sites and the emotional data, the generative AI module creates a travel plan (Plan A) that includes a visit to Sensoji Temple and Tokyo Skytree and dinner in Ginza, and a travel plan (Plan B) that includes a visit to Ueno Zoo and Tokyo Tower and shopping in Shibuya. These plans are presented to the user, and the user selects Plan B. Based on Plan B, the server automatically arranges airfare, reserves admission tickets to Ueno Zoo, arranges tickets to the Tokyo Tower observation deck, and generates a shopping mall guide, and notifies the user that all reservations are complete. Because the plan is based on emotional data, it provides a plan that will result in higher user satisfaction.

[0641] Example 2

[0642] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0643] Conventional travel plan creation systems generate travel plans based on basic user information (destination, budget, number of people, departure date, return date), but because they do not take the user's emotional state into account, it is difficult to maximize user satisfaction. Furthermore, there is also the issue of not guaranteeing that the reservation process will be carried out appropriately based on the user's selections, even when automating the reservation process.

[0644] The specification process by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for the user to input the travel destination, budget, number of people, departure date, and return date, means for receiving the input information including the user's emotional data, a generation AI module means for generating a travel plan based on the received information and emotional data, means for returning multiple plans generated by the generation AI module to the user, means for the user to select one of the multiple plans, means for automatically performing the necessary reservation procedures based on the selected plan, and means for notifying the completion of the reservation. This enables the generation of a travel plan optimal for the user's emotional state and consistent automatic management of each reservation procedure.

[0645] "User" refers to an individual or organization that uses the travel plan creation agent system.

[0646] A "terminal" is a device such as a smartphone, personal computer, or tablet that is used to access the travel planning agency system.

[0647] A "travel destination" is a geographic location that a user selects as a travel destination.

[0648] A "budget" is a limit on the total amount of expenses a user can spend on a trip.

[0649] "Number of people" is the total number of people participating in the trip.

[0650] "Departure date" is the date on which the user begins their trip.

[0651] The "return date" is the date on which the user returns from their trip.

[0652] "Emotion data" is information that indicates the emotional state of a user analyzed from facial expressions, voice, text input, and the like.

[0653] A "server" is a computer system that receives data sent by users, analyzes, stores, and processes the data in cooperation with other systems.

[0654] The "generative AI module" is an artificial intelligence module that analyzes the received information and emotional data to generate the optimal travel plan.

[0655] A "prompt sentence" is an instruction sentence that instructs the generation AI module to generate a travel plan based on input information.

[0656] A "travel plan" is a detailed travel itinerary that includes tourist attractions, accommodations, restaurants, etc. at a destination.

[0657] The "reservation procedure" refers to the procedure for making reservations for airline tickets, accommodations, restaurants, etc. based on a travel plan.

[0658] "Reservation API" means an application programming interface used to automate the reservation process.

[0659] A "partner system" is a system of an external company or organization that provides travel-related services.

[0660] "Notification" is the act or method of conveying information to a user.

[0661] The present invention relates to a travel plan creation agent system that proposes more optimal travel plans and automates reservation procedures by combining an emotion engine that recognizes user emotions. Detailed embodiments are described below.

[0662] User's initial operation and emotion recognition

[0663] The user launches the "travel planning agent system" application using a device (such as a smartphone or personal computer). The application interface displays a form for entering basic trip information (destination, budget, number of people, departure date, and return date). The user enters this information and presses the "send" button. At the same time, the device's built-in emotion engine analyzes and acquires emotion data from the user's facial expressions, voice, and text input. This emotion engine operates in real time using the user's camera and microphone.

[0664] Receiving and analyzing input information on the server

[0665] The basic travel information and emotion data sent from the device are received by the server. The server analyzes the received data and extracts the necessary information. This information includes the destination, budget, number of people, departure date, return date, and emotion data. Based on this information, the server makes a request to the generation AI module in the next step.

[0666] Generative AI module generates travel plans

[0667] The server sends the analyzed basic information and emotional data to the generation AI module. The generation AI module generates multiple travel plans that best fit the user's emotional state, referencing data from external social media and rating sites. The generation AI module performs its analysis using prompts such as the following:

[0668] "User emotions are excited. Destination is Tokyo, budget is 100,000 yen, number of people is 2, departure date is November 10, 2023, and return date is November 15, 2023. Create the optimal travel plan based on emotions."

[0669] The generated travel plans include information on tourist attractions, accommodations, restaurants, etc., and each travel plan (e.g., Plan A, Plan B, Plan C) has detailed descriptions of its features.

[0670] Presenting and selecting a travel plan

[0671] The generated travel plan is sent to the terminal via the server. The terminal displays detailed information about each plan to the user. The user compares the multiple plans presented and selects the most suitable one. When the "Confirm" button is pressed, information about the selected plan is sent to the server.

[0672] Automatic booking process and notification of booking completion

[0673] The server analyzes the information of the plan selected by the user and identifies the necessary reservation procedures. This analysis includes booking airline tickets, accommodations, and restaurants. The server accesses the appropriate reservation API or partner system and automatically executes the reservation procedures. Once all reservation procedures are completed, the server compiles the reservation confirmation and related ticket information and notifies the user's device. The user can then confirm the reservation on their device.

[0674] Specific examples

[0675] For example, when a user plans a trip to Tokyo, the following operations are performed. The user enters and submits information such as "Tokyo," "100,000 yen," "2 people," "November 10, 2023," and "November 15, 2023." The application uses the camera and microphone to capture emotion data and sends it to the server. The generation AI module analyzes the prompt text and generates multiple travel plans. The generated plans are displayed on the device, and the user selects Plan B. The server automatically reserves flights, accommodation, and restaurants based on Plan B and notifies the user that the reservation is complete.

[0676] The above is a specific embodiment of the "travel plan creation agent system incorporating an emotion engine" of the present invention. This system allows users to easily and efficiently carry out the entire process from outlining their travel plans to booking procedures in a way that is optimized for their emotions.

[0677] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0678] Step 1:

[0679] The user launches the "Travel Planning Agent System" application using a terminal. The application interface displays a form for entering basic information about the trip (destination, budget, number of people, departure date, and return date).

[0680] Input: User's travel information (destination, budget, number of people, departure date, return date)

[0681] Output: Trip information entered by the user

[0682] Step 2:

[0683] The user enters the necessary information and presses the "Send" button. At the same time, the emotion engine uses the device's camera and microphone to analyze the user's facial expressions, voice, and text input to obtain emotional data.

[0684] Input: Click of the send button, user voice and facial expression data

[0685] Output: Emotion data (e.g., excitement, joy, etc.)

[0686] Step 3:

[0687] The device sends travel information and emotion data to the server, which analyzes the received data and extracts the necessary information.

[0688] Input: Travel information, emotion data

[0689] Output: Extracted basic information (destination, budget, number of people, departure date, return date), emotion data

[0690] Step 4:

[0691] The server sends the analysis results to the generation AI module, which generates a prompt sentence and then generates a travel plan based on the prompt sentence.

[0692] Input: Basic information, emotion data

[0693] Output: Prompt sentence to be passed to the generation AI module (e.g., "The user is excited. The destination is Tokyo, the budget is 100,000 yen, the number of people is 2, the departure date is November 10, 2023, and the return date is November 15, 2023. Please create the optimal travel plan based on the user's emotions.")

[0694] Step 5:

[0695] The generative AI module analyzes data from external social media and rating sites based on the prompt text and generates multiple travel plans (e.g., Plan A, Plan B, Plan C).

[0696] Input: prompt statement, external data

[0697] Output: Multiple travel plans (Plan A, Plan B, Plan C)

[0698] Step 6:

[0699] The server sends the generated travel plans to the device, where each plan is displayed on the device interface for the user to compare and consider.

[0700] Input: Travel Plan

[0701] Output: Trip plan displayed on the device

[0702] Step 7:

[0703] The user compares the multiple plans presented and selects the most attractive one. Once the selection is complete, the user presses the "Confirm" button.

[0704] Input: User's plan selection

[0705] Output: Selected plan

[0706] Step 8:

[0707] The terminal sends the selected plan information to the server, which analyzes the information and identifies the necessary reservation procedures.

[0708] Input: Selected travel plan

[0709] Output: Identifying items requiring reservations

[0710] Step 9:

[0711] The server executes the specified reservation procedure, accessing each reservation API and partner company system to automatically complete the reservation procedure.

[0712] Input: Items that require reservation

[0713] Output: Completed booking process

[0714] Step 10:

[0715] After all reservation procedures are completed, the server compiles the reservation confirmation and related ticket information and notifies the user's terminal.

[0716] Input: Completed reservation procedure

[0717] Output: Booking confirmation and ticket information sent to the device

[0718] The above are the specific processing steps in the "travel plan creation agent system combined with an emotion engine."

[0719] (Application example 2)

[0720] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0721] Conventional travel plan creation systems generate travel plans based only on basic information entered by the user, making it difficult to provide an optimal plan based on the user's feelings and preferences. Furthermore, they lacked efficient methods for comparing and considering multiple travel plans at once, and systems for automatically completing reservation procedures. This resulted in low user satisfaction and left the process cumbersome.

[0722] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0723] In this invention, the server includes a means for the user to input the travel destination, budget, number of people, departure date, and return date, a means for acquiring and receiving the user's emotional data, and a means for generating a travel plan based on the received information and emotional data. This makes it possible to generate multiple travel plans that best suit the user's emotional state and allow the user to select one. Furthermore, the server automatically executes the necessary reservation procedures based on the selected plan and notifies the user of completion, thereby improving the efficiency of the procedure and increasing user satisfaction.

[0724] The "means for the user to input the travel destination, budget, number of people, departure date and return date" provides an interface that allows the user to input basic information about the trip into the system.

[0725] "Means for acquiring and receiving user emotional data" refers to a mechanism for analyzing emotions from the user's facial expressions, voice, text, etc., and incorporating that data into the system.

[0726] The "means for generating a travel plan based on received information and emotional data" is a component that has the function of analyzing the basic travel information and emotional data input and automatically generating an optimal travel plan based on that information.

[0727] The "generative AI module" is a module equipped with artificial intelligence that analyzes input data and emotional data from users, and automatically generates multiple optimal travel plans using data from social networking services and rating websites.

[0728] A "social network service" is an online platform that enables users to share information and interact with others via the Internet.

[0729] A "rating website" is a website where users can post ratings and reviews of specific services or products, and other users can use these as a reference.

[0730] A "reservation application program interface" is an interface that allows the reservation system and other application software to communicate with each other and automate the reservation procedure.

[0731] A "cooperating company system" is a reservation management system owned by a provider of various services (air tickets, accommodation, activities, etc.) necessary for implementing a travel plan.

[0732] "Means for automatic execution" are functions or modules designed to allow a program to automatically perform necessary processes or procedures.

[0733] The "means for notifying completion" is a system for notifying the user when the reservation procedure is completed.

[0734] This invention is a travel plan creation agent system that allows users to input basic travel information and emotion data, generates an optimal travel plan based on that information, and automates the reservation procedure. The following describes in detail the system that realizes this application example.

[0735] The system provides an interface on devices such as smartphones and personal computers for users to input their travel destination, budget, number of people, departure date, and return date. When the user inputs this basic information and presses the send button, the device sends the information to a server. At the same time, an emotion engine is used to analyze the user's facial expressions, voice, and text input to obtain emotion data, which is also sent to the server.

[0736] The server analyzes the received basic information and emotional data and sends a request to the generation AI module. The generation AI module analyzes data from social networking services and rating websites to generate multiple travel plans that are optimal for the user's emotional state. The generated travel plans are then sent back to the device via the server.

[0737] The terminal displays the received travel plans to the user, allowing the user to select a plan. The user selects one plan from multiple plans and presses the confirm button. This operation sends the information of the selected plan to the server.

[0738] The server analyzes the information of the selected plan and identifies the necessary reservation procedures, such as reserving airline tickets, accommodations, and restaurants. The server accesses each reservation application program interface and partner company systems to automatically complete the reservation procedures. Once all reservation procedures are complete, the server compiles a reservation confirmation and related ticket information and notifies the user.

[0739] As a specific example of this system, consider a user planning a trip to Tokyo. The user enters and submits information such as "Tokyo," "100,000 yen," "2 people," "November 10, 2023," and "November 15, 2023." The emotion engine analyzes the user's facial expressions and voice and obtains emotional data such as "I want to relax." The server then requests an analysis of this information from a generation AI module. The generation AI module then creates a travel plan (Plan A) that includes a visit to Sensoji Temple and Skytree and dinner in Ginza, and a travel plan (Plan B) that includes a visit to Ueno Zoo and Tokyo Tower and shopping in Shibuya. These plans are presented to the user, and the user selects Plan B. Based on Plan B, the server automatically arranges airfare, reserves admission tickets to Ueno Zoo, arranges tickets to the Tokyo Tower observation deck, and generates a shopping mall guide, and notifies the user that all reservations have been completed.

[0740] Examples of prompts to input to the generative AI model include:

[0741] "Travel Planner API:

[0742] {

[0743] "basic_info": {

[0744] "destination": "Tokyo",

[0745] "budget": 100000,

[0746] "number_of_people": 2,

[0747] "departure_date": "2023-11-10",

[0748] "return_date": "2023-11-15"

[0749] },

[0750] "emotion_data": {

[0751] "emotion": "I want to relax",

[0752] "intensity": "high"

[0753] }

[0754] }"

[0755] There is.

[0756] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0757] Step 1:

[0758] The user (using a smartphone or personal computer) enters the travel destination, budget, number of people, departure date, and return date into the input form and presses the send button. This operation sends basic information from the device to the server. At the same time, the emotion engine analyzes the user's facial expressions, voice, and text input to obtain emotion data.

[0759] (Input) Travel destination, budget, number of people, departure date, return date, user emotional data (facial expression, voice, text)

[0760] (Output) Basic information and emotion data sent to the server

[0761] Step 2:

[0762] The server receives the basic information and emotion data sent from the device. The received data is stored in a database and analyzed as needed. The server analyzes the received data and converts it into the data format required to generate a travel plan.

[0763] (Input) Basic information and emotion data sent

[0764] (Output) Data format for generating travel plans

[0765] Step 3:

[0766] The server then sends a request to the generative AI module based on the converted data. This request includes the user's basic information and emotional data. The generative AI module analyzes data from social networking services and rating websites to generate multiple travel plans that best fit the user's emotional state.

[0767] (Input) Converted data (data format for generating travel plans)

[0768] (Output) Multiple travel plans (Plan A, Plan B, Plan C, etc.)

[0769] Step 4:

[0770] The multiple plans generated by the generation AI module are sent to the server, which analyzes the received plan data and converts it into a data format for sending back to the user.

[0771] (Input) Travel plan data sent from the generation AI module

[0772] (Output) Data format for sending back to the user

[0773] Step 5:

[0774] The terminal receives multiple travel plans sent from the server and displays them to the user. The user compares and considers these plans and selects the most attractive one. When the user presses the select button, information about the selected plan is sent to the server.

[0775] (Input) Multiple travel plans sent from the server

[0776] (Output) User selection information (selected plan)

[0777] Step 6:

[0778] The server receives and analyzes the information of the plan selected by the user. Based on the analyzed information, it identifies items that require reservation and accesses each reservation application program interface or partner company system to automatically carry out the reservation procedure.

[0779] (Input) Information about the plan selected by the user

[0780] (Output) Completed reservation procedures (airline tickets, accommodation, restaurant reservations)

[0781] Step 7:

[0782] Once all the booking procedures are completed, the server compiles the booking confirmation and related ticket information and notifies the user, who can then confirm the booking.

[0783] (Input) Information on completed reservation procedures

[0784] (Output) Reservation confirmation notification and ticket information to the user

[0785] The above is a detailed description of each processing step in this system.

[0786] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0787] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0788] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0789] [Third embodiment]

[0790] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0791] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0792] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0793] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0794] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0795] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0796] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0797] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0798] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0799] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0800] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0801] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0802] Overall system overview

[0803] This invention relates to a travel plan creation agent system in which users simply input basic travel information, and a generation AI analyzes data from social media and review sites to create an optimal travel plan, and then automatically handles the necessary reservation procedures. This system simplifies users' travel planning and allows them to enjoy traveling more easily.

[0804] User's initial operation

[0805] The user launches the "Travel Butler" application using a device (such as a smartphone or PC). The application interface displays a form for entering basic trip information (destination, budget, number of people, departure date, and return date). The user enters the necessary information and presses the "Submit" button.

[0806] Receiving and analyzing input information on the server

[0807] The information sent from the device is received by the server. The server analyzes this information and requests the generation AI module to generate a travel plan. The generation AI module analyzes data from social media and rating sites and generates multiple travel plans (e.g., Plan A, Plan B, Plan C).

[0808] Generate a travel plan and present it to the user

[0809] The generated travel plans are sent to the terminal via the server. The terminal receives them and displays the details of each plan to the user. The travel plans include information on tourist spots, accommodations, restaurants, etc., and the features of each plan are presented in an easy-to-understand manner.

[0810] User selection and confirmation

[0811] The user compares and considers the multiple plans presented and selects the most attractive one. Once the selection is complete, the user presses the "Confirm" button. This operation sends the information of the selected travel plan to the server.

[0812] Execute automatic reservation procedures

[0813] The server analyzes the information of the plan selected by the user and identifies the necessary reservations (e.g., plane tickets, accommodations, restaurants). For each reservation, it accesses the appropriate reservation API or partner system and automatically processes the reservation.

[0814] Notification of reservation completion

[0815] Once all the booking procedures are completed, the server compiles the booking confirmation and related ticket information and notifies the user, who can then confirm the booking.

[0816] Specific examples

[0817] For example, when a user plans a trip to Tokyo, the following operations are performed. First, the user enters and submits information such as "Tokyo," "100,000 yen," "2 people," "November 10, 2023," and "November 15, 2023." The server receives this information and requests analysis from the generation AI module. Based on data from social media and review sites, the generation AI module creates a travel plan (Plan A) that includes a visit to Sensoji Temple and Skytree and dinner in Ginza, and a travel plan (Plan B) that includes a visit to Ueno Zoo and Tokyo Tower and shopping in Shibuya. These plans are presented to the user, and the user selects Plan B. Based on Plan B, the server automatically arranges airfare, reserves admission tickets to Ueno Zoo, arranges tickets to the Tokyo Tower observation deck, and generates a shopping mall guide, and notifies the user that all reservations are complete. In this way, the user can complete their travel planning without any complicated procedures.

[0818] The above is an embodiment of the "travel plan creation agent system" of the present invention. This system allows users to easily and efficiently complete a series of procedures from planning a trip to making reservations.

[0819] The processing flow will be explained below.

[0820] Step 1:

[0821] The user launches the "Travel Butler" application using a device (such as a smartphone or PC). The application interface displays a form for entering basic trip information (destination, budget, number of people, departure date, and return date). The user enters the necessary information and presses the "Submit" button.

[0822] Step 2:

[0823] The device compiles the information entered by the user and creates an HTTP request to send to the server. This request includes the trip destination, budget, number of people, departure date, and return date. Once the request is complete, it is sent to the server.

[0824] Step 3:

[0825] The server analyzes the request received from the user and extracts basic information about the trip, including the destination, budget, number of people, departure date, and return date, and is then ready to proceed to the next step.

[0826] Step 4:

[0827] The server sends the analyzed basic information as a request to the generation AI module. Upon receiving this request, the generation AI module collects data from social media and rating sites based on the input information and begins analysis.

[0828] Step 5:

[0829] The generative AI module analyzes the collected data using statistical methods and machine learning algorithms to generate multiple optimal travel plans. This generation process includes information on tourist attractions, accommodations, restaurants, etc. The generative AI creates at least three travel plans (e.g., Plan A, Plan B, and Plan C).

[0830] Step 6:

[0831] The multiple travel plans generated by the generation AI module are sent back to the server, which analyzes the received travel plans and creates a response to present them to the user.

[0832] Step 7:

[0833] The server sends multiple travel plans to the user as an HTTP response, which includes details of Plan A, Plan B, and Plan C.

[0834] Step 8:

[0835] The terminal displays multiple travel plans received from the server to the user, who then checks the details of each plan and considers which one is most suitable.

[0836] Step 9:

[0837] The user selects the most attractive plan from the multiple plans presented and presses the "Confirm" button. This selection operation sends information about the selected travel plan to the server.

[0838] Step 10:

[0839] The server analyzes the selected plan information received from the user and identifies the necessary reservation procedures, including airfare, accommodation, and restaurant reservations.

[0840] Step 11:

[0841] The server connects to each reservation API and partner system to automate each reservation procedure. After connecting, the server sends reservation requests and completes the necessary reservations.

[0842] Step 12:

[0843] Once all booking procedures are completed, the server compiles the booking confirmation and related ticket information into a response to notify the user.

[0844] Step 13:

[0845] The server sends a response to the user's terminal, including a reservation completion notice and ticket information. The user confirms the reservation on the terminal and confirms that the travel plan is complete.

[0846] This is the specific process flow of the "Travel Butler" travel planning agent system. At each step, the user, device, and server play different roles, working together to automate the entire process from planning to booking a trip.

[0847] Example 1

[0848] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0849] Current travel planning is complex and time-consuming, requiring a lot of effort. Users must create an optimal plan based on basic information such as the destination, budget, number of people, and departure and return dates, and then make all the necessary reservations individually. This creates a need for a way to simplify and streamline travel planning.

[0850] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0851] In this invention, the server includes: means for a user to input a travel destination, budget, number of people, departure date, and return date; an information processing device that receives the input information; machine learning module means that generates a travel plan based on the received information; means for returning multiple plans generated by the machine learning module to the user; means for the user to select one of the multiple plans; service linkage means that automatically executes the necessary reservation procedures based on the selected plan; and display means that notifies the user that the reservation is complete. This enables the user to simply and efficiently complete a series of travel planning and reservation procedures.

[0852] A "user" is an individual or group that inputs basic information such as the travel destination, budget, number of people, departure date, and return date, and selects and confirms a travel plan.

[0853] An "information processing device" is a device that receives and analyzes information sent from a user, and includes a server or cloud computer that generates travel plans and executes various reservation procedures.

[0854] "Machine learning module" refers to an algorithm or program that analyzes data from social media and rating sites based on the information it receives and generates optimal travel plans.

[0855] "Social media" means online platforms for user communication, including sites and applications where travel reviews and opinions are posted.

[0856] A "review site" refers to a website where users can rate specific travel destinations or services and provide the data necessary to generate travel plans.

[0857] The "service linking means" is a means for connecting to various reservation application program interfaces and partner systems in order to automatically execute the necessary reservation procedures based on the travel plan.

[0858] "Display means" refers to a method for notifying the user that the reservation procedure has been completed, and includes an interface or notification function that is visually displayed on the user's terminal.

[0859] System Overview

[0860] The travel plan creation agent system of this invention is a system in which users simply input basic travel information, and a generative AI model analyzes data from social media and review sites to create an optimal travel plan, and then automatically handles the necessary reservation procedures. Users interface with the system using devices such as smartphones or personal computers.

[0861] User operations

[0862] The user installs the "Travel Butler" application and launches it. The application interface displays a form for entering the travel destination, budget, number of people, departure date, and return date. The user enters the necessary information and presses the "Submit" button to send the information to the server. For example, the user enters the following:

[0863] Please tell me your plans for a trip to Tokyo. The budget is 100,000 yen, there are two people, the departure date is November 10, 2023, and the return date is November 15, 2023.

[0864] Information analysis on the server

[0865] The information sent from the device reaches the server via the Internet. The server is a high-performance information processing device that utilizes technologies such as Python and Django. The server analyzes the received information and sends a request to the generation AI module to generate a travel plan.

[0866] Generate a travel plan

[0867] The generative AI model collects and analyzes data from social media and rating sites. It uses BeautifulSoup and Scrapy as scraping tools and natural language processing (NLP) techniques for analysis. The generated travel plans are presented to the user as multiple options.

[0868] Presenting your travel plan

[0869] The server sends the generated travel plan to the user's device. The device receives it and displays the details of each plan. For example, the following plan is presented to the user:

[0870] Plan A: Visit Sensoji Temple and Skytree, and dinner in Ginza

[0871] Plan B: Visit Ueno Zoo, Tokyo Tower, and shopping in Shibuya

[0872] User selection of plan

[0873] The user compares and considers the plans presented and selects the most attractive one. Once the selection is complete, the user presses the "Confirm" button and sends the information of the selected plan to the server.

[0874] Automated booking process

[0875] The server analyzes the information of the plan selected by the user and accesses various reservation application program interfaces (APIs) to automate the necessary reservation procedures, such as reserving airline tickets, accommodations, and restaurants.

[0876] Notification of reservation completion

[0877] Once all reservation procedures are complete, the server compiles the reservation confirmation information and notifies the user's device, where the user can confirm the completion of the reservation and smoothly prepare for their trip.

[0878] Specific examples

[0879] For example, when a user plans a trip to Tokyo, they perform the following operations. The user enters and submits the information "Tokyo," "100,000 yen," "2 people," "November 10, 2023," and "November 15, 2023." Based on this, the generation AI module generates and presents Plan A, which includes visiting Sensoji Temple and Skytree, and Plan B, which includes visiting Ueno Zoo and Tokyo Tower. If the user selects Plan B, the server automatically performs the necessary reservation procedures and notifies the user once they are complete.

[0880] The above is an embodiment of the "Travel Planning Agent System" of the present invention. This system allows users to easily plan and book their trips, further enhancing their travel experience.

[0881] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0882] Step 1:

[0883] The user launches the "Travel Butler" application on their smartphone or personal computer. The application displays an interface for user input and provides a form for entering basic trip information (destination, budget, number of people, departure date, and return date). The user enters this information and presses the "Submit" button.

[0884] Input: Destination, budget, number of people, departure date, return date

[0885] Output: Request to send input information

[0886] Step 2:

[0887] The device packages the information entered by the user and sends it over the internet to a server, using the HTTPS protocol to ensure data security.

[0888] Input: Request to send input information

[0889] Output: Send data to the server

[0890] Step 3:

[0891] The server analyzes the data received from the device. The technologies used here are Python scripts and the Django framework. The server decodes the received JSON format data and extracts the necessary information. Then, based on the analysis results, it sends a request to the generative AI model to generate a travel plan.

[0892] Input: Send data to the server

[0893] Output: Travel plan generation request

[0894] Step 4:

[0895] The generative AI model collects relevant data from social media and review sites using web scraping tools like BeautifulSoup and Scrapy, and analyzes it using natural language processing (NLP) techniques. The resulting itinerary includes lists of tourist attractions, accommodations, and restaurants.

[0896] Input: Travel plan generation request

[0897] Output: Generated itinerary (Plan A, Plan B, Plan C)

[0898] Step 5:

[0899] The server sends the generated travel plan to the device, which receives it and displays the plan details to the user in a visually easy-to-understand format using HTML and CSS.

[0900] Input: Generated itinerary

[0901] Output: Plan details

[0902] Step 6:

[0903] The user compares and considers the multiple travel plans presented and selects the most attractive one. Once the selection is complete, the user presses the "Confirm" button and the information about the selected plan is sent to the server.

[0904] Input: Plan details

[0905] Output: Notification of selected plan

[0906] Step 7:

[0907] The server analyzes the information of the plan selected by the user. As a result of the analysis, it identifies the necessary reservation procedures and automatically performs the reservation procedures by accessing various reservation APIs and partner systems. Examples include reservations for airline tickets, accommodations, and restaurants.

[0908] Input: Confirmation of selected plan

[0909] Output: Reservation request

[0910] Step 8:

[0911] Once all the reservation procedures are completed, the server compiles the reservation confirmation information. The server sends this information to the user's device and notifies the user that the reservation is complete. The device receives the notification and displays it visually to the user.

[0912] Input: Reservation request

[0913] Output: Reservation completion notification

[0914] This is the specific program processing flow of the travel plan creation agent system. This system allows users to easily create travel plans and automatically complete the necessary reservation procedures.

[0915] (Application example 1)

[0916] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0917] The process of planning and booking a trip is complicated and time-consuming, which can be frustrating for many users. It's also not easy to find photo spots, video guides, or blog post ideas while traveling. There's a need to efficiently solve these problems and enable users to enjoy their trips more.

[0918] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0919] In this invention, the server includes: means for a user to input a travel destination, budget, number of people, departure date, and return date; a server that receives the input information; a generation AI module that generates a travel plan based on the received information; a means for returning multiple plans generated by the generation AI module to the user; a means for the user to select one of the multiple plans; a means for automatically performing the necessary reservation procedures based on the selected plan; a means for notifying the user that the reservation is complete; and a means for suggesting photo spots, video guides, and ideas for blog posts based on the user's location information. This makes it possible to perform all processes, from planning a trip to the reservation procedures and support for creating content during the trip, all in one place.

[0920] A "travel destination" is a place where a user wishes to travel.

[0921] A "budget" is the total amount of money available for travel.

[0922] "Number of people" is the total number of people participating in the trip.

[0923] "Departure Date" means the date on which a trip begins.

[0924] The "return date" is the date on which you plan to return home after your trip ends.

[0925] "Means" refers to the methods or techniques used to achieve a particular goal.

[0926] The "server that receives the input information" is a server that receives basic information about the trip that the user inputs.

[0927] "Generative AI module means" means a module that uses artificial intelligence techniques to generate a travel plan based on received information.

[0928] "Generating a travel plan" means making a travel plan based on the information entered by the user.

[0929] "Multiple plans" refers to travel plans with multiple options presented to the user.

[0930] "Means for automatically performing the necessary reservation procedures based on the selected plan" refers to methods or technologies that enable the automatic making of necessary reservations (e.g., transportation, accommodation, etc.) based on the travel plan selected by the user.

[0931] The "means for notifying the user that the reservation has been completed" is a means for notifying the user that all reservation procedures have been completed.

[0932] "Location information" is geographical information about the user's current location.

[0933] A "photo spot" refers to a place suitable for taking photos.

[0934] A "videography guide" provides advice and guidance for videography.

[0935] "Blog Post Ideas" are suggestions for topics and content for users to create blog posts about while traveling.

[0936] This invention relates to a travel plan creation agent system, in which a user simply inputs basic travel information, and a generation AI generates an optimal travel plan and automatically performs the necessary reservation procedures.

[0937] Overall system overview

[0938] The purpose of this system is to simplify users' travel planning and provide a consistent process from planning to booking, as well as support for content creation during the trip.The main components of the system are the user's device, a server, a generation AI module, a reservation API, and a content generation support tool.

[0939] User's initial operation

[0940] The user launches the "Travel Butler" application using a device (such as a smartphone or PC). The application interface displays a form for entering basic trip information (destination, budget, number of people, departure date, and return date). The user enters the necessary information and presses the "Submit" button.

[0941] Receiving and analyzing input information on the server

[0942] The information sent from the device is received by the server. The server analyzes this information and requests the generation AI module to generate a travel plan. The generation AI module analyzes data from social media and rating sites and generates multiple travel plans (e.g., Plan A, Plan B, Plan C).

[0943] Generate a travel plan and present it to the user

[0944] The generated travel plans are sent to the terminal via the server. The terminal receives them and displays the details of each plan to the user. The travel plans include information on tourist spots, accommodations, restaurants, etc., and the features of each plan are presented in an easy-to-understand manner.

[0945] User selection and confirmation

[0946] The user compares and considers the multiple plans presented and selects the most attractive one. Once the selection is complete, the user presses the "Confirm" button. This operation sends the information of the selected travel plan to the server.

[0947] Execute automatic reservation procedures

[0948] The server analyzes the information of the plan selected by the user and identifies the necessary reservations (e.g., plane tickets, accommodations, restaurants). For each reservation, it accesses the appropriate reservation API or partner system and automatically processes the reservation.

[0949] Notification of reservation completion

[0950] Once all the booking procedures are completed, the server compiles the booking confirmation and related ticket information and notifies the user, who can then confirm the booking.

[0951] Content Creation Support

[0952] Additionally, a content generation support tool will be activated that will provide photo spots, video shooting guides, and blog post ideas based on the location information of places the user visits during their trip. This tool will analyze the collected location information and suggest appropriate content.

[0953] For example, when a user plans a trip to Tokyo, the following steps are performed. First, the user enters and submits information such as "Tokyo," "100,000 yen," "2 people," "November 10, 2023," and "November 15, 2023." The server receives this information and requests analysis from the generation AI module. Based on data from social media and review sites, the generation AI module creates a travel plan that includes visiting Sensoji Temple and Tokyo Skytree, dinner in Ginza, and visiting Ueno Zoo and Tokyo Tower, and shopping in Shibuya. These plans are presented to the user, who selects Plan B. Based on Plan B, the server automatically arranges airfare, reserves admission tickets to Ueno Zoo, and arranges tickets to the Tokyo Tower observation deck, and generates a shopping mall guide. The server then notifies the user that all reservations are complete. Furthermore, when visiting Tokyo Skytree during the trip, the server also provides suitable photo spots, video guides, and blog post ideas.

[0954] In this way, the user can complete the travel plan without complicated procedures and enjoy the trip. Specific examples of prompt sentences are shown below.

[0955] Example prompt sentence:

[0956] "I want to create an app that generates travel plans for Tokyo, automates bookings, and helps me create content while traveling."

[0957] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0958] Step 1:

[0959] The user enters basic information about the trip. Using the application interface, the user enters the destination, budget, number of people, departure date, and return date, and then presses the "Submit" button. The application sends the entered information to the server.

[0960] Step 2:

[0961] The server receives the input information. The server receives the basic trip information (destination, budget, number of people, departure date, and return date) sent by the user and stores it in a database. It then analyzes this information and prepares it for making a request to the generation AI module.

[0962] Step 3:

[0963] The generative AI module generates a travel plan. The server sends a request to the generative AI model based on the received information. The generative AI model analyzes data from social media and rating sites to generate multiple travel plans (e.g., Plan A, Plan B, Plan C). This generation process calculates the optimal combination of tourist attractions, accommodations, restaurants, etc. based on the input information.

[0964] Step 4:

[0965] The generated plan is sent to the user. The server receives multiple travel plans returned from the generation AI module and sends them to the user's device. The details of each plan are displayed on the user's device, allowing the user to compare them.

[0966] Step 5:

[0967] The user selects a travel plan. The user compares the presented travel plans and selects the most attractive one. Information about the selected plan is then sent from the terminal to the server.

[0968] Step 6:

[0969] The server automatically performs the reservation procedure. The server analyzes the detailed information of the plan selected by the user and automatically makes the necessary reservations (e.g., plane tickets, accommodation, restaurant). The server accesses each reservation API and partner company system and performs the necessary reservation procedures.

[0970] Step 7:

[0971] A reservation completion notification is sent to the user. Once all reservation procedures are completed, the server compiles the reservation confirmation and related ticket information and sends a notification to the user's device, allowing the user to confirm that the reservation was successfully completed.

[0972] Step 8:

[0973] Supports content creation during travel. Based on location information of places the user visits during their trip, the server suggests photo spots, video shooting guides, and blog post ideas. In this process, the server receives the user's current location information and supports the creation of appropriate content based on that information. These suggestions are displayed on the user's device, supporting content creation during their trip.

[0974] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0975] Overall system overview

[0976] This invention relates to a travel plan creation agent system that proposes more optimal travel plans and automates the booking process by combining an emotion engine that recognizes the user's emotions. By using emotion data in addition to inputting basic travel information, the system can propose travel plans that are more suited to the user's emotional state.

[0977] User's initial operation and emotion recognition

[0978] The user launches the "Travel Butler" application using a device (such as a smartphone or PC). The application interface displays a form for entering basic trip information (destination, budget, number of people, departure date, and return date). The user enters the necessary information and presses the "Submit" button. In parallel, the emotion engine analyzes the user's facial expressions, voice, and text input to obtain emotional data.

[0979] Receiving and analyzing input information on the server

[0980] The information sent from the device is received by the server. The server analyzes this information and extracts basic information about the entered trip and emotional data from the emotion engine. The extracted information includes the destination, budget, number of people, departure date, return date, emotional data, etc.

[0981] Generative AI module generates travel plans

[0982] The server sends the analyzed basic information and emotional data as a request to the generation AI module. The generation AI module begins analysis based on data from social media and rating sites and the acquired emotional data, and generates multiple travel plans that are optimal for the user's emotional state (e.g., Plan A, Plan B, Plan C).

[0983] Generate a travel plan and present it to the user

[0984] The generated travel plans are sent to the terminal via the server. The terminal receives them and displays the details of each plan to the user. The travel plans include information on tourist spots, accommodations, restaurants, etc., and the features of each plan are presented in an easy-to-understand manner.

[0985] User selection and confirmation

[0986] The user compares and considers the multiple plans presented and selects the most attractive one. Once the selection is complete, the user presses the "Confirm" button. This operation sends the information of the selected travel plan to the server.

[0987] Execute automatic reservation procedures

[0988] The server analyzes the information of the plan selected by the user and identifies the necessary reservation procedures. This analysis includes booking airline tickets, accommodations, and restaurants. For each reservation, the server accesses the appropriate reservation API or partner system and automatically completes the reservation procedures.

[0989] Notification of reservation completion

[0990] Once all the booking procedures are completed, the server compiles the booking confirmation and related ticket information and notifies the user, who can then confirm the booking.

[0991] Specific examples

[0992] For example, when a user plans a trip to Tokyo, the following steps are performed. First, the user enters and submits information such as "Tokyo," "100,000 yen," "2 people," "November 10, 2023," and "November 15, 2023." In parallel, the emotion engine analyzes the user's facial expressions and voice to obtain emotional data. The server receives this information and requests analysis from the generative AI module. Based on data from social media and review sites and the emotional data, the generative AI module creates a travel plan (Plan A) that includes a visit to Sensoji Temple and Tokyo Skytree and dinner in Ginza, and a travel plan (Plan B) that includes a visit to Ueno Zoo and Tokyo Tower and shopping in Shibuya. These plans are presented to the user, and the user selects Plan B. Based on Plan B, the server automatically arranges airfare, reserves admission tickets to Ueno Zoo, arranges tickets to the Tokyo Tower observation deck, and generates a shopping mall guide, and notifies the user that all reservations are complete. Because the plan is based on emotional data, it provides a plan that will result in higher user satisfaction.

[0993] The above is an embodiment of the "travel plan creation agent system incorporating an emotion engine." This system allows users to easily and efficiently carry out a series of procedures from planning to booking a trip in a way that is optimized based on their emotions.

[0994] The processing flow will be explained below.

[0995] Step 1:

[0996] The user launches the "Travel Butler" application using a device (such as a smartphone or PC). The application interface displays a form for entering basic trip information (destination, budget, number of people, departure date, and return date). The user enters the necessary information and presses the "Submit" button. In parallel, the emotion engine analyzes the user's facial expressions, voice, and text input to obtain emotion data.

[0997] Step 2:

[0998] The device compiles the information entered by the user and creates an HTTP request to send to the server. This request includes the trip destination, budget, number of people, departure and return dates, and emotional data. Once the request is complete, it is sent to the server.

[0999] Step 3:

[1000] The server analyzes the request received from the user and extracts the basic information and emotion data of the entered trip. The extracted information includes the destination, budget, number of people, departure date, return date, and emotion data. This completes the preparation for the next step of the process.

[1001] Step 4:

[1002] The server sends the analyzed basic information and emotion data as a request to the generation AI module. Upon receiving this request, the generation AI module collects data from social media and rating sites based on the input information and begins analysis.

[1003] Step 5:

[1004] The generative AI module analyzes the collected data and acquired emotional data using statistical methods and machine learning algorithms to generate multiple travel plans that are optimal for the user's emotional state. The generative AI creates at least three travel plans (e.g., Plan A, Plan B, and Plan C).

[1005] Step 6:

[1006] The multiple travel plans generated by the generation AI module are sent back to the server, which analyzes the received travel plans and creates a response to present them to the user.

[1007] Step 7:

[1008] The server sends multiple travel plans to the user as an HTTP response, which includes details of Plan A, Plan B, and Plan C.

[1009] Step 8:

[1010] The terminal displays multiple travel plans received from the server to the user, who then checks the details of each plan and considers which one is most suitable.

[1011] Step 9:

[1012] The user selects the most attractive plan from the multiple plans presented and presses the "Confirm" button. This selection operation sends information about the selected travel plan to the server.

[1013] Step 10:

[1014] The server analyzes the selected plan information received from the user and identifies the necessary reservation procedures, including airfare, accommodation, and restaurant reservations.

[1015] Step 11:

[1016] The server connects to each reservation API and partner system to automate each reservation procedure. After connecting, the server sends reservation requests and completes the necessary reservations.

[1017] Step 12:

[1018] Once all booking procedures are completed, the server compiles the booking confirmation and related ticket information into a response to notify the user.

[1019] Step 13:

[1020] The server sends a response to the user's terminal, including a reservation completion notice and ticket information. The user confirms the reservation on the terminal and confirms that the travel plan is complete.

[1021] Specific examples

[1022] For example, when a user plans a trip to Tokyo, the following steps are performed. First, the user enters and submits information such as "Tokyo," "100,000 yen," "2 people," "November 10, 2023," and "November 15, 2023." In parallel, the emotion engine analyzes the user's facial expressions and voice to obtain emotional data. The server receives this information and requests analysis from the generative AI module. Based on data from social media and review sites and the emotional data, the generative AI module creates a travel plan (Plan A) that includes a visit to Sensoji Temple and Tokyo Skytree and dinner in Ginza, and a travel plan (Plan B) that includes a visit to Ueno Zoo and Tokyo Tower and shopping in Shibuya. These plans are presented to the user, and the user selects Plan B. Based on Plan B, the server automatically arranges airfare, reserves admission tickets to Ueno Zoo, arranges tickets to the Tokyo Tower observation deck, and generates a shopping mall guide, and notifies the user that all reservations are complete. Because the plan is based on emotional data, it provides a plan that will result in higher user satisfaction.

[1023] Example 2

[1024] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1025] Conventional travel plan creation systems generate travel plans based on basic user information (destination, budget, number of people, departure date, return date), but because they do not take the user's emotional state into account, it is difficult to maximize user satisfaction. Furthermore, there is also the issue of not guaranteeing that the reservation process will be carried out appropriately based on the user's selections, even when automating the reservation process.

[1026] The specification process by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for the user to input the travel destination, budget, number of people, departure date, and return date, means for receiving the input information including the user's emotional data, a generation AI module means for generating a travel plan based on the received information and emotional data, means for returning multiple plans generated by the generation AI module to the user, means for the user to select one of the multiple plans, means for automatically performing the necessary reservation procedures based on the selected plan, and means for notifying the completion of the reservation. This enables the generation of a travel plan optimal for the user's emotional state and consistent automatic management of each reservation procedure.

[1027] "User" refers to an individual or organization that uses the travel plan creation agent system.

[1028] A "terminal" is a device such as a smartphone, personal computer, or tablet that is used to access the travel planning agency system.

[1029] A "travel destination" is a geographic location that a user selects as a travel destination.

[1030] A "budget" is a limit on the total amount of expenses a user can spend on a trip.

[1031] "Number of people" is the total number of people participating in the trip.

[1032] "Departure date" is the date on which the user begins their trip.

[1033] The "return date" is the date on which the user returns from their trip.

[1034] "Emotion data" is information that indicates the emotional state of a user analyzed from facial expressions, voice, text input, and the like.

[1035] A "server" is a computer system that receives data sent by users, analyzes, stores, and processes the data in cooperation with other systems.

[1036] The "generative AI module" is an artificial intelligence module that analyzes the received information and emotional data to generate the optimal travel plan.

[1037] A "prompt sentence" is an instruction sentence that instructs the generation AI module to generate a travel plan based on input information.

[1038] A "travel plan" is a detailed travel itinerary that includes tourist attractions, accommodations, restaurants, etc. at a destination.

[1039] The "reservation procedure" refers to the procedure for making reservations for airline tickets, accommodations, restaurants, etc. based on a travel plan.

[1040] "Reservation API" means an application programming interface used to automate the reservation process.

[1041] A "partner system" is a system of an external company or organization that provides travel-related services.

[1042] "Notification" is the act or method of conveying information to a user.

[1043] The present invention relates to a travel plan creation agent system that proposes more optimal travel plans and automates reservation procedures by combining an emotion engine that recognizes user emotions. Detailed embodiments are described below.

[1044] User's initial operation and emotion recognition

[1045] The user launches the "travel planning agent system" application using a device (such as a smartphone or personal computer). The application interface displays a form for entering basic trip information (destination, budget, number of people, departure date, and return date). The user enters this information and presses the "send" button. At the same time, the device's built-in emotion engine analyzes and acquires emotion data from the user's facial expressions, voice, and text input. This emotion engine operates in real time using the user's camera and microphone.

[1046] Receiving and analyzing input information on the server

[1047] The basic travel information and emotion data sent from the device are received by the server. The server analyzes the received data and extracts the necessary information. This information includes the destination, budget, number of people, departure date, return date, and emotion data. Based on this information, the server makes a request to the generation AI module in the next step.

[1048] Generative AI module generates travel plans

[1049] The server sends the analyzed basic information and emotional data to the generation AI module. The generation AI module generates multiple travel plans that best fit the user's emotional state, referencing data from external social media and rating sites. The generation AI module performs its analysis using prompts such as the following:

[1050] "User emotions are excited. Destination is Tokyo, budget is 100,000 yen, number of people is 2, departure date is November 10, 2023, and return date is November 15, 2023. Create the optimal travel plan based on emotions."

[1051] The generated travel plans include information on tourist attractions, accommodations, restaurants, etc., and each travel plan (e.g., Plan A, Plan B, Plan C) has detailed descriptions of its features.

[1052] Presenting and selecting a travel plan

[1053] The generated travel plan is sent to the terminal via the server. The terminal displays detailed information about each plan to the user. The user compares the multiple plans presented and selects the most suitable one. When the "Confirm" button is pressed, information about the selected plan is sent to the server.

[1054] Automatic booking process and notification of booking completion

[1055] The server analyzes the information of the plan selected by the user and identifies the necessary reservation procedures. This analysis includes booking airline tickets, accommodations, and restaurants. The server accesses the appropriate reservation API or partner system and automatically executes the reservation procedures. Once all reservation procedures are completed, the server compiles the reservation confirmation and related ticket information and notifies the user's device. The user can then confirm the reservation on their device.

[1056] Specific examples

[1057] For example, when a user plans a trip to Tokyo, the following operations are performed. The user enters and submits information such as "Tokyo," "100,000 yen," "2 people," "November 10, 2023," and "November 15, 2023." The application uses the camera and microphone to capture emotion data and sends it to the server. The generation AI module analyzes the prompt text and generates multiple travel plans. The generated plans are displayed on the device, and the user selects Plan B. The server automatically reserves flights, accommodation, and restaurants based on Plan B and notifies the user that the reservation is complete.

[1058] The above is a specific embodiment of the "travel plan creation agent system incorporating an emotion engine" of the present invention. This system allows users to easily and efficiently carry out the entire process from outlining their travel plans to booking procedures in a way that is optimized for their emotions.

[1059] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1060] Step 1:

[1061] The user launches the "Travel Planning Agent System" application using a terminal. The application interface displays a form for entering basic information about the trip (destination, budget, number of people, departure date, and return date).

[1062] Input: User's travel information (destination, budget, number of people, departure date, return date)

[1063] Output: Trip information entered by the user

[1064] Step 2:

[1065] The user enters the necessary information and presses the "Send" button. At the same time, the emotion engine uses the device's camera and microphone to analyze the user's facial expressions, voice, and text input to obtain emotional data.

[1066] Input: Click of the send button, user voice and facial expression data

[1067] Output: Emotion data (e.g., excitement, joy, etc.)

[1068] Step 3:

[1069] The device sends travel information and emotion data to the server, which analyzes the received data and extracts the necessary information.

[1070] Input: Travel information, emotion data

[1071] Output: Extracted basic information (destination, budget, number of people, departure date, return date), emotion data

[1072] Step 4:

[1073] The server sends the analysis results to the generation AI module, which generates a prompt sentence and then generates a travel plan based on the prompt sentence.

[1074] Input: Basic information, emotion data

[1075] Output: Prompt sentence to be passed to the generation AI module (e.g., "The user is excited. The destination is Tokyo, the budget is 100,000 yen, the number of people is 2, the departure date is November 10, 2023, and the return date is November 15, 2023. Please create the optimal travel plan based on the user's emotions.")

[1076] Step 5:

[1077] The generative AI module analyzes data from external social media and rating sites based on the prompt text and generates multiple travel plans (e.g., Plan A, Plan B, Plan C).

[1078] Input: prompt statement, external data

[1079] Output: Multiple travel plans (Plan A, Plan B, Plan C)

[1080] Step 6:

[1081] The server sends the generated travel plans to the device, where each plan is displayed on the device interface for the user to compare and consider.

[1082] Input: Travel Plan

[1083] Output: Trip plan displayed on the device

[1084] Step 7:

[1085] The user compares the multiple plans presented and selects the most attractive one. Once the selection is complete, the user presses the "Confirm" button.

[1086] Input: User's plan selection

[1087] Output: Selected plan

[1088] Step 8:

[1089] The terminal sends the selected plan information to the server, which analyzes the information and identifies the necessary reservation procedures.

[1090] Input: Selected travel plan

[1091] Output: Identifying items requiring reservations

[1092] Step 9:

[1093] The server executes the specified reservation procedure, accessing each reservation API and partner company system to automatically complete the reservation procedure.

[1094] Input: Items that require reservation

[1095] Output: Completed booking process

[1096] Step 10:

[1097] After all reservation procedures are completed, the server compiles the reservation confirmation and related ticket information and notifies the user's terminal.

[1098] Input: Completed reservation procedure

[1099] Output: Booking confirmation and ticket information sent to the device

[1100] The above are the specific processing steps in the "travel plan creation agent system combined with an emotion engine."

[1101] (Application example 2)

[1102] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1103] Conventional travel plan creation systems generate travel plans based only on basic information entered by the user, making it difficult to provide an optimal plan based on the user's feelings and preferences. Furthermore, they lacked efficient methods for comparing and considering multiple travel plans at once, and systems for automatically completing reservation procedures. This resulted in low user satisfaction and left the process cumbersome.

[1104] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1105] In this invention, the server includes a means for the user to input the travel destination, budget, number of people, departure date, and return date, a means for acquiring and receiving the user's emotional data, and a means for generating a travel plan based on the received information and emotional data. This makes it possible to generate multiple travel plans that best suit the user's emotional state and allow the user to select one. Furthermore, the server automatically executes the necessary reservation procedures based on the selected plan and notifies the user of completion, thereby improving the efficiency of the procedure and increasing user satisfaction.

[1106] The "means for the user to input the travel destination, budget, number of people, departure date and return date" provides an interface that allows the user to input basic information about the trip into the system.

[1107] "Means for acquiring and receiving user emotional data" refers to a mechanism for analyzing emotions from the user's facial expressions, voice, text, etc., and incorporating that data into the system.

[1108] The "means for generating a travel plan based on received information and emotional data" is a component that has the function of analyzing the basic travel information and emotional data input and automatically generating an optimal travel plan based on that information.

[1109] The "generative AI module" is a module equipped with artificial intelligence that analyzes input data and emotional data from users, and automatically generates multiple optimal travel plans using data from social networking services and rating websites.

[1110] A "social network service" is an online platform that enables users to share information and interact with others via the Internet.

[1111] A "rating website" is a website where users can post ratings and reviews of specific services or products, and other users can use these as a reference.

[1112] A "reservation application program interface" is an interface that allows the reservation system and other application software to communicate with each other and automate the reservation procedure.

[1113] A "cooperating company system" is a reservation management system owned by a provider of various services (air tickets, accommodation, activities, etc.) necessary for implementing a travel plan.

[1114] "Means for automatic execution" are functions or modules designed to allow a program to automatically perform necessary processes or procedures.

[1115] The "means for notifying completion" is a system for notifying the user when the reservation procedure is completed.

[1116] This invention is a travel plan creation agent system that allows users to input basic travel information and emotion data, generates an optimal travel plan based on that information, and automates the reservation procedure. The following describes in detail the system that realizes this application example.

[1117] The system provides an interface on devices such as smartphones and personal computers for users to input their travel destination, budget, number of people, departure date, and return date. When the user inputs this basic information and presses the send button, the device sends the information to a server. At the same time, an emotion engine is used to analyze the user's facial expressions, voice, and text input to obtain emotion data, which is also sent to the server.

[1118] The server analyzes the received basic information and emotional data and sends a request to the generation AI module. The generation AI module analyzes data from social networking services and rating websites to generate multiple travel plans that are optimal for the user's emotional state. The generated travel plans are then sent back to the device via the server.

[1119] The terminal displays the received travel plans to the user, allowing the user to select a plan. The user selects one plan from multiple plans and presses the confirm button. This operation sends the information of the selected plan to the server.

[1120] The server analyzes the information of the selected plan and identifies the necessary reservation procedures, such as reserving airline tickets, accommodations, and restaurants. The server accesses each reservation application program interface and partner company systems to automatically complete the reservation procedures. Once all reservation procedures are complete, the server compiles a reservation confirmation and related ticket information and notifies the user.

[1121] As a specific example of this system, consider a user planning a trip to Tokyo. The user enters and submits information such as "Tokyo," "100,000 yen," "2 people," "November 10, 2023," and "November 15, 2023." The emotion engine analyzes the user's facial expressions and voice and obtains emotional data such as "I want to relax." The server then requests an analysis of this information from a generation AI module. The generation AI module then creates a travel plan (Plan A) that includes a visit to Sensoji Temple and Skytree and dinner in Ginza, and a travel plan (Plan B) that includes a visit to Ueno Zoo and Tokyo Tower and shopping in Shibuya. These plans are presented to the user, and the user selects Plan B. Based on Plan B, the server automatically arranges airfare, reserves admission tickets to Ueno Zoo, arranges tickets to the Tokyo Tower observation deck, and generates a shopping mall guide, and notifies the user that all reservations have been completed.

[1122] Examples of prompts to input to the generative AI model include:

[1123] "Travel Planner API:

[1124] {

[1125] "basic_info": {

[1126] "destination": "Tokyo",

[1127] "budget": 100000,

[1128] "number_of_people": 2,

[1129] "departure_date": "2023-11-10",

[1130] "return_date": "2023-11-15"

[1131] },

[1132] "emotion_data": {

[1133] "emotion": "I want to relax",

[1134] "intensity": "high"

[1135] }

[1136] }"

[1137] There is.

[1138] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1139] Step 1:

[1140] The user (using a smartphone or personal computer) enters the travel destination, budget, number of people, departure date, and return date into the input form and presses the send button. This operation sends basic information from the device to the server. At the same time, the emotion engine analyzes the user's facial expressions, voice, and text input to obtain emotion data.

[1141] (Input) Travel destination, budget, number of people, departure date, return date, user emotional data (facial expression, voice, text)

[1142] (Output) Basic information and emotion data sent to the server

[1143] Step 2:

[1144] The server receives the basic information and emotion data sent from the device. The received data is stored in a database and analyzed as needed. The server analyzes the received data and converts it into the data format required to generate a travel plan.

[1145] (Input) Basic information and emotion data sent

[1146] (Output) Data format for generating travel plans

[1147] Step 3:

[1148] The server then sends a request to the generative AI module based on the converted data. This request includes the user's basic information and emotional data. The generative AI module analyzes data from social networking services and rating websites to generate multiple travel plans that best fit the user's emotional state.

[1149] (Input) Converted data (data format for generating travel plans)

[1150] (Output) Multiple travel plans (Plan A, Plan B, Plan C, etc.)

[1151] Step 4:

[1152] The multiple plans generated by the generation AI module are sent to the server, which analyzes the received plan data and converts it into a data format for sending back to the user.

[1153] (Input) Travel plan data sent from the generation AI module

[1154] (Output) Data format for sending back to the user

[1155] Step 5:

[1156] The terminal receives multiple travel plans sent from the server and displays them to the user. The user compares and considers these plans and selects the most attractive one. When the user presses the select button, information about the selected plan is sent to the server.

[1157] (Input) Multiple travel plans sent from the server

[1158] (Output) User selection information (selected plan)

[1159] Step 6:

[1160] The server receives and analyzes the information of the plan selected by the user. Based on the analyzed information, it identifies items that require reservation and accesses each reservation application program interface or partner company system to automatically carry out the reservation procedure.

[1161] (Input) Information about the plan selected by the user

[1162] (Output) Completed reservation procedures (airline tickets, accommodation, restaurant reservations)

[1163] Step 7:

[1164] Once all the booking procedures are completed, the server compiles the booking confirmation and related ticket information and notifies the user, who can then confirm the booking.

[1165] (Input) Information on completed reservation procedures

[1166] (Output) Reservation confirmation notification and ticket information to the user

[1167] The above is a detailed description of each processing step in this system.

[1168] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1169] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1170] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1171] [Fourth embodiment]

[1172] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1173] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1174] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1175] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1176] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1177] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1178] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1179] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1180] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1181] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1182] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1183] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1184] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1185] Overall system overview

[1186] This invention relates to a travel plan creation agent system in which users simply input basic travel information, and a generation AI analyzes data from social media and review sites to create an optimal travel plan, and then automatically handles the necessary reservation procedures. This system simplifies users' travel planning and allows them to enjoy traveling more easily.

[1187] User's initial operation

[1188] The user launches the "Travel Butler" application using a device (such as a smartphone or PC). The application interface displays a form for entering basic trip information (destination, budget, number of people, departure date, and return date). The user enters the necessary information and presses the "Submit" button.

[1189] Receiving and analyzing input information on the server

[1190] The information sent from the device is received by the server. The server analyzes this information and requests the generation AI module to generate a travel plan. The generation AI module analyzes data from social media and rating sites and generates multiple travel plans (e.g., Plan A, Plan B, Plan C).

[1191] Generate a travel plan and present it to the user

[1192] The generated travel plans are sent to the terminal via the server. The terminal receives them and displays the details of each plan to the user. The travel plans include information on tourist spots, accommodations, restaurants, etc., and the features of each plan are presented in an easy-to-understand manner.

[1193] User selection and confirmation

[1194] The user compares and considers the multiple plans presented and selects the most attractive one. Once the selection is complete, the user presses the "Confirm" button. This operation sends the information of the selected travel plan to the server.

[1195] Execute automatic reservation procedures

[1196] The server analyzes the information of the plan selected by the user and identifies the necessary reservations (e.g., plane tickets, accommodations, restaurants). For each reservation, it accesses the appropriate reservation API or partner system and automatically processes the reservation.

[1197] Notification of reservation completion

[1198] Once all the booking procedures are completed, the server compiles the booking confirmation and related ticket information and notifies the user, who can then confirm the booking.

[1199] Specific examples

[1200] For example, when a user plans a trip to Tokyo, the following operations are performed. First, the user enters and submits information such as "Tokyo," "100,000 yen," "2 people," "November 10, 2023," and "November 15, 2023." The server receives this information and requests analysis from the generation AI module. Based on data from social media and review sites, the generation AI module creates a travel plan (Plan A) that includes a visit to Sensoji Temple and Skytree and dinner in Ginza, and a travel plan (Plan B) that includes a visit to Ueno Zoo and Tokyo Tower and shopping in Shibuya. These plans are presented to the user, and the user selects Plan B. Based on Plan B, the server automatically arranges airfare, reserves admission tickets to Ueno Zoo, arranges tickets to the Tokyo Tower observation deck, and generates a shopping mall guide, and notifies the user that all reservations are complete. In this way, the user can complete their travel planning without any complicated procedures.

[1201] The above is an embodiment of the "travel plan creation agent system" of the present invention. This system allows users to easily and efficiently complete a series of procedures from planning a trip to making reservations.

[1202] The processing flow will be explained below.

[1203] Step 1:

[1204] The user launches the "Travel Butler" application using a device (such as a smartphone or PC). The application interface displays a form for entering basic trip information (destination, budget, number of people, departure date, and return date). The user enters the necessary information and presses the "Submit" button.

[1205] Step 2:

[1206] The device compiles the information entered by the user and creates an HTTP request to send to the server. This request includes the trip destination, budget, number of people, departure date, and return date. Once the request is complete, it is sent to the server.

[1207] Step 3:

[1208] The server analyzes the request received from the user and extracts basic information about the trip, including the destination, budget, number of people, departure date, and return date, and is then ready to proceed to the next step.

[1209] Step 4:

[1210] The server sends the analyzed basic information as a request to the generation AI module. Upon receiving this request, the generation AI module collects data from social media and rating sites based on the input information and begins analysis.

[1211] Step 5:

[1212] The generative AI module analyzes the collected data using statistical methods and machine learning algorithms to generate multiple optimal travel plans. This generation process includes information on tourist attractions, accommodations, restaurants, etc. The generative AI creates at least three travel plans (e.g., Plan A, Plan B, and Plan C).

[1213] Step 6:

[1214] The multiple travel plans generated by the generation AI module are sent back to the server, which analyzes the received travel plans and creates a response to present them to the user.

[1215] Step 7:

[1216] The server sends multiple travel plans to the user as an HTTP response, which includes details of Plan A, Plan B, and Plan C.

[1217] Step 8:

[1218] The terminal displays multiple travel plans received from the server to the user, who then checks the details of each plan and considers which one is most suitable.

[1219] Step 9:

[1220] The user selects the most attractive plan from the multiple plans presented and presses the "Confirm" button. This selection operation sends information about the selected travel plan to the server.

[1221] Step 10:

[1222] The server analyzes the selected plan information received from the user and identifies the necessary reservation procedures, including airfare, accommodation, and restaurant reservations.

[1223] Step 11:

[1224] The server connects to each reservation API and partner system to automate each reservation procedure. After connecting, the server sends reservation requests and completes the necessary reservations.

[1225] Step 12:

[1226] Once all booking procedures are completed, the server compiles the booking confirmation and related ticket information into a response to notify the user.

[1227] Step 13:

[1228] The server sends a response to the user's terminal, including a reservation completion notice and ticket information. The user confirms the reservation on the terminal and confirms that the travel plan is complete.

[1229] This is the specific process flow of the "Travel Butler" travel planning agent system. At each step, the user, device, and server play different roles, working together to automate the entire process from planning to booking a trip.

[1230] Example 1

[1231] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1232] Current travel planning is complex and time-consuming, requiring a lot of effort. Users must create an optimal plan based on basic information such as the destination, budget, number of people, and departure and return dates, and then make all the necessary reservations individually. This creates a need for a way to simplify and streamline travel planning.

[1233] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1234] In this invention, the server includes: means for a user to input a travel destination, budget, number of people, departure date, and return date; an information processing device that receives the input information; machine learning module means that generates a travel plan based on the received information; means for returning multiple plans generated by the machine learning module to the user; means for the user to select one of the multiple plans; service linkage means that automatically executes the necessary reservation procedures based on the selected plan; and display means that notifies the user that the reservation is complete. This enables the user to simply and efficiently complete a series of travel planning and reservation procedures.

[1235] A "user" is an individual or group that inputs basic information such as the travel destination, budget, number of people, departure date, and return date, and selects and confirms a travel plan.

[1236] An "information processing device" is a device that receives and analyzes information sent from a user, and includes a server or cloud computer that generates travel plans and executes various reservation procedures.

[1237] "Machine learning module" refers to an algorithm or program that analyzes data from social media and rating sites based on the information it receives and generates optimal travel plans.

[1238] "Social media" means online platforms for user communication, including sites and applications where travel reviews and opinions are posted.

[1239] A "review site" refers to a website where users can rate specific travel destinations or services and provide the data necessary to generate travel plans.

[1240] The "service linking means" is a means for connecting to various reservation application program interfaces and partner systems in order to automatically execute the necessary reservation procedures based on the travel plan.

[1241] "Display means" refers to a method for notifying the user that the reservation procedure has been completed, and includes an interface or notification function that is visually displayed on the user's terminal.

[1242] System Overview

[1243] The travel plan creation agent system of this invention is a system in which users simply input basic travel information, and a generative AI model analyzes data from social media and review sites to create an optimal travel plan, and then automatically handles the necessary reservation procedures. Users interface with the system using devices such as smartphones or personal computers.

[1244] User operations

[1245] The user installs the "Travel Butler" application and launches it. The application interface displays a form for entering the travel destination, budget, number of people, departure date, and return date. The user enters the necessary information and presses the "Submit" button to send the information to the server. For example, the user enters the following:

[1246] Please tell me your plans for a trip to Tokyo. The budget is 100,000 yen, there are two people, the departure date is November 10, 2023, and the return date is November 15, 2023.

[1247] Information analysis on the server

[1248] The information sent from the device reaches the server via the Internet. The server is a high-performance information processing device that utilizes technologies such as Python and Django. The server analyzes the received information and sends a request to the generation AI module to generate a travel plan.

[1249] Generate a travel plan

[1250] The generative AI model collects and analyzes data from social media and rating sites. It uses BeautifulSoup and Scrapy as scraping tools and natural language processing (NLP) techniques for analysis. The generated travel plans are presented to the user as multiple options.

[1251] Presenting your travel plan

[1252] The server sends the generated travel plan to the user's device. The device receives it and displays the details of each plan. For example, the following plan is presented to the user:

[1253] Plan A: Visit Sensoji Temple and Skytree, and dinner in Ginza

[1254] Plan B: Visit Ueno Zoo, Tokyo Tower, and shopping in Shibuya

[1255] User selection of plan

[1256] The user compares and considers the plans presented and selects the most attractive one. Once the selection is complete, the user presses the "Confirm" button and sends the information of the selected plan to the server.

[1257] Automated booking process

[1258] The server analyzes the information of the plan selected by the user and accesses various reservation application program interfaces (APIs) to automate the necessary reservation procedures, such as reserving airline tickets, accommodations, and restaurants.

[1259] Notification of reservation completion

[1260] Once all reservation procedures are complete, the server compiles the reservation confirmation information and notifies the user's device, where the user can confirm the completion of the reservation and smoothly prepare for their trip.

[1261] Specific examples

[1262] For example, when a user plans a trip to Tokyo, they perform the following operations. The user enters and submits the information "Tokyo," "100,000 yen," "2 people," "November 10, 2023," and "November 15, 2023." Based on this, the generation AI module generates and presents Plan A, which includes visiting Sensoji Temple and Skytree, and Plan B, which includes visiting Ueno Zoo and Tokyo Tower. If the user selects Plan B, the server automatically performs the necessary reservation procedures and notifies the user once they are complete.

[1263] The above is an embodiment of the "Travel Planning Agent System" of the present invention. This system allows users to easily plan and book their trips, further enhancing their travel experience.

[1264] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1265] Step 1:

[1266] The user launches the "Travel Butler" application on their smartphone or personal computer. The application displays an interface for user input and provides a form for entering basic trip information (destination, budget, number of people, departure date, and return date). The user enters this information and presses the "Submit" button.

[1267] Input: Destination, budget, number of people, departure date, return date

[1268] Output: Request to send input information

[1269] Step 2:

[1270] The device packages the information entered by the user and sends it over the internet to a server, using the HTTPS protocol to ensure data security.

[1271] Input: Request to send input information

[1272] Output: Send data to the server

[1273] Step 3:

[1274] The server analyzes the data received from the device. The technologies used here are Python scripts and the Django framework. The server decodes the received JSON format data and extracts the necessary information. Then, based on the analysis results, it sends a request to the generative AI model to generate a travel plan.

[1275] Input: Send data to the server

[1276] Output: Travel plan generation request

[1277] Step 4:

[1278] The generative AI model collects relevant data from social media and review sites using web scraping tools like BeautifulSoup and Scrapy, and analyzes it using natural language processing (NLP) techniques. The resulting itinerary includes lists of tourist attractions, accommodations, and restaurants.

[1279] Input: Travel plan generation request

[1280] Output: Generated itinerary (Plan A, Plan B, Plan C)

[1281] Step 5:

[1282] The server sends the generated travel plan to the device, which receives it and displays the plan details to the user in a visually easy-to-understand format using HTML and CSS.

[1283] Input: Generated itinerary

[1284] Output: Plan details

[1285] Step 6:

[1286] The user compares and considers the multiple travel plans presented and selects the most attractive one. Once the selection is complete, the user presses the "Confirm" button and the information about the selected plan is sent to the server.

[1287] Input: Plan details

[1288] Output: Notification of selected plan

[1289] Step 7:

[1290] The server analyzes the information of the plan selected by the user. As a result of the analysis, it identifies the necessary reservation procedures and automatically performs the reservation procedures by accessing various reservation APIs and partner systems. Examples include reservations for airline tickets, accommodations, and restaurants.

[1291] Input: Confirmation of selected plan

[1292] Output: Reservation request

[1293] Step 8:

[1294] Once all the reservation procedures are completed, the server compiles the reservation confirmation information. The server sends this information to the user's device and notifies the user that the reservation is complete. The device receives the notification and displays it visually to the user.

[1295] Input: Reservation request

[1296] Output: Reservation completion notification

[1297] This is the specific program processing flow of the travel plan creation agent system. This system allows users to easily create travel plans and automatically complete the necessary reservation procedures.

[1298] (Application example 1)

[1299] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1300] The process of planning and booking a trip is complicated and time-consuming, which can be frustrating for many users. It's also not easy to find photo spots, video guides, or blog post ideas while traveling. There's a need to efficiently solve these problems and enable users to enjoy their trips more.

[1301] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1302] In this invention, the server includes: means for a user to input a travel destination, budget, number of people, departure date, and return date; a server that receives the input information; a generation AI module that generates a travel plan based on the received information; a means for returning multiple plans generated by the generation AI module to the user; a means for the user to select one of the multiple plans; a means for automatically performing the necessary reservation procedures based on the selected plan; a means for notifying the user that the reservation is complete; and a means for suggesting photo spots, video guides, and ideas for blog posts based on the user's location information. This makes it possible to perform all processes, from planning a trip to the reservation procedures and support for creating content during the trip, all in one place.

[1303] A "travel destination" is a place where a user wishes to travel.

[1304] A "budget" is the total amount of money available for travel.

[1305] "Number of people" is the total number of people participating in the trip.

[1306] "Departure Date" means the date on which a trip begins.

[1307] The "return date" is the date on which you plan to return home after your trip ends.

[1308] "Means" refers to the methods or techniques used to achieve a particular goal.

[1309] The "server that receives the input information" is a server that receives basic information about the trip that the user inputs.

[1310] "Generative AI module means" means a module that uses artificial intelligence techniques to generate a travel plan based on received information.

[1311] "Generating a travel plan" means making a travel plan based on the information entered by the user.

[1312] "Multiple plans" refers to travel plans with multiple options presented to the user.

[1313] "Means for automatically performing the necessary reservation procedures based on the selected plan" refers to methods or technologies that enable the automatic making of necessary reservations (e.g., transportation, accommodation, etc.) based on the travel plan selected by the user.

[1314] The "means for notifying the user that the reservation has been completed" is a means for notifying the user that all reservation procedures have been completed.

[1315] "Location information" is geographical information about the user's current location.

[1316] A "photo spot" refers to a place suitable for taking photos.

[1317] A "videography guide" provides advice and guidance for videography.

[1318] "Blog Post Ideas" are suggestions for topics and content for users to create blog posts about while traveling.

[1319] This invention relates to a travel plan creation agent system, in which a user simply inputs basic travel information, and a generation AI generates an optimal travel plan and automatically performs the necessary reservation procedures.

[1320] Overall system overview

[1321] The purpose of this system is to simplify users' travel planning and provide a consistent process from planning to booking, as well as support for content creation during the trip.The main components of the system are the user's device, a server, a generation AI module, a reservation API, and a content generation support tool.

[1322] User's initial operation

[1323] The user launches the "Travel Butler" application using a device (such as a smartphone or PC). The application interface displays a form for entering basic trip information (destination, budget, number of people, departure date, and return date). The user enters the necessary information and presses the "Submit" button.

[1324] Receiving and analyzing input information on the server

[1325] The information sent from the device is received by the server. The server analyzes this information and requests the generation AI module to generate a travel plan. The generation AI module analyzes data from social media and rating sites and generates multiple travel plans (e.g., Plan A, Plan B, Plan C).

[1326] Generate a travel plan and present it to the user

[1327] The generated travel plans are sent to the terminal via the server. The terminal receives them and displays the details of each plan to the user. The travel plans include information on tourist spots, accommodations, restaurants, etc., and the features of each plan are presented in an easy-to-understand manner.

[1328] User selection and confirmation

[1329] The user compares and considers the multiple plans presented and selects the most attractive one. Once the selection is complete, the user presses the "Confirm" button. This operation sends the information of the selected travel plan to the server.

[1330] Execute automatic reservation procedures

[1331] The server analyzes the information of the plan selected by the user and identifies the necessary reservations (e.g., plane tickets, accommodations, restaurants). For each reservation, it accesses the appropriate reservation API or partner system and automatically processes the reservation.

[1332] Notification of reservation completion

[1333] Once all the booking procedures are completed, the server compiles the booking confirmation and related ticket information and notifies the user, who can then confirm the booking.

[1334] Content Creation Support

[1335] Additionally, a content generation support tool will be activated that will provide photo spots, video shooting guides, and blog post ideas based on the location information of places the user visits during their trip. This tool will analyze the collected location information and suggest appropriate content.

[1336] For example, when a user plans a trip to Tokyo, the following steps are performed. First, the user enters and submits information such as "Tokyo," "100,000 yen," "2 people," "November 10, 2023," and "November 15, 2023." The server receives this information and requests analysis from the generation AI module. Based on data from social media and review sites, the generation AI module creates a travel plan that includes visiting Sensoji Temple and Tokyo Skytree, dinner in Ginza, and visiting Ueno Zoo and Tokyo Tower, and shopping in Shibuya. These plans are presented to the user, who selects Plan B. Based on Plan B, the server automatically arranges airfare, reserves admission tickets to Ueno Zoo, and arranges tickets to the Tokyo Tower observation deck, and generates a shopping mall guide. The server then notifies the user that all reservations are complete. Furthermore, when visiting Tokyo Skytree during the trip, the server also provides suitable photo spots, video guides, and blog post ideas.

[1337] In this way, the user can complete the travel plan without complicated procedures and enjoy the trip. Specific examples of prompt sentences are shown below.

[1338] Example prompt sentence:

[1339] "I want to create an app that generates travel plans for Tokyo, automates bookings, and helps me create content while traveling."

[1340] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1341] Step 1:

[1342] The user enters basic information about the trip. Using the application interface, the user enters the destination, budget, number of people, departure date, and return date, and then presses the "Submit" button. The application sends the entered information to the server.

[1343] Step 2:

[1344] The server receives the input information. The server receives the basic trip information (destination, budget, number of people, departure date, and return date) sent by the user and stores it in a database. It then analyzes this information and prepares it for making a request to the generation AI module.

[1345] Step 3:

[1346] The generative AI module generates a travel plan. The server sends a request to the generative AI model based on the received information. The generative AI model analyzes data from social media and rating sites to generate multiple travel plans (e.g., Plan A, Plan B, Plan C). This generation process calculates the optimal combination of tourist attractions, accommodations, restaurants, etc. based on the input information.

[1347] Step 4:

[1348] The generated plan is sent to the user. The server receives multiple travel plans returned from the generation AI module and sends them to the user's device. The details of each plan are displayed on the user's device, allowing the user to compare them.

[1349] Step 5:

[1350] The user selects a travel plan. The user compares the presented travel plans and selects the most attractive one. Information about the selected plan is then sent from the terminal to the server.

[1351] Step 6:

[1352] The server automatically performs the reservation procedure. The server analyzes the detailed information of the plan selected by the user and automatically makes the necessary reservations (e.g., plane tickets, accommodation, restaurant). The server accesses each reservation API and partner company system and performs the necessary reservation procedures.

[1353] Step 7:

[1354] A reservation completion notification is sent to the user. Once all reservation procedures are completed, the server compiles the reservation confirmation and related ticket information and sends a notification to the user's device, allowing the user to confirm that the reservation was successfully completed.

[1355] Step 8:

[1356] Supports content creation during travel. Based on location information of places the user visits during their trip, the server suggests photo spots, video shooting guides, and blog post ideas. In this process, the server receives the user's current location information and supports the creation of appropriate content based on that information. These suggestions are displayed on the user's device, supporting content creation during their trip.

[1357] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1358] Overall system overview

[1359] This invention relates to a travel plan creation agent system that proposes more optimal travel plans and automates the booking process by combining an emotion engine that recognizes the user's emotions. By using emotion data in addition to inputting basic travel information, the system can propose travel plans that are more suited to the user's emotional state.

[1360] User's initial operation and emotion recognition

[1361] The user launches the "Travel Butler" application using a device (such as a smartphone or PC). The application interface displays a form for entering basic trip information (destination, budget, number of people, departure date, and return date). The user enters the necessary information and presses the "Submit" button. In parallel, the emotion engine analyzes the user's facial expressions, voice, and text input to obtain emotional data.

[1362] Receiving and analyzing input information on the server

[1363] The information sent from the device is received by the server. The server analyzes this information and extracts basic information about the entered trip and emotional data from the emotion engine. The extracted information includes the destination, budget, number of people, departure date, return date, emotional data, etc.

[1364] Generative AI module generates travel plans

[1365] The server sends the analyzed basic information and emotional data as a request to the generation AI module. The generation AI module begins analysis based on data from social media and rating sites and the acquired emotional data, and generates multiple travel plans that are optimal for the user's emotional state (e.g., Plan A, Plan B, Plan C).

[1366] Generate a travel plan and present it to the user

[1367] The generated travel plans are sent to the terminal via the server. The terminal receives them and displays the details of each plan to the user. The travel plans include information on tourist spots, accommodations, restaurants, etc., and the features of each plan are presented in an easy-to-understand manner.

[1368] User selection and confirmation

[1369] The user compares and considers the multiple plans presented and selects the most attractive one. Once the selection is complete, the user presses the "Confirm" button. This operation sends the information of the selected travel plan to the server.

[1370] Execute automatic reservation procedures

[1371] The server analyzes the information of the plan selected by the user and identifies the necessary reservation procedures. This analysis includes booking airline tickets, accommodations, and restaurants. For each reservation, the server accesses the appropriate reservation API or partner system and automatically completes the reservation procedures.

[1372] Notification of reservation completion

[1373] Once all the booking procedures are completed, the server compiles the booking confirmation and related ticket information and notifies the user, who can then confirm the booking.

[1374] Specific examples

[1375] For example, when a user plans a trip to Tokyo, the following steps are performed. First, the user enters and submits information such as "Tokyo," "100,000 yen," "2 people," "November 10, 2023," and "November 15, 2023." In parallel, the emotion engine analyzes the user's facial expressions and voice to obtain emotional data. The server receives this information and requests analysis from the generative AI module. Based on data from social media and review sites and the emotional data, the generative AI module creates a travel plan (Plan A) that includes a visit to Sensoji Temple and Tokyo Skytree and dinner in Ginza, and a travel plan (Plan B) that includes a visit to Ueno Zoo and Tokyo Tower and shopping in Shibuya. These plans are presented to the user, and the user selects Plan B. Based on Plan B, the server automatically arranges airfare, reserves admission tickets to Ueno Zoo, arranges tickets to the Tokyo Tower observation deck, and generates a shopping mall guide, and notifies the user that all reservations are complete. Because the plan is based on emotional data, it provides a plan that will result in higher user satisfaction.

[1376] The above is an embodiment of the "travel plan creation agent system incorporating an emotion engine." This system allows users to easily and efficiently carry out a series of procedures from planning to booking a trip in a way that is optimized based on their emotions.

[1377] The processing flow will be explained below.

[1378] Step 1:

[1379] The user launches the "Travel Butler" application using a device (such as a smartphone or PC). The application interface displays a form for entering basic trip information (destination, budget, number of people, departure date, and return date). The user enters the necessary information and presses the "Submit" button. In parallel, the emotion engine analyzes the user's facial expressions, voice, and text input to obtain emotion data.

[1380] Step 2:

[1381] The device compiles the information entered by the user and creates an HTTP request to send to the server. This request includes the trip destination, budget, number of people, departure and return dates, and emotional data. Once the request is complete, it is sent to the server.

[1382] Step 3:

[1383] The server analyzes the request received from the user and extracts the basic information and emotion data of the entered trip. The extracted information includes the destination, budget, number of people, departure date, return date, and emotion data. This completes the preparation for the next step of the process.

[1384] Step 4:

[1385] The server sends the analyzed basic information and emotion data as a request to the generation AI module. Upon receiving this request, the generation AI module collects data from social media and rating sites based on the input information and begins analysis.

[1386] Step 5:

[1387] The generative AI module analyzes the collected data and acquired emotional data using statistical methods and machine learning algorithms to generate multiple travel plans that are optimal for the user's emotional state. The generative AI creates at least three travel plans (e.g., Plan A, Plan B, and Plan C).

[1388] Step 6:

[1389] The multiple travel plans generated by the generation AI module are sent back to the server, which analyzes the received travel plans and creates a response to present them to the user.

[1390] Step 7:

[1391] The server sends multiple travel plans to the user as an HTTP response, which includes details of Plan A, Plan B, and Plan C.

[1392] Step 8:

[1393] The terminal displays multiple travel plans received from the server to the user, who then checks the details of each plan and considers which one is most suitable.

[1394] Step 9:

[1395] The user selects the most attractive plan from the multiple plans presented and presses the "Confirm" button. This selection operation sends information about the selected travel plan to the server.

[1396] Step 10:

[1397] The server analyzes the selected plan information received from the user and identifies the necessary reservation procedures, including airfare, accommodation, and restaurant reservations.

[1398] Step 11:

[1399] The server connects to each reservation API and partner system to automate each reservation procedure. After connecting, the server sends reservation requests and completes the necessary reservations.

[1400] Step 12:

[1401] Once all booking procedures are completed, the server compiles the booking confirmation and related ticket information into a response to notify the user.

[1402] Step 13:

[1403] The server sends a response to the user's terminal, including a reservation completion notice and ticket information. The user confirms the reservation on the terminal and confirms that the travel plan is complete.

[1404] Specific examples

[1405] For example, when a user plans a trip to Tokyo, the following steps are performed. First, the user enters and submits information such as "Tokyo," "100,000 yen," "2 people," "November 10, 2023," and "November 15, 2023." In parallel, the emotion engine analyzes the user's facial expressions and voice to obtain emotional data. The server receives this information and requests analysis from the generative AI module. Based on data from social media and review sites and the emotional data, the generative AI module creates a travel plan (Plan A) that includes a visit to Sensoji Temple and Tokyo Skytree and dinner in Ginza, and a travel plan (Plan B) that includes a visit to Ueno Zoo and Tokyo Tower and shopping in Shibuya. These plans are presented to the user, and the user selects Plan B. Based on Plan B, the server automatically arranges airfare, reserves admission tickets to Ueno Zoo, arranges tickets to the Tokyo Tower observation deck, and generates a shopping mall guide, and notifies the user that all reservations are complete. Because the plan is based on emotional data, it provides a plan that will result in higher user satisfaction.

[1406] Example 2

[1407] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1408] Conventional travel plan creation systems generate travel plans based on basic user information (destination, budget, number of people, departure date, return date), but because they do not take the user's emotional state into account, it is difficult to maximize user satisfaction. Furthermore, there is also the issue of not guaranteeing that the reservation process will be carried out appropriately based on the user's selections, even when automating the reservation process.

[1409] The specification process by the specification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for the user to input the travel destination, budget, number of people, departure date, and return date, means for receiving the input information including the user's emotional data, a generation AI module means for generating a travel plan based on the received information and emotional data, means for returning multiple plans generated by the generation AI module to the user, means for the user to select one of the multiple plans, means for automatically performing the necessary reservation procedures based on the selected plan, and means for notifying the completion of the reservation. This enables the generation of a travel plan optimal for the user's emotional state and consistent automatic management of each reservation procedure.

[1410] "User" refers to an individual or organization that uses the travel plan creation agent system.

[1411] A "terminal" is a device such as a smartphone, personal computer, or tablet that is used to access the travel planning agency system.

[1412] A "travel destination" is a geographic location that a user selects as a travel destination.

[1413] A "budget" is a limit on the total amount of expenses a user can spend on a trip.

[1414] "Number of people" is the total number of people participating in the trip.

[1415] "Departure date" is the date on which the user begins their trip.

[1416] The "return date" is the date on which the user returns from their trip.

[1417] "Emotion data" is information that indicates the emotional state of a user analyzed from facial expressions, voice, text input, and the like.

[1418] A "server" is a computer system that receives data sent by users, analyzes, stores, and processes the data in cooperation with other systems.

[1419] The "generative AI module" is an artificial intelligence module that analyzes the received information and emotional data to generate the optimal travel plan.

[1420] A "prompt sentence" is an instruction sentence that instructs the generation AI module to generate a travel plan based on input information.

[1421] A "travel plan" is a detailed travel itinerary that includes tourist attractions, accommodations, restaurants, etc. at a destination.

[1422] The "reservation procedure" refers to the procedure for making reservations for airline tickets, accommodations, restaurants, etc. based on a travel plan.

[1423] "Reservation API" means an application programming interface used to automate the reservation process.

[1424] A "partner system" is a system of an external company or organization that provides travel-related services.

[1425] "Notification" is the act or method of conveying information to a user.

[1426] The present invention relates to a travel plan creation agent system that proposes more optimal travel plans and automates reservation procedures by combining an emotion engine that recognizes user emotions. Detailed embodiments are described below.

[1427] User's initial operation and emotion recognition

[1428] The user launches the "travel planning agent system" application using a device (such as a smartphone or personal computer). The application interface displays a form for entering basic trip information (destination, budget, number of people, departure date, and return date). The user enters this information and presses the "send" button. At the same time, the device's built-in emotion engine analyzes and acquires emotion data from the user's facial expressions, voice, and text input. This emotion engine operates in real time using the user's camera and microphone.

[1429] Receiving and analyzing input information on the server

[1430] The basic travel information and emotion data sent from the device are received by the server. The server analyzes the received data and extracts the necessary information. This information includes the destination, budget, number of people, departure date, return date, and emotion data. Based on this information, the server makes a request to the generation AI module in the next step.

[1431] Generative AI module generates travel plans

[1432] The server sends the analyzed basic information and emotional data to the generation AI module. The generation AI module generates multiple travel plans that best fit the user's emotional state, referencing data from external social media and rating sites. The generation AI module performs its analysis using prompts such as the following:

[1433] "User emotions are excited. Destination is Tokyo, budget is 100,000 yen, number of people is 2, departure date is November 10, 2023, and return date is November 15, 2023. Create the optimal travel plan based on emotions."

[1434] The generated travel plans include information on tourist attractions, accommodations, restaurants, etc., and each travel plan (e.g., Plan A, Plan B, Plan C) has detailed descriptions of its features.

[1435] Presenting and selecting a travel plan

[1436] The generated travel plan is sent to the terminal via the server. The terminal displays detailed information about each plan to the user. The user compares the multiple plans presented and selects the most suitable one. When the "Confirm" button is pressed, information about the selected plan is sent to the server.

[1437] Automatic booking process and notification of booking completion

[1438] The server analyzes the information of the plan selected by the user and identifies the necessary reservation procedures. This analysis includes booking airline tickets, accommodations, and restaurants. The server accesses the appropriate reservation API or partner system and automatically executes the reservation procedures. Once all reservation procedures are completed, the server compiles the reservation confirmation and related ticket information and notifies the user's device. The user can then confirm the reservation on their device.

[1439] Specific examples

[1440] For example, when a user plans a trip to Tokyo, the following operations are performed. The user enters and submits information such as "Tokyo," "100,000 yen," "2 people," "November 10, 2023," and "November 15, 2023." The application uses the camera and microphone to capture emotion data and sends it to the server. The generation AI module analyzes the prompt text and generates multiple travel plans. The generated plans are displayed on the device, and the user selects Plan B. The server automatically reserves flights, accommodation, and restaurants based on Plan B and notifies the user that the reservation is complete.

[1441] The above is a specific embodiment of the "travel plan creation agent system incorporating an emotion engine" of the present invention. This system allows users to easily and efficiently carry out the entire process from outlining their travel plans to booking procedures in a way that is optimized for their emotions.

[1442] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1443] Step 1:

[1444] The user launches the "Travel Planning Agent System" application using a terminal. The application interface displays a form for entering basic information about the trip (destination, budget, number of people, departure date, and return date).

[1445] Input: User's travel information (destination, budget, number of people, departure date, return date)

[1446] Output: Trip information entered by the user

[1447] Step 2:

[1448] The user enters the necessary information and presses the "Send" button. At the same time, the emotion engine uses the device's camera and microphone to analyze the user's facial expressions, voice, and text input to obtain emotional data.

[1449] Input: Click of the send button, user voice and facial expression data

[1450] Output: Emotion data (e.g., excitement, joy, etc.)

[1451] Step 3:

[1452] The device sends travel information and emotion data to the server, which analyzes the received data and extracts the necessary information.

[1453] Input: Travel information, emotion data

[1454] Output: Extracted basic information (destination, budget, number of people, departure date, return date), emotion data

[1455] Step 4:

[1456] The server sends the analysis results to the generation AI module, which generates a prompt sentence and then generates a travel plan based on the prompt sentence.

[1457] Input: Basic information, emotion data

[1458] Output: Prompt sentence to be passed to the generation AI module (e.g., "The user is excited. The destination is Tokyo, the budget is 100,000 yen, the number of people is 2, the departure date is November 10, 2023, and the return date is November 15, 2023. Please create the optimal travel plan based on the user's emotions.")

[1459] Step 5:

[1460] The generative AI module analyzes data from external social media and rating sites based on the prompt text and generates multiple travel plans (e.g., Plan A, Plan B, Plan C).

[1461] Input: prompt statement, external data

[1462] Output: Multiple travel plans (Plan A, Plan B, Plan C)

[1463] Step 6:

[1464] The server sends the generated travel plans to the device, where each plan is displayed on the device interface for the user to compare and consider.

[1465] Input: Travel Plan

[1466] Output: Trip plan displayed on the device

[1467] Step 7:

[1468] The user compares the multiple plans presented and selects the most attractive one. Once the selection is complete, the user presses the "Confirm" button.

[1469] Input: User's plan selection

[1470] Output: Selected plan

[1471] Step 8:

[1472] The terminal sends the selected plan information to the server, which analyzes the information and identifies the necessary reservation procedures.

[1473] Input: Selected travel plan

[1474] Output: Identifying items requiring reservations

[1475] Step 9:

[1476] The server executes the specified reservation procedure, accessing each reservation API and partner company system to automatically complete the reservation procedure.

[1477] Input: Items that require reservation

[1478] Output: Completed booking process

[1479] Step 10:

[1480] After all reservation procedures are completed, the server compiles the reservation confirmation and related ticket information and notifies the user's terminal.

[1481] Input: Completed reservation procedure

[1482] Output: Booking confirmation and ticket information sent to the device

[1483] The above are the specific processing steps in the "travel plan creation agent system combined with an emotion engine."

[1484] (Application example 2)

[1485] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1486] Conventional travel plan creation systems generate travel plans based only on basic information entered by the user, making it difficult to provide an optimal plan based on the user's feelings and preferences. Furthermore, they lacked efficient methods for comparing and considering multiple travel plans at once, and systems for automatically completing reservation procedures. This resulted in low user satisfaction and left the process cumbersome.

[1487] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1488] In this invention, the server includes a means for the user to input the travel destination, budget, number of people, departure date, and return date, a means for acquiring and receiving the user's emotional data, and a means for generating a travel plan based on the received information and emotional data. This makes it possible to generate multiple travel plans that best suit the user's emotional state and allow the user to select one. Furthermore, the server automatically executes the necessary reservation procedures based on the selected plan and notifies the user of completion, thereby improving the efficiency of the procedure and increasing user satisfaction.

[1489] The "means for the user to input the travel destination, budget, number of people, departure date and return date" provides an interface that allows the user to input basic information about the trip into the system.

[1490] "Means for acquiring and receiving user emotional data" refers to a mechanism for analyzing emotions from the user's facial expressions, voice, text, etc., and incorporating that data into the system.

[1491] The "means for generating a travel plan based on received information and emotional data" is a component that has the function of analyzing the basic travel information and emotional data input and automatically generating an optimal travel plan based on that information.

[1492] The "generative AI module" is a module equipped with artificial intelligence that analyzes input data and emotional data from users, and automatically generates multiple optimal travel plans using data from social networking services and rating websites.

[1493] A "social network service" is an online platform that enables users to share information and interact with others via the Internet.

[1494] A "rating website" is a website where users can post ratings and reviews of specific services or products, and other users can use these as a reference.

[1495] A "reservation application program interface" is an interface that allows the reservation system and other application software to communicate with each other and automate the reservation procedure.

[1496] A "cooperating company system" is a reservation management system owned by a provider of various services (air tickets, accommodation, activities, etc.) necessary for implementing a travel plan.

[1497] "Means for automatic execution" are functions or modules designed to allow a program to automatically perform necessary processes or procedures.

[1498] The "means for notifying completion" is a system for notifying the user when the reservation procedure is completed.

[1499] This invention is a travel plan creation agent system that allows users to input basic travel information and emotion data, generates an optimal travel plan based on that information, and automates the reservation procedure. The following describes in detail the system that realizes this application example.

[1500] The system provides an interface on devices such as smartphones and personal computers for users to input their travel destination, budget, number of people, departure date, and return date. When the user inputs this basic information and presses the send button, the device sends the information to a server. At the same time, an emotion engine is used to analyze the user's facial expressions, voice, and text input to obtain emotion data, which is also sent to the server.

[1501] The server analyzes the received basic information and emotional data and sends a request to the generation AI module. The generation AI module analyzes data from social networking services and rating websites to generate multiple travel plans that are optimal for the user's emotional state. The generated travel plans are then sent back to the device via the server.

[1502] The terminal displays the received travel plans to the user, allowing the user to select a plan. The user selects one plan from multiple plans and presses the confirm button. This operation sends the information of the selected plan to the server.

[1503] The server analyzes the information of the selected plan and identifies the necessary reservation procedures, such as reserving airline tickets, accommodations, and restaurants. The server accesses each reservation application program interface and partner company systems to automatically complete the reservation procedures. Once all reservation procedures are complete, the server compiles a reservation confirmation and related ticket information and notifies the user.

[1504] As a specific example of this system, consider a user planning a trip to Tokyo. The user enters and submits information such as "Tokyo," "100,000 yen," "2 people," "November 10, 2023," and "November 15, 2023." The emotion engine analyzes the user's facial expressions and voice and obtains emotional data such as "I want to relax." The server then requests an analysis of this information from a generation AI module. The generation AI module then creates a travel plan (Plan A) that includes a visit to Sensoji Temple and Skytree and dinner in Ginza, and a travel plan (Plan B) that includes a visit to Ueno Zoo and Tokyo Tower and shopping in Shibuya. These plans are presented to the user, and the user selects Plan B. Based on Plan B, the server automatically arranges airfare, reserves admission tickets to Ueno Zoo, arranges tickets to the Tokyo Tower observation deck, and generates a shopping mall guide, and notifies the user that all reservations have been completed.

[1505] Examples of prompts to input to the generative AI model include:

[1506] "Travel Planner API:

[1507] {

[1508] "basic_info": {

[1509] "destination": "Tokyo",

[1510] "budget": 100000,

[1511] "number_of_people": 2,

[1512] "departure_date": "2023-11-10",

[1513] "return_date": "2023-11-15"

[1514] },

[1515] "emotion_data": {

[1516] "emotion": "I want to relax",

[1517] "intensity": "high"

[1518] }

[1519] }"

[1520] There is.

[1521] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1522] Step 1:

[1523] The user (using a smartphone or personal computer) enters the travel destination, budget, number of people, departure date, and return date into the input form and presses the send button. This operation sends basic information from the device to the server. At the same time, the emotion engine analyzes the user's facial expressions, voice, and text input to obtain emotion data.

[1524] (Input) Travel destination, budget, number of people, departure date, return date, user emotional data (facial expression, voice, text)

[1525] (Output) Basic information and emotion data sent to the server

[1526] Step 2:

[1527] The server receives the basic information and emotion data sent from the device. The received data is stored in a database and analyzed as needed. The server analyzes the received data and converts it into the data format required to generate a travel plan.

[1528] (Input) Basic information and emotion data sent

[1529] (Output) Data format for generating travel plans

[1530] Step 3:

[1531] The server then sends a request to the generative AI module based on the converted data. This request includes the user's basic information and emotional data. The generative AI module analyzes data from social networking services and rating websites to generate multiple travel plans that best fit the user's emotional state.

[1532] (Input) Converted data (data format for generating travel plans)

[1533] (Output) Multiple travel plans (Plan A, Plan B, Plan C, etc.)

[1534] Step 4:

[1535] The multiple plans generated by the generation AI module are sent to the server, which analyzes the received plan data and converts it into a data format for sending back to the user.

[1536] (Input) Travel plan data sent from the generation AI module

[1537] (Output) Data format for sending back to the user

[1538] Step 5:

[1539] The terminal receives multiple travel plans sent from the server and displays them to the user. The user compares and considers these plans and selects the most attractive one. When the user presses the select button, information about the selected plan is sent to the server.

[1540] (Input) Multiple travel plans sent from the server

[1541] (Output) User selection information (selected plan)

[1542] Step 6:

[1543] The server receives and analyzes the information of the plan selected by the user. Based on the analyzed information, it identifies items that require reservation and accesses each reservation application program interface or partner company system to automatically carry out the reservation procedure.

[1544] (Input) Information about the plan selected by the user

[1545] (Output) Completed reservation procedures (airline tickets, accommodation, restaurant reservations)

[1546] Step 7:

[1547] Once all the booking procedures are completed, the server compiles the booking confirmation and related ticket information and notifies the user, who can then confirm the booking.

[1548] (Input) Information on completed reservation procedures

[1549] (Output) Reservation confirmation notification and ticket information to the user

[1550] The above is a detailed description of each processing step in this system.

[1551] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1552] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1553] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1554] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1555] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1556] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1557] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1558] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1559] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1560] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1561] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1562] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1563] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1564] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1565] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1566] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1567] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1568] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1569] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1570] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1571] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1572] The following is further disclosed regarding the above embodiment.

[1573] (Claim 1)

[1574] A means for a user to input a travel destination, a budget, a number of people, a departure date, and a return date;

[1575] a server that receives the input information;

[1576] a generation AI module means for generating a travel plan based on the received information by the server;

[1577] means for returning the plurality of plans generated from the generation AI module to the user;

[1578] means for the user to select one of the plurality of plans;

[1579] means for automatically executing a necessary reservation procedure based on the selected plan;

[1580] The system includes a means for notifying completion of the reservation.

[1581] (Claim 2)

[1582] The system of claim 1, wherein the generation AI module includes means for analyzing data from social media and rating sites to generate multiple optimal travel plans.

[1583] (Claim 3)

[1584] The system of claim 1 includes a means for the server to analyze information on the plan selected by the user, identify items that require reservation, and connect to each reservation API or partner company system to automate the reservation procedure.

[1585] "Example 1"

[1586] (Claim 1)

[1587] A means for a user to input a travel destination, a budget, a number of people, a departure date, and a return date;

[1588] an information processing device that receives the input information;

[1589] a machine learning module means for generating a travel plan based on the received information by the information processing device;

[1590] means for returning a plurality of plans generated from the machine learning module to the user;

[1591] means for the user to select one of the plurality of plans;

[1592] a service linking means for automatically executing a necessary reservation procedure based on the selected plan;

[1593] The system includes a display means for notifying completion of the reservation.

[1594] (Claim 2)

[1595] 10. The system of claim 1, wherein the machine learning module includes means for analyzing data from social media and review sites to generate multiple optimal travel plans.

[1596] (Claim 3)

[1597] The system of claim 1 includes a means for an information processing device to analyze information on the plan selected by the user, identify items that require reservation, and connect to each reservation application program interface or collaborator system to automate the reservation procedure.

[1598] "Application Example 1"

[1599] (Claim 1)

[1600] A means for a user to input a travel destination, a budget, a number of people, a departure date, and a return date;

[1601] a server that receives the input information;

[1602] a generation AI module means for generating a travel plan based on the received information by the server;

[1603] means for returning the plurality of plans generated from the generation AI module to the user;

[1604] means for the user to select one of the plurality of plans;

[1605] means for automatically executing a necessary reservation procedure based on the selected plan;

[1606] means for notifying completion of the reservation;

[1607] The system includes a means to suggest photo spots, video shooting guides, and blog post ideas based on the user's location information.

[1608] (Claim 2)

[1609] The system of claim 1, wherein the generation AI module includes means for analyzing data from social media and rating sites to generate multiple optimal travel plans.

[1610] (Claim 3)

[1611] The system of claim 1 includes a means for the server to analyze information on the plan selected by the user, identify items that require reservation, and connect to each reservation API or partner company system to automate the reservation procedure.

[1612] "Example 2: Combining Emotion Engines"

[1613] (Claim 1)

[1614] A means for a user to input a travel destination, a budget, a number of people, a departure date, and a return date;

[1615] a server means for receiving the input information and the user's emotion data;

[1616] a generation AI module means for generating a travel plan based on the received information and emotion data by the server;

[1617] means for returning the plurality of plans generated from the generation AI module to the user;

[1618] means for the user to select one of the plurality of plans;

[1619] means for automatically executing a necessary reservation procedure based on the selected plan;

[1620] The system includes a means for notifying completion of the reservation.

[1621] (Claim 2)

[1622] The system of claim 1, wherein the generation AI module includes means for analyzing data from social media and rating sites and emotional data to generate multiple optimal travel plans.

[1623] (Claim 3)

[1624] The system of claim 1 includes a means for the server to analyze information on the plan selected by the user, identify items that require reservation, and connect to each reservation API or partner company system to automate the reservation procedure.

[1625] "Application example 2 when combining emotion engines"

[1626] (Claim 1)

[1627] A means for a user to input a travel destination, a budget, a number of people, a departure date, and a return date;

[1628] a server that receives the input information and the user's emotion data;

[1629] a generation AI module means for generating a travel plan based on the received information and emotion data by the server;

[1630] means for returning the plurality of plans generated from the generation AI module to the user;

[1631] means for the user to select one of the plurality of plans;

[1632] means for automatically executing a necessary reservation procedure based on the selected plan;

[1633] The system includes a means for notifying completion of the reservation.

[1634] (Claim 2)

[1635] The system according to claim 1, wherein the generation AI module includes means for analyzing data from social networking services and rating websites and creating multiple optimal travel plans based on the acquired emotional data.

[1636] (Claim 3)

[1637] The system of claim 1 includes a means for the server to analyze information on the plan selected by the user, identify items that require reservation, and connect to each reservation application program interface or cooperating company system to automate the reservation procedure. [Explanation of symbols]

[1638] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. A means for a user to input a travel destination, a budget, a number of people, a departure date, and a return date; a server that receives the input information; a generation AI module means for generating a travel plan based on the received information by the server; means for returning the plurality of plans generated from the generation AI module to the user; means for the user to select one of the plurality of plans; means for automatically executing a necessary reservation procedure based on the selected plan; The system includes a means for notifying completion of the reservation.

2. The system according to claim 1, wherein the generation AI module includes means for analyzing data from social media and rating sites to generate multiple optimal travel plans.

3. The system of claim 1 further includes a means for the server to analyze information on the plan selected by the user, identify items that require reservation, and connect to each reservation API or partner company system to automate the reservation procedure.

Images