System

Abstract

A system is provided.SOLUTION: A system comprising: means for receiving itinerary information from a user; means for validating and normalizing the itinerary information; means for generating a proposed plan with a generative AI using the normalized itinerary information; means for selecting an optimal plan from the generated proposed plan; and means for providing the selected plan to a user.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Planning a trip is a time-consuming and stressful task for many people. Creating an optimal plan on your own can be difficult, especially since multiple factors must be considered, such as the date, region, mode of transportation, number of people, and budget. Furthermore, existing planning tools struggle to provide flexible suggestions that address the user's specific needs. The present invention aims to solve these problems and provide a system that allows users to easily obtain optimal travel plans. [Means for solving the problem]

[0005] The present invention provides a system that includes a means for receiving itinerary information provided by a user, such as dates, regions, transportation methods, number of people, and budget, and a means for verifying and normalizing the received information. It also includes a means for generating multiple proposed plans using a generation AI using the normalized itinerary information, and a means for evaluating the generated proposed plans and selecting the optimal plan. It also provides a system that includes a means for formatting the selected plan into a readable format and providing it to the user. This allows users to easily and efficiently obtain the optimal travel plan, significantly reducing the time and effort required for planning a trip.

[0006] "User" refers to an individual or organization that uses this system to obtain travel plans.

[0007] "Itinerary Information" refers to detailed information required for travel planning, such as dates, areas, means of transportation, number of people, and budget.

[0008] "Means for receiving" refers to the functionality and method for receiving the itinerary information provided by the user in digital form.

[0009] "Validation" refers to the process of checking whether received itinerary information is accurate and complete.

[0010] "Normalization" refers to the process of converting received itinerary information into a consistent format or standard.

[0011] "Generative AI" refers to a system that uses artificial intelligence to process information and automatically generate travel plans.

[0012] "Proposed plan" refers to a travel schedule created by the generation AI based on the itinerary information provided by the user.

[0013] "Evaluation" refers to the process of comparing each of the generated proposed plan candidates and determining whether they are superior.

[0014] "Selection" refers to the process of selecting the most suitable proposed plan based on evaluation.

[0015] "Means for providing" refers to the functions and methods for presenting the selected travel plan to the user.

[0016] "Readable format" refers to a format that organizes and presents information in a way that is easy for a user to understand. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0018] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0021] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0022] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0023] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0025] [First embodiment]

[0026] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0027] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0030] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0033] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0037] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0038] The present invention relates to an automated system for enabling a user to efficiently obtain a travel plan. Specific embodiments of the system of the present invention will be described below.

[0039] 1. Enter user information

[0040] The user uses a terminal to input the necessary information about the trip (date, area, transportation, number of people, budget). This information is collected through a dedicated form or user interface. For example, the user can input the following information:

[0041] Dates: 2023-12-01 to 2023-12-05

[0042] Region: Kyoto

[0043] Transportation: Train

[0044] Number of people: 2

[0045] Budget: 100,000 yen

[0046] 2. Sending and Receiving Information

[0047] The device sends the entered information to the server. Specifically, it sends data using an HTTP POST request. The server receives this request and processes the information. In this step, the information is generally sent in JSON format.

[0048] 3. Data Validation and Normalization

[0049] Validates and normalizes the information received by the server. First, it verifies the information for completeness and accuracy. For example, it checks that dates are in a valid format, that budgets are entered in the correct numeric format, and it verifies that locality names are in a standardized format and corrects them if necessary.

[0050] 4. Plan proposals using generative AI

[0051] The server then passes the normalized information to a generation AI to create a travel plan. The AI ​​generates multiple itineraries based on the input information and then generates several proposals from them. Factors taken into account at this stage include tourist destinations, accommodations, transportation options, and activities within a budget.

[0052] 5. Selecting the best plan and format

[0053] The server selects the optimal plan from the multiple plans generated. Evaluation criteria for the selection include whether the plan is within budget, whether the schedule is reasonable, and whether it includes activities that match the user's preferences. The selected plan is then formatted in a way that is easy for the user to understand. For example, the daily schedule and total cost are clearly displayed.

[0054] 6. Submitting and Viewing Plans

[0055] The server sends the optimal travel plan to the device. The device then displays the received plan to the user. Possible display methods include displaying it on a web screen, making it available for download in PDF format, or sending it by email. This allows the user to easily obtain the optimal travel plan and put it into action.

[0056] As described above, the system of the present invention provides a convenient tool for users to easily plan their trips, allowing users to significantly reduce the time and effort required for planning trips, making discovering new travel destinations and planning trips more fun and easier.

[0057] Examples:

[0058] For example, if a user plans a "5-day trip to Kyoto," selects "train" as their means of transportation, and has a budget of "100,000 yen," the AI ​​generator will suggest a daily schedule that includes tourist attractions such as Kiyomizu-dera Temple, Arashiyama, and Nijo Castle.

[0059] Day 1: Arrive at Kyoto Station -> Visit Kiyomizu-dera Temple -> Dinner in Gion

[0060] Day 2: Arashiyama sightseeing -> Bamboo forest path -> Sagano sightseeing train

[0061] Day 3: Visit Nijo Castle -> Eat your way around Nishiki Market

[0062] Day 4: Heian Shrine -> Philosopher's Path Walk -> Ginkakuji Temple

[0063] Day 5: Shopping around Kyoto Station -> Buying ekiben and heading home

[0064] Total cost: 95,000 yen

[0065] In this way, an optimal travel plan is automatically generated based on the conditions provided by the user.

[0066] The processing flow will be explained below.

[0067] Step 1:

[0068] The user enters the necessary information about the trip (date, location, mode of transportation, number of people, budget) into the terminal. This information is collected through a dedicated form or user interface. The entered information is formatted for further processing.

[0069] Step 2:

[0070] The device sends the entered information to the server. Specifically, it sends data using an HTTP POST request. This information is passed to the server in JSON format.

[0071] Step 3:

[0072] The server receives the information sent as an HTTP request, parses it, and converts it into an internal data structure.

[0073] Step 4:

[0074] Validating the information received by the server: Checking that the itinerary information is accurate and complete, for example, ensuring that dates are in a valid format, that the budget is entered in the correct numeric format, and that all required fields are filled in.

[0075] Step 5:

[0076] The server normalizes the information it receives, for example, to unify date formats and standardize locality names, e.g., unifying "2023-12-01 to 2023-12-05" to "2023-12-01 - 2023-12-05".

[0077] Step 6:

[0078] The server passes the normalized information to the generation AI to create a travel plan. The generation AI generates multiple proposed plans based on the input information. The proposed plans generated at this stage include daily sightseeing schedules, transportation options, accommodations, etc.

[0079] Step 7:

[0080] The server evaluates the multiple proposed plans returned by the generation AI and compares the suitability of each plan, based on criteria such as whether it is within budget, whether the schedule is reasonable, and whether it includes activities that match the user's preferences.

[0081] Step 8:

[0082] The server selects the best plan based on the evaluation results. An evaluation algorithm is used to determine the best plan.

[0083] Step 9:

[0084] The server formats the selected plan into a readable format, such as a text format that includes a daily schedule and total costs.

[0085] Step 10:

[0086] The server sends the optimal travel plan to the terminal, which then receives the plan and displays it for the user to view.

[0087] Step 11:

[0088] The terminal displays the received plan to the user. The display method may include displaying it on a web screen, making it downloadable in PDF format, or sending it by email.

[0089] This allows users to easily and efficiently obtain optimal travel plans.

[0090] Example 1

[0091] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0092] Creating a travel plan is a time-consuming and labor-intensive task for users. For example, users must plan sightseeing spots, accommodations, and other activities while taking into account factors such as travel dates, region, transportation, number of people, and budget. This process is complex, and there is a need for a system that can automatically create an efficient and satisfying travel plan for users.

[0093] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0094] In this invention, the server includes means for receiving travel information from a user, means for verifying and normalizing the travel information, means for creating a proposed plan using the normalized travel information with a generative AI model, means for selecting an optimal plan from the generated multiple proposed plans, and means for formatting the selected plan and providing it to the user, thereby enabling the user to automatically and efficiently obtain an optimal travel plan based on the conditions entered by the user.

[0095] "User" means an individual or entity that provides information and uses the System to create a travel plan.

[0096] "Travel information" refers to data necessary to create a travel plan, such as dates, area, transportation, number of people, and budget.

[0097] "Means for receiving" refers to an interface or system for capturing information provided by a user.

[0098] "Validation and normalization measures" refers to processes and systems for verifying the completeness and accuracy of received information and converting it into a standard format.

[0099] "Generative AI model" refers to an algorithm or software that uses artificial intelligence to generate a travel plan based on specific inputs.

[0100] "Proposed Plans" refers to multiple travel plans created by the generative AI model.

[0101] "Means of selection" refers to the process or system for evaluating and selecting the most appropriate plan from multiple proposed plans.

[0102] "Formatting means" refers to the process or system for converting the selected plan into a user-understandable format.

[0103] "Means for providing" refers to a method or system for informing the user of the selected and formatted plan.

[0104] The present invention relates to an automated system for users to efficiently obtain travel plans. The main components of this system include a user terminal, a server, and a generative AI model.

[0105] When a user uses the system, they first use a terminal to enter the necessary information about their trip (date, area, mode of transportation, number of people, budget). This information is collected through a dedicated form and user interface (UI). The terminal can be a smartphone or PC with a standard internet connection. A web browser (e.g., GOOGLE CHROME®) is used as the interface.

[0106] The device then sends the information entered by the user to the server. An HTTP POST request is used to send the data, and the data is sent in JSON format. The server is a computer system such as a cloud service (e.g., an EC2 instance from Amazon Web Services), and web server software (e.g., Apache (registered trademark) or Nginx) manages the data transmission and reception.

[0107] The server validates and normalizes the information it receives. This step checks the information for completeness and accuracy and corrects any deficiencies. For example, it ensures that dates are formatted correctly, budgets are in numeric format, and region names are standardized. This process is implemented using a database management system (e.g., MySQL®) and a programming language (e.g., Python).

[0108] The server then passes the normalized information to a generative AI model to generate a travel plan. The generative AI model uses advanced artificial intelligence (e.g., OpenAI® GPT-4®). The AI ​​model generates multiple travel plans based on a given prompt. Examples of prompts include:

[0109] "I'm planning a trip to Kyoto for two people between 2023-12-01 and 2023-12-05. We'll be traveling by train, with a total budget of 100,000 yen. Please suggest the best travel plan for these conditions."

[0110] The server selects the best plan from the generated plans, using criteria such as whether it is within budget, whether the schedule is reasonable, and whether it includes activities that meet the user's preferences. An algorithm (e.g., linear programming) is used to select the best plan.

[0111] The selected plan is formatted in a user-friendly format, for example, showing the daily schedule and total cost, using a formatting tool (e.g., the Jinja2 template engine).

[0112] Finally, the server sends the formatted plan to the device, which displays it to the user, possibly on a web screen, downloaded as a PDF, or emailed. To generate a PDF, a PDF generation tool (e.g., wkhtmltopdf) or a mail server (e.g., SendGrid) can be used.

[0113] The above is a detailed description of the embodiment of the present invention. Based on the conditions entered by the user, the user can automatically and efficiently obtain an optimal travel plan, significantly reducing the time and effort required for travel planning.

[0114] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0115] Step 1: Enter your user information

[0116] The user uses a terminal to input the necessary information about the trip (date, region, transportation, number of people, budget). Specifically, the information is entered into a form on the user interface (UI) and prepared for transmission to the server. The terminal receives input such as "Date: 2023-12-01 to 2023-12-05, Region: Kyoto, Transportation: Train, Number of people: 2, Budget: 100,000 yen," converts this to JSON format, and transmits it.

[0117] Step 2: Send information

[0118] The terminal sends the information entered by the user to the server. An HTTP POST request is used to send the data, and the information is sent in JSON format. Specifically, an HTTP request is created with the itinerary information encoded in JSON format as the payload, and sent to the server's endpoint. The input is the JSON data prepared in step 1, and the data is sent to the server as the output.

[0119] Step 3: Receiving and verifying information on the server

[0120] The server parses and validates the information received from the terminal. It parses the received JSON data and breaks it down into each field (reverse itinerary, schedule, region, etc.) to check for completeness and accuracy. For example, it checks whether the date format is "YYYY-MM-DD" and whether the budget is in numeric format. The input is the JSON data received in step 2, and the output is the validation result (e.g., checking that the data is in the correct format).

[0121] Step 4: Normalize the data

[0122] The server normalizes the validated information. It standardizes place names, date formats, etc. into a standard format and converts them into a format that can be passed to the generative AI model. Specifically, it standardizes "Kyoto" to "Kyoto" and converts dates to ISO 8601 format ("2023-12-01T00:00:00Z"). The input is the data validated in step 3, and the output is normalized data.

[0123] Step 5: Generate a travel plan using a generative AI model

[0124] The server passes the normalized information to a generative AI model, which generates a travel plan. The AI ​​model uses advanced artificial intelligence to generate multiple travel plans based on a prompt. For example, a prompt such as "We are planning a trip for two to Kyoto between 2023-12-01 and 2023-12-05. The mode of transportation will be by train, and the budget is 100,000 yen. Please suggest the optimal travel plan that meets these conditions" is created and input into the AI ​​model. The input is the normalized data obtained in step 4, and the output is multiple generated travel plans.

[0125] Step 6: Select the best plan

[0126] The server selects the best plan from the multiple itineraries generated. Selection criteria include being within budget, having a reasonable schedule, and including activities that match the user's preferences. An algorithm (e.g., linear programming) is used to evaluate each plan and select the best one. The input is the itineraries generated in step 5, and the output is the single best itinerary.

[0127] Step 7: Format your plan

[0128] The selected plan is formatted in a format that is easy for the user to understand. It is formatted so that the daily schedule and total cost are clearly displayed, and converted into a readable format (e.g., HTML or PDF). Specifically, the schedule list and total cost are calculated, and a plan is created in tabular or text format. The input is the optimal plan selected in step 6, and the output is a formatted, readable plan.

[0129] Step 8: Submit your plan

[0130] The server sends the formatted plan to the device. The sending method can be sending data in an HTTP response or sending it by email. Specifically, the formatted plan is returned as an HTTP response or sent to the user's email address and a download link is provided. The input is the plan formatted in step 7, and the output is the plan provided to the user.

[0131] Step 9: View your plan

[0132] The device displays the travel plan received from the server to the user, providing options such as displaying it in a web browser or downloading it as a PDF. Specifically, the device parses the received data and generates HTML to display in the browser or display it in a PDF viewer. The input is the formatted plan received in step 8, and the output is displayed visually to the user.

[0133] (Application example 1)

[0134] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0135] Conventional automatic travel plan generation systems have difficulty responding flexibly to users' real-time requests, and generating plans that take into account the situation and traffic information when the user actually arrives at the destination. As a result, users have to frequently readjust their plans during their trip, which reduces the enjoyment of the trip.

[0136] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0137] In this invention, the server includes means for receiving itinerary information from a user, means for verifying and normalizing the itinerary information, means for creating a proposed plan using a generation AI using the normalized itinerary information, means for selecting an optimal plan from the generated proposed plans, means for receiving a user request through voice input, means for generating an optimal sightseeing route in real time based on the voice input and presenting it on a visual display device, and means for providing the selected plan and the real-time generated sightseeing route to the user. This allows the user to obtain an optimal travel plan in real time that suits the local situation, enabling them to enjoy their trip while reducing stress during their trip.

[0138] "Itinerary information" refers to data related to a user's trip, such as the date, location, means of transportation, number of people, and budget.

[0139] "Validation and normalization" refers to verifying the completeness, accuracy, and conversion of received itinerary information into a standard format.

[0140] "Generative AI" refers to an algorithm or system that uses artificial intelligence techniques to automatically generate itineraries based on specific input data.

[0141] "Proposed plan" refers to multiple travel plan candidates created by the generation AI.

[0142] The "optimal plan" refers to the travel plan that best meets the user's conditions and preferences.

[0143] "Voice input" refers to a method of using a microphone to recognize a user's verbal instructions or requests as digital information.

[0144] "Visual display device" refers to a device that allows a user to obtain information visually, such as smart glasses or a head-mounted display.

[0145] A "tourist route" refers to a travel route that includes tourist spots that a user visits.

[0146] "Real-time" refers to the immediate processing and delivery of information based on the current time and situation.

[0147] "User" refers to an individual or organization that uses the automatic travel plan generation system.

[0148] This invention relates to an automated system for users to efficiently obtain travel plans. The system includes a terminal such as a smartphone or smart glasses, a server, and a generative AI model.

[0149] The server receives itinerary information (date, location, transportation, number of people, budget) from the user. The itinerary information is entered through a smartphone application or the interface of the smart glasses. For example, if a user plans a "5-day trip to Kyoto," he or she enters the following information:

[0150] Date: 2023-12-01 to 2023-12-05

[0151] Location: Kyoto

[0152] Transportation: Train

[0153] Number of people: 2

[0154] Budget: 100,000 yen

[0155] Once received, the information is validated and normalized by the server, ensuring completeness and accuracy, and converting it to the required format, for example by checking date formats and standardizing locality names.

[0156] The normalized information is then passed to a generative AI model, which automatically generates multiple itineraries based on the input data, including destinations, accommodations, transportation options, and activities within a budget.

[0157] The server selects the best plan from the generated plans. The selection criteria may include being within the budget, being within the schedule, and including activities that match the user's preferences.

[0158] The best plan is then formatted and displayed on a smartphone or smart glasses in a user-friendly format, including a daily schedule and total costs.

[0159] Furthermore, when users make requests through voice input in real time while traveling, the server receives the information and optimizes sightseeing routes based on real-time conditions. This information is displayed on smart glasses or smartphones, so users can instantly know the optimal route during their trip.

[0160] For example, you can use the following prompts for voice input:

[0161] "What is the shortest route from Kyoto Station to Kiyomizu-dera Temple?"

[0162] The server processes real-time traffic information and current location data based on voice input and generates the optimal route, allowing users to obtain the optimal travel plan in real time based on local conditions, allowing them to enjoy their trip while reducing stress.

[0163] As described above, the system of the present invention provides a convenient tool that allows users to easily create a travel plan and obtain the optimal route in real time while traveling. This system allows users to significantly reduce the time and effort required for planning a trip and to have a more fulfilling travel experience.

[0164] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0165] Step 1:

[0166] The user inputs itinerary information using a device (smartphone or smart glasses). Specifically, information such as date, location, mode of transportation, number of people, and budget is provided using a dedicated form or voice input. The input information is temporarily stored on the device as JSON format data.

[0167] Step 2:

[0168] The device sends the itinerary information entered by the user to the server, which then sends the JSON formatted data using an HTTP POST request. The server receives this request and stores the data in variables for processing.

[0169] Step 3:

[0170] The server validates and normalizes the itinerary information received, checking for completeness (all required fields filled in), accuracy (checking date formats and numbers), and converting it to a standard format (such as standardizing place names). Successfully validated information is reformatted for further processing.

[0171] Step 4:

[0172] The server passes the normalized itinerary information to a generative AI model, which then automatically generates multiple itineraries based on the input data. This process takes into account factors such as tourist destinations, accommodations, transportation options, and activity schedules. The generated itineraries are returned to the server in list form.

[0173] Step 5:

[0174] The server evaluates multiple proposed plans and selects the best one, based on criteria such as whether it fits within the budget, whether it fits within the schedule, and whether it includes activities that match the user's preferences. The best plan is then formatted for delivery to the user.

[0175] Step 6:

[0176] The optimal plan is provided to the user. The server sends the formatted plan to the device. The device visually displays the received plan on the screen. The user can check the daily schedule and total cost.

[0177] Step 7:

[0178] While traveling, the user issues a request to the server through voice input, for example, using a prompt such as "Tell me the shortest route from Kyoto Station to Kiyomizu-dera Temple." The voice input is converted into text format on the device and sent to the server.

[0179] Step 8:

[0180] The server generates a real-time sightseeing route based on the user's voice input, taking into account the user's current location and real-time traffic conditions, and sends the optimized route information in JSON format to the device.

[0181] Step 9:

[0182] The terminal then presents the received real-time tourist route on a visual display device (such as smart glasses), allowing the user to act on the information.

[0183] Through these steps, users can obtain optimal information throughout the entire process, from pre-trip planning to real-time route guidance on-site.

[0184] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0185] The present invention relates to an automated system that combines an emotion engine to enable users to efficiently obtain travel plans. Specific embodiments of the system of the present invention will be described below.

[0186] 1. Enter user information

[0187] The user uses a terminal to input the necessary information about the trip (date, area, transportation, number of people, budget). This information is collected through a dedicated form or user interface. For example, the user can input the following information:

[0188] Dates: 2023-12-01 to 2023-12-05

[0189] Region: Kyoto

[0190] Transportation: Train

[0191] Number of people: 2

[0192] Budget: 100,000 yen

[0193] 2. Sending and Receiving Information

[0194] The device sends the entered information to the server. Specifically, it sends data using an HTTP POST request. The server receives this request and processes the information. In this step, the information is generally sent in JSON format.

[0195] 3. Data Validation and Normalization

[0196] The server validates and normalizes the information it receives. First, it checks the information for completeness and accuracy. For example, it checks that dates are in a valid format and that budgets are entered in the correct numeric format. It also checks that locality names are in a standardized format and corrects them if necessary.

[0197] 4. Emotion Recognition by Emotion Engine

[0198] While the user is inputting information or during other interactions, the device passes voice and input data to an emotion engine to sense the user's emotional state. The emotion engine analyzes this data and determines the user's emotional state (e.g., excitement, joy, stress).

[0199] 5. Plan proposals using generative AI

[0200] The server passes the normalized information and the results of the emotion engine to the generation AI to create a travel plan. The generation AI generates multiple proposed plans based on the input information and the user's emotional state. The proposed plans generated at this stage include sightseeing schedules, transportation options, accommodations, etc., tailored to the user's emotional state.

[0201] 6. Selecting the best plan and format

[0202] The server selects the optimal plan from the generated plans. Evaluation criteria for the selection include whether the plan is within budget, whether the schedule is reasonable, and whether it includes activities that match the user's emotional state. The selected plan is then formatted in a way that is easy for the user to understand. For example, the daily schedule and total cost are clearly displayed.

[0203] 7. Real-time emotional state monitoring

[0204] The server continues to monitor the user's emotional state in real time while the proposed plan is being provided to the user and afterwards. If a change in the user's emotional state is detected, the content of the proposed plan and the presentation method are changed accordingly.

[0205] 8. Submitting and Viewing Plans

[0206] The server sends the optimal travel plan to the device. The device then displays the received plan to the user. The display method can be on a web screen, downloadable in PDF format, or sent by email. This allows the user to easily obtain the optimal travel plan and put it into action.

[0207] Examples:

[0208] For example, if a user plans a "5-day trip to Kyoto," selects "train" as their means of transportation, has a budget of "100,000 yen," and the emotion engine determines that the user is tired, the generative AI will create a plan that prioritizes tourist spots and activities that will help the user relax. See the example below.

[0209] Day 1: Arrive at Kyoto Station -> Visit Kiyomizu-dera Temple -> Dinner in Gion

[0210] Day 2: Sightseeing in Arashiyama -> Bamboo Forest Path -> Relaxing Cafe Break

[0211] Day 3: Visit Nijo Castle -> Eat your way around Nishiki Market

[0212] Day 4: Heian Shrine -> Philosopher's Path Walk -> Ginkakuji Temple

[0213] Day 5: Shopping around Kyoto Station -> Buying ekiben and heading home

[0214] Total cost: 95,000 yen

[0215] In this way, by providing a plan that takes into account the user's emotional state, the user experience can be enhanced.

[0216] The processing flow will be explained below.

[0217] Step 1:

[0218] The user inputs the necessary information about the trip (date, area, transportation, number of people, budget) into the terminal. The user can easily provide the information through a dedicated form or user interface.

[0219] Step 2:

[0220] The device sends the entered information to the server, specifically by using an HTTP POST request to send the data to the server in JSON format.

[0221] Step 3:

[0222] The server receives the information sent as an HTTP request, parses it, and converts it into an internal data structure.

[0223] Step 4:

[0224] The server validates and normalizes the information it receives, first checking that information such as dates and budgets are in the correct format, and then standardizing date formats and locality names as needed.

[0225] Step 5:

[0226] To sense the user's emotional state, the device passes the input voice data and input data to the emotion engine, which analyzes this data and determines the user's emotional state (e.g., excitement, joy, stress).

[0227] Step 6:

[0228] The server passes the normalized information and the results of the emotion engine to the generation AI, which then creates a travel plan. The generation AI then generates multiple proposed plans based on this information. The plans generated at this stage include sightseeing schedules and accommodations based on the user's emotional state.

[0229] Step 7:

[0230] The server evaluates the multiple proposed plans returned by the generation AI and selects the optimal plan. Evaluation criteria include whether the plan is within budget, the schedule is feasible, and whether it matches the user's emotional state.

[0231] Step 8:

[0232] The server selects the optimal plan based on the evaluation results and then provides it to the user in a format that is easy for the user to understand, such as by showing the daily schedule and total cost.

[0233] Step 9:

[0234] The server sends the selected travel plan to the terminal, which can then be displayed on a web screen, made available for download in PDF format, or sent via email.

[0235] Step 10:

[0236] The terminal displays the received plan to the user, who can then proceed with specific travel preparations based on the displayed plan.

[0237] Step 11:

[0238] The server monitors the user's emotional state in real time during and after the proposed plan is provided. If a change in the user's emotional state is detected, the content of the proposed plan and the way it is presented are changed appropriately. This allows the user to use the travel plan more comfortably.

[0239] In this way, by combining an emotion engine, the present invention provides travel plans that take into account the user's emotional state, realizing a more personalized user experience.

[0240] Example 2

[0241] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0242] Conventional travel plan providing systems do not take into account the user's emotional state when making suggestions, which can lead to a poor user experience. Furthermore, the process from inputting travel information to creating a plan, and then selecting and providing the optimal plan, is complicated and inefficient, making it difficult for users to use.

[0243] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for receiving necessary travel information from a user, means for verifying and normalizing the travel information, means for inputting a prompt sentence into a generative AI model using the normalized travel information and creating a proposed plan, means for selecting an optimal plan from the generated proposed plans, means for providing the selected plan to the user, and means for monitoring the user's emotional state using an emotion engine and reflecting the user's emotional state in the proposed plan. This enables automatic generation of an optimal travel plan that takes the user's emotional state into consideration and flexible provision of plans by monitoring the emotional state in real time.

[0244] A "user" is an individual or organization who wishes to use this system to create a travel plan.

[0245] "Necessary travel information" refers to data necessary for making travel plans, including dates, areas, means of transportation, number of people, budget, etc.

[0246] "Validation and normalization" is the process of verifying received travel information for accuracy and completeness and converting it into a standard format.

[0247] A "generative AI model" is an artificial intelligence system that automatically suggests travel plans based on input information.

[0248] A "prompt sentence" is an input sentence used to give instructions to a generative AI model.

[0249] A "proposed plan" is a proposed travel plan generated by a generative AI model.

[0250] The "emotion engine" is a system that analyzes the user's emotional state and adjusts travel plans based on that information.

[0251] "Real-time emotional state monitoring" is the process of continuously analyzing the user's emotional state in real time and appropriately changing the travel plan and presentation method based on the results.

[0252] The present invention relates to an automated system that combines various engines and AI technology to enable users to efficiently obtain travel plans. This system generates and provides optimal travel plans based on the user's travel information and emotional state. Specific embodiments for carrying out the invention are described below.

[0253] First, the user uses the device to input the necessary information about the trip. This information includes the itinerary, area, mode of transportation, number of people, budget, etc. The device collects this information through a dedicated form or user interface. For example, the user can input the following information:

[0254] Dates: 2023-12-01 to 2023-12-05

[0255] Region: Kyoto

[0256] Transportation: Train

[0257] Number of people: 2

[0258] Budget: 100,000 yen

[0259] The device sends this input information to the server using an HTTP POST request. The data is typically sent in JSON format. The server receives this request and parses the data.

[0260] The server then validates and normalizes the received information. The validation process checks the accuracy of date formats, the numeric format of budgets, and also standardizes locality names. For example, it verifies that "2023-12-01 to 2023-12-05" is a valid date format, and that "100000" is a valid numeric format. It also converts the locality name "Kyoto" to a standard format.

[0261] The device then passes the user's input and voice data to the emotion engine in real time. The emotion engine analyzes this data and determines the user's emotional state. For example, it can analyze whether the user is relaxed or stressed while typing.

[0262] The server then passes the normalized information and emotional state to a generative AI model, which automatically generates a travel plan. The generative AI model generates multiple proposed plans based on the input information and the user's emotional state. It also selects the most suitable plan from the multiple plans. Selection criteria include being within budget, having a reasonable schedule, and including activities that match the user's emotional state.

[0263] For example, a generative AI model might suggest the following plan:

[0264] Day 1: Arrive at Kyoto Station -> Visit Kiyomizu-dera Temple -> Dinner in Gion

[0265] Day 2: Sightseeing in Arashiyama -> Bamboo Forest Path -> Relaxing Cafe Break

[0266] Day 3: Visit Nijo Castle -> Eat your way around Nishiki Market

[0267] Day 4: Heian Shrine -> Philosopher's Path Walk -> Ginkakuji Temple

[0268] Day 5: Shopping around Kyoto Station -> Buying ekiben and heading home

[0269] Total cost: 95,000 yen

[0270] Furthermore, the system has a function to monitor the user's emotional state in real time. This allows the system to appropriately change the content and presentation method of the proposed plan when a change in the user's emotional state is detected. The proposed plan is formatted in a user-friendly format, and can be displayed on a web screen, downloaded as a PDF, or sent by email, for example.

[0271] Through the above process, users can easily obtain the optimal travel plan and put it into action. Below is an example of a prompt for the generative AI model:

[0272] User input: Kyoto trip from 2023-12-01 to 2023-12-05, transportation: train, number of people: 2, budget: 100,000 yen

[0273] Emotional state: User is tired

[0274] Input prompt for the generation AI: Generate a Kyoto itinerary. The user is tired. Prioritize relaxing activities. Budget is within 100,000 yen.

[0275] In this way, the automatically generated travel plan can meet the user's expectations and provide a satisfying travel experience.

[0276] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0277] Step 1:

[0278] The user inputs the necessary information about the trip into the terminal. Specifically, the user uses a form to input the dates, area, transportation, number of people, budget, etc. Examples of input data are as follows:

[0279] Dates: 2023-12-01 to 2023-12-05

[0280] Region: Kyoto

[0281] Transportation: Train

[0282] Number of people: 2

[0283] Budget: 100,000 yen

[0284] The entered data is saved on the device.

[0285] Step 2:

[0286] The device converts the input information into JSON format and sends it to the server using an HTTP POST request. Specifically, it generates the following JSON data:

[0287] json

[0288] {

[0289] "Dates": "2023-12-01 to 2023-12-05",

[0290] "Region": "Kyoto",

[0291] "Transportation": "Train",

[0292] "Number of people": 2,

[0293] "Budget": 100000

[0294] }

[0295] This data is sent to the server and received by the server.

[0296] Step 3:

[0297] Validates and normalizes the information received by the server, specifically ensuring that dates are in the correct format, that budgets are in numeric format, and converts region names to a standard format. Transformations include:

[0298] Verify that "2023-12-01 to 2023-12-05" is a valid date format.

[0299] Verify that the budget is "100000" and convert it to a number format.

[0300] The normalized data is passed on to the next process.

[0301] Step 4:

[0302] The device passes the user's input data and voice data to the emotion engine. The emotion engine analyzes this data and determines the user's emotional state. For example, it analyzes whether the user is relaxed or stressed while inputting, and outputs the results as data. The emotional state is determined to be "relaxed" or "stressed," for example.

[0303] Step 5:

[0304] The server passes the normalized information and emotional state to the generative AI model, which then automatically generates a travel plan. The server inputs the following prompt into the generative AI model:

[0305] "Generate a Kyoto itinerary. The user is tired. Prioritize relaxing activities. Budget is under 100,000 yen."

[0306] The generative AI model generates and outputs multiple travel plans based on the input prompt and data.

[0307] Step 6:

[0308] The server selects the best travel plan from the multiple plans generated. Selection criteria include being within budget, having a reasonable schedule, and including activities that match the user's emotional state. The selected plan is then passed on to the next process.

[0309] Step 7:

[0310] The server formats the optimal itinerary in a user-friendly format, showing the daily schedule and total cost. For example, the following output might be generated:

[0311] Day 1: Arrive at Kyoto Station -> Visit Kiyomizu-dera Temple -> Dinner in Gion

[0312] Day 2: Sightseeing in Arashiyama -> Bamboo Forest Path -> Relaxing Cafe Break

[0313] Day 3: Visit Nijo Castle -> Eat your way around Nishiki Market

[0314] Day 4: Heian Shrine -> Philosopher's Path Walk -> Ginkakuji Temple

[0315] Day 5: Shopping around Kyoto Station -> Buying ekiben and heading home

[0316] Total cost: 95,000 yen

[0317] Step 8:

[0318] The server sends the optimal travel plan to the device. The device displays the received plan to the user. Display methods include displaying it on a web screen, downloading it in PDF format, or sending it by email. This allows the user to confirm the travel plan and put it into action.

[0319] (Application example 2)

[0320] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0321] Conventional travel planning systems mainly generate plans based on basic information entered by the user, but lack consideration for the user's emotional state or individual circumstances. This makes it difficult to alleviate the emotional anxiety and stress that users experience while traveling, making it difficult to provide a satisfying travel experience. Furthermore, since there was no system that could immediately respond to changes in the user's emotional state, it was also impossible to provide an optimal plan in real time.

[0322] The specification process by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving itinerary information from a user, means for verifying and normalizing the itinerary information, means for creating a proposed plan by a generation AI using the normalized itinerary information, and means having an emotion engine for analyzing voice data and input data to sense the user's emotional state. This makes it possible to monitor the user's emotional state in real time and change the proposed plan as appropriate in response to changes in the user's emotional state.

[0323] The "means for receiving itinerary information from the user" is an interface through which the system collects information about the trip entered by the user.

[0324] The "means for verifying and normalizing said itinerary information" is a function for checking the accuracy and consistency of collected itinerary information and arranging it into a standard format.

[0325] "Means for creating proposed plans using a generation AI based on the normalized itinerary information" refers to a method for automatically generating multiple travel plans using a generation AI based on normalized itinerary information.

[0326] "Means having an emotion engine that analyzes voice data and input data to sense the user's emotional state" refers to a device that has the function of analyzing the user's voice and input data and determining the user's emotional state.

[0327] "Means for evaluating the generated multiple proposed plans and selecting the most suitable plan based on said evaluation" refers to a method for evaluating the generated multiple travel plans and selecting the most suitable travel plan based on the evaluation results.

[0328] The "means for providing the selected plan to the user" refers to an interface or method for presenting the selected optimal travel plan to the user in an easy-to-understand manner.

[0329] "Means for monitoring the user's emotional state in real time and changing the proposed plan as appropriate in response to changes in the emotional state" refers to a function that constantly monitors the user's emotional state and quickly updates or changes the travel plan when a change in emotion is detected.

[0330] This invention is an automated system that combines an emotion engine to help users efficiently obtain travel plans. This system can also be used as a security alert app. The detailed configuration and processing procedures of the system for realizing this invention are described below.

[0331] System configuration

[0332] 1. User Device:

[0333] Smartphone: A device that collects voice and text data from users and sends them to a server. It also displays travel plans and security alerts to users.

[0334] Speech recognition software: Software that analyzes a user's voice data and converts it into text data.

[0335] 2. Server:

[0336] EmotionEngine: An engine for analyzing the user's emotional state. This engine analyzes voice and text data in real time to determine the user's emotional state.

[0337] AIGeneratePlan: A model with algorithms that generate optimal travel plans and security alerts based on normalized itinerary information and emotional states.

[0338] Database: A database for storing information entered by users, generated plans, analysis results of the emotion engine, etc.

[0339] Program processing and data calculation

[0340] 1. Data transmission and reception:

[0341] The user uses their smartphone to enter basic information such as itinerary and emergency contact details, which is sent to the server as an HTTP POST request and received as JSON format on the server side.

[0342] 2. Data validation and normalization:

[0343] The server validates and normalizes the information it receives, for example, ensuring that schedule information is in a valid format and that budgets are entered in the correct numeric format.

[0344] 3. Emotion Recognition with Emotion Engine:

[0345] The voice and text data entered by the user is analyzed in real time by the Emotion Engine, which determines the user's emotional state (e.g., anxiety, fear, joy).

[0346] 4. Plan proposals by generative AI:

[0347] AIGeneratePlan generates the most suitable travel and security plans based on normalized itinerary information and the analysis results of the emotion engine.

[0348] 5. Plan Selection and Display:

[0349] The server selects the best plan from the multiple plans generated and provides it to the user, who can then display the plan on their smartphone screen or download it in PDF format.

[0350] Specific examples

[0351] If a user feels anxious or scared while returning home late at night, the app will detect the user's anxiety through its emotion engine and generate a security measure using the following prompt:

[0352] Prompt: The user is out late at night and feeling anxious. What is the best security plan for this situation? For example, automatic notification of emergency contacts, calling local police, or directing the user to a safe location?

[0353] This example allows users to receive real-time security prompts tailored to their emotional state, including notifying emergency contacts, calling local police, and navigating to safe locations.

[0354] This invention makes it possible to monitor the user's emotional state in real time and provide an optimal plan accordingly.

[0355] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0356] Step 1:

[0357] The user uses a device (smartphone) to enter basic travel and security information, including the destination, itinerary, budget, mode of transportation, number of people, and emergency contact information. The device formats this information into JSON format and sends it to the server as an HTTP POST request (input: basic information entered by the user, output: JSON format data).

[0358] Step 2:

[0359] The server receives the basic information in JSON format sent from the device and validates the received data, checking, for example, whether the date format is correct, whether the budget is in the correct numeric format, whether the address is valid, etc. (Input: Basic information in JSON format, Output: Validated data)

[0360] Step 3:

[0361] The server normalizes the validated data, which is the process of converting input data into a consistent, standard format and preparing it for storage in the database (input: validated data, output: normalized data).

[0362] Step 4:

[0363] The voice and text data entered by the user is sent to a server via the device. This data is then analyzed by the Emotion Engine, which determines the user's emotional state (e.g., anxiety, joy, stress) in real time from the voice and text data (input: voice and text data, output: emotional state).

[0364] Step 5:

[0365] The server generates multiple proposed plans using AIGeneratePlan based on the normalized basic information and the emotional state analyzed by EmotionEngine. The generated plans correspond to the user's emotional state (input: normalized basic information, emotional state, output: multiple proposed plans).

[0366] Step 6:

[0367] The server evaluates the generated proposed plans and selects the optimal plan. The evaluation criteria for the plans include whether they are within budget, whether the schedule is reasonable, and whether they include activities that match the user's emotional state (input: multiple proposed plans, output: optimal plan).

[0368] Step 7:

[0369] The server sends the selected optimal plan to the user's terminal. The terminal receives this plan and displays it in a format that is easy for the user to view. For example, it can be displayed on a web screen or downloaded in PDF format (input: optimal plan, output: display of plan to user).

[0370] Step 8:

[0371] When the user's emotional state changes while traveling or out, the device sends voice and input data to the server in real time. The server then uses this new data to re-analyze the emotional state using the Emotion Engine and update the proposed plan as necessary (input: real-time voice and text data, output: updated proposed plan).

[0372] This process allows users to get optimal travel plans and security measures that adapt to their emotional state in real time.

[0373] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0374] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0375] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0376] [Second embodiment]

[0377] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0378] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0379] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0380] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0381] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0382] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0383] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0384] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0385] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0386] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0387] In the smart glasses 214, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0388] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0389] The present invention relates to an automated system for enabling a user to efficiently obtain a travel plan. Specific embodiments of the system of the present invention will be described below.

[0390] 1. Enter user information

[0391] The user uses a terminal to input the necessary information about the trip (date, area, transportation, number of people, budget). This information is collected through a dedicated form or user interface. For example, the user can input the following information:

[0392] Dates: 2023-12-01 to 2023-12-05

[0393] Region: Kyoto

[0394] Transportation: Train

[0395] Number of people: 2

[0396] Budget: 100,000 yen

[0397] 2. Sending and Receiving Information

[0398] The device sends the entered information to the server. Specifically, it sends data using an HTTP POST request. The server receives this request and processes the information. In this step, the information is generally sent in JSON format.

[0399] 3. Data Validation and Normalization

[0400] Validates and normalizes the information received by the server. First, it verifies the information for completeness and accuracy. For example, it checks that dates are in a valid format, that budgets are entered in the correct numeric format, and it verifies that locality names are in a standardized format and corrects them if necessary.

[0401] 4. Plan proposals using generative AI

[0402] The server then passes the normalized information to a generation AI to create a travel plan. The AI ​​generates multiple itineraries based on the input information and then generates several proposals from them. Factors taken into account at this stage include tourist destinations, accommodations, transportation options, and activities within a budget.

[0403] 5. Selecting the best plan and format

[0404] The server selects the optimal plan from the multiple plans generated. Evaluation criteria for the selection include whether the plan is within budget, whether the schedule is reasonable, and whether it includes activities that match the user's preferences. The selected plan is then formatted in a way that is easy for the user to understand. For example, the daily schedule and total cost are clearly displayed.

[0405] 6. Submitting and Viewing Plans

[0406] The server sends the optimal travel plan to the device. The device then displays the received plan to the user. Possible display methods include displaying it on a web screen, making it available for download in PDF format, or sending it by email. This allows the user to easily obtain the optimal travel plan and put it into action.

[0407] As described above, the system of the present invention provides a convenient tool for users to easily plan their trips, allowing users to significantly reduce the time and effort required for planning trips, making discovering new travel destinations and planning trips more fun and easier.

[0408] Examples:

[0409] For example, if a user plans a "5-day trip to Kyoto," selects "train" as their means of transportation, and has a budget of "100,000 yen," the AI ​​generator will suggest a daily schedule that includes tourist attractions such as Kiyomizu-dera Temple, Arashiyama, and Nijo Castle.

[0410] Day 1: Arrive at Kyoto Station -> Visit Kiyomizu-dera Temple -> Dinner in Gion

[0411] Day 2: Arashiyama sightseeing -> Bamboo forest path -> Sagano sightseeing train

[0412] Day 3: Visit Nijo Castle -> Eat your way around Nishiki Market

[0413] Day 4: Heian Shrine -> Philosopher's Path Walk -> Ginkakuji Temple

[0414] Day 5: Shopping around Kyoto Station -> Buying ekiben and heading home

[0415] Total cost: 95,000 yen

[0416] In this way, an optimal travel plan is automatically generated based on the conditions provided by the user.

[0417] The processing flow will be explained below.

[0418] Step 1:

[0419] The user enters the necessary information about the trip (date, location, mode of transportation, number of people, budget) into the terminal. This information is collected through a dedicated form or user interface. The entered information is formatted for further processing.

[0420] Step 2:

[0421] The device sends the entered information to the server. Specifically, it sends data using an HTTP POST request. This information is passed to the server in JSON format.

[0422] Step 3:

[0423] The server receives the information sent as an HTTP request, parses it, and converts it into an internal data structure.

[0424] Step 4:

[0425] Validating the information received by the server: Checking that the itinerary information is accurate and complete, for example, ensuring that dates are in a valid format, that the budget is entered in the correct numeric format, and that all required fields are filled in.

[0426] Step 5:

[0427] The server normalizes the information it receives, for example, to unify date formats and standardize locality names, e.g., unifying "2023-12-01 to 2023-12-05" to "2023-12-01 - 2023-12-05".

[0428] Step 6:

[0429] The server passes the normalized information to the generation AI to create a travel plan. The generation AI generates multiple proposed plans based on the input information. The proposed plans generated at this stage include daily sightseeing schedules, transportation options, accommodations, etc.

[0430] Step 7:

[0431] The server evaluates the multiple proposed plans returned by the generation AI and compares the suitability of each plan, based on criteria such as whether it is within budget, whether the schedule is reasonable, and whether it includes activities that match the user's preferences.

[0432] Step 8:

[0433] The server selects the best plan based on the evaluation results. An evaluation algorithm is used to determine the best plan.

[0434] Step 9:

[0435] The server formats the selected plan into a readable format, such as a text format that includes a daily schedule and total costs.

[0436] Step 10:

[0437] The server sends the optimal travel plan to the terminal, which then receives the plan and displays it for the user to view.

[0438] Step 11:

[0439] The terminal displays the received plan to the user. The display method may include displaying it on a web screen, making it downloadable in PDF format, or sending it by email.

[0440] This allows users to easily and efficiently obtain optimal travel plans.

[0441] Example 1

[0442] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0443] Creating a travel plan is a time-consuming and labor-intensive task for users. For example, users must plan sightseeing spots, accommodations, and other activities while taking into account factors such as travel dates, region, transportation, number of people, and budget. This process is complex, and there is a need for a system that can automatically create an efficient and satisfying travel plan for users.

[0444] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0445] In this invention, the server includes means for receiving travel information from a user, means for verifying and normalizing the travel information, means for creating a proposed plan using the normalized travel information with a generative AI model, means for selecting an optimal plan from the generated multiple proposed plans, and means for formatting the selected plan and providing it to the user, thereby enabling the user to automatically and efficiently obtain an optimal travel plan based on the conditions entered by the user.

[0446] "User" means an individual or entity that provides information and uses the System to create a travel plan.

[0447] "Travel information" refers to data necessary to create a travel plan, such as dates, area, transportation, number of people, and budget.

[0448] "Means for receiving" refers to an interface or system for capturing information provided by a user.

[0449] "Validation and normalization measures" refers to processes and systems for verifying the completeness and accuracy of received information and converting it into a standard format.

[0450] "Generative AI model" refers to an algorithm or software that uses artificial intelligence to generate a travel plan based on specific inputs.

[0451] "Proposed Plans" refers to multiple travel plans created by the generative AI model.

[0452] "Means of selection" refers to the process or system for evaluating and selecting the most appropriate plan from multiple proposed plans.

[0453] "Formatting means" refers to the process or system for converting the selected plan into a user-understandable format.

[0454] "Means for providing" refers to a method or system for informing the user of the selected and formatted plan.

[0455] The present invention relates to an automated system for users to efficiently obtain travel plans. The main components of this system include a user terminal, a server, and a generative AI model.

[0456] When a user uses the system, they first use a device to enter the necessary travel information (date, area, mode of transportation, number of people, budget). This information is collected through a dedicated form and user interface (UI). The device can be a smartphone or PC with a standard internet connection. A web browser (e.g., Google® Chrome) is used as the interface.

[0457] The device then sends the information entered by the user to a server using an HTTP POST request, with the data sent in JSON format. The server is typically a computer system such as a cloud service (e.g., an EC2 instance from Amazon Web Services), and web server software (e.g., Apache or Nginx) manages the data transmission and reception.

[0458] The server validates and normalizes the information it receives. This step checks the information for completeness and accuracy and corrects any deficiencies. For example, it ensures that dates are formatted correctly, budgets are in numeric format, and region names are standardized. A database management system (e.g., MySQL) and a programming language (e.g., Python) are used to implement this process.

[0459] The server then passes the normalized information to a generative AI model to generate a travel plan. The generative AI model uses advanced artificial intelligence (e.g., OpenAI GPT-4). The AI ​​model generates multiple travel plans based on a given prompt. Examples of prompts include:

[0460] "I'm planning a trip to Kyoto for two people between 2023-12-01 and 2023-12-05. We'll be traveling by train, with a total budget of 100,000 yen. Please suggest the best travel plan for these conditions."

[0461] The server selects the best plan from the generated plans, using criteria such as whether it is within budget, whether the schedule is reasonable, and whether it includes activities that meet the user's preferences. An algorithm (e.g., linear programming) is used to select the best plan.

[0462] The selected plan is formatted in a user-friendly format, for example, showing the daily schedule and total cost, using a formatting tool (e.g., the Jinja2 template engine).

[0463] Finally, the server sends the formatted plan to the device, which displays it to the user, possibly on a web screen, downloaded as a PDF, or emailed. To generate a PDF, a PDF generation tool (e.g., wkhtmltopdf) or a mail server (e.g., SendGrid) can be used.

[0464] The above is a detailed description of the embodiment of the present invention. Based on the conditions entered by the user, the user can automatically and efficiently obtain an optimal travel plan, significantly reducing the time and effort required for travel planning.

[0465] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0466] Step 1: Enter your user information

[0467] The user uses a terminal to input the necessary information about the trip (date, region, transportation, number of people, budget). Specifically, the information is entered into a form on the user interface (UI) and prepared for transmission to the server. The terminal receives input such as "Date: 2023-12-01 to 2023-12-05, Region: Kyoto, Transportation: Train, Number of people: 2, Budget: 100,000 yen," converts this to JSON format, and transmits it.

[0468] Step 2: Send information

[0469] The terminal sends the information entered by the user to the server. An HTTP POST request is used to send the data, and the information is sent in JSON format. Specifically, an HTTP request is created with the itinerary information encoded in JSON format as the payload, and sent to the server's endpoint. The input is the JSON data prepared in step 1, and the data is sent to the server as the output.

[0470] Step 3: Receiving and verifying information on the server

[0471] The server parses and validates the information received from the terminal. It parses the received JSON data and breaks it down into each field (reverse itinerary, schedule, region, etc.) to check for completeness and accuracy. For example, it checks whether the date format is "YYYY-MM-DD" and whether the budget is in numeric format. The input is the JSON data received in step 2, and the output is the validation result (e.g., checking that the data is in the correct format).

[0472] Step 4: Normalize the data

[0473] The server normalizes the validated information. It standardizes place names, date formats, etc. into a standard format and converts them into a format that can be passed to the generative AI model. Specifically, it standardizes "Kyoto" to "Kyoto" and converts dates to ISO 8601 format ("2023-12-01T00:00:00Z"). The input is the data validated in step 3, and the output is normalized data.

[0474] Step 5: Generate a travel plan using a generative AI model

[0475] The server passes the normalized information to a generative AI model, which generates a travel plan. The AI ​​model uses advanced artificial intelligence to generate multiple travel plans based on a prompt. For example, a prompt such as "We are planning a trip for two to Kyoto between 2023-12-01 and 2023-12-05. The mode of transportation will be by train, and the budget is 100,000 yen. Please suggest the optimal travel plan that meets these conditions" is created and input into the AI ​​model. The input is the normalized data obtained in step 4, and the output is multiple generated travel plans.

[0476] Step 6: Select the best plan

[0477] The server selects the best plan from the multiple itineraries generated. Selection criteria include being within budget, having a reasonable schedule, and including activities that match the user's preferences. An algorithm (e.g., linear programming) is used to evaluate each plan and select the best one. The input is the itineraries generated in step 5, and the output is the single best itinerary.

[0478] Step 7: Format your plan

[0479] The selected plan is formatted in a format that is easy for the user to understand. It is formatted so that the daily schedule and total cost are clearly displayed, and converted into a readable format (e.g., HTML or PDF). Specifically, the schedule list and total cost are calculated, and a plan is created in tabular or text format. The input is the optimal plan selected in step 6, and the output is a formatted, readable plan.

[0480] Step 8: Submit your plan

[0481] The server sends the formatted plan to the device. The sending method can be sending data in an HTTP response or sending it by email. Specifically, the formatted plan is returned as an HTTP response or sent to the user's email address and a download link is provided. The input is the plan formatted in step 7, and the output is the plan provided to the user.

[0482] Step 9: View your plan

[0483] The device displays the travel plan received from the server to the user, providing options such as displaying it in a web browser or downloading it as a PDF. Specifically, the device parses the received data and generates HTML to display in the browser or display it in a PDF viewer. The input is the formatted plan received in step 8, and the output is displayed visually to the user.

[0484] (Application example 1)

[0485] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0486] Conventional automatic travel plan generation systems have difficulty responding flexibly to users' real-time requests, and generating plans that take into account the situation and traffic information when the user actually arrives at the destination. As a result, users have to frequently readjust their plans during their trip, which reduces the enjoyment of the trip.

[0487] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0488] In this invention, the server includes means for receiving itinerary information from a user, means for verifying and normalizing the itinerary information, means for creating a proposed plan using a generation AI using the normalized itinerary information, means for selecting an optimal plan from the generated proposed plans, means for receiving a user request through voice input, means for generating an optimal sightseeing route in real time based on the voice input and presenting it on a visual display device, and means for providing the selected plan and the real-time generated sightseeing route to the user. This allows the user to obtain an optimal travel plan in real time that suits the local situation, enabling them to enjoy their trip while reducing stress during their trip.

[0489] "Itinerary information" refers to data related to a user's trip, such as the date, location, means of transportation, number of people, and budget.

[0490] "Validation and normalization" refers to verifying the completeness, accuracy, and conversion of received itinerary information into a standard format.

[0491] "Generative AI" refers to an algorithm or system that uses artificial intelligence techniques to automatically generate itineraries based on specific input data.

[0492] "Proposed plan" refers to multiple travel plan candidates created by the generation AI.

[0493] The "optimal plan" refers to the travel plan that best meets the user's conditions and preferences.

[0494] "Voice input" refers to a method of using a microphone to recognize a user's verbal instructions or requests as digital information.

[0495] "Visual display device" refers to a device that allows a user to obtain information visually, such as smart glasses or a head-mounted display.

[0496] A "tourist route" refers to a travel route that includes tourist spots that a user visits.

[0497] "Real-time" refers to the immediate processing and delivery of information based on the current time and situation.

[0498] "User" refers to an individual or organization that uses the automatic travel plan generation system.

[0499] This invention relates to an automated system for users to efficiently obtain travel plans. The system includes a terminal such as a smartphone or smart glasses, a server, and a generative AI model.

[0500] The server receives itinerary information (date, location, transportation, number of people, budget) from the user. The itinerary information is entered through a smartphone application or the interface of the smart glasses. For example, if a user plans a "5-day trip to Kyoto," he or she enters the following information:

[0501] Date: 2023-12-01 to 2023-12-05

[0502] Location: Kyoto

[0503] Transportation: Train

[0504] Number of people: 2

[0505] Budget: 100,000 yen

[0506] Once received, the information is validated and normalized by the server, ensuring completeness and accuracy, and converting it to the required format, for example by checking date formats and standardizing locality names.

[0507] The normalized information is then passed to a generative AI model, which automatically generates multiple itineraries based on the input data, including destinations, accommodations, transportation options, and activities within a budget.

[0508] The server selects the best plan from the generated plans. The selection criteria may include being within the budget, being within the schedule, and including activities that match the user's preferences.

[0509] The best plan is then formatted and displayed on a smartphone or smart glasses in a user-friendly format, including a daily schedule and total costs.

[0510] Furthermore, when users make requests through voice input in real time while traveling, the server receives the information and optimizes sightseeing routes based on real-time conditions. This information is displayed on smart glasses or smartphones, so users can instantly know the optimal route during their trip.

[0511] For example, you can use the following prompts for voice input:

[0512] "What is the shortest route from Kyoto Station to Kiyomizu-dera Temple?"

[0513] The server processes real-time traffic information and current location data based on voice input and generates the optimal route, allowing users to obtain the optimal travel plan in real time based on local conditions, allowing them to enjoy their trip while reducing stress.

[0514] As described above, the system of the present invention provides a convenient tool that allows users to easily create a travel plan and obtain the optimal route in real time while traveling. This system allows users to significantly reduce the time and effort required for planning a trip and to have a more fulfilling travel experience.

[0515] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0516] Step 1:

[0517] The user inputs itinerary information using a device (smartphone or smart glasses). Specifically, information such as date, location, mode of transportation, number of people, and budget is provided using a dedicated form or voice input. The input information is temporarily stored on the device as JSON format data.

[0518] Step 2:

[0519] The device sends the itinerary information entered by the user to the server, which then sends the JSON formatted data using an HTTP POST request. The server receives this request and stores the data in variables for processing.

[0520] Step 3:

[0521] The server validates and normalizes the itinerary information received, checking for completeness (all required fields filled in), accuracy (checking date formats and numbers), and converting it to a standard format (such as standardizing place names). Successfully validated information is reformatted for further processing.

[0522] Step 4:

[0523] The server passes the normalized itinerary information to a generative AI model, which then automatically generates multiple itineraries based on the input data. This process takes into account factors such as tourist destinations, accommodations, transportation options, and activity schedules. The generated itineraries are returned to the server in list form.

[0524] Step 5:

[0525] The server evaluates multiple proposed plans and selects the best one, based on criteria such as whether it fits within the budget, whether it fits within the schedule, and whether it includes activities that match the user's preferences. The best plan is then formatted for delivery to the user.

[0526] Step 6:

[0527] The optimal plan is provided to the user. The server sends the formatted plan to the device. The device visually displays the received plan on the screen. The user can check the daily schedule and total cost.

[0528] Step 7:

[0529] While traveling, the user issues a request to the server through voice input, for example, using a prompt such as "Tell me the shortest route from Kyoto Station to Kiyomizu-dera Temple." The voice input is converted into text format on the device and sent to the server.

[0530] Step 8:

[0531] The server generates a real-time sightseeing route based on the user's voice input, taking into account the user's current location and real-time traffic conditions, and sends the optimized route information in JSON format to the device.

[0532] Step 9:

[0533] The terminal then presents the received real-time tourist route on a visual display device (such as smart glasses), allowing the user to act on the information.

[0534] Through these steps, users can obtain optimal information throughout the entire process, from pre-trip planning to real-time route guidance on-site.

[0535] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0536] The present invention relates to an automated system that combines an emotion engine to enable users to efficiently obtain travel plans. Specific embodiments of the system of the present invention will be described below.

[0537] 1. Enter user information

[0538] The user uses a terminal to input the necessary information about the trip (date, area, transportation, number of people, budget). This information is collected through a dedicated form or user interface. For example, the user can input the following information:

[0539] Dates: 2023-12-01 to 2023-12-05

[0540] Region: Kyoto

[0541] Transportation: Train

[0542] Number of people: 2

[0543] Budget: 100,000 yen

[0544] 2. Sending and Receiving Information

[0545] The device sends the entered information to the server. Specifically, it sends data using an HTTP POST request. The server receives this request and processes the information. In this step, the information is generally sent in JSON format.

[0546] 3. Data Validation and Normalization

[0547] The server validates and normalizes the information it receives. First, it checks the information for completeness and accuracy. For example, it checks that dates are in a valid format and that budgets are entered in the correct numeric format. It also checks that locality names are in a standardized format and corrects them if necessary.

[0548] 4. Emotion Recognition by Emotion Engine

[0549] While the user is inputting information or during other interactions, the device passes voice and input data to an emotion engine to sense the user's emotional state. The emotion engine analyzes this data and determines the user's emotional state (e.g., excitement, joy, stress).

[0550] 5. Plan proposals using generative AI

[0551] The server passes the normalized information and the results of the emotion engine to the generation AI to create a travel plan. The generation AI generates multiple proposed plans based on the input information and the user's emotional state. The proposed plans generated at this stage include sightseeing schedules, transportation options, accommodations, etc., tailored to the user's emotional state.

[0552] 6. Selecting the best plan and format

[0553] The server selects the optimal plan from the generated plans. Evaluation criteria for the selection include whether the plan is within budget, whether the schedule is reasonable, and whether it includes activities that match the user's emotional state. The selected plan is then formatted in a way that is easy for the user to understand. For example, the daily schedule and total cost are clearly displayed.

[0554] 7. Real-time emotional state monitoring

[0555] The server continues to monitor the user's emotional state in real time while the proposed plan is being provided to the user and afterwards. If a change in the user's emotional state is detected, the content of the proposed plan and the presentation method are changed accordingly.

[0556] 8. Submitting and Viewing Plans

[0557] The server sends the optimal travel plan to the device. The device then displays the received plan to the user. The display method can be on a web screen, downloadable in PDF format, or sent by email. This allows the user to easily obtain the optimal travel plan and put it into action.

[0558] Examples:

[0559] For example, if a user plans a "5-day trip to Kyoto," selects "train" as their means of transportation, has a budget of "100,000 yen," and the emotion engine determines that the user is tired, the generative AI will create a plan that prioritizes tourist spots and activities that will help the user relax. See the example below.

[0560] Day 1: Arrive at Kyoto Station -> Visit Kiyomizu-dera Temple -> Dinner in Gion

[0561] Day 2: Sightseeing in Arashiyama -> Bamboo Forest Path -> Relaxing Cafe Break

[0562] Day 3: Visit Nijo Castle -> Eat your way around Nishiki Market

[0563] Day 4: Heian Shrine -> Philosopher's Path Walk -> Ginkakuji Temple

[0564] Day 5: Shopping around Kyoto Station -> Buying ekiben and heading home

[0565] Total cost: 95,000 yen

[0566] In this way, by providing a plan that takes into account the user's emotional state, the user experience can be enhanced.

[0567] The processing flow will be explained below.

[0568] Step 1:

[0569] The user inputs the necessary information about the trip (date, area, transportation, number of people, budget) into the terminal. The user can easily provide the information through a dedicated form or user interface.

[0570] Step 2:

[0571] The device sends the entered information to the server, specifically by using an HTTP POST request to send the data to the server in JSON format.

[0572] Step 3:

[0573] The server receives the information sent as an HTTP request, parses it, and converts it into an internal data structure.

[0574] Step 4:

[0575] The server validates and normalizes the information it receives, first checking that information such as dates and budgets are in the correct format, and then standardizing date formats and locality names as needed.

[0576] Step 5:

[0577] To sense the user's emotional state, the device passes the input voice data and input data to the emotion engine, which analyzes this data and determines the user's emotional state (e.g., excitement, joy, stress).

[0578] Step 6:

[0579] The server passes the normalized information and the results of the emotion engine to the generation AI, which then creates a travel plan. The generation AI then generates multiple proposed plans based on this information. The plans generated at this stage include sightseeing schedules and accommodations based on the user's emotional state.

[0580] Step 7:

[0581] The server evaluates the multiple proposed plans returned by the generation AI and selects the optimal plan. Evaluation criteria include whether the plan is within budget, the schedule is feasible, and whether it matches the user's emotional state.

[0582] Step 8:

[0583] The server selects the optimal plan based on the evaluation results and then provides it to the user in a format that is easy for the user to understand, such as by showing the daily schedule and total cost.

[0584] Step 9:

[0585] The server sends the selected travel plan to the terminal, which can then be displayed on a web screen, made available for download in PDF format, or sent via email.

[0586] Step 10:

[0587] The terminal displays the received plan to the user, who can then proceed with specific travel preparations based on the displayed plan.

[0588] Step 11:

[0589] The server monitors the user's emotional state in real time during and after the proposed plan is provided. If a change in the user's emotional state is detected, the content of the proposed plan and the way it is presented are changed appropriately. This allows the user to use the travel plan more comfortably.

[0590] In this way, by combining an emotion engine, the present invention provides travel plans that take into account the user's emotional state, realizing a more personalized user experience.

[0591] Example 2

[0592] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0593] Conventional travel plan providing systems do not take into account the user's emotional state when making suggestions, which can lead to a poor user experience. Furthermore, the process from inputting travel information to creating a plan, and then selecting and providing the optimal plan, is complicated and inefficient, making it difficult for users to use.

[0594] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for receiving necessary travel information from a user, means for verifying and normalizing the travel information, means for inputting a prompt sentence into a generative AI model using the normalized travel information and creating a proposed plan, means for selecting an optimal plan from the generated proposed plans, means for providing the selected plan to the user, and means for monitoring the user's emotional state using an emotion engine and reflecting the user's emotional state in the proposed plan. This enables automatic generation of an optimal travel plan that takes the user's emotional state into consideration and flexible provision of plans by monitoring the emotional state in real time.

[0595] A "user" is an individual or organization who wishes to use this system to create a travel plan.

[0596] "Necessary travel information" refers to data necessary for making travel plans, including dates, areas, means of transportation, number of people, budget, etc.

[0597] "Validation and normalization" is the process of verifying received travel information for accuracy and completeness and converting it into a standard format.

[0598] A "generative AI model" is an artificial intelligence system that automatically suggests travel plans based on input information.

[0599] A "prompt sentence" is an input sentence used to give instructions to a generative AI model.

[0600] A "proposed plan" is a proposed travel plan generated by a generative AI model.

[0601] The "emotion engine" is a system that analyzes the user's emotional state and adjusts travel plans based on that information.

[0602] "Real-time emotional state monitoring" is the process of continuously analyzing the user's emotional state in real time and appropriately changing the travel plan and presentation method based on the results.

[0603] The present invention relates to an automated system that combines various engines and AI technology to enable users to efficiently obtain travel plans. This system generates and provides optimal travel plans based on the user's travel information and emotional state. Specific embodiments for carrying out the invention are described below.

[0604] First, the user uses the device to input the necessary information about the trip. This information includes the itinerary, area, mode of transportation, number of people, budget, etc. The device collects this information through a dedicated form or user interface. For example, the user can input the following information:

[0605] Dates: 2023-12-01 to 2023-12-05

[0606] Region: Kyoto

[0607] Transportation: Train

[0608] Number of people: 2

[0609] Budget: 100,000 yen

[0610] The device sends this input information to the server using an HTTP POST request. The data is typically sent in JSON format. The server receives this request and parses the data.

[0611] The server then validates and normalizes the received information. The validation process checks the accuracy of date formats, the numeric format of budgets, and also standardizes locality names. For example, it verifies that "2023-12-01 to 2023-12-05" is a valid date format, and that "100000" is a valid numeric format. It also converts the locality name "Kyoto" to a standard format.

[0612] The device then passes the user's input and voice data to the emotion engine in real time. The emotion engine analyzes this data and determines the user's emotional state. For example, it can analyze whether the user is relaxed or stressed while typing.

[0613] The server then passes the normalized information and emotional state to a generative AI model, which automatically generates a travel plan. The generative AI model generates multiple proposed plans based on the input information and the user's emotional state. It also selects the most suitable plan from the multiple plans. Selection criteria include being within budget, having a reasonable schedule, and including activities that match the user's emotional state.

[0614] For example, a generative AI model might suggest the following plan:

[0615] Day 1: Arrive at Kyoto Station -> Visit Kiyomizu-dera Temple -> Dinner in Gion

[0616] Day 2: Sightseeing in Arashiyama -> Bamboo Forest Path -> Relaxing Cafe Break

[0617] Day 3: Visit Nijo Castle -> Eat your way around Nishiki Market

[0618] Day 4: Heian Shrine -> Philosopher's Path Walk -> Ginkakuji Temple

[0619] Day 5: Shopping around Kyoto Station -> Buying ekiben and heading home

[0620] Total cost: 95,000 yen

[0621] Furthermore, the system has a function to monitor the user's emotional state in real time. This allows the system to appropriately change the content and presentation method of the proposed plan when a change in the user's emotional state is detected. The proposed plan is formatted in a user-friendly format, and can be displayed on a web screen, downloaded as a PDF, or sent by email, for example.

[0622] Through the above process, users can easily obtain the optimal travel plan and put it into action. Below is an example of a prompt for the generative AI model:

[0623] User input: Kyoto trip from 2023-12-01 to 2023-12-05, transportation: train, number of people: 2, budget: 100,000 yen

[0624] Emotional state: User is tired

[0625] Input prompt for the generation AI: Generate a Kyoto itinerary. The user is tired. Prioritize relaxing activities. Budget is within 100,000 yen.

[0626] In this way, the automatically generated travel plan can meet the user's expectations and provide a satisfying travel experience.

[0627] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0628] Step 1:

[0629] The user inputs the necessary information about the trip into the terminal. Specifically, the user uses a form to input the dates, area, transportation, number of people, budget, etc. Examples of input data are as follows:

[0630] Dates: 2023-12-01 to 2023-12-05

[0631] Region: Kyoto

[0632] Transportation: Train

[0633] Number of people: 2

[0634] Budget: 100,000 yen

[0635] The entered data is saved on the device.

[0636] Step 2:

[0637] The device converts the input information into JSON format and sends it to the server using an HTTP POST request. Specifically, it generates the following JSON data:

[0638] json

[0639] {

[0640] "Dates": "2023-12-01 to 2023-12-05",

[0641] "Region": "Kyoto",

[0642] "Transportation": "Train",

[0643] "Number of people": 2,

[0644] "Budget": 100000

[0645] }

[0646] This data is sent to the server and received by the server.

[0647] Step 3:

[0648] Validates and normalizes the information received by the server, specifically ensuring that dates are in the correct format, that budgets are in numeric format, and converts region names to a standard format. Transformations include:

[0649] Verify that "2023-12-01 to 2023-12-05" is a valid date format.

[0650] Verify that the budget is "100000" and convert it to a number format.

[0651] The normalized data is passed on to the next process.

[0652] Step 4:

[0653] The device passes the user's input data and voice data to the emotion engine. The emotion engine analyzes this data and determines the user's emotional state. For example, it analyzes whether the user is relaxed or stressed while inputting, and outputs the results as data. The emotional state is determined to be "relaxed" or "stressed," for example.

[0654] Step 5:

[0655] The server passes the normalized information and emotional state to the generative AI model, which then automatically generates a travel plan. The server inputs the following prompt into the generative AI model:

[0656] "Generate a Kyoto itinerary. The user is tired. Prioritize relaxing activities. Budget is under 100,000 yen."

[0657] The generative AI model generates and outputs multiple travel plans based on the input prompt and data.

[0658] Step 6:

[0659] The server selects the best travel plan from the multiple plans generated. Selection criteria include being within budget, having a reasonable schedule, and including activities that match the user's emotional state. The selected plan is then passed on to the next process.

[0660] Step 7:

[0661] The server formats the optimal itinerary in a user-friendly format, showing the daily schedule and total cost. For example, the following output might be generated:

[0662] Day 1: Arrive at Kyoto Station -> Visit Kiyomizu-dera Temple -> Dinner in Gion

[0663] Day 2: Sightseeing in Arashiyama -> Bamboo Forest Path -> Relaxing Cafe Break

[0664] Day 3: Visit Nijo Castle -> Eat your way around Nishiki Market

[0665] Day 4: Heian Shrine -> Philosopher's Path Walk -> Ginkakuji Temple

[0666] Day 5: Shopping around Kyoto Station -> Buying ekiben and heading home

[0667] Total cost: 95,000 yen

[0668] Step 8:

[0669] The server sends the optimal travel plan to the device. The device displays the received plan to the user. Display methods include displaying it on a web screen, downloading it in PDF format, or sending it by email. This allows the user to confirm the travel plan and put it into action.

[0670] (Application example 2)

[0671] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0672] Conventional travel planning systems mainly generate plans based on basic information entered by the user, but lack consideration for the user's emotional state or individual circumstances. This makes it difficult to alleviate the emotional anxiety and stress that users experience while traveling, making it difficult to provide a satisfying travel experience. Furthermore, since there was no system that could immediately respond to changes in the user's emotional state, it was also impossible to provide an optimal plan in real time.

[0673] The specification process by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving itinerary information from a user, means for verifying and normalizing the itinerary information, means for creating a proposed plan by a generation AI using the normalized itinerary information, and means having an emotion engine for analyzing voice data and input data to sense the user's emotional state. This makes it possible to monitor the user's emotional state in real time and change the proposed plan as appropriate in response to changes in the user's emotional state.

[0674] The "means for receiving itinerary information from the user" is an interface through which the system collects information about the trip entered by the user.

[0675] The "means for verifying and normalizing said itinerary information" is a function for checking the accuracy and consistency of collected itinerary information and arranging it into a standard format.

[0676] "Means for creating proposed plans using a generation AI based on the normalized itinerary information" refers to a method for automatically generating multiple travel plans using a generation AI based on normalized itinerary information.

[0677] "Means having an emotion engine that analyzes voice data and input data to sense the user's emotional state" refers to a device that has the function of analyzing the user's voice and input data and determining the user's emotional state.

[0678] "Means for evaluating the generated multiple proposed plans and selecting the most suitable plan based on said evaluation" refers to a method for evaluating the generated multiple travel plans and selecting the most suitable travel plan based on the evaluation results.

[0679] The "means for providing the selected plan to the user" refers to an interface or method for presenting the selected optimal travel plan to the user in an easy-to-understand manner.

[0680] "Means for monitoring the user's emotional state in real time and changing the proposed plan as appropriate in response to changes in the emotional state" refers to a function that constantly monitors the user's emotional state and quickly updates or changes the travel plan when a change in emotion is detected.

[0681] This invention is an automated system that combines an emotion engine to help users efficiently obtain travel plans. This system can also be used as a security alert app. The detailed configuration and processing procedures of the system for realizing this invention are described below.

[0682] System configuration

[0683] 1. User Device:

[0684] Smartphone: A device that collects voice and text data from users and sends them to a server. It also displays travel plans and security alerts to users.

[0685] Speech recognition software: Software that analyzes a user's voice data and converts it into text data.

[0686] 2. Server:

[0687] EmotionEngine: An engine for analyzing the user's emotional state. This engine analyzes voice and text data in real time to determine the user's emotional state.

[0688] AIGeneratePlan: A model with algorithms that generate optimal travel plans and security alerts based on normalized itinerary information and emotional states.

[0689] Database: A database for storing information entered by users, generated plans, analysis results of the emotion engine, etc.

[0690] Program processing and data calculation

[0691] 1. Data transmission and reception:

[0692] The user uses their smartphone to enter basic information such as itinerary and emergency contact details, which is sent to the server as an HTTP POST request and received as JSON format on the server side.

[0693] 2. Data validation and normalization:

[0694] The server validates and normalizes the information it receives, for example, ensuring that schedule information is in a valid format and that budgets are entered in the correct numeric format.

[0695] 3. Emotion Recognition with Emotion Engine:

[0696] The voice and text data entered by the user is analyzed in real time by the Emotion Engine, which determines the user's emotional state (e.g., anxiety, fear, joy).

[0697] 4. Plan proposals by generative AI:

[0698] AIGeneratePlan generates the most suitable travel and security plans based on normalized itinerary information and the analysis results of the emotion engine.

[0699] 5. Plan Selection and Display:

[0700] The server selects the best plan from the multiple plans generated and provides it to the user, who can then display the plan on their smartphone screen or download it in PDF format.

[0701] Specific examples

[0702] If a user feels anxious or scared while returning home late at night, the app will detect the user's anxiety through its emotion engine and generate a security measure using the following prompt:

[0703] Prompt: The user is out late at night and feeling anxious. What is the best security plan for this situation? For example, automatic notification of emergency contacts, calling local police, or directing the user to a safe location?

[0704] This example allows users to receive real-time security prompts tailored to their emotional state, including notifying emergency contacts, calling local police, and navigating to safe locations.

[0705] This invention makes it possible to monitor the user's emotional state in real time and provide an optimal plan accordingly.

[0706] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0707] Step 1:

[0708] The user uses a device (smartphone) to enter basic travel and security information, including the destination, itinerary, budget, mode of transportation, number of people, and emergency contact information. The device formats this information into JSON format and sends it to the server as an HTTP POST request (input: basic information entered by the user, output: JSON format data).

[0709] Step 2:

[0710] The server receives the basic information in JSON format sent from the device and validates the received data, checking, for example, whether the date format is correct, whether the budget is in the correct numeric format, whether the address is valid, etc. (Input: Basic information in JSON format, Output: Validated data)

[0711] Step 3:

[0712] The server normalizes the validated data, which is the process of converting input data into a consistent, standard format and preparing it for storage in the database (input: validated data, output: normalized data).

[0713] Step 4:

[0714] The voice and text data entered by the user is sent to a server via the device. This data is then analyzed by the Emotion Engine, which determines the user's emotional state (e.g., anxiety, joy, stress) in real time from the voice and text data (input: voice and text data, output: emotional state).

[0715] Step 5:

[0716] The server generates multiple proposed plans using AIGeneratePlan based on the normalized basic information and the emotional state analyzed by EmotionEngine. The generated plans correspond to the user's emotional state (input: normalized basic information, emotional state, output: multiple proposed plans).

[0717] Step 6:

[0718] The server evaluates the generated proposed plans and selects the optimal plan. The evaluation criteria for the plans include whether they are within budget, whether the schedule is reasonable, and whether they include activities that match the user's emotional state (input: multiple proposed plans, output: optimal plan).

[0719] Step 7:

[0720] The server sends the selected optimal plan to the user's terminal. The terminal receives this plan and displays it in a format that is easy for the user to view. For example, it can be displayed on a web screen or downloaded in PDF format (input: optimal plan, output: display of plan to user).

[0721] Step 8:

[0722] When the user's emotional state changes while traveling or out, the device sends voice and input data to the server in real time. The server then uses this new data to re-analyze the emotional state using the Emotion Engine and update the proposed plan as necessary (input: real-time voice and text data, output: updated proposed plan).

[0723] This process allows users to get optimal travel plans and security measures that adapt to their emotional state in real time.

[0724] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0725] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0726] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0727] [Third embodiment]

[0728] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0729] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0730] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0731] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0732] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0733] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0734] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0735] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0736] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0737] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0738] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0739] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0740] The present invention relates to an automated system for enabling a user to efficiently obtain a travel plan. Specific embodiments of the system of the present invention will be described below.

[0741] 1. Enter user information

[0742] The user uses a terminal to input the necessary information about the trip (date, area, transportation, number of people, budget). This information is collected through a dedicated form or user interface. For example, the user can input the following information:

[0743] Dates: 2023-12-01 to 2023-12-05

[0744] Region: Kyoto

[0745] Transportation: Train

[0746] Number of people: 2

[0747] Budget: 100,000 yen

[0748] 2. Sending and Receiving Information

[0749] The device sends the entered information to the server. Specifically, it sends data using an HTTP POST request. The server receives this request and processes the information. In this step, the information is generally sent in JSON format.

[0750] 3. Data Validation and Normalization

[0751] Validates and normalizes the information received by the server. First, it verifies the information for completeness and accuracy. For example, it checks that dates are in a valid format, that budgets are entered in the correct numeric format, and it verifies that locality names are in a standardized format and corrects them if necessary.

[0752] 4. Plan proposals using generative AI

[0753] The server then passes the normalized information to a generation AI to create a travel plan. The AI ​​generates multiple itineraries based on the input information and then generates several proposals from them. Factors taken into account at this stage include tourist destinations, accommodations, transportation options, and activities within a budget.

[0754] 5. Selecting the best plan and format

[0755] The server selects the optimal plan from the multiple plans generated. Evaluation criteria for the selection include whether the plan is within budget, whether the schedule is reasonable, and whether it includes activities that match the user's preferences. The selected plan is then formatted in a way that is easy for the user to understand. For example, the daily schedule and total cost are clearly displayed.

[0756] 6. Submitting and Viewing Plans

[0757] The server sends the optimal travel plan to the device. The device then displays the received plan to the user. Possible display methods include displaying it on a web screen, making it available for download in PDF format, or sending it by email. This allows the user to easily obtain the optimal travel plan and put it into action.

[0758] As described above, the system of the present invention provides a convenient tool for users to easily plan their trips, allowing users to significantly reduce the time and effort required for planning trips, making discovering new travel destinations and planning trips more fun and easier.

[0759] Examples:

[0760] For example, if a user plans a "5-day trip to Kyoto," selects "train" as their means of transportation, and has a budget of "100,000 yen," the AI ​​generator will suggest a daily schedule that includes tourist attractions such as Kiyomizu-dera Temple, Arashiyama, and Nijo Castle.

[0761] Day 1: Arrive at Kyoto Station -> Visit Kiyomizu-dera Temple -> Dinner in Gion

[0762] Day 2: Arashiyama sightseeing -> Bamboo forest path -> Sagano sightseeing train

[0763] Day 3: Visit Nijo Castle -> Eat your way around Nishiki Market

[0764] Day 4: Heian Shrine -> Philosopher's Path Walk -> Ginkakuji Temple

[0765] Day 5: Shopping around Kyoto Station -> Buying ekiben and heading home

[0766] Total cost: 95,000 yen

[0767] In this way, an optimal travel plan is automatically generated based on the conditions provided by the user.

[0768] The processing flow will be explained below.

[0769] Step 1:

[0770] The user enters the necessary information about the trip (date, location, mode of transportation, number of people, budget) into the terminal. This information is collected through a dedicated form or user interface. The entered information is formatted for further processing.

[0771] Step 2:

[0772] The device sends the entered information to the server. Specifically, it sends data using an HTTP POST request. This information is passed to the server in JSON format.

[0773] Step 3:

[0774] The server receives the information sent as an HTTP request, parses it, and converts it into an internal data structure.

[0775] Step 4:

[0776] Validating the information received by the server: Checking that the itinerary information is accurate and complete, for example, ensuring that dates are in a valid format, that the budget is entered in the correct numeric format, and that all required fields are filled in.

[0777] Step 5:

[0778] The server normalizes the information it receives, for example, to unify date formats and standardize locality names, e.g., unifying "2023-12-01 to 2023-12-05" to "2023-12-01 - 2023-12-05".

[0779] Step 6:

[0780] The server passes the normalized information to the generation AI to create a travel plan. The generation AI generates multiple proposed plans based on the input information. The proposed plans generated at this stage include daily sightseeing schedules, transportation options, accommodations, etc.

[0781] Step 7:

[0782] The server evaluates the multiple proposed plans returned by the generation AI and compares the suitability of each plan, based on criteria such as whether it is within budget, whether the schedule is reasonable, and whether it includes activities that match the user's preferences.

[0783] Step 8:

[0784] The server selects the best plan based on the evaluation results. An evaluation algorithm is used to determine the best plan.

[0785] Step 9:

[0786] The server formats the selected plan into a readable format, such as a text format that includes a daily schedule and total costs.

[0787] Step 10:

[0788] The server sends the optimal travel plan to the terminal, which then receives the plan and displays it for the user to view.

[0789] Step 11:

[0790] The terminal displays the received plan to the user. The display method may include displaying it on a web screen, making it downloadable in PDF format, or sending it by email.

[0791] This allows users to easily and efficiently obtain optimal travel plans.

[0792] Example 1

[0793] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0794] Creating a travel plan is a time-consuming and labor-intensive task for users. For example, users must plan sightseeing spots, accommodations, and other activities while taking into account factors such as travel dates, region, transportation, number of people, and budget. This process is complex, and there is a need for a system that can automatically create an efficient and satisfying travel plan for users.

[0795] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0796] In this invention, the server includes means for receiving travel information from a user, means for verifying and normalizing the travel information, means for creating a proposed plan using the normalized travel information with a generative AI model, means for selecting an optimal plan from the generated multiple proposed plans, and means for formatting the selected plan and providing it to the user, thereby enabling the user to automatically and efficiently obtain an optimal travel plan based on the conditions entered by the user.

[0797] "User" means an individual or entity that provides information and uses the System to create a travel plan.

[0798] "Travel information" refers to data necessary to create a travel plan, such as dates, area, transportation, number of people, and budget.

[0799] "Means for receiving" refers to an interface or system for capturing information provided by a user.

[0800] "Validation and normalization measures" refers to processes and systems for verifying the completeness and accuracy of received information and converting it into a standard format.

[0801] "Generative AI model" refers to an algorithm or software that uses artificial intelligence to generate a travel plan based on specific inputs.

[0802] "Proposed Plans" refers to multiple travel plans created by the generative AI model.

[0803] "Means of selection" refers to the process or system for evaluating and selecting the most appropriate plan from multiple proposed plans.

[0804] "Formatting means" refers to the process or system for converting the selected plan into a user-understandable format.

[0805] "Means for providing" refers to a method or system for informing the user of the selected and formatted plan.

[0806] The present invention relates to an automated system for users to efficiently obtain travel plans. The main components of this system include a user terminal, a server, and a generative AI model.

[0807] When a user uses the system, they first use a device to enter the necessary travel information (date, location, mode of transportation, number of people, budget). This information is collected through a dedicated form and user interface (UI). The device can be a smartphone or PC with a standard internet connection. A web browser (e.g., Google Chrome) is used as the interface.

[0808] The device then sends the information entered by the user to a server using an HTTP POST request, with the data sent in JSON format. The server is typically a computer system such as a cloud service (e.g., an EC2 instance from Amazon Web Services), and web server software (e.g., Apache or Nginx) manages the data transmission and reception.

[0809] The server validates and normalizes the information it receives. This step checks the information for completeness and accuracy and corrects any deficiencies. For example, it ensures that dates are formatted correctly, budgets are in numeric format, and region names are standardized. A database management system (e.g., MySQL) and a programming language (e.g., Python) are used to implement this process.

[0810] The server then passes the normalized information to a generative AI model to generate a travel plan. The generative AI model uses advanced artificial intelligence (e.g., OpenAI GPT-4). The AI ​​model generates multiple travel plans based on a given prompt. Examples of prompts include:

[0811] "I'm planning a trip to Kyoto for two people between 2023-12-01 and 2023-12-05. We'll be traveling by train, with a total budget of 100,000 yen. Please suggest the best travel plan for these conditions."

[0812] The server selects the best plan from the generated plans, using criteria such as whether it is within budget, whether the schedule is reasonable, and whether it includes activities that meet the user's preferences. An algorithm (e.g., linear programming) is used to select the best plan.

[0813] The selected plan is formatted in a user-friendly format, for example, showing the daily schedule and total cost, using a formatting tool (e.g., the Jinja2 template engine).

[0814] Finally, the server sends the formatted plan to the device, which displays it to the user, possibly on a web screen, downloaded as a PDF, or emailed. To generate a PDF, a PDF generation tool (e.g., wkhtmltopdf) or a mail server (e.g., SendGrid) can be used.

[0815] The above is a detailed description of the embodiment of the present invention. Based on the conditions entered by the user, the user can automatically and efficiently obtain an optimal travel plan, significantly reducing the time and effort required for travel planning.

[0816] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0817] Step 1: Enter your user information

[0818] The user uses a terminal to input the necessary information about the trip (date, region, transportation, number of people, budget). Specifically, the information is entered into a form on the user interface (UI) and prepared for transmission to the server. The terminal receives input such as "Date: 2023-12-01 to 2023-12-05, Region: Kyoto, Transportation: Train, Number of people: 2, Budget: 100,000 yen," converts this to JSON format, and transmits it.

[0819] Step 2: Send information

[0820] The terminal sends the information entered by the user to the server. An HTTP POST request is used to send the data, and the information is sent in JSON format. Specifically, an HTTP request is created with the itinerary information encoded in JSON format as the payload, and sent to the server's endpoint. The input is the JSON data prepared in step 1, and the data is sent to the server as the output.

[0821] Step 3: Receiving and verifying information on the server

[0822] The server parses and validates the information received from the terminal. It parses the received JSON data and breaks it down into each field (reverse itinerary, schedule, region, etc.) to check for completeness and accuracy. For example, it checks whether the date format is "YYYY-MM-DD" and whether the budget is in numeric format. The input is the JSON data received in step 2, and the output is the validation result (e.g., checking that the data is in the correct format).

[0823] Step 4: Normalize the data

[0824] The server normalizes the validated information. It standardizes place names, date formats, etc. into a standard format and converts them into a format that can be passed to the generative AI model. Specifically, it standardizes "Kyoto" to "Kyoto" and converts dates to ISO 8601 format ("2023-12-01T00:00:00Z"). The input is the data validated in step 3, and the output is normalized data.

[0825] Step 5: Generate a travel plan using a generative AI model

[0826] The server passes the normalized information to a generative AI model, which generates a travel plan. The AI ​​model uses advanced artificial intelligence to generate multiple travel plans based on a prompt. For example, a prompt such as "We are planning a trip for two to Kyoto between 2023-12-01 and 2023-12-05. The mode of transportation will be by train, and the budget is 100,000 yen. Please suggest the optimal travel plan that meets these conditions" is created and input into the AI ​​model. The input is the normalized data obtained in step 4, and the output is multiple generated travel plans.

[0827] Step 6: Select the best plan

[0828] The server selects the best plan from the multiple itineraries generated. Selection criteria include being within budget, having a reasonable schedule, and including activities that match the user's preferences. An algorithm (e.g., linear programming) is used to evaluate each plan and select the best one. The input is the itineraries generated in step 5, and the output is the single best itinerary.

[0829] Step 7: Format your plan

[0830] The selected plan is formatted in a format that is easy for the user to understand. It is formatted so that the daily schedule and total cost are clearly displayed, and converted into a readable format (e.g., HTML or PDF). Specifically, the schedule list and total cost are calculated, and a plan is created in tabular or text format. The input is the optimal plan selected in step 6, and the output is a formatted, readable plan.

[0831] Step 8: Submit your plan

[0832] The server sends the formatted plan to the device. The sending method can be sending data in an HTTP response or sending it by email. Specifically, the formatted plan is returned as an HTTP response or sent to the user's email address and a download link is provided. The input is the plan formatted in step 7, and the output is the plan provided to the user.

[0833] Step 9: View your plan

[0834] The device displays the travel plan received from the server to the user, providing options such as displaying it in a web browser or downloading it as a PDF. Specifically, the device parses the received data and generates HTML to display in the browser or display it in a PDF viewer. The input is the formatted plan received in step 8, and the output is displayed visually to the user.

[0835] (Application example 1)

[0836] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0837] Conventional automatic travel plan generation systems have difficulty responding flexibly to users' real-time requests, and generating plans that take into account the situation and traffic information when the user actually arrives at the destination. As a result, users have to frequently readjust their plans during their trip, which reduces the enjoyment of the trip.

[0838] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0839] In this invention, the server includes means for receiving itinerary information from a user, means for verifying and normalizing the itinerary information, means for creating a proposed plan using a generation AI using the normalized itinerary information, means for selecting an optimal plan from the generated proposed plans, means for receiving a user request through voice input, means for generating an optimal sightseeing route in real time based on the voice input and presenting it on a visual display device, and means for providing the selected plan and the real-time generated sightseeing route to the user. This allows the user to obtain an optimal travel plan in real time that suits the local situation, enabling them to enjoy their trip while reducing stress during their trip.

[0840] "Itinerary information" refers to data related to a user's trip, such as the date, location, means of transportation, number of people, and budget.

[0841] "Validation and normalization" refers to verifying the completeness, accuracy, and conversion of received itinerary information into a standard format.

[0842] "Generative AI" refers to an algorithm or system that uses artificial intelligence techniques to automatically generate itineraries based on specific input data.

[0843] "Proposed plan" refers to multiple travel plan candidates created by the generation AI.

[0844] The "optimal plan" refers to the travel plan that best meets the user's conditions and preferences.

[0845] "Voice input" refers to a method of using a microphone to recognize a user's verbal instructions or requests as digital information.

[0846] "Visual display device" refers to a device that allows a user to obtain information visually, such as smart glasses or a head-mounted display.

[0847] A "tourist route" refers to a travel route that includes tourist spots that a user visits.

[0848] "Real-time" refers to the immediate processing and delivery of information based on the current time and situation.

[0849] "User" refers to an individual or organization that uses the automatic travel plan generation system.

[0850] This invention relates to an automated system for users to efficiently obtain travel plans. The system includes a terminal such as a smartphone or smart glasses, a server, and a generative AI model.

[0851] The server receives itinerary information (date, location, transportation, number of people, budget) from the user. The itinerary information is entered through a smartphone application or the interface of the smart glasses. For example, if a user plans a "5-day trip to Kyoto," he or she enters the following information:

[0852] Date: 2023-12-01 to 2023-12-05

[0853] Location: Kyoto

[0854] Transportation: Train

[0855] Number of people: 2

[0856] Budget: 100,000 yen

[0857] Once received, the information is validated and normalized by the server, ensuring completeness and accuracy, and converting it to the required format, for example by checking date formats and standardizing locality names.

[0858] The normalized information is then passed to a generative AI model, which automatically generates multiple itineraries based on the input data, including destinations, accommodations, transportation options, and activities within a budget.

[0859] The server selects the best plan from the generated plans. The selection criteria may include being within the budget, being within the schedule, and including activities that match the user's preferences.

[0860] The best plan is then formatted and displayed on a smartphone or smart glasses in a user-friendly format, including a daily schedule and total costs.

[0861] Furthermore, when users make requests through voice input in real time while traveling, the server receives the information and optimizes sightseeing routes based on real-time conditions. This information is displayed on smart glasses or smartphones, so users can instantly know the optimal route during their trip.

[0862] For example, you can use the following prompts for voice input:

[0863] "What is the shortest route from Kyoto Station to Kiyomizu-dera Temple?"

[0864] The server processes real-time traffic information and current location data based on voice input and generates the optimal route, allowing users to obtain the optimal travel plan in real time based on local conditions, allowing them to enjoy their trip while reducing stress.

[0865] As described above, the system of the present invention provides a convenient tool that allows users to easily create a travel plan and obtain the optimal route in real time while traveling. This system allows users to significantly reduce the time and effort required for planning a trip and to have a more fulfilling travel experience.

[0866] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0867] Step 1:

[0868] The user inputs itinerary information using a device (smartphone or smart glasses). Specifically, information such as date, location, mode of transportation, number of people, and budget is provided using a dedicated form or voice input. The input information is temporarily stored on the device as JSON format data.

[0869] Step 2:

[0870] The device sends the itinerary information entered by the user to the server, which then sends the JSON formatted data using an HTTP POST request. The server receives this request and stores the data in variables for processing.

[0871] Step 3:

[0872] The server validates and normalizes the itinerary information received, checking for completeness (all required fields filled in), accuracy (checking date formats and numbers), and converting it to a standard format (such as standardizing place names). Successfully validated information is reformatted for further processing.

[0873] Step 4:

[0874] The server passes the normalized itinerary information to a generative AI model, which then automatically generates multiple itineraries based on the input data. This process takes into account factors such as tourist destinations, accommodations, transportation options, and activity schedules. The generated itineraries are returned to the server in list form.

[0875] Step 5:

[0876] The server evaluates multiple proposed plans and selects the best one, based on criteria such as whether it fits within the budget, whether it fits within the schedule, and whether it includes activities that match the user's preferences. The best plan is then formatted for delivery to the user.

[0877] Step 6:

[0878] The optimal plan is provided to the user. The server sends the formatted plan to the device. The device visually displays the received plan on the screen. The user can check the daily schedule and total cost.

[0879] Step 7:

[0880] While traveling, the user issues a request to the server through voice input, for example, using a prompt such as "Tell me the shortest route from Kyoto Station to Kiyomizu-dera Temple." The voice input is converted into text format on the device and sent to the server.

[0881] Step 8:

[0882] The server generates a real-time sightseeing route based on the user's voice input, taking into account the user's current location and real-time traffic conditions, and sends the optimized route information in JSON format to the device.

[0883] Step 9:

[0884] The terminal then presents the received real-time tourist route on a visual display device (such as smart glasses), allowing the user to act on the information.

[0885] Through these steps, users can obtain optimal information throughout the entire process, from pre-trip planning to real-time route guidance on-site.

[0886] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0887] The present invention relates to an automated system that combines an emotion engine to enable users to efficiently obtain travel plans. Specific embodiments of the system of the present invention will be described below.

[0888] 1. Enter user information

[0889] The user uses a terminal to input the necessary information about the trip (date, area, transportation, number of people, budget). This information is collected through a dedicated form or user interface. For example, the user can input the following information:

[0890] Dates: 2023-12-01 to 2023-12-05

[0891] Region: Kyoto

[0892] Transportation: Train

[0893] Number of people: 2

[0894] Budget: 100,000 yen

[0895] 2. Sending and Receiving Information

[0896] The device sends the entered information to the server. Specifically, it sends data using an HTTP POST request. The server receives this request and processes the information. In this step, the information is generally sent in JSON format.

[0897] 3. Data Validation and Normalization

[0898] The server validates and normalizes the information it receives. First, it checks the information for completeness and accuracy. For example, it checks that dates are in a valid format and that budgets are entered in the correct numeric format. It also checks that locality names are in a standardized format and corrects them if necessary.

[0899] 4. Emotion Recognition by Emotion Engine

[0900] While the user is inputting information or during other interactions, the device passes voice and input data to an emotion engine to sense the user's emotional state. The emotion engine analyzes this data and determines the user's emotional state (e.g., excitement, joy, stress).

[0901] 5. Plan proposals using generative AI

[0902] The server passes the normalized information and the results of the emotion engine to the generation AI to create a travel plan. The generation AI generates multiple proposed plans based on the input information and the user's emotional state. The proposed plans generated at this stage include sightseeing schedules, transportation options, accommodations, etc., tailored to the user's emotional state.

[0903] 6. Selecting the best plan and format

[0904] The server selects the optimal plan from the generated plans. Evaluation criteria for the selection include whether the plan is within budget, whether the schedule is reasonable, and whether it includes activities that match the user's emotional state. The selected plan is then formatted in a way that is easy for the user to understand. For example, the daily schedule and total cost are clearly displayed.

[0905] 7. Real-time emotional state monitoring

[0906] The server continues to monitor the user's emotional state in real time while the proposed plan is being provided to the user and afterwards. If a change in the user's emotional state is detected, the content of the proposed plan and the presentation method are changed accordingly.

[0907] 8. Submitting and Viewing Plans

[0908] The server sends the optimal travel plan to the device. The device then displays the received plan to the user. The display method can be on a web screen, downloadable in PDF format, or sent by email. This allows the user to easily obtain the optimal travel plan and put it into action.

[0909] Examples:

[0910] For example, if a user plans a "5-day trip to Kyoto," selects "train" as their means of transportation, has a budget of "100,000 yen," and the emotion engine determines that the user is tired, the generative AI will create a plan that prioritizes tourist spots and activities that will help the user relax. See the example below.

[0911] Day 1: Arrive at Kyoto Station -> Visit Kiyomizu-dera Temple -> Dinner in Gion

[0912] Day 2: Sightseeing in Arashiyama -> Bamboo Forest Path -> Relaxing Cafe Break

[0913] Day 3: Visit Nijo Castle -> Eat your way around Nishiki Market

[0914] Day 4: Heian Shrine -> Philosopher's Path Walk -> Ginkakuji Temple

[0915] Day 5: Shopping around Kyoto Station -> Buying ekiben and heading home

[0916] Total cost: 95,000 yen

[0917] In this way, by providing a plan that takes into account the user's emotional state, the user experience can be enhanced.

[0918] The processing flow will be explained below.

[0919] Step 1:

[0920] The user inputs the necessary information about the trip (date, area, transportation, number of people, budget) into the terminal. The user can easily provide the information through a dedicated form or user interface.

[0921] Step 2:

[0922] The device sends the entered information to the server, specifically by using an HTTP POST request to send the data to the server in JSON format.

[0923] Step 3:

[0924] The server receives the information sent as an HTTP request, parses it, and converts it into an internal data structure.

[0925] Step 4:

[0926] The server validates and normalizes the information it receives, first checking that information such as dates and budgets are in the correct format, and then standardizing date formats and locality names as needed.

[0927] Step 5:

[0928] To sense the user's emotional state, the device passes the input voice data and input data to the emotion engine, which analyzes this data and determines the user's emotional state (e.g., excitement, joy, stress).

[0929] Step 6:

[0930] The server passes the normalized information and the results of the emotion engine to the generation AI, which then creates a travel plan. The generation AI then generates multiple proposed plans based on this information. The plans generated at this stage include sightseeing schedules and accommodations based on the user's emotional state.

[0931] Step 7:

[0932] The server evaluates the multiple proposed plans returned by the generation AI and selects the optimal plan. Evaluation criteria include whether the plan is within budget, the schedule is feasible, and whether it matches the user's emotional state.

[0933] Step 8:

[0934] The server selects the optimal plan based on the evaluation results and then provides it to the user in a format that is easy for the user to understand, such as by showing the daily schedule and total cost.

[0935] Step 9:

[0936] The server sends the selected travel plan to the terminal, which can then be displayed on a web screen, made available for download in PDF format, or sent via email.

[0937] Step 10:

[0938] The terminal displays the received plan to the user, who can then proceed with specific travel preparations based on the displayed plan.

[0939] Step 11:

[0940] The server monitors the user's emotional state in real time during and after the proposed plan is provided. If a change in the user's emotional state is detected, the content of the proposed plan and the way it is presented are changed appropriately. This allows the user to use the travel plan more comfortably.

[0941] In this way, by combining an emotion engine, the present invention provides travel plans that take into account the user's emotional state, realizing a more personalized user experience.

[0942] Example 2

[0943] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0944] Conventional travel plan providing systems do not take into account the user's emotional state when making suggestions, which can lead to a poor user experience. Furthermore, the process from inputting travel information to creating a plan, and then selecting and providing the optimal plan, is complicated and inefficient, making it difficult for users to use.

[0945] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for receiving necessary travel information from a user, means for verifying and normalizing the travel information, means for inputting a prompt sentence into a generative AI model using the normalized travel information and creating a proposed plan, means for selecting an optimal plan from the generated proposed plans, means for providing the selected plan to the user, and means for monitoring the user's emotional state using an emotion engine and reflecting the user's emotional state in the proposed plan. This enables automatic generation of an optimal travel plan that takes the user's emotional state into consideration and flexible provision of plans by monitoring the emotional state in real time.

[0946] A "user" is an individual or organization who wishes to use this system to create a travel plan.

[0947] "Necessary travel information" refers to data necessary for making travel plans, including dates, areas, means of transportation, number of people, budget, etc.

[0948] "Validation and normalization" is the process of verifying received travel information for accuracy and completeness and converting it into a standard format.

[0949] A "generative AI model" is an artificial intelligence system that automatically suggests travel plans based on input information.

[0950] A "prompt sentence" is an input sentence used to give instructions to a generative AI model.

[0951] A "proposed plan" is a proposed travel plan generated by a generative AI model.

[0952] The "emotion engine" is a system that analyzes the user's emotional state and adjusts travel plans based on that information.

[0953] "Real-time emotional state monitoring" is the process of continuously analyzing the user's emotional state in real time and appropriately changing the travel plan and presentation method based on the results.

[0954] The present invention relates to an automated system that combines various engines and AI technology to enable users to efficiently obtain travel plans. This system generates and provides optimal travel plans based on the user's travel information and emotional state. Specific embodiments for carrying out the invention are described below.

[0955] First, the user uses the device to input the necessary information about the trip. This information includes the itinerary, area, mode of transportation, number of people, budget, etc. The device collects this information through a dedicated form or user interface. For example, the user can input the following information:

[0956] Dates: 2023-12-01 to 2023-12-05

[0957] Region: Kyoto

[0958] Transportation: Train

[0959] Number of people: 2

[0960] Budget: 100,000 yen

[0961] The device sends this input information to the server using an HTTP POST request. The data is typically sent in JSON format. The server receives this request and parses the data.

[0962] The server then validates and normalizes the received information. The validation process checks the accuracy of date formats, the numeric format of budgets, and also standardizes locality names. For example, it verifies that "2023-12-01 to 2023-12-05" is a valid date format, and that "100000" is a valid numeric format. It also converts the locality name "Kyoto" to a standard format.

[0963] The device then passes the user's input and voice data to the emotion engine in real time. The emotion engine analyzes this data and determines the user's emotional state. For example, it can analyze whether the user is relaxed or stressed while typing.

[0964] The server then passes the normalized information and emotional state to a generative AI model, which automatically generates a travel plan. The generative AI model generates multiple proposed plans based on the input information and the user's emotional state. It also selects the most suitable plan from the multiple plans. Selection criteria include being within budget, having a reasonable schedule, and including activities that match the user's emotional state.

[0965] For example, a generative AI model might suggest the following plan:

[0966] Day 1: Arrive at Kyoto Station -> Visit Kiyomizu-dera Temple -> Dinner in Gion

[0967] Day 2: Sightseeing in Arashiyama -> Bamboo Forest Path -> Relaxing Cafe Break

[0968] Day 3: Visit Nijo Castle -> Eat your way around Nishiki Market

[0969] Day 4: Heian Shrine -> Philosopher's Path Walk -> Ginkakuji Temple

[0970] Day 5: Shopping around Kyoto Station -> Buying ekiben and heading home

[0971] Total cost: 95,000 yen

[0972] Furthermore, the system has a function to monitor the user's emotional state in real time. This allows the system to appropriately change the content and presentation method of the proposed plan when a change in the user's emotional state is detected. The proposed plan is formatted in a user-friendly format, and can be displayed on a web screen, downloaded as a PDF, or sent by email, for example.

[0973] Through the above process, users can easily obtain the optimal travel plan and put it into action. Below is an example of a prompt for the generative AI model:

[0974] User input: Kyoto trip from 2023-12-01 to 2023-12-05, transportation: train, number of people: 2, budget: 100,000 yen

[0975] Emotional state: User is tired

[0976] Input prompt for the generation AI: Generate a Kyoto itinerary. The user is tired. Prioritize relaxing activities. Budget is within 100,000 yen.

[0977] In this way, the automatically generated travel plan can meet the user's expectations and provide a satisfying travel experience.

[0978] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0979] Step 1:

[0980] The user inputs the necessary information about the trip into the terminal. Specifically, the user uses a form to input the dates, area, transportation, number of people, budget, etc. Examples of input data are as follows:

[0981] Dates: 2023-12-01 to 2023-12-05

[0982] Region: Kyoto

[0983] Transportation: Train

[0984] Number of people: 2

[0985] Budget: 100,000 yen

[0986] The entered data is saved on the device.

[0987] Step 2:

[0988] The device converts the input information into JSON format and sends it to the server using an HTTP POST request. Specifically, it generates the following JSON data:

[0989] json

[0990] {

[0991] "Dates": "2023-12-01 to 2023-12-05",

[0992] "Region": "Kyoto",

[0993] "Transportation": "Train",

[0994] "Number of people": 2,

[0995] "Budget": 100000

[0996] }

[0997] This data is sent to the server and received by the server.

[0998] Step 3:

[0999] Validates and normalizes the information received by the server, specifically ensuring that dates are in the correct format, that budgets are in numeric format, and converts region names to a standard format. Transformations include:

[1000] Verify that "2023-12-01 to 2023-12-05" is a valid date format.

[1001] Verify that the budget is "100000" and convert it to a number format.

[1002] The normalized data is passed on to the next process.

[1003] Step 4:

[1004] The device passes the user's input data and voice data to the emotion engine. The emotion engine analyzes this data and determines the user's emotional state. For example, it analyzes whether the user is relaxed or stressed while inputting, and outputs the results as data. The emotional state is determined to be "relaxed" or "stressed," for example.

[1005] Step 5:

[1006] The server passes the normalized information and emotional state to the generative AI model, which then automatically generates a travel plan. The server inputs the following prompt into the generative AI model:

[1007] "Generate a Kyoto itinerary. The user is tired. Prioritize relaxing activities. Budget is under 100,000 yen."

[1008] The generative AI model generates and outputs multiple travel plans based on the input prompt and data.

[1009] Step 6:

[1010] The server selects the best travel plan from the multiple plans generated. Selection criteria include being within budget, having a reasonable schedule, and including activities that match the user's emotional state. The selected plan is then passed on to the next process.

[1011] Step 7:

[1012] The server formats the optimal itinerary in a user-friendly format, showing the daily schedule and total cost. For example, the following output might be generated:

[1013] Day 1: Arrive at Kyoto Station -> Visit Kiyomizu-dera Temple -> Dinner in Gion

[1014] Day 2: Sightseeing in Arashiyama -> Bamboo Forest Path -> Relaxing Cafe Break

[1015] Day 3: Visit Nijo Castle -> Eat your way around Nishiki Market

[1016] Day 4: Heian Shrine -> Philosopher's Path Walk -> Ginkakuji Temple

[1017] Day 5: Shopping around Kyoto Station -> Buying ekiben and heading home

[1018] Total cost: 95,000 yen

[1019] Step 8:

[1020] The server sends the optimal travel plan to the device. The device displays the received plan to the user. Display methods include displaying it on a web screen, downloading it in PDF format, or sending it by email. This allows the user to confirm the travel plan and put it into action.

[1021] (Application example 2)

[1022] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1023] Conventional travel planning systems mainly generate plans based on basic information entered by the user, but lack consideration for the user's emotional state or individual circumstances. This makes it difficult to alleviate the emotional anxiety and stress that users experience while traveling, making it difficult to provide a satisfying travel experience. Furthermore, since there was no system that could immediately respond to changes in the user's emotional state, it was also impossible to provide an optimal plan in real time.

[1024] The specification process by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving itinerary information from a user, means for verifying and normalizing the itinerary information, means for creating a proposed plan by a generation AI using the normalized itinerary information, and means having an emotion engine for analyzing voice data and input data to sense the user's emotional state. This makes it possible to monitor the user's emotional state in real time and change the proposed plan as appropriate in response to changes in the user's emotional state.

[1025] The "means for receiving itinerary information from the user" is an interface through which the system collects information about the trip entered by the user.

[1026] The "means for verifying and normalizing said itinerary information" is a function for checking the accuracy and consistency of collected itinerary information and arranging it into a standard format.

[1027] "Means for creating proposed plans using a generation AI based on the normalized itinerary information" refers to a method for automatically generating multiple travel plans using a generation AI based on normalized itinerary information.

[1028] "Means having an emotion engine that analyzes voice data and input data to sense the user's emotional state" refers to a device that has the function of analyzing the user's voice and input data and determining the user's emotional state.

[1029] "Means for evaluating the generated multiple proposed plans and selecting the most suitable plan based on said evaluation" refers to a method for evaluating the generated multiple travel plans and selecting the most suitable travel plan based on the evaluation results.

[1030] The "means for providing the selected plan to the user" refers to an interface or method for presenting the selected optimal travel plan to the user in an easy-to-understand manner.

[1031] "Means for monitoring the user's emotional state in real time and changing the proposed plan as appropriate in response to changes in the emotional state" refers to a function that constantly monitors the user's emotional state and quickly updates or changes the travel plan when a change in emotion is detected.

[1032] This invention is an automated system that combines an emotion engine to help users efficiently obtain travel plans. This system can also be used as a security alert app. The detailed configuration and processing procedures of the system for realizing this invention are described below.

[1033] System configuration

[1034] 1. User Device:

[1035] Smartphone: A device that collects voice and text data from users and sends them to a server. It also displays travel plans and security alerts to users.

[1036] Speech recognition software: Software that analyzes a user's voice data and converts it into text data.

[1037] 2. Server:

[1038] EmotionEngine: An engine for analyzing the user's emotional state. This engine analyzes voice and text data in real time to determine the user's emotional state.

[1039] AIGeneratePlan: A model with algorithms that generate optimal travel plans and security alerts based on normalized itinerary information and emotional states.

[1040] Database: A database for storing information entered by users, generated plans, analysis results of the emotion engine, etc.

[1041] Program processing and data calculation

[1042] 1. Data transmission and reception:

[1043] The user uses their smartphone to enter basic information such as itinerary and emergency contact details, which is sent to the server as an HTTP POST request and received as JSON format on the server side.

[1044] 2. Data validation and normalization:

[1045] The server validates and normalizes the information it receives, for example, ensuring that schedule information is in a valid format and that budgets are entered in the correct numeric format.

[1046] 3. Emotion Recognition with Emotion Engine:

[1047] The voice and text data entered by the user is analyzed in real time by the Emotion Engine, which determines the user's emotional state (e.g., anxiety, fear, joy).

[1048] 4. Plan proposals by generative AI:

[1049] AIGeneratePlan generates the most suitable travel and security plans based on normalized itinerary information and the analysis results of the emotion engine.

[1050] 5. Plan Selection and Display:

[1051] The server selects the best plan from the multiple plans generated and provides it to the user, who can then display the plan on their smartphone screen or download it in PDF format.

[1052] Specific examples

[1053] If a user feels anxious or scared while returning home late at night, the app will detect the user's anxiety through its emotion engine and generate a security measure using the following prompt:

[1054] Prompt: The user is out late at night and feeling anxious. What is the best security plan for this situation? For example, automatic notification of emergency contacts, calling local police, or directing the user to a safe location?

[1055] This example allows users to receive real-time security prompts tailored to their emotional state, including notifying emergency contacts, calling local police, and navigating to safe locations.

[1056] This invention makes it possible to monitor the user's emotional state in real time and provide an optimal plan accordingly.

[1057] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1058] Step 1:

[1059] The user uses a device (smartphone) to enter basic travel and security information, including the destination, itinerary, budget, mode of transportation, number of people, and emergency contact information. The device formats this information into JSON format and sends it to the server as an HTTP POST request (input: basic information entered by the user, output: JSON format data).

[1060] Step 2:

[1061] The server receives the basic information in JSON format sent from the device and validates the received data, checking, for example, whether the date format is correct, whether the budget is in the correct numeric format, whether the address is valid, etc. (Input: Basic information in JSON format, Output: Validated data)

[1062] Step 3:

[1063] The server normalizes the validated data, which is the process of converting input data into a consistent, standard format and preparing it for storage in the database (input: validated data, output: normalized data).

[1064] Step 4:

[1065] The voice and text data entered by the user is sent to a server via the device. This data is then analyzed by the Emotion Engine, which determines the user's emotional state (e.g., anxiety, joy, stress) in real time from the voice and text data (input: voice and text data, output: emotional state).

[1066] Step 5:

[1067] The server generates multiple proposed plans using AIGeneratePlan based on the normalized basic information and the emotional state analyzed by EmotionEngine. The generated plans correspond to the user's emotional state (input: normalized basic information, emotional state, output: multiple proposed plans).

[1068] Step 6:

[1069] The server evaluates the generated proposed plans and selects the optimal plan. The evaluation criteria for the plans include whether they are within budget, whether the schedule is reasonable, and whether they include activities that match the user's emotional state (input: multiple proposed plans, output: optimal plan).

[1070] Step 7:

[1071] The server sends the selected optimal plan to the user's terminal. The terminal receives this plan and displays it in a format that is easy for the user to view. For example, it can be displayed on a web screen or downloaded in PDF format (input: optimal plan, output: display of plan to user).

[1072] Step 8:

[1073] When the user's emotional state changes while traveling or out, the device sends voice and input data to the server in real time. The server then uses this new data to re-analyze the emotional state using the Emotion Engine and update the proposed plan as necessary (input: real-time voice and text data, output: updated proposed plan).

[1074] This process allows users to get optimal travel plans and security measures that adapt to their emotional state in real time.

[1075] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1076] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1077] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1078] [Fourth embodiment]

[1079] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1080] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1081] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1082] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1083] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1084] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1085] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1086] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1087] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1088] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1089] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1090] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1091] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1092] The present invention relates to an automated system for enabling a user to efficiently obtain a travel plan. Specific embodiments of the system of the present invention will be described below.

[1093] 1. Enter user information

[1094] The user uses a terminal to input the necessary information about the trip (date, area, transportation, number of people, budget). This information is collected through a dedicated form or user interface. For example, the user can input the following information:

[1095] Dates: 2023-12-01 to 2023-12-05

[1096] Region: Kyoto

[1097] Transportation: Train

[1098] Number of people: 2

[1099] Budget: 100,000 yen

[1100] 2. Sending and Receiving Information

[1101] The device sends the entered information to the server. Specifically, it sends data using an HTTP POST request. The server receives this request and processes the information. In this step, the information is generally sent in JSON format.

[1102] 3. Data Validation and Normalization

[1103] Validates and normalizes the information received by the server. First, it verifies the information for completeness and accuracy. For example, it checks that dates are in a valid format, that budgets are entered in the correct numeric format, and it verifies that locality names are in a standardized format and corrects them if necessary.

[1104] 4. Plan proposals using generative AI

[1105] The server then passes the normalized information to a generation AI to create a travel plan. The AI ​​generates multiple itineraries based on the input information and then generates several proposals from them. Factors taken into account at this stage include tourist destinations, accommodations, transportation options, and activities within a budget.

[1106] 5. Selecting the best plan and format

[1107] The server selects the optimal plan from the multiple plans generated. Evaluation criteria for the selection include whether the plan is within budget, whether the schedule is reasonable, and whether it includes activities that match the user's preferences. The selected plan is then formatted in a way that is easy for the user to understand. For example, the daily schedule and total cost are clearly displayed.

[1108] 6. Submitting and Viewing Plans

[1109] The server sends the optimal travel plan to the device. The device then displays the received plan to the user. Possible display methods include displaying it on a web screen, making it available for download in PDF format, or sending it by email. This allows the user to easily obtain the optimal travel plan and put it into action.

[1110] As described above, the system of the present invention provides a convenient tool for users to easily plan their trips, allowing users to significantly reduce the time and effort required for planning trips, making discovering new travel destinations and planning trips more fun and easier.

[1111] Examples:

[1112] For example, if a user plans a "5-day trip to Kyoto," selects "train" as their means of transportation, and has a budget of "100,000 yen," the AI ​​generator will suggest a daily schedule that includes tourist attractions such as Kiyomizu-dera Temple, Arashiyama, and Nijo Castle.

[1113] Day 1: Arrive at Kyoto Station -> Visit Kiyomizu-dera Temple -> Dinner in Gion

[1114] Day 2: Arashiyama sightseeing -> Bamboo forest path -> Sagano sightseeing train

[1115] Day 3: Visit Nijo Castle -> Eat your way around Nishiki Market

[1116] Day 4: Heian Shrine -> Philosopher's Path Walk -> Ginkakuji Temple

[1117] Day 5: Shopping around Kyoto Station -> Buying ekiben and heading home

[1118] Total cost: 95,000 yen

[1119] In this way, an optimal travel plan is automatically generated based on the conditions provided by the user.

[1120] The processing flow will be explained below.

[1121] Step 1:

[1122] The user enters the necessary information about the trip (date, location, mode of transportation, number of people, budget) into the terminal. This information is collected through a dedicated form or user interface. The entered information is formatted for further processing.

[1123] Step 2:

[1124] The device sends the entered information to the server. Specifically, it sends data using an HTTP POST request. This information is passed to the server in JSON format.

[1125] Step 3:

[1126] The server receives the information sent as an HTTP request, parses it, and converts it into an internal data structure.

[1127] Step 4:

[1128] Validating the information received by the server: Checking that the itinerary information is accurate and complete, for example, ensuring that dates are in a valid format, that the budget is entered in the correct numeric format, and that all required fields are filled in.

[1129] Step 5:

[1130] The server normalizes the information it receives, for example, to unify date formats and standardize locality names, e.g., unifying "2023-12-01 to 2023-12-05" to "2023-12-01 - 2023-12-05".

[1131] Step 6:

[1132] The server passes the normalized information to the generation AI to create a travel plan. The generation AI generates multiple proposed plans based on the input information. The proposed plans generated at this stage include daily sightseeing schedules, transportation options, accommodations, etc.

[1133] Step 7:

[1134] The server evaluates the multiple proposed plans returned by the generation AI and compares the suitability of each plan, based on criteria such as whether it is within budget, whether the schedule is reasonable, and whether it includes activities that match the user's preferences.

[1135] Step 8:

[1136] The server selects the best plan based on the evaluation results. An evaluation algorithm is used to determine the best plan.

[1137] Step 9:

[1138] The server formats the selected plan into a readable format, such as a text format that includes a daily schedule and total costs.

[1139] Step 10:

[1140] The server sends the optimal travel plan to the terminal, which then receives the plan and displays it for the user to view.

[1141] Step 11:

[1142] The terminal displays the received plan to the user. The display method may include displaying it on a web screen, making it downloadable in PDF format, or sending it by email.

[1143] This allows users to easily and efficiently obtain optimal travel plans.

[1144] Example 1

[1145] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1146] Creating a travel plan is a time-consuming and labor-intensive task for users. For example, users must plan sightseeing spots, accommodations, and other activities while taking into account factors such as travel dates, region, transportation, number of people, and budget. This process is complex, and there is a need for a system that can automatically create an efficient and satisfying travel plan for users.

[1147] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1148] In this invention, the server includes means for receiving travel information from a user, means for verifying and normalizing the travel information, means for creating a proposed plan using the normalized travel information with a generative AI model, means for selecting an optimal plan from the generated multiple proposed plans, and means for formatting the selected plan and providing it to the user, thereby enabling the user to automatically and efficiently obtain an optimal travel plan based on the conditions entered by the user.

[1149] "User" means an individual or entity that provides information and uses the System to create a travel plan.

[1150] "Travel information" refers to data necessary to create a travel plan, such as dates, area, transportation, number of people, and budget.

[1151] "Means for receiving" refers to an interface or system for capturing information provided by a user.

[1152] "Validation and normalization measures" refers to processes and systems for verifying the completeness and accuracy of received information and converting it into a standard format.

[1153] "Generative AI model" refers to an algorithm or software that uses artificial intelligence to generate a travel plan based on specific inputs.

[1154] "Proposed Plans" refers to multiple travel plans created by the generative AI model.

[1155] "Means of selection" refers to the process or system for evaluating and selecting the most appropriate plan from multiple proposed plans.

[1156] "Formatting means" refers to the process or system for converting the selected plan into a user-understandable format.

[1157] "Means for providing" refers to a method or system for informing the user of the selected and formatted plan.

[1158] The present invention relates to an automated system for users to efficiently obtain travel plans. The main components of this system include a user terminal, a server, and a generative AI model.

[1159] When a user uses the system, they first use a device to enter the necessary travel information (date, location, mode of transportation, number of people, budget). This information is collected through a dedicated form and user interface (UI). The device can be a smartphone or PC with a standard internet connection. A web browser (e.g., Google Chrome) is used as the interface.

[1160] The device then sends the information entered by the user to a server using an HTTP POST request, with the data sent in JSON format. The server is typically a computer system such as a cloud service (e.g., an EC2 instance from Amazon Web Services), and web server software (e.g., Apache or Nginx) manages the data transmission and reception.

[1161] The server validates and normalizes the information it receives. This step checks the information for completeness and accuracy and corrects any deficiencies. For example, it ensures that dates are formatted correctly, budgets are in numeric format, and region names are standardized. A database management system (e.g., MySQL) and a programming language (e.g., Python) are used to implement this process.

[1162] The server then passes the normalized information to a generative AI model to generate a travel plan. The generative AI model uses advanced artificial intelligence (e.g., OpenAI GPT-4). The AI ​​model generates multiple travel plans based on a given prompt. Examples of prompts include:

[1163] "I'm planning a trip to Kyoto for two people between 2023-12-01 and 2023-12-05. We'll be traveling by train, with a total budget of 100,000 yen. Please suggest the best travel plan for these conditions."

[1164] The server selects the best plan from the generated plans, using criteria such as whether it is within budget, whether the schedule is reasonable, and whether it includes activities that meet the user's preferences. An algorithm (e.g., linear programming) is used to select the best plan.

[1165] The selected plan is formatted in a user-friendly format, for example, showing the daily schedule and total cost, using a formatting tool (e.g., the Jinja2 template engine).

[1166] Finally, the server sends the formatted plan to the device, which displays it to the user, possibly on a web screen, downloaded as a PDF, or emailed. To generate a PDF, a PDF generation tool (e.g., wkhtmltopdf) or a mail server (e.g., SendGrid) can be used.

[1167] The above is a detailed description of the embodiment of the present invention. Based on the conditions entered by the user, the user can automatically and efficiently obtain an optimal travel plan, significantly reducing the time and effort required for travel planning.

[1168] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1169] Step 1: Enter your user information

[1170] The user uses a terminal to input the necessary information about the trip (date, region, transportation, number of people, budget). Specifically, the information is entered into a form on the user interface (UI) and prepared for transmission to the server. The terminal receives input such as "Date: 2023-12-01 to 2023-12-05, Region: Kyoto, Transportation: Train, Number of people: 2, Budget: 100,000 yen," converts this to JSON format, and transmits it.

[1171] Step 2: Send information

[1172] The terminal sends the information entered by the user to the server. An HTTP POST request is used to send the data, and the information is sent in JSON format. Specifically, an HTTP request is created with the itinerary information encoded in JSON format as the payload, and sent to the server's endpoint. The input is the JSON data prepared in step 1, and the data is sent to the server as the output.

[1173] Step 3: Receiving and verifying information on the server

[1174] The server parses and validates the information received from the terminal. It parses the received JSON data and breaks it down into each field (reverse itinerary, schedule, region, etc.) to check for completeness and accuracy. For example, it checks whether the date format is "YYYY-MM-DD" and whether the budget is in numeric format. The input is the JSON data received in step 2, and the output is the validation result (e.g., checking that the data is in the correct format).

[1175] Step 4: Normalize the data

[1176] The server normalizes the validated information. It standardizes place names, date formats, etc. into a standard format and converts them into a format that can be passed to the generative AI model. Specifically, it standardizes "Kyoto" to "Kyoto" and converts dates to ISO 8601 format ("2023-12-01T00:00:00Z"). The input is the data validated in step 3, and the output is normalized data.

[1177] Step 5: Generate a travel plan using a generative AI model

[1178] The server passes the normalized information to a generative AI model, which generates a travel plan. The AI ​​model uses advanced artificial intelligence to generate multiple travel plans based on a prompt. For example, a prompt such as "We are planning a trip for two to Kyoto between 2023-12-01 and 2023-12-05. The mode of transportation will be by train, and the budget is 100,000 yen. Please suggest the optimal travel plan that meets these conditions" is created and input into the AI ​​model. The input is the normalized data obtained in step 4, and the output is multiple generated travel plans.

[1179] Step 6: Select the best plan

[1180] The server selects the best plan from the multiple itineraries generated. Selection criteria include being within budget, having a reasonable schedule, and including activities that match the user's preferences. An algorithm (e.g., linear programming) is used to evaluate each plan and select the best one. The input is the itineraries generated in step 5, and the output is the single best itinerary.

[1181] Step 7: Format your plan

[1182] The selected plan is formatted in a format that is easy for the user to understand. It is formatted so that the daily schedule and total cost are clearly displayed, and converted into a readable format (e.g., HTML or PDF). Specifically, the schedule list and total cost are calculated, and a plan is created in tabular or text format. The input is the optimal plan selected in step 6, and the output is a formatted, readable plan.

[1183] Step 8: Submit your plan

[1184] The server sends the formatted plan to the device. The sending method can be sending data in an HTTP response or sending it by email. Specifically, the formatted plan is returned as an HTTP response or sent to the user's email address and a download link is provided. The input is the plan formatted in step 7, and the output is the plan provided to the user.

[1185] Step 9: View your plan

[1186] The device displays the travel plan received from the server to the user, providing options such as displaying it in a web browser or downloading it as a PDF. Specifically, the device parses the received data and generates HTML to display in the browser or display it in a PDF viewer. The input is the formatted plan received in step 8, and the output is displayed visually to the user.

[1187] (Application example 1)

[1188] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1189] Conventional automatic travel plan generation systems have difficulty responding flexibly to users' real-time requests, and generating plans that take into account the situation and traffic information when the user actually arrives at the destination. As a result, users have to frequently readjust their plans during their trip, which reduces the enjoyment of the trip.

[1190] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1191] In this invention, the server includes means for receiving itinerary information from a user, means for verifying and normalizing the itinerary information, means for creating a proposed plan using a generation AI using the normalized itinerary information, means for selecting an optimal plan from the generated proposed plans, means for receiving a user request through voice input, means for generating an optimal sightseeing route in real time based on the voice input and presenting it on a visual display device, and means for providing the selected plan and the real-time generated sightseeing route to the user. This allows the user to obtain an optimal travel plan in real time that suits the local situation, enabling them to enjoy their trip while reducing stress during their trip.

[1192] "Itinerary information" refers to data related to a user's trip, such as the date, location, means of transportation, number of people, and budget.

[1193] "Validation and normalization" refers to verifying the completeness, accuracy, and conversion of received itinerary information into a standard format.

[1194] "Generative AI" refers to an algorithm or system that uses artificial intelligence techniques to automatically generate itineraries based on specific input data.

[1195] "Proposed plan" refers to multiple travel plan candidates created by the generation AI.

[1196] The "optimal plan" refers to the travel plan that best meets the user's conditions and preferences.

[1197] "Voice input" refers to a method of using a microphone to recognize a user's verbal instructions or requests as digital information.

[1198] "Visual display device" refers to a device that allows a user to obtain information visually, such as smart glasses or a head-mounted display.

[1199] A "tourist route" refers to a travel route that includes tourist spots that a user visits.

[1200] "Real-time" refers to the immediate processing and delivery of information based on the current time and situation.

[1201] "User" refers to an individual or organization that uses the automatic travel plan generation system.

[1202] This invention relates to an automated system for users to efficiently obtain travel plans. The system includes a terminal such as a smartphone or smart glasses, a server, and a generative AI model.

[1203] The server receives itinerary information (date, location, transportation, number of people, budget) from the user. The itinerary information is entered through a smartphone application or the interface of the smart glasses. For example, if a user plans a "5-day trip to Kyoto," he or she enters the following information:

[1204] Date: 2023-12-01 to 2023-12-05

[1205] Location: Kyoto

[1206] Transportation: Train

[1207] Number of people: 2

[1208] Budget: 100,000 yen

[1209] Once received, the information is validated and normalized by the server, ensuring completeness and accuracy, and converting it to the required format, for example by checking date formats and standardizing locality names.

[1210] The normalized information is then passed to a generative AI model, which automatically generates multiple itineraries based on the input data, including destinations, accommodations, transportation options, and activities within a budget.

[1211] The server selects the best plan from the generated plans. The selection criteria may include being within the budget, being within the schedule, and including activities that match the user's preferences.

[1212] The best plan is then formatted and displayed on a smartphone or smart glasses in a user-friendly format, including a daily schedule and total costs.

[1213] Furthermore, when users make requests through voice input in real time while traveling, the server receives the information and optimizes sightseeing routes based on real-time conditions. This information is displayed on smart glasses or smartphones, so users can instantly know the optimal route during their trip.

[1214] For example, you can use the following prompts for voice input:

[1215] "What is the shortest route from Kyoto Station to Kiyomizu-dera Temple?"

[1216] The server processes real-time traffic information and current location data based on voice input and generates the optimal route, allowing users to obtain the optimal travel plan in real time based on local conditions, allowing them to enjoy their trip while reducing stress.

[1217] As described above, the system of the present invention provides a convenient tool that allows users to easily create a travel plan and obtain the optimal route in real time while traveling. This system allows users to significantly reduce the time and effort required for planning a trip and to have a more fulfilling travel experience.

[1218] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1219] Step 1:

[1220] The user inputs itinerary information using a device (smartphone or smart glasses). Specifically, information such as date, location, mode of transportation, number of people, and budget is provided using a dedicated form or voice input. The input information is temporarily stored on the device as JSON format data.

[1221] Step 2:

[1222] The device sends the itinerary information entered by the user to the server, which then sends the JSON formatted data using an HTTP POST request. The server receives this request and stores the data in variables for processing.

[1223] Step 3:

[1224] The server validates and normalizes the itinerary information received, checking for completeness (all required fields filled in), accuracy (checking date formats and numbers), and converting it to a standard format (such as standardizing place names). Successfully validated information is reformatted for further processing.

[1225] Step 4:

[1226] The server passes the normalized itinerary information to a generative AI model, which then automatically generates multiple itineraries based on the input data. This process takes into account factors such as tourist destinations, accommodations, transportation options, and activity schedules. The generated itineraries are returned to the server in list form.

[1227] Step 5:

[1228] The server evaluates multiple proposed plans and selects the best one, based on criteria such as whether it fits within the budget, whether it fits within the schedule, and whether it includes activities that match the user's preferences. The best plan is then formatted for delivery to the user.

[1229] Step 6:

[1230] The optimal plan is provided to the user. The server sends the formatted plan to the device. The device visually displays the received plan on the screen. The user can check the daily schedule and total cost.

[1231] Step 7:

[1232] While traveling, the user issues a request to the server through voice input, for example, using a prompt such as "Tell me the shortest route from Kyoto Station to Kiyomizu-dera Temple." The voice input is converted into text format on the device and sent to the server.

[1233] Step 8:

[1234] The server generates a real-time sightseeing route based on the user's voice input, taking into account the user's current location and real-time traffic conditions, and sends the optimized route information in JSON format to the device.

[1235] Step 9:

[1236] The terminal then presents the received real-time tourist route on a visual display device (such as smart glasses), allowing the user to act on the information.

[1237] Through these steps, users can obtain optimal information throughout the entire process, from pre-trip planning to real-time route guidance on-site.

[1238] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1239] The present invention relates to an automated system that combines an emotion engine to enable users to efficiently obtain travel plans. Specific embodiments of the system of the present invention will be described below.

[1240] 1. Enter user information

[1241] The user uses a terminal to input the necessary information about the trip (date, area, transportation, number of people, budget). This information is collected through a dedicated form or user interface. For example, the user can input the following information:

[1242] Dates: 2023-12-01 to 2023-12-05

[1243] Region: Kyoto

[1244] Transportation: Train

[1245] Number of people: 2

[1246] Budget: 100,000 yen

[1247] 2. Sending and Receiving Information

[1248] The device sends the entered information to the server. Specifically, it sends data using an HTTP POST request. The server receives this request and processes the information. In this step, the information is generally sent in JSON format.

[1249] 3. Data Validation and Normalization

[1250] The server validates and normalizes the information it receives. First, it checks the information for completeness and accuracy. For example, it checks that dates are in a valid format and that budgets are entered in the correct numeric format. It also checks that locality names are in a standardized format and corrects them if necessary.

[1251] 4. Emotion Recognition by Emotion Engine

[1252] While the user is inputting information or during other interactions, the device passes voice and input data to an emotion engine to sense the user's emotional state. The emotion engine analyzes this data and determines the user's emotional state (e.g., excitement, joy, stress).

[1253] 5. Plan proposals using generative AI

[1254] The server passes the normalized information and the results of the emotion engine to the generation AI to create a travel plan. The generation AI generates multiple proposed plans based on the input information and the user's emotional state. The proposed plans generated at this stage include sightseeing schedules, transportation options, accommodations, etc., tailored to the user's emotional state.

[1255] 6. Selecting the best plan and format

[1256] The server selects the optimal plan from the generated plans. Evaluation criteria for the selection include whether the plan is within budget, whether the schedule is reasonable, and whether it includes activities that match the user's emotional state. The selected plan is then formatted in a way that is easy for the user to understand. For example, the daily schedule and total cost are clearly displayed.

[1257] 7. Real-time emotional state monitoring

[1258] The server continues to monitor the user's emotional state in real time while the proposed plan is being provided to the user and afterwards. If a change in the user's emotional state is detected, the content of the proposed plan and the presentation method are changed accordingly.

[1259] 8. Submitting and Viewing Plans

[1260] The server sends the optimal travel plan to the device. The device then displays the received plan to the user. The display method can be on a web screen, downloadable in PDF format, or sent by email. This allows the user to easily obtain the optimal travel plan and put it into action.

[1261] Examples:

[1262] For example, if a user plans a "5-day trip to Kyoto," selects "train" as their means of transportation, has a budget of "100,000 yen," and the emotion engine determines that the user is tired, the generative AI will create a plan that prioritizes tourist spots and activities that will help the user relax. See the example below.

[1263] Day 1: Arrive at Kyoto Station -> Visit Kiyomizu-dera Temple -> Dinner in Gion

[1264] Day 2: Sightseeing in Arashiyama -> Bamboo Forest Path -> Relaxing Cafe Break

[1265] Day 3: Visit Nijo Castle -> Eat your way around Nishiki Market

[1266] Day 4: Heian Shrine -> Philosopher's Path Walk -> Ginkakuji Temple

[1267] Day 5: Shopping around Kyoto Station -> Buying ekiben and heading home

[1268] Total cost: 95,000 yen

[1269] In this way, by providing a plan that takes into account the user's emotional state, the user experience can be enhanced.

[1270] The processing flow will be explained below.

[1271] Step 1:

[1272] The user inputs the necessary information about the trip (date, area, transportation, number of people, budget) into the terminal. The user can easily provide the information through a dedicated form or user interface.

[1273] Step 2:

[1274] The device sends the entered information to the server, specifically by using an HTTP POST request to send the data to the server in JSON format.

[1275] Step 3:

[1276] The server receives the information sent as an HTTP request, parses it, and converts it into an internal data structure.

[1277] Step 4:

[1278] The server validates and normalizes the information it receives, first checking that information such as dates and budgets are in the correct format, and then standardizing date formats and locality names as needed.

[1279] Step 5:

[1280] To sense the user's emotional state, the device passes the input voice data and input data to the emotion engine, which analyzes this data and determines the user's emotional state (e.g., excitement, joy, stress).

[1281] Step 6:

[1282] The server passes the normalized information and the results of the emotion engine to the generation AI, which then creates a travel plan. The generation AI then generates multiple proposed plans based on this information. The plans generated at this stage include sightseeing schedules and accommodations based on the user's emotional state.

[1283] Step 7:

[1284] The server evaluates the multiple proposed plans returned by the generation AI and selects the optimal plan. Evaluation criteria include whether the plan is within budget, the schedule is feasible, and whether it matches the user's emotional state.

[1285] Step 8:

[1286] The server selects the optimal plan based on the evaluation results and then provides it to the user in a format that is easy for the user to understand, such as by showing the daily schedule and total cost.

[1287] Step 9:

[1288] The server sends the selected travel plan to the terminal, which can then be displayed on a web screen, made available for download in PDF format, or sent via email.

[1289] Step 10:

[1290] The terminal displays the received plan to the user, who can then proceed with specific travel preparations based on the displayed plan.

[1291] Step 11:

[1292] The server monitors the user's emotional state in real time during and after the proposed plan is provided. If a change in the user's emotional state is detected, the content of the proposed plan and the way it is presented are changed appropriately. This allows the user to use the travel plan more comfortably.

[1293] In this way, by combining an emotion engine, the present invention provides travel plans that take into account the user's emotional state, realizing a more personalized user experience.

[1294] Example 2

[1295] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1296] Conventional travel plan providing systems do not take into account the user's emotional state when making suggestions, which can lead to a poor user experience. Furthermore, the process from inputting travel information to creating a plan, and then selecting and providing the optimal plan, is complicated and inefficient, making it difficult for users to use.

[1297] The identification process by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means. In this invention, the server includes means for receiving necessary travel information from a user, means for verifying and normalizing the travel information, means for inputting a prompt sentence into a generative AI model using the normalized travel information and creating a proposed plan, means for selecting an optimal plan from the generated proposed plans, means for providing the selected plan to the user, and means for monitoring the user's emotional state using an emotion engine and reflecting the user's emotional state in the proposed plan. This enables automatic generation of an optimal travel plan that takes the user's emotional state into consideration and flexible provision of plans by monitoring the emotional state in real time.

[1298] A "user" is an individual or organization who wishes to use this system to create a travel plan.

[1299] "Necessary travel information" refers to data necessary for making travel plans, including dates, areas, means of transportation, number of people, budget, etc.

[1300] "Validation and normalization" is the process of verifying received travel information for accuracy and completeness and converting it into a standard format.

[1301] A "generative AI model" is an artificial intelligence system that automatically suggests travel plans based on input information.

[1302] A "prompt sentence" is an input sentence used to give instructions to a generative AI model.

[1303] A "proposed plan" is a proposed travel plan generated by a generative AI model.

[1304] The "emotion engine" is a system that analyzes the user's emotional state and adjusts travel plans based on that information.

[1305] "Real-time emotional state monitoring" is the process of continuously analyzing the user's emotional state in real time and appropriately changing the travel plan and presentation method based on the results.

[1306] The present invention relates to an automated system that combines various engines and AI technology to enable users to efficiently obtain travel plans. This system generates and provides optimal travel plans based on the user's travel information and emotional state. Specific embodiments for carrying out the invention are described below.

[1307] First, the user uses the device to input the necessary information about the trip. This information includes the itinerary, area, mode of transportation, number of people, budget, etc. The device collects this information through a dedicated form or user interface. For example, the user can input the following information:

[1308] Dates: 2023-12-01 to 2023-12-05

[1309] Region: Kyoto

[1310] Transportation: Train

[1311] Number of people: 2

[1312] Budget: 100,000 yen

[1313] The device sends this input information to the server using an HTTP POST request. The data is typically sent in JSON format. The server receives this request and parses the data.

[1314] The server then validates and normalizes the received information. The validation process checks the accuracy of date formats, the numeric format of budgets, and also standardizes locality names. For example, it verifies that "2023-12-01 to 2023-12-05" is a valid date format, and that "100000" is a valid numeric format. It also converts the locality name "Kyoto" to a standard format.

[1315] The device then passes the user's input and voice data to the emotion engine in real time. The emotion engine analyzes this data and determines the user's emotional state. For example, it can analyze whether the user is relaxed or stressed while typing.

[1316] The server then passes the normalized information and emotional state to a generative AI model, which automatically generates a travel plan. The generative AI model generates multiple proposed plans based on the input information and the user's emotional state. It also selects the most suitable plan from the multiple plans. Selection criteria include being within budget, having a reasonable schedule, and including activities that match the user's emotional state.

[1317] For example, a generative AI model might suggest the following plan:

[1318] Day 1: Arrive at Kyoto Station -> Visit Kiyomizu-dera Temple -> Dinner in Gion

[1319] Day 2: Sightseeing in Arashiyama -> Bamboo Forest Path -> Relaxing Cafe Break

[1320] Day 3: Visit Nijo Castle -> Eat your way around Nishiki Market

[1321] Day 4: Heian Shrine -> Philosopher's Path Walk -> Ginkakuji Temple

[1322] Day 5: Shopping around Kyoto Station -> Buying ekiben and heading home

[1323] Total cost: 95,000 yen

[1324] Furthermore, the system has a function to monitor the user's emotional state in real time. This allows the system to appropriately change the content and presentation method of the proposed plan when a change in the user's emotional state is detected. The proposed plan is formatted in a user-friendly format, and can be displayed on a web screen, downloaded as a PDF, or sent by email, for example.

[1325] Through the above process, users can easily obtain the optimal travel plan and put it into action. Below is an example of a prompt for the generative AI model:

[1326] User input: Kyoto trip from 2023-12-01 to 2023-12-05, transportation: train, number of people: 2, budget: 100,000 yen

[1327] Emotional state: User is tired

[1328] Input prompt for the generation AI: Generate a Kyoto itinerary. The user is tired. Prioritize relaxing activities. Budget is within 100,000 yen.

[1329] In this way, the automatically generated travel plan can meet the user's expectations and provide a satisfying travel experience.

[1330] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1331] Step 1:

[1332] The user inputs the necessary information about the trip into the terminal. Specifically, the user uses a form to input the dates, area, transportation, number of people, budget, etc. Examples of input data are as follows:

[1333] Dates: 2023-12-01 to 2023-12-05

[1334] Region: Kyoto

[1335] Transportation: Train

[1336] Number of people: 2

[1337] Budget: 100,000 yen

[1338] The entered data is saved on the device.

[1339] Step 2:

[1340] The device converts the input information into JSON format and sends it to the server using an HTTP POST request. Specifically, it generates the following JSON data:

[1341] json

[1342] {

[1343] "Dates": "2023-12-01 to 2023-12-05",

[1344] "Region": "Kyoto",

[1345] "Transportation": "Train",

[1346] "Number of people": 2,

[1347] "Budget": 100000

[1348] }

[1349] This data is sent to the server and received by the server.

[1350] Step 3:

[1351] Validates and normalizes the information received by the server, specifically ensuring that dates are in the correct format, that budgets are in numeric format, and converts region names to a standard format. Transformations include:

[1352] Verify that "2023-12-01 to 2023-12-05" is a valid date format.

[1353] Verify that the budget is "100000" and convert it to a number format.

[1354] The normalized data is passed on to the next process.

[1355] Step 4:

[1356] The device passes the user's input data and voice data to the emotion engine. The emotion engine analyzes this data and determines the user's emotional state. For example, it analyzes whether the user is relaxed or stressed while inputting, and outputs the results as data. The emotional state is determined to be "relaxed" or "stressed," for example.

[1357] Step 5:

[1358] The server passes the normalized information and emotional state to the generative AI model, which then automatically generates a travel plan. The server inputs the following prompt into the generative AI model:

[1359] "Generate a Kyoto itinerary. The user is tired. Prioritize relaxing activities. Budget is under 100,000 yen."

[1360] The generative AI model generates and outputs multiple travel plans based on the input prompt and data.

[1361] Step 6:

[1362] The server selects the best travel plan from the multiple plans generated. Selection criteria include being within budget, having a reasonable schedule, and including activities that match the user's emotional state. The selected plan is then passed on to the next process.

[1363] Step 7:

[1364] The server formats the optimal itinerary in a user-friendly format, showing the daily schedule and total cost. For example, the following output might be generated:

[1365] Day 1: Arrive at Kyoto Station -> Visit Kiyomizu-dera Temple -> Dinner in Gion

[1366] Day 2: Sightseeing in Arashiyama -> Bamboo Forest Path -> Relaxing Cafe Break

[1367] Day 3: Visit Nijo Castle -> Eat your way around Nishiki Market

[1368] Day 4: Heian Shrine -> Philosopher's Path Walk -> Ginkakuji Temple

[1369] Day 5: Shopping around Kyoto Station -> Buying ekiben and heading home

[1370] Total cost: 95,000 yen

[1371] Step 8:

[1372] The server sends the optimal travel plan to the device. The device displays the received plan to the user. Display methods include displaying it on a web screen, downloading it in PDF format, or sending it by email. This allows the user to confirm the travel plan and put it into action.

[1373] (Application example 2)

[1374] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1375] Conventional travel planning systems mainly generate plans based on basic information entered by the user, but lack consideration for the user's emotional state or individual circumstances. This makes it difficult to alleviate the emotional anxiety and stress that users experience while traveling, making it difficult to provide a satisfying travel experience. Furthermore, since there was no system that could immediately respond to changes in the user's emotional state, it was also impossible to provide an optimal plan in real time.

[1376] The specification process by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving itinerary information from a user, means for verifying and normalizing the itinerary information, means for creating a proposed plan by a generation AI using the normalized itinerary information, and means having an emotion engine for analyzing voice data and input data to sense the user's emotional state. This makes it possible to monitor the user's emotional state in real time and change the proposed plan as appropriate in response to changes in the user's emotional state.

[1377] The "means for receiving itinerary information from the user" is an interface through which the system collects information about the trip entered by the user.

[1378] The "means for verifying and normalizing said itinerary information" is a function for checking the accuracy and consistency of collected itinerary information and arranging it into a standard format.

[1379] "Means for creating proposed plans using a generation AI based on the normalized itinerary information" refers to a method for automatically generating multiple travel plans using a generation AI based on normalized itinerary information.

[1380] "Means having an emotion engine that analyzes voice data and input data to sense the user's emotional state" refers to a device that has the function of analyzing the user's voice and input data and determining the user's emotional state.

[1381] "Means for evaluating the generated multiple proposed plans and selecting the most suitable plan based on said evaluation" refers to a method for evaluating the generated multiple travel plans and selecting the most suitable travel plan based on the evaluation results.

[1382] The "means for providing the selected plan to the user" refers to an interface or method for presenting the selected optimal travel plan to the user in an easy-to-understand manner.

[1383] "Means for monitoring the user's emotional state in real time and changing the proposed plan as appropriate in response to changes in the emotional state" refers to a function that constantly monitors the user's emotional state and quickly updates or changes the travel plan when a change in emotion is detected.

[1384] This invention is an automated system that combines an emotion engine to help users efficiently obtain travel plans. This system can also be used as a security alert app. The detailed configuration and processing procedures of the system for realizing this invention are described below.

[1385] System configuration

[1386] 1. User Device:

[1387] Smartphone: A device that collects voice and text data from users and sends them to a server. It also displays travel plans and security alerts to users.

[1388] Speech recognition software: Software that analyzes a user's voice data and converts it into text data.

[1389] 2. Server:

[1390] EmotionEngine: An engine for analyzing the user's emotional state. This engine analyzes voice and text data in real time to determine the user's emotional state.

[1391] AIGeneratePlan: A model with algorithms that generate optimal travel plans and security alerts based on normalized itinerary information and emotional states.

[1392] Database: A database for storing information entered by users, generated plans, analysis results of the emotion engine, etc.

[1393] Program processing and data calculation

[1394] 1. Data transmission and reception:

[1395] The user uses their smartphone to enter basic information such as itinerary and emergency contact details, which is sent to the server as an HTTP POST request and received as JSON format on the server side.

[1396] 2. Data validation and normalization:

[1397] The server validates and normalizes the information it receives, for example, ensuring that schedule information is in a valid format and that budgets are entered in the correct numeric format.

[1398] 3. Emotion Recognition with Emotion Engine:

[1399] The voice and text data entered by the user is analyzed in real time by the Emotion Engine, which determines the user's emotional state (e.g., anxiety, fear, joy).

[1400] 4. Plan proposals by generative AI:

[1401] AIGeneratePlan generates the most suitable travel and security plans based on normalized itinerary information and the analysis results of the emotion engine.

[1402] 5. Plan Selection and Display:

[1403] The server selects the best plan from the multiple plans generated and provides it to the user, who can then display the plan on their smartphone screen or download it in PDF format.

[1404] Specific examples

[1405] If a user feels anxious or scared while returning home late at night, the app will detect the user's anxiety through its emotion engine and generate a security measure using the following prompt:

[1406] Prompt: The user is out late at night and feeling anxious. What is the best security plan for this situation? For example, automatic notification of emergency contacts, calling local police, or directing the user to a safe location?

[1407] This example allows users to receive real-time security prompts tailored to their emotional state, including notifying emergency contacts, calling local police, and navigating to safe locations.

[1408] This invention makes it possible to monitor the user's emotional state in real time and provide an optimal plan accordingly.

[1409] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1410] Step 1:

[1411] The user uses a device (smartphone) to enter basic travel and security information, including the destination, itinerary, budget, mode of transportation, number of people, and emergency contact information. The device formats this information into JSON format and sends it to the server as an HTTP POST request (input: basic information entered by the user, output: JSON format data).

[1412] Step 2:

[1413] The server receives the basic information in JSON format sent from the device and validates the received data, checking, for example, whether the date format is correct, whether the budget is in the correct numeric format, whether the address is valid, etc. (Input: Basic information in JSON format, Output: Validated data)

[1414] Step 3:

[1415] The server normalizes the validated data, which is the process of converting input data into a consistent, standard format and preparing it for storage in the database (input: validated data, output: normalized data).

[1416] Step 4:

[1417] The voice and text data entered by the user is sent to a server via the device. This data is then analyzed by the Emotion Engine, which determines the user's emotional state (e.g., anxiety, joy, stress) in real time from the voice and text data (input: voice and text data, output: emotional state).

[1418] Step 5:

[1419] The server generates multiple proposed plans using AIGeneratePlan based on the normalized basic information and the emotional state analyzed by EmotionEngine. The generated plans correspond to the user's emotional state (input: normalized basic information, emotional state, output: multiple proposed plans).

[1420] Step 6:

[1421] The server evaluates the generated proposed plans and selects the optimal plan. The evaluation criteria for the plans include whether they are within budget, whether the schedule is reasonable, and whether they include activities that match the user's emotional state (input: multiple proposed plans, output: optimal plan).

[1422] Step 7:

[1423] The server sends the selected optimal plan to the user's terminal. The terminal receives this plan and displays it in a format that is easy for the user to view. For example, it can be displayed on a web screen or downloaded in PDF format (input: optimal plan, output: display of plan to user).

[1424] Step 8:

[1425] When the user's emotional state changes while traveling or out, the device sends voice and input data to the server in real time. The server then uses this new data to re-analyze the emotional state using the Emotion Engine and update the proposed plan as necessary (input: real-time voice and text data, output: updated proposed plan).

[1426] This process allows users to get optimal travel plans and security measures that adapt to their emotional state in real time.

[1427] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1428] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1429] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1430] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1431] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1432] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1433] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1434] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1435] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1436] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1437] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1438] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1439] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1440] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1441] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1442] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1443] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1444] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1445] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1446] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1447] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1448] The following is further disclosed regarding the above embodiment.

[1449] (Claim 1)

[1450] means for receiving itinerary information from a user;

[1451] means for validating and normalizing said itinerary information;

[1452] A means for generating a proposed plan by a generation AI using the normalized itinerary information;

[1453] a means for selecting an optimal plan from the generated proposed plans;

[1454] means for providing the selected plan to a user;

[1455] A system including:

[1456] (Claim 2)

[1457] 10. The system according to claim 1, further comprising means for evaluating the generated proposed plans and selecting an optimal plan based on the evaluation.

[1458] (Claim 3)

[1459] 10. The system of claim 1, further comprising: means for formatting the plan to be provided to the user into a readable format.

[1460] "Example 1"

[1461] (Claim 1)

[1462] means for receiving travel information from a user;

[1463] means for verifying and normalizing said travel information;

[1464] A means for creating a proposed plan using the normalized travel information by a generative AI model;

[1465] a means for selecting an optimal plan from the plurality of proposed plans generated;

[1466] means for formatting and presenting the selected plan to a user;

[1467] A system including:

[1468] (Claim 2)

[1469] 10. The system according to claim 1, further comprising means for evaluating the generated proposed plans and selecting an optimal plan based on the evaluation.

[1470] (Claim 3)

[1471] 10. The system of claim 1, further comprising: means for formatting the plan to be provided to the user into a readable format.

[1472] "Application Example 1"

[1473] (Claim 1)

[1474] means for receiving itinerary information from a user;

[1475] means for validating and normalizing said itinerary information;

[1476] A means for generating a proposed plan by a generation AI using the normalized itinerary information;

[1477] a means for selecting an optimal plan from the generated proposed plans;

[1478] means for receiving a user request via voice input;

[1479] means for generating an optimal sightseeing route in real time based on the voice input and presenting the route on a visual display device;

[1480] means for providing the user with the selected plan and the sightseeing route generated in real time;

[1481] A system including:

[1482] (Claim 2)

[1483] 10. The system according to claim 1, further comprising means for evaluating the generated proposed plans and selecting an optimal plan based on the evaluation.

[1484] (Claim 3)

[1485] 10. The system of claim 1, further comprising: means for formatting the plan to be provided to the user into a readable format.

[1486] "Example 2: Combining Emotion Engines"

[1487] (Claim 1)

[1488] means for receiving necessary travel information from a user;

[1489] means for verifying and normalizing said travel information;

[1490] A means for inputting a prompt sentence into a generative AI model using the normalized travel information to generate a proposed plan;

[1491] a means for selecting an optimal plan from the generated proposed plans;

[1492] means for providing the selected plan to a user;

[1493] a means for monitoring the user's emotional state by an emotion engine and reflecting the state in the proposed plan;

[1494] A system including:

[1495] (Claim 2)

[1496] 10. The system according to claim 1, further comprising means for evaluating the generated proposed plans and selecting an optimal plan based on the evaluation.

[1497] (Claim 3)

[1498] 10. The system of claim 1, further comprising: means for formatting the plan to be provided to the user into a readable format.

[1499] "Application example 2 when combining emotion engines"

[1500] (Claim 1)

[1501] means for receiving itinerary information from a user;

[1502] means for validating and normalizing said itinerary information;

[1503] A means for generating a proposed plan by a generation AI using the normalized itinerary information;

[1504] means for detecting an emotional state of a user, the emotional engine analyzing voice data and input data;

[1505] a means for evaluating the generated proposed plans and selecting an optimal plan based on the evaluation;

[1506] means for providing the selected plan to a user;

[1507] A system including:

[1508] (Claim 2)

[1509] 10. The system of claim 1, further comprising means for monitoring the user's emotional state in real time and appropriately modifying the proposed plan in response to changes in the user's emotional state.

[1510] (Claim 3)

[1511] 10. The system of claim 1, further comprising: means for formatting the plan to be provided to the user into a readable format. [Explanation of symbols]

[1512] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. means for receiving itinerary information from a user; means for validating and normalizing said itinerary information; A means for generating a proposed plan by a generation AI using the normalized itinerary information; a means for selecting an optimal plan from the generated proposed plans; means for providing the selected plan to a user; A system including:

2. The system of claim 1 , further comprising means for evaluating the generated proposed plans and selecting an optimal plan based on the evaluation.

3. The system of claim 1 further comprising means for formatting the plan provided to the user into a readable format.

Images